-- Logs begin at Wed 2022-10-26 04:18:53 UTC, end at Wed 2022-10-26 06:47:27 UTC. -- Oct 26 04:50:03.087968 n-d-862416-4 systemd[1]: Starting Devstack devstack@n-api.service... Oct 26 04:50:03.100054 n-d-862416-4 devstack@n-api.service[104560]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 04:50:03 2022] *** Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: nodename: n-d-862416-4 Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: machine: x86_64 Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: clock source: unix Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: pcre jit disabled Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: detected number of CPU cores: 4 Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: current working directory: / Oct 26 04:50:03.102078 n-d-862416-4 devstack@n-api.service[104560]: detected binary path: /usr/bin/uwsgi-core Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: your processes number limit is 47680 Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: your memory page size is 4096 bytes Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: detected max file descriptor number: 2048 Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: lock engine: pthread robust mutexes Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: thunder lock: enabled Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 26 04:50:03.102732 n-d-862416-4 devstack@n-api.service[104560]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 04:50:03.142250 n-d-862416-4 devstack@n-api.service[104560]: Python main interpreter initialized at 0x55f5e68db9c0 Oct 26 04:50:03.142250 n-d-862416-4 devstack@n-api.service[104560]: python threads support enabled Oct 26 04:50:03.142250 n-d-862416-4 devstack@n-api.service[104560]: your server socket listen backlog is limited to 100 connections Oct 26 04:50:03.142250 n-d-862416-4 devstack@n-api.service[104560]: your mercy for graceful operations on workers is 90 seconds Oct 26 04:50:03.142689 n-d-862416-4 devstack@n-api.service[104560]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 04:50:03.142689 n-d-862416-4 devstack@n-api.service[104560]: *** Operational MODE: preforking *** Oct 26 04:50:03.142912 n-d-862416-4 devstack@n-api.service[104560]: *** uWSGI is running in multiple interpreter mode *** Oct 26 04:50:03.142912 n-d-862416-4 devstack@n-api.service[104560]: spawned uWSGI master process (pid: 104560) Oct 26 04:50:03.143099 n-d-862416-4 systemd[1]: Started Devstack devstack@n-api.service. Oct 26 04:50:03.144066 n-d-862416-4 devstack@n-api.service[104560]: spawned uWSGI worker 1 (pid: 104561, cores: 1) Oct 26 04:50:03.144066 n-d-862416-4 devstack@n-api.service[104560]: spawned uWSGI worker 2 (pid: 104562, cores: 1) Oct 26 04:50:03.144233 n-d-862416-4 devstack@n-api.service[104560]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 04:50:03.799743 n-d-862416-4 devstack@n-api.service[104561]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 04:50:03.803200 n-d-862416-4 devstack@n-api.service[104562]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 04:50:04.867480 n-d-862416-4 devstack@n-api.service[104561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:50:04.867480 n-d-862416-4 devstack@n-api.service[104561]: from cryptography.utils import int_from_bytes Oct 26 04:50:04.868095 n-d-862416-4 devstack@n-api.service[104561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:50:04.868095 n-d-862416-4 devstack@n-api.service[104561]: from cryptography.utils import int_from_bytes Oct 26 04:50:04.870120 n-d-862416-4 devstack@n-api.service[104562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:50:04.870120 n-d-862416-4 devstack@n-api.service[104562]: from cryptography.utils import int_from_bytes Oct 26 04:50:04.871576 n-d-862416-4 devstack@n-api.service[104562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:50:04.871576 n-d-862416-4 devstack@n-api.service[104562]: from cryptography.utils import int_from_bytes Oct 26 04:50:07.399969 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 04:50:07.400651 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 04:50:07.400755 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 04:50:07.401095 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 04:50:07.402005 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 04:50:07.402315 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.402495 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 04:50:07.402877 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.402973 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 04:50:07.403056 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.403256 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.403347 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 04:50:07.403586 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.403682 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 04:50:07.403884 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 04:50:07.403972 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.404203 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.404305 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.404524 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.404614 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.404854 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.404948 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.405114 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.405211 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.405454 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.405546 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.405783 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-4 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.405886 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.406105 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.406202 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.406430 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.406568 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.406725 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.406814 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407044 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407132 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407347 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407434 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407668 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407764 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-4 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.407979 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.408074 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.408293 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.408473 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.408606 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.408911 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409048 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409221 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409339 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409560 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409666 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409866 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.409966 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.410203 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.410367 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.410515 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.410682 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.410835 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.410991 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.411138 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.411304 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.411456 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.411642 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.411775 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.411958 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.412162 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-4 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.412259 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.412483 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.412571 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.412798 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.412885 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.413111 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.413243 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.413516 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.413617 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.413862 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.413950 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-4 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.414173 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.414260 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.414494 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.414639 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.414820 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.414967 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.415129 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.415218 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.415457 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.415546 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.415784 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.415893 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.416106 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.416202 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.416432 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.416541 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.416740 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.416837 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.417670 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.417782 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.418002 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.418090 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.418686 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.418780 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419015 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419116 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419326 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419427 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419592 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419678 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.419908 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420006 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420237 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420324 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420549 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420635 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420861 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.420958 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.421117 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.421205 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.421402 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.421517 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.421725 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.421827 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422051 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422150 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422364 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422460 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422641 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422740 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422899 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.422987 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.423225 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.423321 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.423552 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.423641 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.423866 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.423953 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.424178 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.424266 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.424488 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.424576 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.424801 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.424899 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.425116 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.425229 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.425451 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.425545 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.425764 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.425892 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.426092 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.426258 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.426404 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.426493 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.426719 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.426823 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427032 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427130 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427346 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427434 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427671 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427758 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.427979 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.428067 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.428301 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.428398 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.428626 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.428743 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.428932 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429027 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429241 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429361 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429577 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429679 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429900 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.429997 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.430227 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.430313 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.430532 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.430632 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.430787 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.430881 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.431091 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.431179 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.431403 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.431562 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.431726 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.431865 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.432037 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.432180 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.432325 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.432458 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.432600 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.432835 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.433051 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.433291 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.433486 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.433626 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.433776 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.433922 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.434060 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.434202 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.434352 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.434491 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.434635 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.434789 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435012 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435154 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435300 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435445 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435583 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435721 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.435858 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436014 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436232 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436376 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436512 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436649 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436787 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.436954 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437093 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437230 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437396 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437540 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437686 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437824 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.437969 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438106 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438242 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438378 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438515 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438660 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438809 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.438965 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439112 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439256 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439392 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439527 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439673 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439817 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.439961 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.440645 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.440796 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.440935 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441082 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441218 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441397 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441543 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441688 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441835 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.441974 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442111 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442210 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442294 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442388 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442478 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442560 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442641 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442722 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442802 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442891 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.442973 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.443174 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.443263 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.443487 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.443585 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.443797 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.443884 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.444107 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.444195 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.444406 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.444500 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.444713 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.444806 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445027 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445150 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445351 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445513 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445663 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445801 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.445966 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.446101 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.446282 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.446441 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.446608 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.446743 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.446923 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.447067 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.447234 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.447370 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.447543 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.447679 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.447867 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:50:07.448003 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.448203 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.448338 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.448566 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.448681 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.448911 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.449000 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.449232 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.449395 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.449597 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.449688 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.449917 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450014 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450232 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450321 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450547 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450635 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450865 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.450962 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.451185 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.451273 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.451499 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.451585 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.451816 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.451914 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.452148 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.452256 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.452446 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.452543 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.452761 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.452859 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.453083 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.453172 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.453426 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.453518 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.453748 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.453849 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.454058 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.454146 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.454374 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.454462 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.454698 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.454800 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455033 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455132 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455356 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455447 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455673 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455786 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.455982 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.456070 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.456294 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.456447 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.456607 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.456705 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.456955 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.457047 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.457271 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.457393 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.457612 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.457713 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.457928 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458016 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458240 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458328 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458571 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458661 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458889 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.458976 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.459198 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.459292 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.459514 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.459603 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.459830 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.459919 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.460145 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.460289 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.460461 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.460557 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.460776 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.460872 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.461095 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.461192 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.461436 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.461543 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.461754 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.461842 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.462072 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.462169 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.462389 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.462480 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.462702 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.462798 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.463015 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.463112 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.463321 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.463417 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.463629 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.463732 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.464498 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.464612 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.464804 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.464899 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.465121 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.465219 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.465456 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.465564 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.465768 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.465864 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.466077 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.466166 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.466393 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.466521 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.466703 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.466799 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467027 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467122 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467342 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467431 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467653 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467740 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.467960 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468046 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468274 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468371 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468586 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468674 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468893 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.468988 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.469203 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.469291 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.469538 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.469627 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.469843 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.469940 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.470158 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.470246 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.470464 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.470551 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.470773 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.470873 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.471088 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.471176 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.471398 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.471486 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.471711 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.471808 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472017 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472111 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472384 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472485 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472639 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472774 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.472953 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.473040 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.473267 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.473375 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.473608 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.473699 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.473924 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474012 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474237 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474324 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474557 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474646 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474875 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.474963 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.475189 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.475359 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.475492 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.475590 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.475804 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.475896 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.476098 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.476195 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.476404 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.476500 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.476711 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.476803 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477022 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477122 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477357 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477451 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477657 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477745 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.477961 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478062 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478267 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478356 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478569 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478656 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478883 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.478979 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.479196 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.479291 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.480167 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.480274 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.480388 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.480485 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.480716 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.480834 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481031 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481131 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481358 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481457 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481674 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481770 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.481985 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.482093 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.482295 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.482391 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.482645 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.482750 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.482975 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.483126 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.483276 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.483366 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.483591 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.483679 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.483910 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484007 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484227 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484315 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484543 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484630 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484868 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.484965 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.485182 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.485269 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.485530 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.485620 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.485843 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.485940 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.486160 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.486247 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.486473 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.486560 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.486793 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.486889 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.487099 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.487194 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.487417 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.487506 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.487744 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.487836 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.488065 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.488154 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.488392 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.488479 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.488709 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.488798 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.489034 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.489122 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.489374 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.489476 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.489691 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.489780 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490008 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490096 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490322 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490411 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490638 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490728 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.490960 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491047 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491272 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491360 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491588 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491676 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491899 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.491986 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.492217 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.492314 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.492608 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.492713 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.492846 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.492935 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.493152 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.493249 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.493495 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.493594 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.493821 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.493916 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.494138 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.494236 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.494455 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.494542 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.494763 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.494850 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.495083 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.495181 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.495453 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.495541 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.495767 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.495858 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.496080 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.496259 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.496390 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.496584 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.496700 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.496915 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.497025 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.497232 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.497341 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.497577 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.497666 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.497896 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498001 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498211 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498299 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498524 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498622 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498836 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.498932 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.499149 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.499238 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.499456 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.499544 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.499768 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.499857 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.500081 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.500169 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.500391 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.500485 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.500706 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.500795 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.501018 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.501115 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.501359 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.501451 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.501675 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.501767 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502001 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502090 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502311 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502399 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502619 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502720 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.502930 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503030 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503233 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503331 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503541 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503632 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503871 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.503967 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.504173 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.504270 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.504482 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.504576 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.504793 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.504890 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.505101 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.505268 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.505448 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.505540 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.505761 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.505850 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.506070 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.506168 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.506390 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.506484 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.506700 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.506787 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507009 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507099 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507319 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507417 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507632 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507720 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.507942 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508038 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508254 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508344 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508571 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508658 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508876 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.508971 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.509191 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.509278 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.509528 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.509617 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.509834 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.509935 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.510145 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.510235 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.510461 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.510549 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.511288 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.511594 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.511782 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.511934 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.512225 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.512410 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.512542 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.512737 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.512866 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.513085 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.513192 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.513438 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.513761 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.513852 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.514094 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.514182 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.514413 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.514502 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.514723 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.514813 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515036 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515125 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515346 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515446 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515654 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515752 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.515966 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516057 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516275 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516372 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516582 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516681 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516888 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.516984 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.517201 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.517292 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.517534 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.517640 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.517841 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.517930 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.518148 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.518237 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.518455 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.518553 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.518762 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.518850 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519066 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519153 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519380 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519469 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519689 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519776 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.519996 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.520083 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.520306 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.520395 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.520609 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.520697 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.520913 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521001 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521218 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521328 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521559 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521648 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521881 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.521968 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.522191 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.522280 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.522502 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.522590 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.522809 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.522908 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.523121 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.523221 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.523446 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.523533 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.523767 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.523868 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524070 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524165 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524376 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524465 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524680 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524781 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.524990 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.525087 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.525301 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.525425 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.525628 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.525726 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.525941 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.526029 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.526262 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.526440 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.526654 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.526758 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.526972 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.527124 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.527286 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.527434 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.527594 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.527746 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.527912 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528053 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528227 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528369 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528542 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528678 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528855 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.528982 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.529164 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.529287 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.529506 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.529620 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.529814 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.529933 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.530134 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.530309 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.530446 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.530534 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.530752 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.530840 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531060 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531158 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531374 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531463 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531687 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531775 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.531991 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.532086 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.532300 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.532389 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.532607 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.532695 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.532912 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533001 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533222 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533374 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533554 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533655 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533857 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.533945 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.534165 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.534255 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.534475 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.534562 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.534776 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.534864 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.535082 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.535178 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.535392 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.535480 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.535698 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.535786 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536006 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536094 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536313 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536442 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536618 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536728 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.536921 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537018 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537229 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537370 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537560 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537650 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537870 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.537958 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.538174 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.538271 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.538479 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.538568 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.538782 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.538872 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.539087 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.539185 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.539390 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.539480 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.539699 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.539786 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540008 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540097 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540310 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540396 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540613 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540701 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.540915 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541011 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541220 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541363 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541572 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541673 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541886 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.541976 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.542716 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.542807 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.543026 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.543373 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.543602 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.543768 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.543951 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.544042 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.544261 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.544359 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.544599 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.544687 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.544907 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545003 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545225 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545343 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545572 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545660 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545886 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.545973 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.546193 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.546299 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.546500 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.546591 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.546808 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.546941 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.547124 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.547222 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.547441 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.547535 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.547760 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.547856 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548071 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548168 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548381 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548469 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548686 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548780 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.548998 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.549087 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.549339 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.549432 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.549642 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.549731 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.549957 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550048 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550275 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550364 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550589 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550674 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550902 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.550991 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.551215 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.551304 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.551526 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.551617 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.551836 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.551924 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.552144 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.552232 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.552455 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.552556 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.552766 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.552866 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.553074 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.553171 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.553412 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.553515 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.553731 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.553826 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554036 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554125 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554343 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554444 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554648 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554737 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.554955 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555043 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555256 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555357 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555583 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555670 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555893 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.555981 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.556206 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.556291 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.556518 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.556614 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.556834 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.556924 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.557145 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.557234 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.557492 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.557602 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.557886 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.557983 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.558193 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.558377 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.558593 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.558690 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.558910 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.558998 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.559224 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.559314 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.559538 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.559627 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.559844 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560006 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560148 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560245 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560466 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560556 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560791 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.560888 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.561096 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.561184 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.561426 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.561533 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.561732 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.561835 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562055 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562144 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562359 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562447 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562681 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562778 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.562989 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.563097 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.563299 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.563409 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.563643 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.563744 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.563930 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.564114 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.564238 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.564424 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.564565 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.564734 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.564984 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.565080 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.565299 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.565421 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.565631 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.565743 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.565996 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.566086 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.566309 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.566397 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.566618 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.566715 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.566941 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567031 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567265 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567359 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567578 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567666 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567887 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.567975 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.568190 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.568277 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.568505 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.568600 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.568824 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.568912 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.569138 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.569227 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.569475 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.569583 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.569804 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.569894 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.570114 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.570210 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.570443 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.570610 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.570769 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.570858 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.571086 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.571174 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.571410 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.571507 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.571717 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.571827 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572027 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572157 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572333 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572475 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572637 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572800 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.572960 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.573130 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.573942 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.574073 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.574269 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.574386 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.574587 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.574703 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.574902 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575015 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575210 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575328 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575516 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575658 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575842 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.575968 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.576151 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.576287 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.576476 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.576632 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.576792 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.576922 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.577116 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.577234 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.577463 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.577567 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.577772 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.577883 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.578094 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.578191 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.578407 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.578509 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.578714 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.578803 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579018 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579106 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579325 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579423 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579668 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579757 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.579975 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.580064 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.580294 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.580385 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.580625 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.580715 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.580935 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.581032 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.581247 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.581372 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.581606 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.581696 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.581931 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582034 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582240 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582338 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582547 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582683 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582868 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.582958 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.583204 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.583306 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.583494 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.583583 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.583800 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.583914 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.584114 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.584215 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.584418 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.584508 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.584723 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.584823 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585028 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585119 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585355 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585495 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585664 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585766 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.585968 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586058 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586272 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586360 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586579 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586700 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586885 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.586973 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.587193 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.587281 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.587502 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.587591 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.587804 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.587891 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.588107 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.588195 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.588409 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.588498 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.588731 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.588820 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.589155 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.589248 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.589571 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.589673 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.589888 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.589977 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.590197 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.590292 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.590511 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.590602 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.590832 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.590934 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.591152 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.591250 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.591469 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.591558 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.591780 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.591868 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.592097 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.592197 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.592414 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.592503 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.592726 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.592821 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.593043 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.593141 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.593377 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.593469 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.593698 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.593787 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594017 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594224 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594356 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594559 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594663 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594875 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.594984 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.595189 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.595288 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.595504 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.595610 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.595819 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.596070 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.596168 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.596404 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.596507 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.596722 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.596832 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.597032 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.597129 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.597363 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.597456 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.597685 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.597786 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598005 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598094 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598320 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598409 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598636 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598733 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.598951 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599040 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599266 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599355 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599579 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599679 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599894 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.599983 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.600226 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.600322 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.600554 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.600644 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.600869 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601023 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601185 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601326 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601529 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601618 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601844 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.601931 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.602157 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.602255 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.602471 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.602559 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.602790 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.602901 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.603105 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.603210 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.603414 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.603503 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.603724 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.603814 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.604038 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.604137 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.604352 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.604445 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.605192 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.605411 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.605662 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.605755 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.605992 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.606082 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.606309 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.606399 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.606645 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.606755 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.606954 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.607070 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.607281 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.607506 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.607609 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.607826 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.607926 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.608163 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.608253 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.608493 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.608584 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.608821 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.608911 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.609140 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.609374 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.609482 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.609697 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.609808 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.610034 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.610122 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.610362 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.610461 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.610690 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.610779 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611001 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611090 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611310 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611409 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611635 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611724 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.611941 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612028 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612245 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612334 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612553 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612642 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612860 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.612995 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.613164 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.613423 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.613516 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.613778 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.613867 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.614098 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.614201 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.614418 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.614512 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.614731 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.614820 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.615048 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.615269 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.615368 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.615620 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.615710 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.615942 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616039 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616255 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616343 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616572 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616668 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616884 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.616997 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.617193 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.617301 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.617523 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.617615 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.617834 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.617933 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.618141 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.618230 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.618445 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.618540 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.618756 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.618853 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619061 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619150 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619370 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619466 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619678 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619767 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.619985 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.620081 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.620475 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.620567 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.620802 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.620899 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.621115 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.621204 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.621451 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.621545 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.621763 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.621854 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622071 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622161 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622385 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622483 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622693 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622790 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.622999 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.623088 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.623303 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.623400 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.623609 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.623698 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.623917 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624007 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624234 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624332 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624541 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624633 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624850 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.624939 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.625157 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.625257 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.625485 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.625575 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.625803 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.625908 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.626114 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.626217 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.626453 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.626550 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.626742 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.626829 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627053 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627142 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627363 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627464 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627680 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627769 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.627994 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.628217 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.628307 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.628552 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.628650 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.628874 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.628972 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.629211 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.629301 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.629572 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.629663 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.629883 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.630112 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.630203 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.630454 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.630550 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.630783 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.630950 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.631096 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.631185 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.631414 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.631512 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.631725 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.631825 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632035 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632124 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632345 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632432 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632653 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632751 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.632963 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.633059 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.633272 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.633395 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.633608 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.633699 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.633919 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634009 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634228 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634320 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634539 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634637 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634851 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.634943 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.635157 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.635306 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.635468 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.635558 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.636298 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.636507 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.636607 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.636700 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.636918 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.637021 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.637233 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.637405 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.637575 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.637709 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.637897 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638000 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638207 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638304 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638520 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638627 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638832 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.638929 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.639151 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.639249 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.639472 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.639577 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.639784 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.639879 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.640091 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.640189 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.640403 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.640716 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.640812 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.641037 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.641134 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.641394 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.641511 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.641717 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.641807 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.642027 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.642116 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.642351 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.642677 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.642765 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.642991 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.643081 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.643312 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.643411 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.643625 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.643714 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.643942 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644029 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644271 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644368 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644602 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644763 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644899 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.644993 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.645219 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.645363 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.645551 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.645641 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.645859 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.645966 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.646168 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.646259 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.646487 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.646584 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.646800 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.646926 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.647106 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.647197 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.647410 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.647499 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.647721 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.647821 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648022 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648112 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648329 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648418 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648634 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648732 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.648939 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.649027 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.649246 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.649354 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.649586 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.649692 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.649891 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650022 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650196 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650296 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650499 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650600 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650803 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.650893 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.651108 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.651197 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.651536 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.651646 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.651844 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652071 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652172 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652319 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652423 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652636 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652733 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.652949 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.653045 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.653263 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.653455 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.653604 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.653694 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.653918 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654019 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654232 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654331 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654544 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654633 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654856 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.654997 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.655166 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.655265 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.655501 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.655598 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.655825 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.655922 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.656141 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.656231 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.656452 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.656541 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.656768 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.656856 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.657081 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.657170 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.657418 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.657511 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.657738 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.657857 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.658052 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.658153 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.658362 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.658461 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.658673 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.658777 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659000 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659097 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659312 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659408 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659623 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659728 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.659936 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660033 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660251 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660348 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660564 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660733 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660878 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.660981 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.661191 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.661280 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.661543 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.661647 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.661853 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.661949 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.662168 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.662257 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.662480 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.662571 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.662794 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.662883 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.663105 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.663195 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.663419 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.663556 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.663728 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.663817 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664039 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664128 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664353 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664453 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664664 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664752 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.664978 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.665077 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.665296 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.665401 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.665629 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.665719 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.665941 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.666039 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.666258 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.666357 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.666581 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.666671 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.666900 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.667503 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.667756 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.667875 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.668351 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.668462 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.668674 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.668766 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.668989 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.669087 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.669295 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.669450 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.669545 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 04:50:07.669753 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.670075 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.670424 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.670759 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.671079 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.671399 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.671711 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:50:07.671964 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 04:50:07.823097 n-d-862416-4 devstack@n-api.service[104562]: INFO dbcounter [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Registered counter for database nova_api Oct 26 04:50:07.825599 n-d-862416-4 devstack@n-api.service[104561]: INFO dbcounter [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Registered counter for database nova_api Oct 26 04:50:07.846292 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_db.sqlalchemy.engines [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:07.848145 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_db.sqlalchemy.engines [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:07.852950 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writer thread running {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:07.855221 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writer thread running {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:07.910122 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.context [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=104562) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 04:50:07.911906 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.context [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=104561) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 04:50:07.913926 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:50:07.914396 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:50:07.915734 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_concurrency.lockutils [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:50:07.915994 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:50:07.916209 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_concurrency.lockutils [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:50:07.916708 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:50:07.917808 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:50:07.918880 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_concurrency.lockutils [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:50:07.919598 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_concurrency.lockutils [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:50:07.920051 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_concurrency.lockutils [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:50:07.920148 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:50:07.922058 n-d-862416-4 devstack@n-api.service[104562]: INFO dbcounter [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Registered counter for database nova_cell0 Oct 26 04:50:07.922152 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_concurrency.lockutils [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:50:07.924062 n-d-862416-4 devstack@n-api.service[104561]: INFO dbcounter [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Registered counter for database nova_cell0 Oct 26 04:50:07.926198 n-d-862416-4 devstack@n-api.service[104562]: INFO dbcounter [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Registered counter for database nova_cell1 Oct 26 04:50:07.928101 n-d-862416-4 devstack@n-api.service[104561]: INFO dbcounter [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Registered counter for database nova_cell1 Oct 26 04:50:07.934593 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_db.sqlalchemy.engines [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:07.936119 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_db.sqlalchemy.engines [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:07.937616 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_db.sqlalchemy.engines [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:07.941473 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writer thread running {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:07.941614 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writer thread running {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:07.942108 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_db.sqlalchemy.engines [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:08.078887 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writer thread running {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:08.083876 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writer thread running {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:08.088774 n-d-862416-4 devstack@n-api.service[104562]: INFO dbcounter [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Registered counter for database nova_cell0 Oct 26 04:50:08.093397 n-d-862416-4 devstack@n-api.service[104561]: INFO dbcounter [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Registered counter for database nova_cell0 Oct 26 04:50:08.096341 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_db.sqlalchemy.engines [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:08.101058 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writer thread running {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:08.102230 n-d-862416-4 devstack@n-api.service[104561]: DEBUG oslo_db.sqlalchemy.engines [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:50:08.107348 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writer thread running {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:50:08.439836 n-d-862416-4 devstack@n-api.service[104562]: WARNING keystonemiddleware.auth_token [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:50:08.442560 n-d-862416-4 devstack@n-api.service[104561]: WARNING keystonemiddleware.auth_token [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:50:08.447033 n-d-862416-4 devstack@n-api.service[104562]: WARNING keystonemiddleware.auth_token [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:50:08.451243 n-d-862416-4 devstack@n-api.service[104561]: WARNING keystonemiddleware.auth_token [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:50:08.791082 n-d-862416-4 devstack@n-api.service[104562]: WARNING keystonemiddleware.auth_token [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:50:08.797474 n-d-862416-4 devstack@n-api.service[104562]: WARNING keystonemiddleware.auth_token [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:50:08.800537 n-d-862416-4 devstack@n-api.service[104561]: WARNING keystonemiddleware.auth_token [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:50:08.802764 n-d-862416-4 devstack@n-api.service[104562]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5e68db9c0 pid: 104562 (default app) Oct 26 04:50:08.804819 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:50:08.806037 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Oct 26 04:50:08.806447 n-d-862416-4 devstack@n-api.service[104561]: WARNING keystonemiddleware.auth_token [None req-108c01ae-e937-4d1c-a4a9-5075e3a7ede2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:50:08.806556 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Oct 26 04:50:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:50:08.812479 n-d-862416-4 devstack@n-api.service[104561]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5e68db9c0 pid: 104561 (default app) Oct 26 04:51:30.256629 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:30.257734 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 26 04:51:30.258152 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:30.270649 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_api:SELECT=3 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:30.271773 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_cell0:SELECT=3 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:30.272507 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_cell1:SELECT=3 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:30.274646 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:31.126095 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-8711a9b5-2421-4cd1-a96e-f92bc598fc94 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:31.159883 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-8711a9b5-2421-4cd1-a96e-f92bc598fc94 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.894459 Oct 26 04:51:31.160847 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 04:51:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:51:33.821266 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:33.823433 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-b1501ad5-d3c1-491e-8bf1-b8601cebf3d8 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 26 04:51:33.824042 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 04:51:34.277804 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-8387087b-46b5-4be2-94bb-8d0cdc83e0ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "vcpus": 1, "ram": 256, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:34.325120 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-8387087b-46b5-4be2-94bb-8d0cdc83e0ba admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495205 Oct 26 04:51:34.325949 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 04:51:34.340439 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_api:SELECT=3 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:34.341264 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_cell0:SELECT=3 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:34.343232 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_cell1:SELECT=3 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:34.343999 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:51:34.550512 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-4b1b154b-6fc9-4261-b6ee-e4cd7c0d7ada admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:34.622913 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-4b1b154b-6fc9-4261-b6ee-e4cd7c0d7ada admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288368 Oct 26 04:51:34.623739 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 26 04:51:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:51:37.297871 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-8387087b-46b5-4be2-94bb-8d0cdc83e0ba admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:37.299503 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-8387087b-46b5-4be2-94bb-8d0cdc83e0ba admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Oct 26 04:51:37.300251 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:38.083860 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-c6e8f864-1ee4-43e0-bfce-ab001d50c4b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "vcpus": 1}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:38.130787 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-c6e8f864-1ee4-43e0-bfce-ab001d50c4b5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.822644 Oct 26 04:51:38.131663 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:51:38.148835 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-301634e3-b838-4aeb-a20d-fda16e61776f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:38.216185 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-301634e3-b838-4aeb-a20d-fda16e61776f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071649 Oct 26 04:51:38.217159 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 26 04:51:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 04:51:41.080606 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-c6e8f864-1ee4-43e0-bfce-ab001d50c4b5 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:41.082321 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-c6e8f864-1ee4-43e0-bfce-ab001d50c4b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 26 04:51:41.083064 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:41.732961 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-329e345a-2bb0-47b3-a0e9-f5b81216c0bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "swap": 0}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:41.753022 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-329e345a-2bb0-47b3-a0e9-f5b81216c0bc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.662316 Oct 26 04:51:41.757348 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:51:41.768171 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-c9acdf35-41db-461c-b42c-bc68a8b1bce5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:41.797200 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-c9acdf35-41db-461c-b42c-bc68a8b1bce5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032882 Oct 26 04:51:41.798125 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 26 04:51:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:51:44.433031 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-329e345a-2bb0-47b3-a0e9-f5b81216c0bc admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:44.433861 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-329e345a-2bb0-47b3-a0e9-f5b81216c0bc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 26 04:51:44.434465 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 04:51:44.931434 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-d8b20f69-e7ef-4135-96da-2571b5975c74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "name": "ds2G", "id": "d3"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:44.957074 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-d8b20f69-e7ef-4135-96da-2571b5975c74 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502399 Oct 26 04:51:44.959231 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:51:44.973550 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-35b27ad6-4bbe-4cb5-a4bd-497285b27077 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:45.013051 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-35b27ad6-4bbe-4cb5-a4bd-497285b27077 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043462 Oct 26 04:51:45.014458 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 26 04:51:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 04:51:47.765107 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-d8b20f69-e7ef-4135-96da-2571b5975c74 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:47.766898 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-d8b20f69-e7ef-4135-96da-2571b5975c74 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002317 Oct 26 04:51:47.776109 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:48.286901 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-c2a36ec5-1f5a-4704-8e78-025ffbf55c20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:48.312029 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-c2a36ec5-1f5a-4704-8e78-025ffbf55c20 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538142 Oct 26 04:51:48.312583 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:51:48.327181 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-4e2174ac-d14c-4fc2-a9d3-54e8fc961757 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:48.378279 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-4e2174ac-d14c-4fc2-a9d3-54e8fc961757 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054832 Oct 26 04:51:48.378914 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 26 04:51:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 04:51:51.169895 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-c2a36ec5-1f5a-4704-8e78-025ffbf55c20 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:51.171235 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-c2a36ec5-1f5a-4704-8e78-025ffbf55c20 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Oct 26 04:51:51.171793 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:51.622232 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-71956c8c-6cf6-4eab-a233-b4f73c6718fa admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:51.647170 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-71956c8c-6cf6-4eab-a233-b4f73c6718fa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469167 Oct 26 04:51:51.647821 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 04:51:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 04:51:54.268752 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-c2a36ec5-1f5a-4704-8e78-025ffbf55c20 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:54.269824 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-c2a36ec5-1f5a-4704-8e78-025ffbf55c20 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 26 04:51:54.270236 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:54.726623 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-391e51ae-67c0-47d1-a19d-5ec9af20a24d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "id": "1", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:54.747220 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-391e51ae-67c0-47d1-a19d-5ec9af20a24d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470292 Oct 26 04:51:54.747767 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:51:54.759717 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-8c02b25c-c297-42e8-9df5-4d047e42a541 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:54.787345 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-8c02b25c-c297-42e8-9df5-4d047e42a541 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031149 Oct 26 04:51:54.787914 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 26 04:51:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:51:57.434888 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-391e51ae-67c0-47d1-a19d-5ec9af20a24d admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:51:57.436560 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-391e51ae-67c0-47d1-a19d-5ec9af20a24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Oct 26 04:51:57.437136 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:51:57.841347 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-5e08198c-ebf2-4b84-bb3f-2b76c52925de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:57.859789 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-5e08198c-ebf2-4b84-bb3f-2b76c52925de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416570 Oct 26 04:51:57.860348 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:51:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 04:51:57.872860 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-c39fd039-616c-4ca5-b998-d089bc27bf3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:51:57.896895 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-c39fd039-616c-4ca5-b998-d089bc27bf3c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028255 Oct 26 04:51:57.897494 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 26 04:51:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:52:00.522214 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-5e08198c-ebf2-4b84-bb3f-2b76c52925de admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:00.523361 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-5e08198c-ebf2-4b84-bb3f-2b76c52925de admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Oct 26 04:52:00.523847 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:00.894250 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-4466fc6b-1c89-4b63-8133-173b2a822817 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "name": "m1.medium", "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:00.915388 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-4466fc6b-1c89-4b63-8133-173b2a822817 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.384469 Oct 26 04:52:00.916400 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:52:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:52:00.928359 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-3ab71c8a-5549-488c-8a87-df436e81f664 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:00.933813 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:52:00.958022 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-3ab71c8a-5549-488c-8a87-df436e81f664 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033271 Oct 26 04:52:00.958707 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 26 04:52:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:52:03.622538 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-4466fc6b-1c89-4b63-8133-173b2a822817 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:03.624353 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-4466fc6b-1c89-4b63-8133-173b2a822817 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Oct 26 04:52:03.624926 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:04.065270 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-42ea2c82-535e-4d09-b3dd-1d693ad400f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:04.085898 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-42ea2c82-535e-4d09-b3dd-1d693ad400f6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454723 Oct 26 04:52:04.086651 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:52:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 04:52:04.099608 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-0b8d4e78-4939-4ed5-9426-b76c941c9778 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:04.127582 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-0b8d4e78-4939-4ed5-9426-b76c941c9778 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031884 Oct 26 04:52:04.128403 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 26 04:52:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:52:06.805866 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-42ea2c82-535e-4d09-b3dd-1d693ad400f6 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:06.807429 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-42ea2c82-535e-4d09-b3dd-1d693ad400f6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Oct 26 04:52:06.807834 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:07.254207 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-1fbf4d42-78c0-4a25-80c2-96ac32cbf62c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:07.269287 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:52:07.284280 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-1fbf4d42-78c0-4a25-80c2-96ac32cbf62c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470241 Oct 26 04:52:07.284842 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 26 04:52:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 04:52:07.297295 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-ebb05f78-ecf8-4eb0-8bde-8642d8d4db36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:07.324153 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-ebb05f78-ecf8-4eb0-8bde-8642d8d4db36 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029815 Oct 26 04:52:07.324358 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 26 04:52:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 04:52:28.454387 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-1fbf4d42-78c0-4a25-80c2-96ac32cbf62c admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:28.455404 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-1fbf4d42-78c0-4a25-80c2-96ac32cbf62c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 26 04:52:28.455814 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:28.467151 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:52:28.847789 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-bb0f1229-202b-4748-af76-d9db01adeec3 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:28.867037 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-bb0f1229-202b-4748-af76-d9db01adeec3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405094 Oct 26 04:52:28.867566 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 04:52:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:30.189616 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-1fbf4d42-78c0-4a25-80c2-96ac32cbf62c admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:30.190635 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-1fbf4d42-78c0-4a25-80c2-96ac32cbf62c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 26 04:52:30.191024 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:30.718685 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-3fbc7dcd-dd0d-429b-bfe8-530df5004334 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:30.723923 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.wsgi [None req-3fbc7dcd-dd0d-429b-bfe8-530df5004334 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-3fbc7dcd-dd0d-429b-bfe8-530df5004334 admin admin] Request method failure captured: Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Accept: application/json Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Accept-Encoding: gzip, deflate Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Connection: keep-alive Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Content-Length: 0 Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Host: 10.222.0.16 Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Openstack-Api-Version: compute 2.92 Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: Openstack-System-Scope: None Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: User-Agent: python-novaclient Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Auth-Token: gAAAAABjWL0Odw24CjcdDlpZnkYKawKgjBTkwb1aOe-NbQYpVTs5A3G2RVgu1n9QlYnXlWlu97uZ3VUSSlMLn8LVAjEUlOiCREeIfLAk4-u3qrJrWHrwF9Lv_4TEkl2VptaKPXJeSG_yZ0DqoN_G_RanOawm2lPsdudDrnEa85jRy8NQza6W_PE Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Domain-Id: None Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Domain-Name: None Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Identity-Status: Confirmed Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Is-Admin-Project: True Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Domain-Id: default Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Domain-Name: Default Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Name: admin Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Role: reader,admin,member Oct 26 04:52:30.727135 n-d-862416-4 devstack@n-api.service[104561]: X-Roles: reader,admin,member Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant: admin Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant-Name: admin Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-User: admin Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-User-Domain-Id: default Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-User-Domain-Name: Default Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-User-Id: 1a4e05ac347c4af08950f7d3f7190668 Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: X-User-Name: admin Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: method: > Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: exception: Flavor 42 could not be found. Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: action_args: {'id': '42'} Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 04:52:30.728885 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:30.730443 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.731889 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-3fbc7dcd-dd0d-429b-bfe8-530df5004334 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 04:52:30.733229 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-3fbc7dcd-dd0d-429b-bfe8-530df5004334 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394339 Oct 26 04:52:30.733229 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 26 04:52:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 04:52:30.739245 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-0adf99d3-7d0a-4f89-bd2c-1533a56b6734 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:30.762931 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-0adf99d3-7d0a-4f89-bd2c-1533a56b6734 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027802 Oct 26 04:52:30.763468 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 26 04:52:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:30.784798 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-3ae6a839-b7ce-4018-a64b-0a037c8371e5 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:30.807817 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-3ae6a839-b7ce-4018-a64b-0a037c8371e5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026990 Oct 26 04:52:30.808349 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 26 04:52:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:30.817543 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-54fa04ab-c58c-49e4-8885-635b5c302564 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:30.823133 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.wsgi [None req-54fa04ab-c58c-49e4-8885-635b5c302564 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-54fa04ab-c58c-49e4-8885-635b5c302564 admin admin] Request method failure captured: Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Accept: application/json Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Accept-Encoding: gzip, deflate Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Connection: keep-alive Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Content-Length: 0 Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Host: 10.222.0.16 Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Openstack-Api-Version: compute 2.92 Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: Openstack-System-Scope: None Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: User-Agent: python-novaclient Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Auth-Token: gAAAAABjWL0Odw24CjcdDlpZnkYKawKgjBTkwb1aOe-NbQYpVTs5A3G2RVgu1n9QlYnXlWlu97uZ3VUSSlMLn8LVAjEUlOiCREeIfLAk4-u3qrJrWHrwF9Lv_4TEkl2VptaKPXJeSG_yZ0DqoN_G_RanOawm2lPsdudDrnEa85jRy8NQza6W_PE Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Domain-Id: None Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Domain-Name: None Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Identity-Status: Confirmed Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Is-Admin-Project: True Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Domain-Id: default Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Domain-Name: Default Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Name: admin Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Role: reader,admin,member Oct 26 04:52:30.826379 n-d-862416-4 devstack@n-api.service[104562]: X-Roles: reader,admin,member Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant: admin Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant-Name: admin Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-User: admin Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-User-Domain-Id: default Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-User-Domain-Name: Default Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-User-Id: 1a4e05ac347c4af08950f7d3f7190668 Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: X-User-Name: admin Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: method: > Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: exception: Flavor 42 could not be found. Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: action_args: {'id': '42'} Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 04:52:30.827864 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:30.828800 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:30.830332 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-54fa04ab-c58c-49e4-8885-635b5c302564 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 04:52:30.831570 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-54fa04ab-c58c-49e4-8885-635b5c302564 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013784 Oct 26 04:52:30.831570 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 26 04:52:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 04:52:32.039296 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-3ae6a839-b7ce-4018-a64b-0a037c8371e5 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:32.040349 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-3ae6a839-b7ce-4018-a64b-0a037c8371e5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 26 04:52:32.040745 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:32.567976 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-295dce63-ae2a-40fb-b132-9545db74c422 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:32.573100 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.wsgi [None req-295dce63-ae2a-40fb-b132-9545db74c422 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-295dce63-ae2a-40fb-b132-9545db74c422 admin admin] Request method failure captured: Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Accept: application/json Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Accept-Encoding: gzip, deflate Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Connection: keep-alive Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Content-Length: 0 Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Host: 10.222.0.16 Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Openstack-Api-Version: compute 2.92 Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: Openstack-System-Scope: None Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: User-Agent: python-novaclient Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Auth-Token: gAAAAABjWL0PZiMfwxaTq_xuK12wkIL5Efb90mZCvSAAeGkbkFq_t4bZqHPI7MpQ5oFKoSuuczKjpgBqcKe4o4tYzSPzuMHFxpor2dzcHY4PeJDAyXAPSfph9KnONm7deN2n369nmkqFz3AoRLzz0x9kv3OieemVdXIJYfOuZXQWnsS-M23whjw Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Domain-Id: None Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Domain-Name: None Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Identity-Status: Confirmed Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Is-Admin-Project: True Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Domain-Id: default Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Domain-Name: Default Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Name: admin Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Role: reader,admin,member Oct 26 04:52:32.574722 n-d-862416-4 devstack@n-api.service[104562]: X-Roles: reader,admin,member Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant: admin Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant-Name: admin Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-User: admin Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-User-Domain-Id: default Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-User-Domain-Name: Default Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-User-Id: 1a4e05ac347c4af08950f7d3f7190668 Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: X-User-Name: admin Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: method: > Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: exception: Flavor 84 could not be found. Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: action_args: {'id': '84'} Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 04:52:32.576279 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:32.577398 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.578880 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-295dce63-ae2a-40fb-b132-9545db74c422 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 04:52:32.580145 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-295dce63-ae2a-40fb-b132-9545db74c422 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394508 Oct 26 04:52:32.580145 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 26 04:52:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 04:52:32.585777 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-c5349511-b1bb-48f7-8aab-cc45eebd5195 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:32.601543 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-c5349511-b1bb-48f7-8aab-cc45eebd5195 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019303 Oct 26 04:52:32.602078 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 26 04:52:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:32.611866 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-1cc3347e-3336-42e9-966c-3feaf2aa6aed admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:32.627042 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-1cc3347e-3336-42e9-966c-3feaf2aa6aed admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018643 Oct 26 04:52:32.627554 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 26 04:52:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:32.636613 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-0e99b20a-c00e-4104-8e1c-7aa8209e347e admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:32.641582 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.wsgi [None req-0e99b20a-c00e-4104-8e1c-7aa8209e347e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-0e99b20a-c00e-4104-8e1c-7aa8209e347e admin admin] Request method failure captured: Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Accept: application/json Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Accept-Encoding: gzip, deflate Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Connection: keep-alive Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Content-Length: 0 Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Host: 10.222.0.16 Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Openstack-Api-Version: compute 2.92 Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: Openstack-System-Scope: None Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: User-Agent: python-novaclient Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Auth-Token: gAAAAABjWL0PZiMfwxaTq_xuK12wkIL5Efb90mZCvSAAeGkbkFq_t4bZqHPI7MpQ5oFKoSuuczKjpgBqcKe4o4tYzSPzuMHFxpor2dzcHY4PeJDAyXAPSfph9KnONm7deN2n369nmkqFz3AoRLzz0x9kv3OieemVdXIJYfOuZXQWnsS-M23whjw Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Domain-Id: None Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Domain-Name: None Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Identity-Status: Confirmed Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Is-Admin-Project: True Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Domain-Id: default Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Domain-Name: Default Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Name: admin Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Role: reader,admin,member Oct 26 04:52:32.643075 n-d-862416-4 devstack@n-api.service[104561]: X-Roles: reader,admin,member Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant: admin Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant-Name: admin Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-User: admin Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-User-Domain-Id: default Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-User-Domain-Name: Default Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-User-Id: 1a4e05ac347c4af08950f7d3f7190668 Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: X-User-Name: admin Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: method: > Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: exception: Flavor 84 could not be found. Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: action_args: {'id': '84'} Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 04:52:32.644590 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:32.645692 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:32.646806 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-0e99b20a-c00e-4104-8e1c-7aa8209e347e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 04:52:32.647851 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-0e99b20a-c00e-4104-8e1c-7aa8209e347e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011336 Oct 26 04:52:32.647851 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 26 04:52:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 26 04:52:33.878293 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-1cc3347e-3336-42e9-966c-3feaf2aa6aed admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:33.879396 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-1cc3347e-3336-42e9-966c-3feaf2aa6aed admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 26 04:52:33.879870 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:34.400390 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-2cadb7c1-f256-4200-9281-3b55b1fe7b56 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:34.406262 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.wsgi [None req-2cadb7c1-f256-4200-9281-3b55b1fe7b56 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-2cadb7c1-f256-4200-9281-3b55b1fe7b56 admin admin] Request method failure captured: Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Accept: application/json Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Accept-Encoding: gzip, deflate Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Connection: keep-alive Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Content-Length: 0 Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Host: 10.222.0.16 Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Openstack-Api-Version: compute 2.92 Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: Openstack-System-Scope: None Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: User-Agent: python-novaclient Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Auth-Token: gAAAAABjWL0RIuqNDq01ZJQjDxShDc813s4QLINd-_QW7mI-DTLaj-t-0fBe9l7zafWLdvHNXwuqJHud3UTB96G_0aTB_gRqsRLyWhjJJPCJhl3Du16q7S_M4cAUfO4fnlC7-yKZqQ2o1nGYFN-5PAY_mysv2DFVLGG07Mxm4PUwBEqp4As8Ij0 Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Domain-Id: None Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Domain-Name: None Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Identity-Status: Confirmed Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Is-Admin-Project: True Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Domain-Id: default Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Domain-Name: Default Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Project-Name: admin Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Role: reader,admin,member Oct 26 04:52:34.407749 n-d-862416-4 devstack@n-api.service[104561]: X-Roles: reader,admin,member Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant: admin Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-Tenant-Name: admin Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-User: admin Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-User-Domain-Id: default Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-User-Domain-Name: Default Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-User-Id: 1a4e05ac347c4af08950f7d3f7190668 Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: X-User-Name: admin Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: method: > Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: exception: Flavor 451 could not be found. Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: action_args: {'id': '451'} Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 04:52:34.409351 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:34.410339 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.411629 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-2cadb7c1-f256-4200-9281-3b55b1fe7b56 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 04:52:34.412889 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-2cadb7c1-f256-4200-9281-3b55b1fe7b56 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392664 Oct 26 04:52:34.412889 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 04:52:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 04:52:34.419629 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-1a01a6a1-6fe7-4ff2-a4f1-58d784eb3569 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:34.435025 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-1a01a6a1-6fe7-4ff2-a4f1-58d784eb3569 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019821 Oct 26 04:52:34.435556 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 26 04:52:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:34.445225 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:34.459939 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018266 Oct 26 04:52:34.460467 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 26 04:52:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:52:34.470055 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-2430fe51-ddad-46f7-9737-4724bdb4cf79 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:34.475473 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.wsgi [None req-2430fe51-ddad-46f7-9737-4724bdb4cf79 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-2430fe51-ddad-46f7-9737-4724bdb4cf79 admin admin] Request method failure captured: Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Accept: application/json Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Accept-Encoding: gzip, deflate Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Connection: keep-alive Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Content-Length: 0 Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Host: 10.222.0.16 Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Openstack-Api-Version: compute 2.92 Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: Openstack-System-Scope: None Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: User-Agent: python-novaclient Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Auth-Token: gAAAAABjWL0RIuqNDq01ZJQjDxShDc813s4QLINd-_QW7mI-DTLaj-t-0fBe9l7zafWLdvHNXwuqJHud3UTB96G_0aTB_gRqsRLyWhjJJPCJhl3Du16q7S_M4cAUfO4fnlC7-yKZqQ2o1nGYFN-5PAY_mysv2DFVLGG07Mxm4PUwBEqp4As8Ij0 Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Domain-Id: None Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Domain-Name: None Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Identity-Status: Confirmed Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Is-Admin-Project: True Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Domain-Id: default Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Domain-Name: Default Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Project-Name: admin Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Role: reader,admin,member Oct 26 04:52:34.477000 n-d-862416-4 devstack@n-api.service[104562]: X-Roles: reader,admin,member Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96380042443d4b3cbe78d05df6f799ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant: admin Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant-Id: 96380042443d4b3cbe78d05df6f799ca Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-Tenant-Name: admin Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-User: admin Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-User-Domain-Id: default Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-User-Domain-Name: Default Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-User-Id: 1a4e05ac347c4af08950f7d3f7190668 Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: X-User-Name: admin Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: method: > Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: exception: Flavor 451 could not be found. Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: action_args: {'id': '451'} Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 04:52:34.478636 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:34.480138 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: ERROR nova.api.openstack.wsgi Oct 26 04:52:34.481448 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-2430fe51-ddad-46f7-9737-4724bdb4cf79 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 04:52:34.483063 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-2430fe51-ddad-46f7-9737-4724bdb4cf79 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011987 Oct 26 04:52:34.483063 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 04:52:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 04:52:35.680981 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:35.682647 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 26 04:52:35.683178 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:36.208421 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-7e82d83e-371d-422a-aa5c-439a325885c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:36.228040 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-7e82d83e-371d-422a-aa5c-439a325885c7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405092 Oct 26 04:52:36.228580 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 26 04:52:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:52:37.454070 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:37.455079 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 26 04:52:37.455497 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:37.980758 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-9043af1e-4148-48d6-b6ac-2dcd377ac3f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:38.000149 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-9043af1e-4148-48d6-b6ac-2dcd377ac3f4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404091 Oct 26 04:52:38.000725 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 26 04:52:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:52:39.211597 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:39.212618 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 26 04:52:39.213018 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:39.741070 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-62e88037-720c-4b54-b3d2-4a3bcea97d55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:39.760530 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-62e88037-720c-4b54-b3d2-4a3bcea97d55 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.410038 Oct 26 04:52:39.761140 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 26 04:52:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 04:52:40.966607 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:40.967631 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 26 04:52:40.968033 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:41.491856 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-544cd723-29b8-4a61-882e-41dc3f453a9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 04:52:41.511435 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-544cd723-29b8-4a61-882e-41dc3f453a9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405673 Oct 26 04:52:41.512556 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 26 04:52:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 04:52:42.734064 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:42.735070 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 26 04:52:42.735464 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:52:43.258974 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-840da2a8-abc9-4510-abe2-d1c6332086f7 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:52:43.280364 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-840da2a8-abc9-4510-abe2-d1c6332086f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404977 Oct 26 04:52:43.280836 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 26 04:52:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:53:40.069541 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:53:40.070608 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-7e42fe89-a753-4c82-8d81-97b8ff90bc00 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 26 04:53:40.071017 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 26 04:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:53:40.081903 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:53:40.469372 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-d3f34af8-ce51-44d7-b584-749514c045fa admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:53:40.489321 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-d3f34af8-ce51-44d7-b584-749514c045fa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411985 Oct 26 04:53:40.489860 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 04:53:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:53:40.512871 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_api:SELECT=14 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:53:40.516849 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-001c00ae-d71a-441c-a5ba-a2ec2fa5780c admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:53:40.524126 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-001c00ae-d71a-441c-a5ba-a2ec2fa5780c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012706 Oct 26 04:53:40.524648 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 26 04:53:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:53:40.536345 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-6089ecaf-b997-4b2a-9fd3-a80e23796b54 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:53:40.543894 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-6089ecaf-b997-4b2a-9fd3-a80e23796b54 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011173 Oct 26 04:53:40.544401 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 26 04:53:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:53:40.555508 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-bdb55842-5316-49a5-bafe-cdeaa542c9c2 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:53:40.563088 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-bdb55842-5316-49a5-bafe-cdeaa542c9c2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011071 Oct 26 04:53:40.563606 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 26 04:53:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 04:53:40.575193 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-d67becee-2209-4fd8-b1c3-5632ea307305 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:53:40.582349 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-d67becee-2209-4fd8-b1c3-5632ea307305 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011237 Oct 26 04:53:40.582856 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 26 04:53:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 04:59:01.457281 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-bdb55842-5316-49a5-bafe-cdeaa542c9c2 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:59:01.458318 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-bdb55842-5316-49a5-bafe-cdeaa542c9c2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 26 04:59:01.458712 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:59:01.601561 n-d-862416-4 devstack@n-api.service[104562]: DEBUG dbcounter [-] [104562] Writing DB stats nova_api:SELECT=6 {{(pid=104562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:59:01.750825 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:59:01.755821 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:01.756297 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:01.756724 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:01.757462 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:01.757906 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:01.758349 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:01.798275 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-10686351-a4b0-4f8c-a47c-3f32296dcb74 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.197847 Oct 26 04:59:01.798841 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 04:59:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:59:02.888200 n-d-862416-4 devstack@n-api.service[104561]: DEBUG nova.api.openstack.wsgi [None req-bdb55842-5316-49a5-bafe-cdeaa542c9c2 admin admin] Calling method '>' {{(pid=104561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:59:02.889237 n-d-862416-4 devstack@n-api.service[104561]: INFO nova.api.openstack.requestlog [None req-bdb55842-5316-49a5-bafe-cdeaa542c9c2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 26 04:59:02.889685 n-d-862416-4 devstack@n-api.service[104561]: [pid: 104561|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 26 04:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 04:59:03.082766 n-d-862416-4 devstack@n-api.service[104562]: DEBUG nova.api.openstack.wsgi [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Calling method '>' {{(pid=104562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 04:59:03.086293 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:03.086905 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:03.087554 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:03.088314 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:03.088768 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:03.089197 n-d-862416-4 devstack@n-api.service[104562]: DEBUG oslo_concurrency.lockutils [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:03.113201 n-d-862416-4 devstack@n-api.service[104562]: INFO nova.api.openstack.requestlog [None req-f8d79a50-f91c-43cd-ad40-91d2a384a09d admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.083558 Oct 26 04:59:03.113824 n-d-862416-4 devstack@n-api.service[104562]: [pid: 104562|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 04:59:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 04:59:47.522376 n-d-862416-4 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 26 04:59:47.522918 n-d-862416-4 devstack@n-api.service[104560]: Wed Oct 26 04:59:47 2022 - graceful shutdown triggered... Oct 26 04:59:47.523404 n-d-862416-4 devstack@n-api.service[104561]: Gracefully killing worker 1 (pid: 104561)... Oct 26 04:59:47.523786 n-d-862416-4 devstack@n-api.service[104562]: Gracefully killing worker 2 (pid: 104562)... Oct 26 04:59:47.657120 n-d-862416-4 devstack@n-api.service[104561]: DEBUG dbcounter [-] [104561] Writing DB stats nova_api:SELECT=4 {{(pid=104561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 04:59:48.523819 n-d-862416-4 devstack@n-api.service[104560]: worker 1 buried after 1 seconds Oct 26 04:59:48.524325 n-d-862416-4 devstack@n-api.service[104560]: worker 2 buried after 1 seconds Oct 26 04:59:48.524325 n-d-862416-4 devstack@n-api.service[104560]: goodbye to uWSGI. Oct 26 04:59:48.525541 n-d-862416-4 systemd[1]: devstack@n-api.service: Succeeded. Oct 26 04:59:48.526117 n-d-862416-4 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 26 04:59:48.528836 n-d-862416-4 systemd[1]: Starting Devstack devstack@n-api.service... Oct 26 04:59:48.544607 n-d-862416-4 devstack@n-api.service[120571]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 04:59:48 2022] *** Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: nodename: n-d-862416-4 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: machine: x86_64 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: clock source: unix Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: pcre jit disabled Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: detected number of CPU cores: 4 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: current working directory: / Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: detected binary path: /usr/bin/uwsgi-core Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: your processes number limit is 47680 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: your memory page size is 4096 bytes Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: detected max file descriptor number: 2048 Oct 26 04:59:48.569873 n-d-862416-4 devstack@n-api.service[120571]: lock engine: pthread robust mutexes Oct 26 04:59:48.571144 n-d-862416-4 devstack@n-api.service[120571]: thunder lock: enabled Oct 26 04:59:48.571144 n-d-862416-4 devstack@n-api.service[120571]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 26 04:59:48.571144 n-d-862416-4 devstack@n-api.service[120571]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 04:59:48.610715 n-d-862416-4 devstack@n-api.service[120571]: Python main interpreter initialized at 0x5613571339c0 Oct 26 04:59:48.610715 n-d-862416-4 devstack@n-api.service[120571]: python threads support enabled Oct 26 04:59:48.610715 n-d-862416-4 devstack@n-api.service[120571]: your server socket listen backlog is limited to 100 connections Oct 26 04:59:48.610715 n-d-862416-4 devstack@n-api.service[120571]: your mercy for graceful operations on workers is 90 seconds Oct 26 04:59:48.611162 n-d-862416-4 devstack@n-api.service[120571]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 04:59:48.611162 n-d-862416-4 devstack@n-api.service[120571]: *** Operational MODE: preforking *** Oct 26 04:59:48.611394 n-d-862416-4 devstack@n-api.service[120571]: *** uWSGI is running in multiple interpreter mode *** Oct 26 04:59:48.611394 n-d-862416-4 devstack@n-api.service[120571]: spawned uWSGI master process (pid: 120571) Oct 26 04:59:48.611605 n-d-862416-4 systemd[1]: Started Devstack devstack@n-api.service. Oct 26 04:59:48.612482 n-d-862416-4 devstack@n-api.service[120571]: spawned uWSGI worker 1 (pid: 120585, cores: 1) Oct 26 04:59:48.614035 n-d-862416-4 devstack@n-api.service[120571]: spawned uWSGI worker 2 (pid: 120586, cores: 1) Oct 26 04:59:48.614035 n-d-862416-4 devstack@n-api.service[120571]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 04:59:49.285978 n-d-862416-4 devstack@n-api.service[120585]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 04:59:49.297090 n-d-862416-4 devstack@n-api.service[120586]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 04:59:50.544037 n-d-862416-4 devstack@n-api.service[120585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:59:50.544037 n-d-862416-4 devstack@n-api.service[120585]: from cryptography.utils import int_from_bytes Oct 26 04:59:50.544677 n-d-862416-4 devstack@n-api.service[120585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:59:50.544677 n-d-862416-4 devstack@n-api.service[120585]: from cryptography.utils import int_from_bytes Oct 26 04:59:50.592788 n-d-862416-4 devstack@n-api.service[120586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:59:50.592788 n-d-862416-4 devstack@n-api.service[120586]: from cryptography.utils import int_from_bytes Oct 26 04:59:50.593494 n-d-862416-4 devstack@n-api.service[120586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 04:59:50.593494 n-d-862416-4 devstack@n-api.service[120586]: from cryptography.utils import int_from_bytes Oct 26 04:59:52.989458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 04:59:52.990076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 04:59:52.990287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 04:59:52.990663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 04:59:52.990927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 04:59:52.991327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.991661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.991990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.992309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.992673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.993001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.993354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.993787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.994157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.994403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.994729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.995061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-4 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.995391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.995948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.996494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.996836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.997151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.997514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.997831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:52.998355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.001764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.002798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-4 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.002798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.002798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.003239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.003414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.003685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.003988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.004317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.004647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.004962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.005326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.005663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.005987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.006314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.006618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.006931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.007245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.007569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.007877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.008828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.008970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.009286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.009638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.009966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.010294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.010550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.010804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.011130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.011454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.011768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.012081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.012391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.012701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.013013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.013352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.013653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.013967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.014294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.014611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.014939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.015249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.015572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.015975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.016230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.016542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.016891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.017216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.017559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.017882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.018208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.018527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.018840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.019153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.019474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.019813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.020121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.020376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.020684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.020993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.021346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.021653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.021966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.022277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.022581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.023704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.023704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.023704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.024612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.024612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.024982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.025227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.025583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.025898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.026211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.026539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.026866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.027176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.027482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.027959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.028279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.028616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.028932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.029246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.029604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.029920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.030233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.030560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.030874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.031189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.031515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.031819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.032129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.032455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.032771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.033081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.033421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.033735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.034045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.034356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.034668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.034980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.035284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.035610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.035938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.036253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.036566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.036876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.037200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.037679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.037956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.038250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.038577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.038916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.039549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.039941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.040262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.040579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.040912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.041231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.041580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.041898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.042225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.042552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.042912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.043211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.043534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.043861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.044180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.044504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.044840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.045171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.045513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.045866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.046222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.046545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.046913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.047203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.047522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.047851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.048154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.048510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.048831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.049148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.049504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.049821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.050148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.050466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.050784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.051511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.051511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.051905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.052072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.052351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.052679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.053003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.053337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.053666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.053986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.054303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.054617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.054941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.055260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.055572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.055888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.056198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.056523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.056856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.057167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.057544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.057982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.058157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.058477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.058793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.059102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.059417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.059734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.060045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.060372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.060689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.060999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.061352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.061657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.061972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.062291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.062609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.062925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.063244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.063558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.063886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.064204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.064519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.064875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.065199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.065534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.065865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.066196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.066520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.066827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.067144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.067456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.067767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.068089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.068484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.068702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.069013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.069331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.069655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.069965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.070294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.070610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.071434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.071748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.072061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.072411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.072724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.073071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.073449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.073779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.074109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.074427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.074588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 04:59:53.075079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.075313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 04:59:53.075466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.075466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.075776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 04:59:53.075932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.076089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 04:59:53.076235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.076394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 04:59:53.076546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.076701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.076846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.077003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.077155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.077300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.077500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.077661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.077808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.077964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.078281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.078447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.078709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.078870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.079025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.079349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.079505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.079659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.079883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.080049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.080049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.080341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.080518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-4 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.080689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.080857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.081014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.081161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.081338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.081503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.081657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.081820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.081964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.082208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.082374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.082529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.082695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.082849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.083001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.083147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.083329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.083544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.083713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.083870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.084025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.084170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.084315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.084469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.084622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.084778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.084932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.085086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.085239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.085867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.086024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.086186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.086343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.086524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.087178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.087325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.087492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.087638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-4 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.087791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.087936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.088088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.088405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.088405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.088728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.088965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.089123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.089277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.089463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.089612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.089768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.089913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.090057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.090209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.090365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.090511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.090663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.090810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.090966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.091118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.091278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.091432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.091600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.091757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.091903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.092060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.092231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.092456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.092615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.092774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.092774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.097556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.097789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.097982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.098142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.098335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.098656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.098656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.098656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.098656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.098656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.099486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.099650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.099811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.099961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.100116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.100327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.100505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.100793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.100793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.101088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.101250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.101250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.101575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.101722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.101722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.102023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.102178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.102178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.102479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.102730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.102730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.103023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.103168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.103168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.103465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.103611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.103763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.103908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.103908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.104204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.104360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.104525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.104680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.104680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.104967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.105121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.105281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.105502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.105502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.105806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.105964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.106119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.106266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.106266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.106566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.106712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.107016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.107185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.107341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.107495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.107648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.107794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.107794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.108078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.108233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.108380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.108690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.108866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.109026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.109201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.109473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.109627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.109780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.109926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.110085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.110239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.110393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.110553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.110700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.110851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.111022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.111175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.111335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.111481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.111634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.111787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.111942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.112088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.112232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.112232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.112512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.112667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.112929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.113090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.113090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.113410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.113560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.113716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.113869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.114022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.114169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.114328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.114474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.114621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.114775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.114775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.114775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.115219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.115364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.115523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.115683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.115837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.115983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.116135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.116288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.116448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.116607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.116755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.116933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.116933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.117432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.117596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.117785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.117933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.118077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.118221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.118366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.118521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.118694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.118997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.119144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.119300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.119464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.119720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.119874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.120030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.120184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.120330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.120474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.120632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.120778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.120924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.121076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.121240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.121429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.121578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.121750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.122028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.122209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.122366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.122527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.122681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.122834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.123077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.123077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.123368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.123538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.123684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.123829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 04:59:53.123974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.124131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.124277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.124431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.124577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.124721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.124865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.125029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.125185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.125375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.125552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.125707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.125853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.126979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.127345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.127502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.127670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.127817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.127962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.128121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.128121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.128407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.128552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.128704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.128876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.129194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.129363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.129515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.129661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.129922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.130999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.131153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.131299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.131444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.131596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.131750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.131921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.132974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.133930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.134085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.134250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.134427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.134590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.134751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.134903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.135063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.135216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.135387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.135684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.135854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.136970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.137121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.137304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.137630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.137801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.137964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.138125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.138278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.138444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.138605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.138767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.138933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.139262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.139434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.139598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.139759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.139938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.140194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.140353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.140513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.140513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.140513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.140965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.141126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.141290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.141521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.141676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.141826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.141979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.142138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.142290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.142455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.142616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.142776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.142940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.143336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.143505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.143680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.143841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.144049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.144212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.144365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.144525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.144693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.144855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.145016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.145177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.145370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.145544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.145709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.145869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.146022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.146175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.146326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.146491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.146645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.146824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.147081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.147263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.147427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.147750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.147920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.148091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.148255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.148408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.148560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.148725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.148927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.149792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.149792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.150101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.150384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.150554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.150708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.150867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.151990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.152141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.152307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.152460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.152611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.152770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.152931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.153105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.153271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.153271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.153707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.153707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.154006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.154173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.154348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.154554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.154717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.154870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.155998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.156163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.156325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.156325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.156624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.156776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.156939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.157091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.157253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.157253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.157253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.157253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.158087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.158087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.158395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.158556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.158710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.158861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.159026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.159192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.159354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.159518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.159695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.160759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.161215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.161386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.161545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.161698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.161872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.162109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.162272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.162434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.162587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.162746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.162900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.163061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.163214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.163366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.163536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.163774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.163944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.164374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.164555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.164724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.164886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.165040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.165216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.165386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.165554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.165716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.165876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.166975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.167137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.167298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.167451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.167612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.167773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.168080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.168252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.168415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.168581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.168733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.168885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.169037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.169037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.169409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.169578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.169733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.169893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.170274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.170437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.170608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.170856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.171807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.172111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.172274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.172427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.172579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.172729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.172881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.173042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.173209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.173391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.173558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.173558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.173938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.174113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.174268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.174430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.174583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.174741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.174893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.175084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.175247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.175406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.175568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.175722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.175881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.176946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.177108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.177274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.177480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.177637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.177796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.177949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.178253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.178430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.178595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.178595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.178896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.179985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.180305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.180478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.180632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.180785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.181883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.182170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.182337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.182490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.182641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.182794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.182945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.183107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.183268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.183429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.183582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.183733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.183893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.184140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.184309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.184309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.184309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.184309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.184903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.185080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.185080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.185465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.185633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.185786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.185939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.186105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.186258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.186410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.186562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.186721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.186873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.187039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.187201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.187372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.187525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.187685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.187847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.188010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.188010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.188463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.188624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.188786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.188950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.189113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.189274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.189498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.189653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.189816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.189979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.190140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.190445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.190687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.190687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.191085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.191337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.191504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.191504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.191797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.191969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.192132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.192293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.192454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.192607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.192758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.192909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.193079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.193234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.193422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.193595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.193759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.193919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.194090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.194337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.194496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.194658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.194823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.194977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.195137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.195297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.195459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.195621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.196290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.196452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.196606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.196897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.197142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.197325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.197490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.197702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.197942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.198113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.198282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.198579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.198747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.198902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.199053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.199206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.199379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.199533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.199686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.199837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.200005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.200005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.200314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.200606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.200768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.200929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.201082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.201247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.201573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.201739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.201901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.202989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.203140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.203301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.203301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.203619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.203774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.203925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.204077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.204239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.204483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.204651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.204806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.204966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.205205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.205383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.205383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.205705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.205872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.206943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.207110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.207272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.207425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.207576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.207746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.207914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.208077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.208231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.208392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.208683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.208851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.209021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.209175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.209367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.209528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.209681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.209845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.210014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.210174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.210326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.210485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.210798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.210965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.211127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.211291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.212035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.212442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.212619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.212795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.212949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.213110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.213110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.213454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.213618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.213779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.213932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.214985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.215322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.215495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.215658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.215811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.215963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.216114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.216273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.216441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.216602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.216763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.216924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.217088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.217253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.217536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.217707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.217863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.217863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.218153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.218319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.218475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.218769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.218932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.219085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.219258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.219426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.219581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.219742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.219902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.220057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.220224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.220379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.220379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.220832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.220994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.221146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.221329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.221513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.221678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.221831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.222011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.222299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.222497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.223200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.223364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.223527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.223682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.223846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.224019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.224173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.224341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.224495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.224667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.224899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.225912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.226215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.226376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.226540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.226692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.226854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.227642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.227810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.227965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.228117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.228269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.228503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.228663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.228965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.229126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.229958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.230122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.230277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.230429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.230581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.231978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.232133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.232296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.232449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.232609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.232762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.232924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.233084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.233390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.233601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.233758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.233928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.234091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.234245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.234416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.234578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.234742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.234929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.235173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.235341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.235496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.235654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.235811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.235980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.236135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.236289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.236450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.236616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.236777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.236777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.237086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.237248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.237439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.237595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.237757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.237911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.238064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.238224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.238378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.238537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.238715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.239020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.239199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.239364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.239521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.239682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.239850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.240005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.240158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.240310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.240464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.240464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.240764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.241944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.242914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.243959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.244941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.245874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.246937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.247953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.248960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.249802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.250952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.251941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.252939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.253983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.254996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.255966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.256959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.257908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.258003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.258099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.258186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.258792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.258894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.258983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.259932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.260928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.261872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.262930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.263121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.263219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.263440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.263536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.263759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.263936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.264078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.264271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.264398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.264593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.264717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.264952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.265099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.265276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.265492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.265643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.265744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.265927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.266031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.266246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.266349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.266564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.266830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.266925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.267188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.267298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.267497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.267655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.267820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.268144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.268480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.268610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.268815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.268939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.269137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.269265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.269494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.269688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.269821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.270967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.271164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.271298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.271488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.271611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.271807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.271941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.272123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.272261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.272379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 04:59:53.272570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.272894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.273215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.273560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.274093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.274464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.274767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.275089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.275411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.275737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.276051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.276356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.276755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.276990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.277327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.277654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.277968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.278287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.278617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.278957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.279286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.279613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.279929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.280251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.280790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.281108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.281477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.281810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.282139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.282462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.282783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.283113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.283426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.283736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.284052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.284365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.284675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.284999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.285412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.285638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.285964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.286274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.286814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.287170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.287489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.287819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.288151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.288470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.288780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.289393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.290219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.290530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.290851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.291167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.291477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.291788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.292101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.292413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.292720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.293033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.293399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.293692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.294006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.294315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.294623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.294938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.295245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.295551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.295858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.296162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.296479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.296782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.297093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.297422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.297737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.298094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.298631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.298910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.299245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.299563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.299874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.300200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.300513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.300841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.301158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.301505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.301861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.302182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.302727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.303065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.303393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.303728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.304065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.304456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.304681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.304990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.305500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.306072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.306312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.306651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.306969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.307283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.307602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.307909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.308222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.308533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.308848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.309160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.309572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.309887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.310198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.310517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.310862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.311185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.311504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.311823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.312143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.312454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.312766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.313076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.313411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.313730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.314062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.314380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.314684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.315815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.316321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.316661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.316998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.317323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.317664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.317993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.318302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.318634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.318949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.319290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.319636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.319970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.320299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.320609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.321461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.322010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.322515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.322846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.323166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.323481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.323792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.324108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.324450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.324727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.325045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.325416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.325840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.326200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.326549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.326966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.327331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.327663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.328071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.328474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.328971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.329294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.329626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.329944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.330377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.330738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.331086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.331504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.332474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.332808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.333198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.333569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.333905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.334234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.334757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.335082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.335425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.335744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.336065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.336804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.337001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.337338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.337517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.337708 n-d-862416-4 devstack@n-api.service[120585]: INFO dbcounter [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Registered counter for database nova_api Oct 26 04:59:53.337879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.338174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.338489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.338821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.339144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.339473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.339805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.340118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.340451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.340771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.341090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.341427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.341744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.342061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.342403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.342725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.343039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.343530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.343852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.344212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.344521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.344835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.345169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.345538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.345896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.346214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.346566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.346940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.347239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.347558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.347869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 04:59:53.348119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 04:59:53.357899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_db.sqlalchemy.engines [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.364767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writer thread running {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.411646 n-d-862416-4 devstack@n-api.service[120586]: INFO dbcounter [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Registered counter for database nova_api Oct 26 04:59:53.423296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.context [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=120585) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 04:59:53.427380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:53.427826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:53.429433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:53.431106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:53.431614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:53.433228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.433695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:53.435804 n-d-862416-4 devstack@n-api.service[120585]: INFO dbcounter [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Registered counter for database nova_cell0 Oct 26 04:59:53.440488 n-d-862416-4 devstack@n-api.service[120585]: INFO dbcounter [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Registered counter for database nova_cell1 Oct 26 04:59:53.448224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_db.sqlalchemy.engines [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.448525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writer thread running {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.453794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writer thread running {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.454436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_db.sqlalchemy.engines [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.512721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.context [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=120586) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 04:59:53.516802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:53.517286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:53.518953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:53.519693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 04:59:53.520145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 04:59:53.522215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 04:59:53.524988 n-d-862416-4 devstack@n-api.service[120586]: INFO dbcounter [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Registered counter for database nova_cell0 Oct 26 04:59:53.529489 n-d-862416-4 devstack@n-api.service[120586]: INFO dbcounter [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Registered counter for database nova_cell1 Oct 26 04:59:53.536972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.541628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.547214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writer thread running {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.552507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writer thread running {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.603323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writer thread running {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.612742 n-d-862416-4 devstack@n-api.service[120585]: INFO dbcounter [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Registered counter for database nova_cell0 Oct 26 04:59:53.620361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_db.sqlalchemy.engines [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.624871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writer thread running {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.703817 n-d-862416-4 devstack@n-api.service[120586]: INFO dbcounter [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Registered counter for database nova_cell0 Oct 26 04:59:53.710419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 04:59:53.716066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writer thread running {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 04:59:53.949689 n-d-862416-4 devstack@n-api.service[120585]: WARNING keystonemiddleware.auth_token [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:59:53.957089 n-d-862416-4 devstack@n-api.service[120585]: WARNING keystonemiddleware.auth_token [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:59:54.043901 n-d-862416-4 devstack@n-api.service[120586]: WARNING keystonemiddleware.auth_token [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:59:54.051782 n-d-862416-4 devstack@n-api.service[120586]: WARNING keystonemiddleware.auth_token [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:59:54.306179 n-d-862416-4 devstack@n-api.service[120585]: WARNING keystonemiddleware.auth_token [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:59:54.312830 n-d-862416-4 devstack@n-api.service[120585]: WARNING keystonemiddleware.auth_token [None req-f1ca793b-5dcd-4d18-9389-6147aae58965 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:59:54.318217 n-d-862416-4 devstack@n-api.service[120585]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5613571339c0 pid: 120585 (default app) Oct 26 04:59:54.410541 n-d-862416-4 devstack@n-api.service[120586]: WARNING keystonemiddleware.auth_token [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 04:59:54.417419 n-d-862416-4 devstack@n-api.service[120586]: WARNING keystonemiddleware.auth_token [None req-74fe891a-f904-4a1b-a3e2-0bbc752df5cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 04:59:54.422764 n-d-862416-4 devstack@n-api.service[120586]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5613571339c0 pid: 120586 (default app) Oct 26 05:00:34.252282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.253414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.254521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.255514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.673046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.673046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.673046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:34.673046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:35.662531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '.version_select at 0x7f470c23dee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:35.670560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=120585) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 26 05:00:35.671430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.671935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.672435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.704654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.704654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.704654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.711929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.712407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.712846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.719399 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0514621a-4848-4f28-a37a-23202b0fcc6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.472609 Oct 26 05:00:35.719970 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:00:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:35.723062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470c23cf70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:35.732401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=120586) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 26 05:00:35.733487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.733730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.734092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.761252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.761772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.762212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.776324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.777294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.777764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.784874 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7653e85e-dda9-4987-8abb-5807878e4c32 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.129888 Oct 26 05:00:35.785472 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:35.921093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:35.922938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.923445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.923935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.925017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:35.926168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:35.926766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:35.969115 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27c2f3c5-22c6-4fcb-bd88-8a0398f7de1f tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.247849 Oct 26 05:00:35.969727 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 26 05:00:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:00:36.021901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Calling method '.version_select at 0x7f470c264280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.026823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.028414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.028856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.047418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.047991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.048533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.063412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.063958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.064484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.071011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c7bde79-b12d-43e3-a199-e890ff3968c0 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.284478 Oct 26 05:00:36.071584 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1208 bytes} [Wed Oct 26 05:00:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:00:36.134585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Calling method '.version_select at 0x7f470c0acb80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.136440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.136940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.137392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.152807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.153284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.153752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.165686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.166350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.166782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.173871 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54f794d7-d66e-4c1e-8f9f-56a63e0bee32 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.202973 Oct 26 05:00:36.174682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.212143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f88c5d00-22dd-42b4-8e3f-be80166e3b71 tempest-AZAdminNegativeTestJSON-1816431384 tempest-AZAdminNegativeTestJSON-1816431384-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.214045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f88c5d00-22dd-42b4-8e3f-be80166e3b71 tempest-AZAdminNegativeTestJSON-1816431384 tempest-AZAdminNegativeTestJSON-1816431384-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3f2bffc0849849e3a83375241d3b65cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab51c59cea8941a89e4d863ab9ad82f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f88c5d00-22dd-42b4-8e3f-be80166e3b71 tempest-AZAdminNegativeTestJSON-1816431384 tempest-AZAdminNegativeTestJSON-1816431384-project] Request method failure captured: Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7wpyXeWZmUa_5TIMNa7FdFvQ-vo4isQ0aqbud4josaWjOjmR6EhDKkQunjh9lx8poaQPuVCHTFjXjqdH8YqsPFjF-7uqlN-gcboCjySyb2i-8uLTnsAPKNvJg02S_M8KszX-V60mrWGS-G3IfyJXUNQO6C6Gd7uELsebh9xRpUUEE Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ab51c59cea8941a89e4d863ab9ad82f8 Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1816431384 Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:00:36.218214 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab51c59cea8941a89e4d863ab9ad82f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab51c59cea8941a89e4d863ab9ad82f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab51c59cea8941a89e4d863ab9ad82f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab51c59cea8941a89e4d863ab9ad82f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AZAdminNegativeTestJSON-1816431384 Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ab51c59cea8941a89e4d863ab9ad82f8 Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1816431384 Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AZAdminNegativeTestJSON-1816431384-project Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3f2bffc0849849e3a83375241d3b65cc Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AZAdminNegativeTestJSON-1816431384-project Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 26 05:00:36.220012 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:36.220969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:36.246852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f88c5d00-22dd-42b4-8e3f-be80166e3b71 tempest-AZAdminNegativeTestJSON-1816431384 tempest-AZAdminNegativeTestJSON-1816431384-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:36.250285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f88c5d00-22dd-42b4-8e3f-be80166e3b71 tempest-AZAdminNegativeTestJSON-1816431384 tempest-AZAdminNegativeTestJSON-1816431384-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.153233 Oct 26 05:00:36.250285 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:00:36.250285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01c8c6a7-946e-471d-a5c3-7223b42e6253 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1810545804", "name": "tempest-test_aggregate-879716548"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:36.286286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-01c8c6a7-946e-471d-a5c3-7223b42e6253 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid 1620d105-d5c7-40ce-9948-2662f901b182 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:00:36.363897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01c8c6a7-946e-471d-a5c3-7223b42e6253 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.130980 Oct 26 05:00:36.366170 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4/7] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 26 05:00:36 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.372689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470c06aee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.376014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.376703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.377551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.393799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.394284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.394732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.405804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.406296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.406742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.413080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe25188e-898b-4776-af8c-66fbf603917a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.044643 Oct 26 05:00:36.413192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.414176 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:36.418753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.419803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.419882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.420658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.421122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.421610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.430313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.432370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.433767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.434591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.436720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.437660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.438310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.449348 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-004d9c4a-ccf8-4a44-b621-2433738f5b68 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.266897 Oct 26 05:00:36.450233 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.463204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Calling method '.version_select at 0x7f470c0acca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.465146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.465665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.466112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.489541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.489992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.490379 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c480c3ba-1ab8-40a3-bc3b-6d6592126930 tempest-AZAdminV2TestJSON-577779184 tempest-AZAdminV2TestJSON-577779184-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.074630 Oct 26 05:00:36.490504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.491646 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.496503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed5e8918-e266-4e20-a1db-54ad692af24d tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.512144 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed5e8918-e266-4e20-a1db-54ad692af24d tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.019216 Oct 26 05:00:36.514208 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.521354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470c020d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.525735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.526226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.526979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.542477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.542976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.543263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.543417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.544037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.544625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.550124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5bbaa376-ce96-459c-8165-d41120f32350 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-862416-4/servers" status: 200 len: 104 microversion: 2.1 time: 0.098695 Oct 26 05:00:36.550995 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/n-h1-862416-4/servers => generated 104 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.556046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dfd3b8b5-7b1a-42fc-ab6c-ef795e1ae518 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:36.574761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.575335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.576536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.589740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfd3b8b5-7b1a-42fc-ab6c-ef795e1ae518 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.590230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9eb9787e-56b9-493e-ab68-3524f466a9a0 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074616 Oct 26 05:00:36.590360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfd3b8b5-7b1a-42fc-ab6c-ef795e1ae518 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.590679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfd3b8b5-7b1a-42fc-ab6c-ef795e1ae518 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.591170 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.597012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Calling method '.version_select at 0x7f470c020ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.599424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.600134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.600816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.616451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.618308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.618825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.629920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.630486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.630993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.640162 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd9230e4-9fd6-477c-bf04-722f2397c136 tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047408 Oct 26 05:00:36.641013 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 9/14] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.645613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470c0824c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.648028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.648988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.649535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.669397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.670010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.670526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.678911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5038fcf6-9087-449c-96df-742c511e69e6 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.036651 Oct 26 05:00:36.685472 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 10/15] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.690927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Calling method '.version_select at 0x7f470c082670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.693881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.694628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.695630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.716559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.717089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.717630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.723659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce43af35-ad37-4170-8391-7f262c62975e tempest-HypervisorAdminUnderV252Test-1322905440 tempest-HypervisorAdminUnderV252Test-1322905440-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-862416-4/search" status: 200 len: 104 microversion: 2.1 time: 0.036753 Oct 26 05:00:36.731519 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 11/16] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/n-h1-862416-4/search => generated 104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.736678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18e29211-1668-420e-acf4-0c00541796e4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470b7cedc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.738448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e29211-1668-420e-acf4-0c00541796e4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.738947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e29211-1668-420e-acf4-0c00541796e4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.739402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e29211-1668-420e-acf4-0c00541796e4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.756656 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18e29211-1668-420e-acf4-0c00541796e4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.024035 Oct 26 05:00:36.757863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 12/17] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.775584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470c018670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.777988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.778844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.779290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.796208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.796691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.797454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.808587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.809167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.809790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.819390 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-218f0769-3d7f-48ea-b4a3-5331a913e751 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048789 Oct 26 05:00:36.825658 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 13/18] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.832354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470b7d0430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.835302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.836819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.837423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.855348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.855848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.856287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.862795 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e03d3d01-a5c1-4960-923d-498ec51fc75a tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.035446 Oct 26 05:00:36.863381 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 14/19] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.881724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470c018820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.885340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.886002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.886460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.900163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.901551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.901995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.908323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1cd3798-df4e-425f-b65e-20dcbc7544d4 tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.031871 Oct 26 05:00:36.909048 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 15/20] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:36.924390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Calling method '.version_select at 0x7f470b7ceca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:36.926272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.926974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.928048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.941565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.942060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.942501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.955043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.955550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.961336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.969498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:00:36.969498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458177de-73f0-4ab5-8fed-84d96a62838c tempest-HypervisorAdminTestJSON-1679956904 tempest-HypervisorAdminTestJSON-1679956904-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:00:36.969498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.969676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.970151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.970886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:36.971347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:36.971778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:36.988336 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.rpcapi [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 26 05:00:36.989633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] Releasing lock "compute-rpcapi-router" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:00:37.043911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e812e2fe-8222-4997-8f99-014afff44a39 None None] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.122894 Oct 26 05:00:37.045621 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 16/21] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 26 05:00:36 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:37.434640 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dfd3b8b5-7b1a-42fc-ab6c-ef795e1ae518 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.882199 Oct 26 05:00:37.435594 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 6/22] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:00:36 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:38.102403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1798785552", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "availability_zone": "tempest-test_az-1810545804"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:38.149837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:38.150405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:38.150864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:38.151625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:38.152191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:38.154648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:39.519861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:00:39.783166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:00:39.783636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:00:39.784278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:00:39.784906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:00:39.785351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:00:39.799929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:39.800430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:39.800876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:39.801848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:39.802523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:39.803065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:39.842550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Getting quotas for project 3daef57793884543a153bbae8b6383b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:00:39.849007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Getting quotas for user 8bf71dafe3d845bc9a68d90d9d729e81 and project 3daef57793884543a153bbae8b6383b9. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:00:39.861747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:00:39.864795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:00:39.923514 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c1ee079-d9f1-41dd-ac16-6e00620a4ead tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189502 Oct 26 05:00:39.931661 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 17/23] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:00:39.938409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8cf9c5ce-597c-4545-af94-dbff59bde774 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:39.939391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8cf9c5ce-597c-4545-af94-dbff59bde774 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:40.383272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c7b8392-7eff-43a5-a9f2-742d9ad93cba tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1832601172", "id": 928745116, "os-flavor-access:is_public": "False"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:40.420077 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c7b8392-7eff-43a5-a9f2-742d9ad93cba tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.281574 Oct 26 05:00:40.420981 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 18/24] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:40 2022] POST /compute/v2.1/flavors => generated 436 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:40.456089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2abc0c62-64a1-4c45-8a36-5db5b7f059c9 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:40.694845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8cf9c5ce-597c-4545-af94-dbff59bde774 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:40.712557 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8cf9c5ce-597c-4545-af94-dbff59bde774 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1243 microversion: 2.1 time: 0.779354 Oct 26 05:00:40.713207 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 7/25] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:39 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1243 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:41.129537 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2abc0c62-64a1-4c45-8a36-5db5b7f059c9 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/928745116/action" status: 200 len: 96 microversion: 2.1 time: 0.677246 Oct 26 05:00:41.135193 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 19/26] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 26 05:00:40 2022] POST /compute/v2.1/flavors/928745116/action => generated 96 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:00:41.144536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b39aed99-80d2-4a49-ba4d-f331b4d5f7ca tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:41.736033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:41.737176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:41.751152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:41.751897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:41.752471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:41.753341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:41.753970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:41.754686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:41.900383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:41.913118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b39aed99-80d2-4a49-ba4d-f331b4d5f7ca tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project bd24a3d21ad042d0a0c8e1b6b403ea87 combination. Oct 26 05:00:41.919194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-38158a35-2a6a-45d0-bb96-a5b188d50f90 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1243 microversion: 2.1 time: 0.187239 Oct 26 05:00:41.920235 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 20/27] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:41 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1243 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b39aed99-80d2-4a49-ba4d-f331b4d5f7ca tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Request method failure captured: Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/flavors/928745116/action HTTP/1.1 Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 67 Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL71lwrPlC2cEMVO--ELvV9NcmbMUB4PYI0-OubQtQdijUJyNW2UPhQ5Ouxg1liCz6yUFjMZ-gC7oIKFKodcP6isgwHk5OFJiGFIhkqmrhsEfDt3z2Gqbft-0cVGpwewNN_KhANHUaD2AYSqeKQWLkJe-24motPshc9hFWMXVRKzdWc Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 63fb016656724e0a9ff1ce9ecafbeefd Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:00:41.936015 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 63fb016656724e0a9ff1ce9ecafbeefd Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0831c3a0018145ec9311a1dbfe55a9cb Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: {"addTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} Oct 26 05:00:41.937435 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: exception: Flavor access already exists for flavor 15 and project bd24a3d21ad042d0a0c8e1b6b403ea87 combination. Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '928745116', 'body': {'addTenantAccess': {'tenant': 'bd24a3d21ad042d0a0c8e1b6b403ea87'}}} Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result.read() Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 05:00:41.938159 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-bd24a3d21ad042d0a0c8e1b6b403ea87' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi session.flush() Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 05:00:41.939236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 05:00:41.940381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 05:00:41.941567 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result.read() Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-bd24a3d21ad042d0a0c8e1b6b403ea87' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 26, 5, 0, 41, 899697), 'updated_at': None, 'flavor_id': 15, 'project_id': 'bd24a3d21ad042d0a0c8e1b6b403ea87'}] Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:41.942614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project bd24a3d21ad042d0a0c8e1b6b403ea87 combination. Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:41.943834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project bd24a3d21ad042d0a0c8e1b6b403ea87 combination. Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:41.946773 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:41.948792 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project bd24a3d21ad042d0a0c8e1b6b403ea87 combination. Oct 26 05:00:41.948792 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:41.950539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b39aed99-80d2-4a49-ba4d-f331b4d5f7ca tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project bd24a3d21ad042d0a0c8e1b6b403ea87 combination. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:41.950539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b39aed99-80d2-4a49-ba4d-f331b4d5f7ca tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/928745116/action" status: 409 len: 152 microversion: 2.1 time: 0.810520 Oct 26 05:00:41.951749 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 8/28] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 26 05:00:41 2022] POST /compute/v2.1/flavors/928745116/action => generated 152 bytes in 813 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:00:41.961089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa8116a6-5d20-4d56-a96e-fb816dac77dc tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:42.626115 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa8116a6-5d20-4d56-a96e-fb816dac77dc tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/928745116/action" status: 200 len: 21 microversion: 2.1 time: 0.669491 Oct 26 05:00:42.631937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 21/29] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 26 05:00:41 2022] POST /compute/v2.1/flavors/928745116/action => generated 21 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:00:42.643114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d5daa48-df66-4760-aed7-0df1e152dcbd tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:42.688784 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d5daa48-df66-4760-aed7-0df1e152dcbd tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/928745116" status: 202 len: 0 microversion: 2.1 time: 0.052499 Oct 26 05:00:42.688784 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 9/30] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:42 2022] DELETE /compute/v2.1/flavors/928745116 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:00:42.696444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-875972fb-c351-48b6-b1f7-41ae8635a108 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:42.730145 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-875972fb-c351-48b6-b1f7-41ae8635a108 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038112 Oct 26 05:00:42.730910 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 22/31] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:42.754100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b5e64a0-effe-40c2-9345-681439d15704 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-882922840", "id": 294196263, "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:42.812530 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b5e64a0-effe-40c2-9345-681439d15704 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.062935 Oct 26 05:00:42.817910 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 10/32] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:42 2022] POST /compute/v2.1/flavors => generated 434 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:42.826426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de7c7fac-3c9d-431e-921b-08a30e763e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:42.843555 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-de7c7fac-3c9d-431e-921b-08a30e763e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de7c7fac-3c9d-431e-921b-08a30e763e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Request method failure captured: Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/flavors/294196263/os-flavor-access HTTP/1.1 Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL71lwrPlC2cEMVO--ELvV9NcmbMUB4PYI0-OubQtQdijUJyNW2UPhQ5Ouxg1liCz6yUFjMZ-gC7oIKFKodcP6isgwHk5OFJiGFIhkqmrhsEfDt3z2Gqbft-0cVGpwewNN_KhANHUaD2AYSqeKQWLkJe-24motPshc9hFWMXVRKzdWc Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 63fb016656724e0a9ff1ce9ecafbeefd Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:00:42.846234 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 63fb016656724e0a9ff1ce9ecafbeefd Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 0831c3a0018145ec9311a1dbfe55a9cb Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: exception: Access list not available for public flavors. Oct 26 05:00:42.847300 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'flavor_id': '294196263'} Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 26 05:00:42.847920 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:42.849012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de7c7fac-3c9d-431e-921b-08a30e763e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:42.849012 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de7c7fac-3c9d-431e-921b-08a30e763e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/294196263/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.025751 Oct 26 05:00:42.849012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 23/33] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 26 05:00:42 2022] GET /compute/v2.1/flavors/294196263/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 05:00:42.858896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a24085a1-69a4-4e9f-9e5e-f25daa336d77 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:42.882188 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a24085a1-69a4-4e9f-9e5e-f25daa336d77 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/294196263" status: 202 len: 0 microversion: 2.1 time: 0.028639 Oct 26 05:00:42.883550 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 11/34] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:42 2022] DELETE /compute/v2.1/flavors/294196263 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:42.895553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98c302bf-5f08-497d-b3fb-aa6dd1987a47 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:42.919364 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98c302bf-5f08-497d-b3fb-aa6dd1987a47 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029346 Oct 26 05:00:42.920141 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 24/35] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:42.943352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7a0b3c5-d758-47f8-af99-af42867401ed tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1516522404", "id": 1194914880, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:42.948623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:42.949829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:42.956210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:42.956883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:42.957507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:42.958353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:42.958953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:42.959691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:42.978592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7a0b3c5-d758-47f8-af99-af42867401ed tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.040740 Oct 26 05:00:42.981348 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 12/36] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:42 2022] POST /compute/v2.1/flavors => generated 439 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:43.045797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:43.056555 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ae915a4f-28b2-487f-80cc-c8c0466a7e75 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1297 microversion: 2.1 time: 0.113288 Oct 26 05:00:43.057141 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 25/37] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:42 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1297 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:43.459951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00423606-4fdd-4c9c-bcf4-91800691c275 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:43.463412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-00423606-4fdd-4c9c-bcf4-91800691c275 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b2277d16d3354f8993aeb279063cc1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd24a3d21ad042d0a0c8e1b6b403ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00423606-4fdd-4c9c-bcf4-91800691c275 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Request method failure captured: Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/flavors/1194914880/action HTTP/1.1 Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 67 Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL70vJey5CgOENd9q8KaCY9_lkdC5gIeJSXhdWOUHBEq7qu7kVu679Vtas_oPqbLq2c4vdZjsr852Pvs_TjQeFPuZq2sZ8ysaaOg0IoyHzvJ9nMyd02tcFiiUjfnSvJrAXLgLw02SfbGbgyYRJHXNVQvSyQEzR5FG-GIXsFFRfBL08o Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bd24a3d21ad042d0a0c8e1b6b403ea87 Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-654199731 Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:00:43.466335 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-654199731 Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bd24a3d21ad042d0a0c8e1b6b403ea87 Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-654199731 Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsAccessNegativeTestJSON-654199731-project Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: b2277d16d3354f8993aeb279063cc1cd Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-654199731-project Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: {"addTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} Oct 26 05:00:43.467660 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1194914880', 'body': {'addTenantAccess': {'tenant': 'bd24a3d21ad042d0a0c8e1b6b403ea87'}}} Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:43.468413 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 26 05:00:43.469575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:43.471413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00423606-4fdd-4c9c-bcf4-91800691c275 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:43.473031 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-00423606-4fdd-4c9c-bcf4-91800691c275 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] 10.222.0.16 "POST /compute/v2.1/flavors/1194914880/action" status: 403 len: 130 microversion: 2.1 time: 0.484924 Oct 26 05:00:43.474069 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 13/38] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 26 05:00:42 2022] POST /compute/v2.1/flavors/1194914880/action => generated 130 bytes in 487 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:00:43.484962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0447dab2-28d1-42bf-be4c-f9c228112a28 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:43.517651 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0447dab2-28d1-42bf-be4c-f9c228112a28 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1194914880" status: 202 len: 0 microversion: 2.1 time: 0.036828 Oct 26 05:00:43.522520 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 14/39] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:43 2022] DELETE /compute/v2.1/flavors/1194914880 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:43.535292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae8e65b3-8529-4160-ad3d-9aa6f9c55e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:43.575506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae8e65b3-8529-4160-ad3d-9aa6f9c55e9f tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051673 Oct 26 05:00:43.576093 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 15/40] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:43.597706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfcc259f-b64e-4629-8908-946abeedb549 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2138251121", "id": 864252680, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:43.622684 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfcc259f-b64e-4629-8908-946abeedb549 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.027990 Oct 26 05:00:43.623801 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 16/41] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:43 2022] POST /compute/v2.1/flavors => generated 436 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:43.637289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c84fa470-36b5-41a9-ab17-ef3908441ee6 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:43.906680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9ed5821-0426-4dd9-a189-f0f973454e0a tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1914070363", "id": 409519123, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:43.918379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:43.938209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9ed5821-0426-4dd9-a189-f0f973454e0a tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.542361 Oct 26 05:00:43.938781 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 26/42] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:00:43 2022] POST /compute/v2.1/flavors => generated 468 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:00:44.279051 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c84fa470-36b5-41a9-ab17-ef3908441ee6 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/864252680/action" status: 200 len: 96 microversion: 2.1 time: 0.646827 Oct 26 05:00:44.289756 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 17/43] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 26 05:00:43 2022] POST /compute/v2.1/flavors/864252680/action => generated 96 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:00:44.296490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0141e2f6-caee-4682-a05e-bcc21973ce80 tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:44.514843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Calling method '.version_select at 0x7f470b593f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:44.516750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.517349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.517894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.557368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.558193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.558781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.574467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.575231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.575803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.582943 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab789d1f-aac9-4e7b-92b8-1cc7370da707 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.643045 Oct 26 05:00:44.583755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 27/44] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:44.611571 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0141e2f6-caee-4682-a05e-bcc21973ce80 tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/409519123/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.322212 Oct 26 05:00:44.613869 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 18/45] 10.222.0.16 () {62 vars in 1262 bytes} [Wed Oct 26 05:00:44 2022] POST /compute/v2.1/flavors/409519123/os-extra_specs => generated 62 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:44.638274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:44.639526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:44.659254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.660670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.661300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.662611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.665535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.665991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.806005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ecf148a-cd65-4402-b15b-489af01805bc tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-24810722", "id": 1125684393, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:44.834569 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ecf148a-cd65-4402-b15b-489af01805bc tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.242826 Oct 26 05:00:44.843350 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 28/46] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:44 2022] POST /compute/v2.1/flavors => generated 428 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:44.848993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c43feb50-1c09-4e83-8749-b290086348e8 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:44.853811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c43feb50-1c09-4e83-8749-b290086348e8 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b2277d16d3354f8993aeb279063cc1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd24a3d21ad042d0a0c8e1b6b403ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c43feb50-1c09-4e83-8749-b290086348e8 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Request method failure captured: Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/flavors/864252680/action HTTP/1.1 Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 70 Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL70vJey5CgOENd9q8KaCY9_lkdC5gIeJSXhdWOUHBEq7qu7kVu679Vtas_oPqbLq2c4vdZjsr852Pvs_TjQeFPuZq2sZ8ysaaOg0IoyHzvJ9nMyd02tcFiiUjfnSvJrAXLgLw02SfbGbgyYRJHXNVQvSyQEzR5FG-GIXsFFRfBL08o Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: bd24a3d21ad042d0a0c8e1b6b403ea87 Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-654199731 Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:00:44.855932 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd24a3d21ad042d0a0c8e1b6b403ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-654199731 Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: bd24a3d21ad042d0a0c8e1b6b403ea87 Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-654199731 Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FlavorsAccessNegativeTestJSON-654199731-project Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b2277d16d3354f8993aeb279063cc1cd Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-654199731-project Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: {"removeTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} Oct 26 05:00:44.857250 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '864252680', 'body': {'removeTenantAccess': {'tenant': 'bd24a3d21ad042d0a0c8e1b6b403ea87'}}} Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can( Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:44.858014 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 26 05:00:44.859228 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:44.860870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c43feb50-1c09-4e83-8749-b290086348e8 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:44.861976 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c43feb50-1c09-4e83-8749-b290086348e8 tempest-FlavorsAccessNegativeTestJSON-654199731 tempest-FlavorsAccessNegativeTestJSON-654199731-project] 10.222.0.16 "POST /compute/v2.1/flavors/864252680/action" status: 403 len: 133 microversion: 2.1 time: 0.017313 Oct 26 05:00:44.866509 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 29/47] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 26 05:00:44 2022] POST /compute/v2.1/flavors/864252680/action => generated 133 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:00:44.953010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Calling method '.version_select at 0x7f470b629e50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:44.955193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.955695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.956142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.974361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.975146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.976702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:44.990640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:44.992096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:44.993163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.000919 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-624ffa42-06d7-4c1b-bc53-31df72792a0c tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.132858 Oct 26 05:00:45.014164 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 30/48] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:00:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:00:45.159432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c5f60e8-e16b-48d2-9719-6977e94d7f22 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Calling method '.version_select at 0x7f470b5c7c10>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.164945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c5f60e8-e16b-48d2-9719-6977e94d7f22 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5f9a2523674c4fc189528bb05702bfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1d2ee6818b405b8715f10f92ce0709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c5f60e8-e16b-48d2-9719-6977e94d7f22 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Request method failure captured: Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors/n-h1-862416-4/search HTTP/1.1 Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7570WhD05EU-01b8ccQam1vcCumbxKiR2_5E2LXTHEkKT6oMP-4F2auyFCyhWgT1M4nCr8DaE4qSOSw_Gp--_xf32SiVniLdZSbM7b22R8H28CWkpSNRuwXiydlgwRFjkB8c2HsmUPj-DcULgwDUwabtUCINu3RgCD9T9SX3-aU5Q Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 5a1d2ee6818b405b8715f10f92ce0709 Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-356933402 Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:00:45.167996 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-356933402 Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 5a1d2ee6818b405b8715f10f92ce0709 Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-356933402 Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-356933402-project Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5f9a2523674c4fc189528bb05702bfa4 Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-356933402-project Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 26 05:00:45.169371 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'n-h1-862416-4'} Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:45.170426 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 26 05:00:45.171841 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.176999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c5f60e8-e16b-48d2-9719-6977e94d7f22 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:45.178667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c5f60e8-e16b-48d2-9719-6977e94d7f22 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-862416-4/search" status: 403 len: 117 microversion: 2.1 time: 0.162894 Oct 26 05:00:45.180853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 31/49] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/os-hypervisors/n-h1-862416-4/search => generated 117 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:00:45.183174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:45.189024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7583aba8-b1f3-4729-9198-77a593b73e1c tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.204327 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4996c07e-2998-486b-856d-aa8b4bbeda94 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.588101 Oct 26 05:00:45.205597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 19/50] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:44 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:45.218614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82613cbc-c78d-4dde-9084-cd24f85baea7 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.236036 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7583aba8-b1f3-4729-9198-77a593b73e1c tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/409519123" status: 202 len: 0 microversion: 2.86 time: 0.053025 Oct 26 05:00:45.237870 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 32/51] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 26 05:00:45 2022] DELETE /compute/v2.1/flavors/409519123 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:00:45.241891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:DELETE=11,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:45.252982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-721ac296-c845-49f1-90f2-91f6dd4dcfef tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bd24a3d21ad042d0a0c8e1b6b403ea87"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:45.271642 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82613cbc-c78d-4dde-9084-cd24f85baea7 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1125684393" status: 202 len: 0 microversion: 2.1 time: 0.058888 Oct 26 05:00:45.273103 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 20/52] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:45 2022] DELETE /compute/v2.1/flavors/1125684393 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:45.280946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Calling method '.version_select at 0x7f470caaa280>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.287069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.287712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.288332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.331644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.334737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.335437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.350183 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1834195d-9c71-4e88-b28a-0b66b16505ca tempest-HypervisorAdminV228Test-590743684 tempest-HypervisorAdminV228Test-590743684-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.076342 Oct 26 05:00:45.354740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 21/53] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:00:45.364112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Calling method '.version_select at 0x7f470b4ce310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.368691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.373544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.374204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.387965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Request method failure captured: Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL77xwALNlBp89GiHpxqq1MWWwbrClxk7Vx_zXPQi_AWCVN3MSa92zkaPFuamjzNN8lhYHNgSI24OtNoqrt7aT-YMvQkOaF2FlB_A4BF-_oV2bQXXBzuyzMID-HNs04R2S_6hfhSnh5PhdTsATN5tO_6G_ktI_MhMnf9o8KePxmfvXk Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 9a7ec21e5813415298da3932b98167de Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1965285361 Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:00:45.390739 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a7ec21e5813415298da3932b98167de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a7ec21e5813415298da3932b98167de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a7ec21e5813415298da3932b98167de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a7ec21e5813415298da3932b98167de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1965285361 Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 9a7ec21e5813415298da3932b98167de Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1965285361 Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2c32dfe6c5fd43afaf4867dd63c836ec Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 05:00:45.392089 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.392861 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.394126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.394126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:45.394126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:45.394126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 26 05:00:45.394126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.398569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:45.400224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-721ac296-c845-49f1-90f2-91f6dd4dcfef tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/864252680/action" status: 200 len: 21 microversion: 2.1 time: 0.157903 Oct 26 05:00:45.401385 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d404a0d6-8c09-488a-a99f-40d9f63bf6ab tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.045472 Oct 26 05:00:45.402653 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 33/54] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 26 05:00:45 2022] POST /compute/v2.1/flavors/864252680/action => generated 21 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:00:45.408729 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 22/55] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:00:45.418032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2f6cce2-71db-4c24-b6c6-b0cb28ee7bac tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.424431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ad8df89-7be9-4c6f-be09-2b9303af95fa tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.452484 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2f6cce2-71db-4c24-b6c6-b0cb28ee7bac tempest-FlavorMetadataValidation-202527619 tempest-FlavorMetadataValidation-202527619-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.048169 Oct 26 05:00:45.461892 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 34/56] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:00:45.488837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Calling method '.version_select at 0x7f470b593ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.496202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.499603 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ad8df89-7be9-4c6f-be09-2b9303af95fa tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089568 Oct 26 05:00:45.500314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.500927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.507826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 23/57] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:45.516599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9745efee-bec8-423b-9880-90e0e5517611 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.552958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.558856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9745efee-bec8-423b-9880-90e0e5517611 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/864252680" status: 202 len: 0 microversion: 2.1 time: 0.048644 Oct 26 05:00:45.559969 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 24/58] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:45 2022] DELETE /compute/v2.1/flavors/864252680 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:45.562030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.565276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.570451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-38024cf0-bc8f-4fb1-ab42-ea186b2497f6 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-61164666", "id": 15323777, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:45.588705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.590593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.591570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.611146 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-38024cf0-bc8f-4fb1-ab42-ea186b2497f6 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.049820 Oct 26 05:00:45.612388 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ce6d27f-8641-4781-9bcd-11fe3b667c63 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.147215 Oct 26 05:00:45.621669 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 35/59] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:45.624928 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 25/60] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:45.635192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c10d8b-dad8-4d22-8a79-ff346d49397d tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.637857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b2dc1b0-1068-4080-ba63-dbd9fcaa76d6 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Calling method '.version_select at 0x7f470b4845e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.645702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b2dc1b0-1068-4080-ba63-dbd9fcaa76d6 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5f9a2523674c4fc189528bb05702bfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1d2ee6818b405b8715f10f92ce0709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b2dc1b0-1068-4080-ba63-dbd9fcaa76d6 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Request method failure captured: Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7570WhD05EU-01b8ccQam1vcCumbxKiR2_5E2LXTHEkKT6oMP-4F2auyFCyhWgT1M4nCr8DaE4qSOSw_Gp--_xf32SiVniLdZSbM7b22R8H28CWkpSNRuwXiydlgwRFjkB8c2HsmUPj-DcULgwDUwabtUCINu3RgCD9T9SX3-aU5Q Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a1d2ee6818b405b8715f10f92ce0709 Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-356933402 Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:00:45.651169 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1d2ee6818b405b8715f10f92ce0709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-356933402 Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a1d2ee6818b405b8715f10f92ce0709 Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-356933402 Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-356933402-project Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5f9a2523674c4fc189528bb05702bfa4 Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-356933402-project Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 26 05:00:45.652326 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1'} Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:45.652941 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 26 05:00:45.653900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.657996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b2dc1b0-1068-4080-ba63-dbd9fcaa76d6 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:45.659764 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b2dc1b0-1068-4080-ba63-dbd9fcaa76d6 tempest-HypervisorAdminNegativeUnderV252Test-356933402 tempest-HypervisorAdminNegativeUnderV252Test-356933402-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.033523 Oct 26 05:00:45.662082 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 26/61] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:00:45.688287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-198bc157-2d19-4496-9d1d-a26a1c5d6896 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.723045 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80c10d8b-dad8-4d22-8a79-ff346d49397d tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.088204 Oct 26 05:00:45.725511 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 36/62] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:45.740585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Calling method '.version_select at 0x7f470b581940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.748659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:45.751732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:45.754342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:45.763844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-198bc157-2d19-4496-9d1d-a26a1c5d6896 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.094415 Oct 26 05:00:45.764866 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 27/63] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:45.776977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:45.782746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dabc2d67-ae2c-4d4f-9a10-486687afde12 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2022022626", "id": 1425094270, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:45.783422 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] HTTP exception thrown: No hypervisor matching '18e0a835-d4fd-40f7-836f-02a385759d47' could be found. Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Request method failure captured: Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors/18e0a835-d4fd-40f7-836f-02a385759d47/servers HTTP/1.1 Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL77xwALNlBp89GiHpxqq1MWWwbrClxk7Vx_zXPQi_AWCVN3MSa92zkaPFuamjzNN8lhYHNgSI24OtNoqrt7aT-YMvQkOaF2FlB_A4BF-_oV2bQXXBzuyzMID-HNs04R2S_6hfhSnh5PhdTsATN5tO_6G_ktI_MhMnf9o8KePxmfvXk Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 9a7ec21e5813415298da3932b98167de Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1965285361 Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:00:45.790906 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a7ec21e5813415298da3932b98167de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a7ec21e5813415298da3932b98167de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a7ec21e5813415298da3932b98167de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a7ec21e5813415298da3932b98167de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1965285361 Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 9a7ec21e5813415298da3932b98167de Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1965285361 Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2c32dfe6c5fd43afaf4867dd63c836ec Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: exception: No hypervisor matching '18e0a835-d4fd-40f7-836f-02a385759d47' could be found. Oct 26 05:00:45.792128 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '18e0a835-d4fd-40f7-836f-02a385759d47'} Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '18e0a835-d4fd-40f7-836f-02a385759d47' could be found. Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.792748 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:45.793720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:45.793720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:45.793720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:45.793720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:45.793720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '18e0a835-d4fd-40f7-836f-02a385759d47' could be found. Oct 26 05:00:45.793720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:45.797509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] Returning 404 to user: No hypervisor matching '18e0a835-d4fd-40f7-836f-02a385759d47' could be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:45.804612 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-611026bc-e7e5-4330-80da-4fcf6e9404e4 tempest-HypervisorAdminNegativeUnderV252Test-1965285361 tempest-HypervisorAdminNegativeUnderV252Test-1965285361-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/18e0a835-d4fd-40f7-836f-02a385759d47/servers" status: 404 len: 123 microversion: 2.1 time: 0.077334 Oct 26 05:00:45.807012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 37/64] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/os-hypervisors/18e0a835-d4fd-40f7-836f-02a385759d47/servers => generated 123 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:00:45.824756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92ea781d-51d0-42c7-b426-56b738f81e8a tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.845429 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dabc2d67-ae2c-4d4f-9a10-486687afde12 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.079064 Oct 26 05:00:45.855067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 28/65] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:45 2022] POST /compute/v2.1/flavors => generated 439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:45.868816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b8e833e-4bae-44e3-a2e5-4a9692f314df tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "32b7688867744f0a900d2766145c8c72"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:45.879849 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92ea781d-51d0-42c7-b426-56b738f81e8a tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/15323777" status: 202 len: 0 microversion: 2.1 time: 0.070439 Oct 26 05:00:45.887586 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 38/66] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:00:45 2022] DELETE /compute/v2.1/flavors/15323777 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:45.904987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-afb64049-90d7-4d3d-aa7b-23979340165f tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:45.959454 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-afb64049-90d7-4d3d-aa7b-23979340165f tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069270 Oct 26 05:00:45.976900 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 39/67] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:45.986130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73b99b11-4bf6-4aac-b36b-8d175869924c tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1674638898", "id": 1041295148, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:46.014705 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73b99b11-4bf6-4aac-b36b-8d175869924c tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.034310 Oct 26 05:00:46.025442 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 40/68] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:45 2022] POST /compute/v2.1/flavors => generated 429 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:46.031989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7774242b-6159-4c29-804c-4cc9a5fa1fb3 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:46.059819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7774242b-6159-4c29-804c-4cc9a5fa1fb3 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1041295148" status: 202 len: 0 microversion: 2.1 time: 0.032839 Oct 26 05:00:46.060844 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 41/69] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:46 2022] DELETE /compute/v2.1/flavors/1041295148 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:46.079550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e64472e-80b0-4631-af4f-14946f1e3e45 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:46.115945 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e64472e-80b0-4631-af4f-14946f1e3e45 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047215 Oct 26 05:00:46.138529 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 42/70] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:46.147466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-14db2b72-7f0a-4198-a6f0-9f0c5a5a06b1 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-97217914", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:46.176785 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-14db2b72-7f0a-4198-a6f0-9f0c5a5a06b1 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.035503 Oct 26 05:00:46.186569 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 43/71] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:46 2022] POST /compute/v2.1/flavors => generated 505 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:46.193410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6edb694b-631f-4c56-bf0b-949fd9b229c3 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:46.224684 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6edb694b-631f-4c56-bf0b-949fd9b229c3 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1dfea874-b8e6-453c-a72d-9912102b7bbc" status: 202 len: 0 microversion: 2.1 time: 0.034550 Oct 26 05:00:46.226636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 44/72] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:00:46 2022] DELETE /compute/v2.1/flavors/1dfea874-b8e6-453c-a72d-9912102b7bbc => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:46.252943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f730911-d80d-4282-bc6a-f39e4f1db2ea tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:46.290931 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f730911-d80d-4282-bc6a-f39e4f1db2ea tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059057 Oct 26 05:00:46.291725 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 45/73] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:46.318472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:46.319133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:46.325485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:46.326049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:46.326496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:46.327207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:46.327976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:46.328412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:46.428477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:46.756041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7b8e833e-4bae-44e3-a2e5-4a9692f314df tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] HTTP exception thrown: Flavor access not found for 22 / 32b7688867744f0a900d2766145c8c72 combination. Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b8e833e-4bae-44e3-a2e5-4a9692f314df tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Request method failure captured: Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/flavors/1425094270/action HTTP/1.1 Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 70 Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL71lwrPlC2cEMVO--ELvV9NcmbMUB4PYI0-OubQtQdijUJyNW2UPhQ5Ouxg1liCz6yUFjMZ-gC7oIKFKodcP6isgwHk5OFJiGFIhkqmrhsEfDt3z2Gqbft-0cVGpwewNN_KhANHUaD2AYSqeKQWLkJe-24motPshc9hFWMXVRKzdWc Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 63fb016656724e0a9ff1ce9ecafbeefd Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:00:46.767636 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63fb016656724e0a9ff1ce9ecafbeefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 63fb016656724e0a9ff1ce9ecafbeefd Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890 Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0831c3a0018145ec9311a1dbfe55a9cb Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: {"removeTenantAccess": {"tenant": "32b7688867744f0a900d2766145c8c72"}} Oct 26 05:00:46.768803 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: exception: Flavor access not found for 22 / 32b7688867744f0a900d2766145c8c72 combination. Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1425094270', 'body': {'removeTenantAccess': {'tenant': '32b7688867744f0a900d2766145c8c72'}}} Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 26 05:00:46.769476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 32b7688867744f0a900d2766145c8c72 combination. Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 32b7688867744f0a900d2766145c8c72 combination. Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:46.770545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:46.774884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:46.774884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:46.774884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:46.774884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:46.774884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 32b7688867744f0a900d2766145c8c72 combination. Oct 26 05:00:46.774884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:46.780016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b8e833e-4bae-44e3-a2e5-4a9692f314df tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Returning 404 to user: Flavor access not found for 22 / 32b7688867744f0a900d2766145c8c72 combination. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:46.782142 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b8e833e-4bae-44e3-a2e5-4a9692f314df tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1425094270/action" status: 404 len: 124 microversion: 2.1 time: 0.918065 Oct 26 05:00:46.785877 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 29/74] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 26 05:00:45 2022] POST /compute/v2.1/flavors/1425094270/action => generated 124 bytes in 923 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:00:46.814035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8ed4685-51b1-4385-b561-d99d287434bc tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1993695367", "id": "7fc7f354-cace-45c1-a8a4-8af6af8f37b4", "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:46.888111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8ed4685-51b1-4385-b561-d99d287434bc tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.095218 Oct 26 05:00:46.892814 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 30/75] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:46.909872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ee9795a-5295-42ab-b605-bfc25b1b7637 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.015045 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ee9795a-5295-42ab-b605-bfc25b1b7637 tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1425094270" status: 202 len: 0 microversion: 2.1 time: 0.119292 Oct 26 05:00:47.020472 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 31/76] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:46 2022] DELETE /compute/v2.1/flavors/1425094270 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:47.028442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c60ca7bb-75d1-4c1c-a54b-f5d893d90b75 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.094811 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c60ca7bb-75d1-4c1c-a54b-f5d893d90b75 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/7fc7f354-cace-45c1-a8a4-8af6af8f37b4" status: 202 len: 0 microversion: 2.1 time: 0.072925 Oct 26 05:00:47.099191 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 32/77] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:00:47 2022] DELETE /compute/v2.1/flavors/7fc7f354-cace-45c1-a8a4-8af6af8f37b4 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:47.201051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13e941a-85ce-4cc9-b189-eb351014dee5", "tag": "acdd3e18-5704-4776-b22f-1c0d306671c5"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:47.207331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:47.226317 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bdb1ee81-5a40-4020-bc11-2d118710b134 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.915127 Oct 26 05:00:47.229454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 46/78] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:46 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:47.235554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d96df70d-f35d-476a-b1c9-971d29a8e0ee tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.252715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:47.253205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:47.253680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:47.274903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d96df70d-f35d-476a-b1c9-971d29a8e0ee tempest-FlavorsAccessNegativeTestJSON-1676166890 tempest-FlavorsAccessNegativeTestJSON-1676166890-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043897 Oct 26 05:00:47.276189 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 47/79] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:47.285026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d8eafd1-84a4-443c-b4b0-84be6e04c59d tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.316087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Creating event network-changed:acdd3e18-5704-4776-b22f-1c0d306671c5 for instance c13e941a-85ce-4cc9-b189-eb351014dee5 on n-h1-862416-4 Oct 26 05:00:47.316636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:00:47.317037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3141156d-e011-417a-89ea-2d74e53bd783 req-0d9dddf0-cf4c-499e-84b1-9aeabfd21e66 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:00:47.318137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:47.318420 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d8eafd1-84a4-443c-b4b0-84be6e04c59d tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038200 Oct 26 05:00:47.320277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:47.327987 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 48/80] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:47.328946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:47.330026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:47.330742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:47.331381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:47.349156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-238756a9-8d79-4858-9ab8-ccce09d940e6 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-713347093", "id": 449651131, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:47.351729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.compute.rpcapi [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 26 05:00:47.354927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9056b958-8dda-4557-9cee-120737619a57 None None] Releasing lock "compute-rpcapi-router" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:00:47.391828 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-238756a9-8d79-4858-9ab8-ccce09d940e6 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.048483 Oct 26 05:00:47.393762 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9056b958-8dda-4557-9cee-120737619a57 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292904 Oct 26 05:00:47.395851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 33/81] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:47.401108 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 49/82] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:47 2022] POST /compute/v2.1/flavors => generated 410 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:47.409229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3719748e-c7c5-45a5-b704-499747b51325 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.425390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3719748e-c7c5-45a5-b704-499747b51325 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/449651131" status: 200 len: 410 microversion: 2.1 time: 0.020164 Oct 26 05:00:47.442141 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 34/83] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:00:47 2022] GET /compute/v2.1/flavors/449651131 => generated 410 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:47.850467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d38d2996-50fd-4562-96b8-1dac0fd0ec72 tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.940995 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d38d2996-50fd-4562-96b8-1dac0fd0ec72 tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.497621 Oct 26 05:00:47.943283 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 50/84] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:47 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:47.961502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02b5f017-41f7-4baf-8be8-e23679634d56 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:47.996971 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02b5f017-41f7-4baf-8be8-e23679634d56 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/449651131" status: 202 len: 0 microversion: 2.1 time: 0.036865 Oct 26 05:00:48.004477 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 35/85] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:47 2022] DELETE /compute/v2.1/flavors/449651131 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:48.008154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-117d91f1-0f70-446c-975e-e18ef7fb2c68 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.066303 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-117d91f1-0f70-446c-975e-e18ef7fb2c68 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062099 Oct 26 05:00:48.080877 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 51/86] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:48.111904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-093e1a1c-b3c6-497b-801a-a6b202a1953d tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-8674096", "id": 1470004510, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:48.162130 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-093e1a1c-b3c6-497b-801a-a6b202a1953d tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.055309 Oct 26 05:00:48.162818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 36/87] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:48 2022] POST /compute/v2.1/flavors => generated 427 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:48.176985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac5aaa87-ee05-482b-8a29-c8d2da4f3d9d tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "1470004510"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:48.211038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ac5aaa87-ee05-482b-8a29-c8d2da4f3d9d tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] HTTP exception thrown: Flavor 1470004510 could not be found. Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac5aaa87-ee05-482b-8a29-c8d2da4f3d9d tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] Request method failure captured: Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 107 Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL75DhOhX7e5kmr1m2yMi38rX3IJAiIw4zAH6FgrJobJd-ssZMCseEqNcplOnwd9-XAVOqNHq_wk3dI-Xk3dthXYPzWMl93eM483O5yR52JEGtmy5iL55bLnP1uz4wmIvkWDboOD6zH1esCcDpAg1vybx022sES-D15PVkin-552Pdw Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 780af27b468445cfb6db7504c29e73ff Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FlavorsAdminTestJSON-561496823 Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:00:48.218046 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_780af27b468445cfb6db7504c29e73ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/780af27b468445cfb6db7504c29e73ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/780af27b468445cfb6db7504c29e73ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/780af27b468445cfb6db7504c29e73ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FlavorsAdminTestJSON-561496823 Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 780af27b468445cfb6db7504c29e73ff Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-561496823 Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FlavorsAdminTestJSON-561496823-project Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 91d31512aecc40c7988f54664a7c52f8 Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FlavorsAdminTestJSON-561496823-project Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "test", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "1470004510"}} Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:00:48.219442 n-d-862416-4 devstack@n-api.service[120586]: exception: Flavor 1470004510 could not be found. Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '1470004510'}}} Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1470004510 could not be found. Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:48.220281 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1470004510 could not be found. Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:48.222428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1470004510 could not be found. Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac5aaa87-ee05-482b-8a29-c8d2da4f3d9d tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] Returning 400 to user: Flavor 1470004510 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac5aaa87-ee05-482b-8a29-c8d2da4f3d9d tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.047107 Oct 26 05:00:48.229050 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 52/88] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:48 2022] POST /compute/v2.1/servers => generated 81 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:00:48.232640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-edeb8a08-e69f-4702-a8c6-42832a84ff66 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.255622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.256262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:48.279519 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-edeb8a08-e69f-4702-a8c6-42832a84ff66 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1470004510" status: 202 len: 0 microversion: 2.1 time: 0.049676 Oct 26 05:00:48.285804 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 37/89] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:48 2022] DELETE /compute/v2.1/flavors/1470004510 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:48.286095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:48.287840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:48.289183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:48.290017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:48.290550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:48.291010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:48.299012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af7b6e21-7d3e-4a63-bcd9-351730e72a83 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.371433 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af7b6e21-7d3e-4a63-bcd9-351730e72a83 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080086 Oct 26 05:00:48.385337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 38/90] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:48.395713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8a27492-63ad-45f1-abbe-12f97599f407 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1012202075", "id": 1461588966, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:48.417634 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8a27492-63ad-45f1-abbe-12f97599f407 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.025872 Oct 26 05:00:48.427167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 39/91] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:48 2022] POST /compute/v2.1/flavors => generated 415 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:48.451255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69292e72-0bf8-478d-b3e4-fcd795674713 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2113708377", "id": 803614104, "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:48.496360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69292e72-0bf8-478d-b3e4-fcd795674713 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.067018 Oct 26 05:00:48.507653 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 40/92] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:48 2022] POST /compute/v2.1/flavors => generated 411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:48.517910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d3f9fb7-b608-4432-833c-7e2b89d35c58 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.564979 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d3f9fb7-b608-4432-833c-7e2b89d35c58 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.055845 Oct 26 05:00:48.581646 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 41/93] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:48.587577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff984714-3b30-4073-bf48-a8a77a26c0c9 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.616063 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff984714-3b30-4073-bf48-a8a77a26c0c9 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.033001 Oct 26 05:00:48.617442 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 42/94] 10.222.0.16 () {58 vars in 1177 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:48.639057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cec153d1-daca-4f81-931c-0f0533ad857b tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.673241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cec153d1-daca-4f81-931c-0f0533ad857b tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.043531 Oct 26 05:00:48.682715 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 43/95] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:48.696046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a460483a-e3ef-4a26-a98a-8fd914ce6e7b tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.712304 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a460483a-e3ef-4a26-a98a-8fd914ce6e7b tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.028286 Oct 26 05:00:48.728971 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 44/96] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:48.738011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43e3b11c-5688-42c5-b13d-24d469aac806 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.778254 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43e3b11c-5688-42c5-b13d-24d469aac806 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.047760 Oct 26 05:00:48.804161 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 45/97] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:48.810395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34ecb9b9-bc41-4c88-a50d-cd2268cdf274 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.854485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34ecb9b9-bc41-4c88-a50d-cd2268cdf274 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.038824 Oct 26 05:00:48.865650 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 46/98] 10.222.0.16 () {58 vars in 1175 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:48.896770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ce898d9-b708-406b-9f84-b738b0afbbf8 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:48.954648 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ce898d9-b708-406b-9f84-b738b0afbbf8 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.078393 Oct 26 05:00:48.962839 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 47/99] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:48.986269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd24806d-848c-4647-8853-75ca48b16f60 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.063066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd24806d-848c-4647-8853-75ca48b16f60 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.083112 Oct 26 05:00:49.067656 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 48/100] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:49.088054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bfb5b7c8-5d39-4759-abf3-836723f91369 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.110781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=19,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:49.130847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bfb5b7c8-5d39-4759-abf3-836723f91369 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/803614104" status: 202 len: 0 microversion: 2.1 time: 0.047158 Oct 26 05:00:49.131862 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 49/101] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:49 2022] DELETE /compute/v2.1/flavors/803614104 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:00:49.160071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91055a3f-789a-4e88-961b-15a3cfaf51ab tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.179846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:49.189674 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-adbc48a7-102e-4e01-a591-288253516667 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.939936 Oct 26 05:00:49.196090 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91055a3f-789a-4e88-961b-15a3cfaf51ab tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045565 Oct 26 05:00:49.210997 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 53/102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:48 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:49.212690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 50/103] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:49.228116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b5376c3-eadd-46de-95bd-c6bb89a42dfe tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.266612 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b5376c3-eadd-46de-95bd-c6bb89a42dfe tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1461588966" status: 202 len: 0 microversion: 2.1 time: 0.042417 Oct 26 05:00:49.268557 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 54/104] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:49 2022] DELETE /compute/v2.1/flavors/1461588966 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:49.276921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-112faa0e-cff2-48e1-a52d-c0ca127cf0d4 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.321494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-112faa0e-cff2-48e1-a52d-c0ca127cf0d4 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048326 Oct 26 05:00:49.323160 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:49.368137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c6a4f020-98ae-4e1c-b8d2-c11649725e8c tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2134073994", "id": 2007887017, "os-flavor-access:is_public": "False"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:49.417973 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c6a4f020-98ae-4e1c-b8d2-c11649725e8c tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.054637 Oct 26 05:00:49.418599 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 55/106] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:49.431713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05d98c9d-e08e-4b6d-9086-bf29aee3f967 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.467450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05d98c9d-e08e-4b6d-9086-bf29aee3f967 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039293 Oct 26 05:00:49.468336 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 52/107] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:49.489931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a277a3b-78b8-4df1-99f6-4a4e88ab7bf9 tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.496938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:DELETE=16 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:49.518721 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a277a3b-78b8-4df1-99f6-4a4e88ab7bf9 tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032763 Oct 26 05:00:49.519936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:49.559592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1afbc6bd-7fa6-4d26-9c14-c13e9d5ab7e4 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.610921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1afbc6bd-7fa6-4d26-9c14-c13e9d5ab7e4 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2007887017" status: 202 len: 0 microversion: 2.1 time: 0.072063 Oct 26 05:00:49.621071 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:49 2022] DELETE /compute/v2.1/flavors/2007887017 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:49.629259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-777b5e42-583b-4bf5-afda-b954d9e77b40 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.702187 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-777b5e42-583b-4bf5-afda-b954d9e77b40 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080264 Oct 26 05:00:49.706066 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:49.745283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-41e57dc6-b295-4fc3-9ea9-fbfd8cf5fbba tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-886523799", "id": 256922230, "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:49.783600 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-41e57dc6-b295-4fc3-9ea9-fbfd8cf5fbba tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.043998 Oct 26 05:00:49.795447 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 54/111] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:49 2022] POST /compute/v2.1/flavors => generated 410 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:49.805231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-13ddce39-93eb-40a7-bb0e-63dc71553955 tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.886979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:49.891245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:49.915746 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-13ddce39-93eb-40a7-bb0e-63dc71553955 tempest-FlavorsAdminTestJSON-561496823 tempest-FlavorsAdminTestJSON-561496823-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.120326 Oct 26 05:00:49.918012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 58/112] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:49.943290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-771e8230-03b6-4161-b98f-64aa759fdb34 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:49.967067 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-771e8230-03b6-4161-b98f-64aa759fdb34 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/256922230" status: 202 len: 0 microversion: 2.1 time: 0.032851 Oct 26 05:00:49.973426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:49 2022] DELETE /compute/v2.1/flavors/256922230 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:49.977987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9746345c-e3b8-4b29-bde4-0f77cac814e4 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:50.035905 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9746345c-e3b8-4b29-bde4-0f77cac814e4 tempest-FlavorsAdminTestJSON-1441431203 tempest-FlavorsAdminTestJSON-1441431203-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062645 Oct 26 05:00:50.045655 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 59/114] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:50.237182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:50.241960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:50.277021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:50.278349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:50.279305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:50.280754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:50.283098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:50.292038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:50.670779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:50.690563 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66d337fb-3050-4a7b-a1b1-00e448b7fee3 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.465615 Oct 26 05:00:50.691407 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 56/115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:50 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:51.717702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:51.719127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:51.727790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:51.728584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:51.729485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:51.730494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:51.731343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:51.732220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:52.161090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:52.175362 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e35d8bdb-986c-46d3-b0cc-93ab6bf1f8c1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.462751 Oct 26 05:00:52.190667 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 60/116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:51 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:53.201793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:53.203038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:53.206549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:53.211867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:53.212770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:53.213954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:53.214981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:53.215581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:53.216143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:53.411190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:53.420437 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4530d158-c95a-4c29-b808-683d52e51953 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.222488 Oct 26 05:00:53.421516 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 57/117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:53 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:54.095065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af16caaf-8d58-4d4f-ab93-5905810b4233 tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:54.104664 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af16caaf-8d58-4d4f-ab93-5905810b4233 tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.459881 Oct 26 05:00:54.105241 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 61/118] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:00:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:54.203530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2ebf5ad-d54e-4225-8ce8-7a0cc93bfad3 tempest-InstanceUsageAuditLogTestJSON-1685836324 tempest-InstanceUsageAuditLogTestJSON-1685836324-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:54.231261 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2ebf5ad-d54e-4225-8ce8-7a0cc93bfad3 tempest-InstanceUsageAuditLogTestJSON-1685836324 tempest-InstanceUsageAuditLogTestJSON-1685836324-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26 05:00:53" status: 200 len: 318 microversion: 2.1 time: 0.378443 Oct 26 05:00:54.240435 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 58/119] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:00:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26%2005%3A00%3A53 => generated 318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:54.245981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b55a8ef-4fd9-42a5-917f-08cd3dfbf00b tempest-InstanceUsageAuditLogTestJSON-1685836324 tempest-InstanceUsageAuditLogTestJSON-1685836324-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:54.269494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b55a8ef-4fd9-42a5-917f-08cd3dfbf00b tempest-InstanceUsageAuditLogTestJSON-1685836324 tempest-InstanceUsageAuditLogTestJSON-1685836324-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027228 Oct 26 05:00:54.270550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 62/120] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:00:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:54.445539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:54.446810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:54.452452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:54.453034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:54.453612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:54.454593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:54.455163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:54.455672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:54.601143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:54.608901 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3390b425-4ace-4bd2-ace1-54008a732a0a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.168584 Oct 26 05:00:54.609724 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 59/121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:54 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:55.161852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-610e1777-c5f2-45d7-9bbb-099f6405e42d tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-178864758", "imageRef": "dfc7d759-2523-4ea3-b9c9-daac06907ccf", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:55.227245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-610e1777-c5f2-45d7-9bbb-099f6405e42d tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:00:55.529265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e29de038-20bb-4601-bf86-5c4303b6150f tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:55.532389 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e29de038-20bb-4601-bf86-5c4303b6150f tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e29de038-20bb-4601-bf86-5c4303b6150f tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin] Request method failure captured: Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8HnFDPo8wA2GypbHBtIiJARGPjPZ3cCJyd4STK6dduR1ozNFIJFvksTDIcuIUXMZg3VVmpkMbgqVGNvZqonvlhHWvbj46cfRHChtH6sPIY6WyPuOz9CvLV2YFmoVwHWZgkzBU5EhIkmEW_CIgsHpI_vFnVd83yGKGjSxl_599fQUI Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8390deab4e9d4b13b7f0acf25329b4a4 Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:00:55.554095 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8390deab4e9d4b13b7f0acf25329b4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8390deab4e9d4b13b7f0acf25329b4a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8390deab4e9d4b13b7f0acf25329b4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8390deab4e9d4b13b7f0acf25329b4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8390deab4e9d4b13b7f0acf25329b4a4 Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f4b18db414054628869526b8a3611361 Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:00:55.555409 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid timestamp for date invalid_time Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'invalid_time'} Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:55.556139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e29de038-20bb-4601-bf86-5c4303b6150f tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:55.557208 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e29de038-20bb-4601-bf86-5c4303b6150f tempest-InstanceUsageAuditLogNegativeTestJSON-405230894 tempest-InstanceUsageAuditLogNegativeTestJSON-405230894-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.376004 Oct 26 05:00:55.558057 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 60/122] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 26 05:00:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:00:55.640431 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-610e1777-c5f2-45d7-9bbb-099f6405e42d tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-610e1777-c5f2-45d7-9bbb-099f6405e42d tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] Request method failure captured: Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 142 Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8FNZVwanBw8EIHsnKPa71WAmRxh_qQKdy7137xkmbP3JA_NzUfMMPssJQ9kzsgKNrJjhADCiqHzn-rAfOtyLSGjHhBTvHu_DXT2AILiRpDcj-dlXKB0HoPx6WlyGCsSOXAKGKUPYVfVt9-Y8H6IY38mzonDPFlolhChizkBbTy5eU Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 35c4209c859643c2ad896ff8b7e07b9b Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FlavorsV2NegativeTest-1476030347 Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:00:55.644802 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_35c4209c859643c2ad896ff8b7e07b9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35c4209c859643c2ad896ff8b7e07b9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35c4209c859643c2ad896ff8b7e07b9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/35c4209c859643c2ad896ff8b7e07b9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FlavorsV2NegativeTest-1476030347 Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 35c4209c859643c2ad896ff8b7e07b9b Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1476030347 Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FlavorsV2NegativeTest-1476030347-project Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a099f06ed2164c32b1f498c4edf8a57d Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FlavorsV2NegativeTest-1476030347-project Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-178864758", "imageRef": "dfc7d759-2523-4ea3-b9c9-daac06907ccf", "flavorRef": "452"}} Oct 26 05:00:55.646221 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: exception: Flavor's memory is too small for requested image. Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-178864758', 'imageRef': 'dfc7d759-2523-4ea3-b9c9-daac06907ccf', 'flavorRef': '452'}}} Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:55.647034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.648600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-610e1777-c5f2-45d7-9bbb-099f6405e42d tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:55.650701 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-610e1777-c5f2-45d7-9bbb-099f6405e42d tempest-FlavorsV2NegativeTest-1476030347 tempest-FlavorsV2NegativeTest-1476030347-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.488291 Oct 26 05:00:55.651284 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 63/123] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:55 2022] POST /compute/v2.1/servers => generated 93 bytes in 493 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:00:55.656018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:55.656640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:55.663187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:55.664144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:55.664557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:55.666027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:55.666495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:55.666931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:55.813716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:55.826053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb7fb48a-5793-4d36-94bd-09a5da143240 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.173937 Oct 26 05:00:55.826629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 64/124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:55 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:55.893042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16b5c98d-0c86-419c-87b3-63b2e9c50d92 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:55.895055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16b5c98d-0c86-419c-87b3-63b2e9c50d92 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5813e78620aa471f936a2ddc2eac94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade6a4ed63a345e3a6a89532cdbee796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16b5c98d-0c86-419c-87b3-63b2e9c50d92 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Request method failure captured: Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8FumaMoiXOJzJZiNVT9i1aIkFNaicYrQdSHoP2tL2p7QZnwYxKUrY4eIMSoCN0Co05XX7uP_bHCjJTlO497H0BaTcrMAOiCDZqz_9yHSshkBcFhYj6ocZoRyP4aZzEgTf1V496J9k436mLgA2vImnykHHC2W2J5DODJZEmrclNcBI Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ade6a4ed63a345e3a6a89532cdbee796 Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:00:55.898135 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ade6a4ed63a345e3a6a89532cdbee796 Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5813e78620aa471f936a2ddc2eac94bd Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project Oct 26 05:00:55.899562 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: action_args: {} Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:55.900256 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 26 05:00:55.901655 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.903465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16b5c98d-0c86-419c-87b3-63b2e9c50d92 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:55.904296 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16b5c98d-0c86-419c-87b3-63b2e9c50d92 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.341295 Oct 26 05:00:55.904827 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 61/125] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:00:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:00:55.913348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2fc4239-5bb0-42ba-9de0-c61556ee9ef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:55.915688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2fc4239-5bb0-42ba-9de0-c61556ee9ef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5813e78620aa471f936a2ddc2eac94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade6a4ed63a345e3a6a89532cdbee796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2fc4239-5bb0-42ba-9de0-c61556ee9ef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Request method failure captured: Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26%2005:00:55 HTTP/1.1 Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8FumaMoiXOJzJZiNVT9i1aIkFNaicYrQdSHoP2tL2p7QZnwYxKUrY4eIMSoCN0Co05XX7uP_bHCjJTlO497H0BaTcrMAOiCDZqz_9yHSshkBcFhYj6ocZoRyP4aZzEgTf1V496J9k436mLgA2vImnykHHC2W2J5DODJZEmrclNcBI Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ade6a4ed63a345e3a6a89532cdbee796 Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:00:55.917903 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ade6a4ed63a345e3a6a89532cdbee796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ade6a4ed63a345e3a6a89532cdbee796 Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5813e78620aa471f936a2ddc2eac94bd Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project Oct 26 05:00:55.919062 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '2022-10-26 05:00:55'} Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:00:55.919612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 26 05:00:55.920647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:00:55.921628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2fc4239-5bb0-42ba-9de0-c61556ee9ef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:00:55.921628 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2fc4239-5bb0-42ba-9de0-c61556ee9ef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404 tempest-InstanceUsageAuditLogNegativeTestJSON-1334495404-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26 05:00:55" status: 403 len: 128 microversion: 2.1 time: 0.009855 Oct 26 05:00:55.921628 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 65/126] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:00:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-26%2005%3A00%3A55 => generated 128 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:00:56.853172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:56.854744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:56.861506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:56.862287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:56.863056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:56.864050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:56.865161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:56.865822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:57.047470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:57.058093 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d64e62f-0c55-4dba-ab20-a43b1d88c8bf tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.211425 Oct 26 05:00:57.058764 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 62/127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:56 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:57.467290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:00:57.866458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ef0702a-2724-430e-8565-2d26eed1ef0c tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-797499596", "id": 962182453, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:57.887562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b20c679-871c-400a-b03c-de664ced52b1 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-178278070", "id": 1304391338, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:57.908348 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ef0702a-2724-430e-8565-2d26eed1ef0c tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.645420 Oct 26 05:00:57.916658 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 66/128] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:00:57 2022] POST /compute/v2.1/flavors => generated 445 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:00:57.951450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b20c679-871c-400a-b03c-de664ced52b1 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.490829 Oct 26 05:00:57.952789 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 63/129] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:57 2022] POST /compute/v2.1/flavors => generated 430 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:00:57.964442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33c7de9b-625e-4a27-b357-796b4c281de2 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "923fd9fbe0ab4e45bee72391c5eedd72"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:58.209958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4624f795-449a-43e0-b44c-a6378b92e875 tempest-FlavorsV255TestJSON-1268773537 tempest-FlavorsV255TestJSON-1268773537-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.221988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4624f795-449a-43e0-b44c-a6378b92e875 tempest-FlavorsV255TestJSON-1268773537 tempest-FlavorsV255TestJSON-1268773537-project] 10.222.0.16 "GET /compute/v2.1/flavors/962182453" status: 200 len: 445 microversion: 2.55 time: 0.302106 Oct 26 05:00:58.223231 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 67/130] 10.222.0.16 () {60 vars in 1196 bytes} [Wed Oct 26 05:00:57 2022] GET /compute/v2.1/flavors/962182453 => generated 445 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:00:58.238099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.238835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:58.246571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:58.247435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:58.248084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:58.249479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:58.250303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:58.250942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:58.405250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:58.414857 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-53b2112e-cbee-44c7-80d0-62c77bf4ff83 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.189987 Oct 26 05:00:58.415479 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 68/131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:58 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:58.421729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc0c4690-adca-413d-b203-72d4bb3931c2 tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] Action: 'update', calling method: .version_select at 0x7f470c60df70>, body: {"flavor": {"description": "new"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:58.469784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc0c4690-adca-413d-b203-72d4bb3931c2 tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/962182453" status: 200 len: 446 microversion: 2.55 time: 0.053053 Oct 26 05:00:58.471032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 69/132] 10.222.0.16 () {62 vars in 1216 bytes} [Wed Oct 26 05:00:58 2022] PUT /compute/v2.1/flavors/962182453 => generated 446 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:00:58.486570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1a4eb47-41a0-4597-91c3-8ad993533cfb tempest-FlavorsV255TestJSON-1268773537 tempest-FlavorsV255TestJSON-1268773537-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.510577 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1a4eb47-41a0-4597-91c3-8ad993533cfb tempest-FlavorsV255TestJSON-1268773537 tempest-FlavorsV255TestJSON-1268773537-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.029901 Oct 26 05:00:58.511214 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 70/133] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:00:58 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:00:58.532737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6dda4ad4-bbab-49c3-8cff-8f526772d134 tempest-FlavorsV255TestJSON-1268773537 tempest-FlavorsV255TestJSON-1268773537-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.556720 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6dda4ad4-bbab-49c3-8cff-8f526772d134 tempest-FlavorsV255TestJSON-1268773537 tempest-FlavorsV255TestJSON-1268773537-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.027742 Oct 26 05:00:58.557859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 71/134] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Oct 26 05:00:58 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:00:58.574594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a30090f-8d5d-4c0a-8d32-10919407d67e tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.597531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a30090f-8d5d-4c0a-8d32-10919407d67e tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/962182453" status: 202 len: 0 microversion: 2.55 time: 0.026471 Oct 26 05:00:58.602353 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 72/135] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 26 05:00:58 2022] DELETE /compute/v2.1/flavors/962182453 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:00:58.607653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c88b6be-9555-4523-84f1-81bf291907b1 tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.618385 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-33c7de9b-625e-4a27-b357-796b4c281de2 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1304391338/action" status: 200 len: 97 microversion: 2.1 time: 0.657755 Oct 26 05:00:58.619738 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 64/136] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 26 05:00:57 2022] POST /compute/v2.1/flavors/1304391338/action => generated 97 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:00:58.633528 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c88b6be-9555-4523-84f1-81bf291907b1 tempest-FlavorsV255TestJSON-603338379 tempest-FlavorsV255TestJSON-603338379-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.029819 Oct 26 05:00:58.634253 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 73/137] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:00:58 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:00:58.815192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0219f524-82b1-4ed2-8830-e7809772582c tempest-FlavorsAccessTestJSON-522421148 tempest-FlavorsAccessTestJSON-522421148-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:58.846208 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0219f524-82b1-4ed2-8830-e7809772582c tempest-FlavorsAccessTestJSON-522421148 tempest-FlavorsAccessTestJSON-522421148-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.220581 Oct 26 05:00:58.847068 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 65/138] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:58 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:58.865929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-96333b67-1635-4d16-8cdd-38b396533a94 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "923fd9fbe0ab4e45bee72391c5eedd72"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:59.419274 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-96333b67-1635-4d16-8cdd-38b396533a94 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1304391338/action" status: 200 len: 21 microversion: 2.1 time: 0.557223 Oct 26 05:00:59.420600 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 74/139] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 26 05:00:58 2022] POST /compute/v2.1/flavors/1304391338/action => generated 21 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:00:59.439636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.440908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:00:59.449829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c67a889-a23c-401e-a899-d39f0fc6ae87 tempest-FlavorsAccessTestJSON-522421148 tempest-FlavorsAccessTestJSON-522421148-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.469964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:59.470516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:59.471224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:59.472444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:00:59.474007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:00:59.475917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:00:59.491305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c67a889-a23c-401e-a899-d39f0fc6ae87 tempest-FlavorsAccessTestJSON-522421148 tempest-FlavorsAccessTestJSON-522421148-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062911 Oct 26 05:00:59.492295 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 66/140] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:00:59.523577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c0eeb5d-71d6-458d-aa2d-0158da2eafb2 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.560345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c0eeb5d-71d6-458d-aa2d-0158da2eafb2 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1304391338" status: 202 len: 0 microversion: 2.1 time: 0.042827 Oct 26 05:00:59.561277 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 67/141] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:00:59 2022] DELETE /compute/v2.1/flavors/1304391338 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:59.576131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef03db8f-e300-4c95-8c8b-aefbb00e91dd tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.629208 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef03db8f-e300-4c95-8c8b-aefbb00e91dd tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062217 Oct 26 05:00:59.632945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 68/142] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:59.658045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a061a1c7-0f4c-406f-b3df-61be50edc774 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1421486704", "id": 705195489, "os-flavor-access:is_public": "False"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:00:59.708584 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a061a1c7-0f4c-406f-b3df-61be50edc774 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.057363 Oct 26 05:00:59.711188 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 69/143] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:00:59 2022] POST /compute/v2.1/flavors => generated 428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:00:59.714080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:00:59.724455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fece0565-6123-4b13-b1f4-c69cfed55157 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.726556 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65d0adc6-9700-42c4-85f5-cb2c1071cef7 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.291409 Oct 26 05:00:59.746075 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 75/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:00:59 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:00:59.750475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fece0565-6123-4b13-b1f4-c69cfed55157 tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/705195489/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.029382 Oct 26 05:00:59.753918 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 70/145] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 26 05:00:59 2022] GET /compute/v2.1/flavors/705195489/os-flavor-access => generated 21 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:00:59.794099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f75848e0-218d-4b7f-bcce-ebef0d46c66a tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.831888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f75848e0-218d-4b7f-bcce-ebef0d46c66a tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/705195489" status: 202 len: 0 microversion: 2.1 time: 0.057590 Oct 26 05:00:59.833277 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 76/146] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:00:59 2022] DELETE /compute/v2.1/flavors/705195489 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:00:59.842790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57209a8b-5c3c-41e6-a2cc-88c980cdc6ed tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:00:59.886805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57209a8b-5c3c-41e6-a2cc-88c980cdc6ed tempest-FlavorsAccessTestJSON-2142261444 tempest-FlavorsAccessTestJSON-2142261444-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048961 Oct 26 05:00:59.889300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 71/147] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:00:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:01:00.215713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-245094cf-0f4d-4626-b025-e98db8b4f5c6 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Calling method '.version_select at 0x7f470b410b80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:00.248006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-245094cf-0f4d-4626-b025-e98db8b4f5c6 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] HTTP exception thrown: Image not found. Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-245094cf-0f4d-4626-b025-e98db8b4f5c6 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Request method failure captured: Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/e1da9754-a51f-4f41-bd09-c2af31dc328a/metadata/os_distro HTTP/1.1 Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8Lrhr48JgwH3pslgVW0EdqJ6zkQL7XH_qG4vWx6QFJg4s5SPQhIhu-1NBhFw-K89ywi_j0sWf0PzFBPS-aCPNRgIw7cFWfs-lGiosI09FP4O8Ou9YqoWIa-WTvTYGAg5zxk9Nad_1M0ptHVWlBko_io2K6l8KkNxB2NgB1DaHzLwU Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:00.257646 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5ba1155883b64af0ad66c0e08c71cf92 Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'image_id': 'e1da9754-a51f-4f41-bd09-c2af31dc328a', 'id': 'os_distro'} Oct 26 05:01:00.259030 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.259921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1da9754-a51f-4f41-bd09-c2af31dc328a Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.261109 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1da9754-a51f-4f41-bd09-c2af31dc328a could not be found. Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:00.267465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.269379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-245094cf-0f4d-4626-b025-e98db8b4f5c6 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:00.270529 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-245094cf-0f4d-4626-b025-e98db8b4f5c6 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] 10.222.0.16 "DELETE /compute/v2.1/images/e1da9754-a51f-4f41-bd09-c2af31dc328a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.392755 Oct 26 05:01:00.270529 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 77/148] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 26 05:00:59 2022] DELETE /compute/v2.1/images/e1da9754-a51f-4f41-bd09-c2af31dc328a/metadata/os_distro => generated 62 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:00.276444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ded4f5ca-7f4e-4216-9153-3de405af347b tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Calling method '.version_select at 0x7f470b4ce550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:00.317250 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-ded4f5ca-7f4e-4216-9153-3de405af347b tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] HTTP exception thrown: Image not found. Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ded4f5ca-7f4e-4216-9153-3de405af347b tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Request method failure captured: Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/images/65044f1d-182d-427e-beb0-ba1ce2226c36/metadata/os_version HTTP/1.1 Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Lrhr48JgwH3pslgVW0EdqJ6zkQL7XH_qG4vWx6QFJg4s5SPQhIhu-1NBhFw-K89ywi_j0sWf0PzFBPS-aCPNRgIw7cFWfs-lGiosI09FP4O8Ou9YqoWIa-WTvTYGAg5zxk9Nad_1M0ptHVWlBko_io2K6l8KkNxB2NgB1DaHzLwU Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:00.321926 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5ba1155883b64af0ad66c0e08c71cf92 Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'image_id': '65044f1d-182d-427e-beb0-ba1ce2226c36', 'id': 'os_version'} Oct 26 05:01:00.323906 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.325255 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65044f1d-182d-427e-beb0-ba1ce2226c36 Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.329118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65044f1d-182d-427e-beb0-ba1ce2226c36 could not be found. Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:00.331659 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.334193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ded4f5ca-7f4e-4216-9153-3de405af347b tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:00.338926 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ded4f5ca-7f4e-4216-9153-3de405af347b tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] 10.222.0.16 "GET /compute/v2.1/images/65044f1d-182d-427e-beb0-ba1ce2226c36/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051960 Oct 26 05:01:00.338926 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 72/149] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 26 05:01:00 2022] GET /compute/v2.1/images/65044f1d-182d-427e-beb0-ba1ce2226c36/metadata/os_version => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:00.338926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba7cc686-6d46-4b0b-9608-5af66e709c0a tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Calling method '.version_select at 0x7f470b542d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:00.365169 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-ba7cc686-6d46-4b0b-9608-5af66e709c0a tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] HTTP exception thrown: Image not found. Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba7cc686-6d46-4b0b-9608-5af66e709c0a tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Request method failure captured: Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/images/fc9b7325-cd77-4809-b409-e917a0c9a9df/metadata HTTP/1.1 Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Lrhr48JgwH3pslgVW0EdqJ6zkQL7XH_qG4vWx6QFJg4s5SPQhIhu-1NBhFw-K89ywi_j0sWf0PzFBPS-aCPNRgIw7cFWfs-lGiosI09FP4O8Ou9YqoWIa-WTvTYGAg5zxk9Nad_1M0ptHVWlBko_io2K6l8KkNxB2NgB1DaHzLwU Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:00.369156 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5ba1155883b64af0ad66c0e08c71cf92 Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'image_id': 'fc9b7325-cd77-4809-b409-e917a0c9a9df'} Oct 26 05:01:00.370636 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.371458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fc9b7325-cd77-4809-b409-e917a0c9a9df Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.372797 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc9b7325-cd77-4809-b409-e917a0c9a9df could not be found. Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:00.374658 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.376056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba7cc686-6d46-4b0b-9608-5af66e709c0a tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:00.377360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba7cc686-6d46-4b0b-9608-5af66e709c0a tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] 10.222.0.16 "GET /compute/v2.1/images/fc9b7325-cd77-4809-b409-e917a0c9a9df/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040277 Oct 26 05:01:00.377360 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 73/150] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:01:00 2022] GET /compute/v2.1/images/fc9b7325-cd77-4809-b409-e917a0c9a9df/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:00.383073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8325b0e9-16c7-445b-af90-b6f89807a435 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Action: 'update_all', calling method: .version_select at 0x7f470b271dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:00.410728 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8325b0e9-16c7-445b-af90-b6f89807a435 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] HTTP exception thrown: Image not found. Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8325b0e9-16c7-445b-af90-b6f89807a435 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Request method failure captured: Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/images/e1f2ce4a-a6df-41f0-9295-6d266a4bf314/metadata HTTP/1.1 Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 57 Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Lrhr48JgwH3pslgVW0EdqJ6zkQL7XH_qG4vWx6QFJg4s5SPQhIhu-1NBhFw-K89ywi_j0sWf0PzFBPS-aCPNRgIw7cFWfs-lGiosI09FP4O8Ou9YqoWIa-WTvTYGAg5zxk9Nad_1M0ptHVWlBko_io2K6l8KkNxB2NgB1DaHzLwU Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:00.415105 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5ba1155883b64af0ad66c0e08c71cf92 Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:01:00.416276 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'image_id': 'e1f2ce4a-a6df-41f0-9295-6d266a4bf314', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.417004 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1f2ce4a-a6df-41f0-9295-6d266a4bf314 Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.418649 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1f2ce4a-a6df-41f0-9295-6d266a4bf314 could not be found. Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:00.420137 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:01:00.421483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.423301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8325b0e9-16c7-445b-af90-b6f89807a435 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:00.423301 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8325b0e9-16c7-445b-af90-b6f89807a435 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] 10.222.0.16 "PUT /compute/v2.1/images/e1f2ce4a-a6df-41f0-9295-6d266a4bf314/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039470 Oct 26 05:01:00.423301 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 74/151] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:01:00 2022] PUT /compute/v2.1/images/e1f2ce4a-a6df-41f0-9295-6d266a4bf314/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:00.427818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c21f13b-d142-45bd-aeda-8d5a57c52a54 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Action: 'update', calling method: .version_select at 0x7f470b2710d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:00.454211 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1c21f13b-d142-45bd-aeda-8d5a57c52a54 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] HTTP exception thrown: Image not found. Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c21f13b-d142-45bd-aeda-8d5a57c52a54 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Request method failure captured: Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/images/baf8399e-b215-4255-8d57-43943c0fe5b0/metadata/os_distro HTTP/1.1 Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 30 Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Lrhr48JgwH3pslgVW0EdqJ6zkQL7XH_qG4vWx6QFJg4s5SPQhIhu-1NBhFw-K89ywi_j0sWf0PzFBPS-aCPNRgIw7cFWfs-lGiosI09FP4O8Ou9YqoWIa-WTvTYGAg5zxk9Nad_1M0ptHVWlBko_io2K6l8KkNxB2NgB1DaHzLwU Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:00.457141 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5ba1155883b64af0ad66c0e08c71cf92 Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: {"meta": {"os_distro": "alt"}} Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:01:00.458280 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'image_id': 'baf8399e-b215-4255-8d57-43943c0fe5b0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.459149 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID baf8399e-b215-4255-8d57-43943c0fe5b0 Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.460119 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image baf8399e-b215-4255-8d57-43943c0fe5b0 could not be found. Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:00.461176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:01:00.462219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.463304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c21f13b-d142-45bd-aeda-8d5a57c52a54 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:00.463304 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c21f13b-d142-45bd-aeda-8d5a57c52a54 tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] 10.222.0.16 "PUT /compute/v2.1/images/baf8399e-b215-4255-8d57-43943c0fe5b0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.035357 Oct 26 05:01:00.463304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 75/152] 10.222.0.16 () {60 vars in 1310 bytes} [Wed Oct 26 05:01:00 2022] PUT /compute/v2.1/images/baf8399e-b215-4255-8d57-43943c0fe5b0/metadata/os_distro => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:00.483754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8700367-9901-47ed-ac7a-9d5442924f9c tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Action: 'create', calling method: .version_select at 0x7f470b24f430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:00.513599 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e8700367-9901-47ed-ac7a-9d5442924f9c tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] HTTP exception thrown: Image not found. Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8700367-9901-47ed-ac7a-9d5442924f9c tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Request method failure captured: Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/images/402d5b09-2708-4cc6-ae3e-d30415fd513e/metadata HTTP/1.1 Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 57 Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Lrhr48JgwH3pslgVW0EdqJ6zkQL7XH_qG4vWx6QFJg4s5SPQhIhu-1NBhFw-K89ywi_j0sWf0PzFBPS-aCPNRgIw7cFWfs-lGiosI09FP4O8Ou9YqoWIa-WTvTYGAg5zxk9Nad_1M0ptHVWlBko_io2K6l8KkNxB2NgB1DaHzLwU Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:00.516463 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f97de85cb109490a98f4d5fdc7c500d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f97de85cb109490a98f4d5fdc7c500d4 Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-663768163 Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5ba1155883b64af0ad66c0e08c71cf92 Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-663768163-project Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:01:00.517661 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'image_id': '402d5b09-2708-4cc6-ae3e-d30415fd513e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.518623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 402d5b09-2708-4cc6-ae3e-d30415fd513e Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:01:00.519566 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 402d5b09-2708-4cc6-ae3e-d30415fd513e could not be found. Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:00.520548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:01:00.521710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:00.523240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8700367-9901-47ed-ac7a-9d5442924f9c tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:00.523240 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8700367-9901-47ed-ac7a-9d5442924f9c tempest-ImagesMetadataNegativeTestJSON-663768163 tempest-ImagesMetadataNegativeTestJSON-663768163-project] 10.222.0.16 "POST /compute/v2.1/images/402d5b09-2708-4cc6-ae3e-d30415fd513e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049200 Oct 26 05:01:00.523240 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 76/153] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 26 05:01:00 2022] POST /compute/v2.1/images/402d5b09-2708-4cc6-ae3e-d30415fd513e/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:00.639936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ef0aa1ac-e37b-40b2-82d3-1fd07b2230d0 req-244cb7cd-f7f5-4d5d-8f3e-9d191d1d05ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13e941a-85ce-4cc9-b189-eb351014dee5", "name": "network-vif-plugged", "status": "completed", "tag": "acdd3e18-5704-4776-b22f-1c0d306671c5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:00.657381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ef0aa1ac-e37b-40b2-82d3-1fd07b2230d0 req-244cb7cd-f7f5-4d5d-8f3e-9d191d1d05ee service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:00.658281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ef0aa1ac-e37b-40b2-82d3-1fd07b2230d0 req-244cb7cd-f7f5-4d5d-8f3e-9d191d1d05ee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:00.658912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ef0aa1ac-e37b-40b2-82d3-1fd07b2230d0 req-244cb7cd-f7f5-4d5d-8f3e-9d191d1d05ee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:00.697143 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ef0aa1ac-e37b-40b2-82d3-1fd07b2230d0 req-244cb7cd-f7f5-4d5d-8f3e-9d191d1d05ee service nova] Creating event network-vif-plugged:acdd3e18-5704-4776-b22f-1c0d306671c5 for instance c13e941a-85ce-4cc9-b189-eb351014dee5 on n-h1-862416-4 Oct 26 05:01:00.702607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ef0aa1ac-e37b-40b2-82d3-1fd07b2230d0 req-244cb7cd-f7f5-4d5d-8f3e-9d191d1d05ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395558 Oct 26 05:01:00.703217 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 78/154] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:01:00.756246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:00.757640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:00.764172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:00.764662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:00.765367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:00.766468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:00.767073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:00.767693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:01.164420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:01.175566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-86e39a3b-150b-4f75-a121-9dc35c44183a tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.423403 Oct 26 05:01:01.182651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:00 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:01.484696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71f8482e-d7d8-46bc-a711-4eeb23e7981f tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Action: 'create', calling method: .version_select at 0x7f470b4105e0>, body: {"keypair": {"name": "tempest-keypair-254075925", "type": "ssh", "user_id": "3990c78791364558ba01e4dfdc38a92e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLtjASxbQiQmhNDPhV58xjLLdI9FTGThxxxDnTX6UW2f6y1qmdqHfVrqjkFIxP1jWA4XN2c7RRBB6Y4/rcOUysrUpeI43GHilm0SU0T9cdnE4Dylkb4RYMNZ/SdIPEv6Q=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:01.508829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-71f8482e-d7d8-46bc-a711-4eeb23e7981f tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Getting quotas for project 1822d91d6cf3460fad42e5cd43038ebe. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:01:01.512830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-71f8482e-d7d8-46bc-a711-4eeb23e7981f tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Getting quotas for user c8e04609ba6040a09aaf10a77cf35cd1 and project 1822d91d6cf3460fad42e5cd43038ebe. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:01:01.537295 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71f8482e-d7d8-46bc-a711-4eeb23e7981f tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.415466 Oct 26 05:01:01.539133 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 79/156] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:01:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 418 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:01:01.553144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31398aaf-901b-4dc2-8d96-f57791e31b22 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Action: 'create', calling method: .version_select at 0x7f470b2713a0>, body: {"keypair": {"name": "tempest-keypair-1343967144", "type": "ssh", "user_id": "3990c78791364558ba01e4dfdc38a92e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz0CV02Chjl0zpHl0WUcQgDJ67XfIHoKNdi1LcxEw3/Y9W1L5UPIHl20NPOH+0xb7qf4FcUmslnp353sNvA3iVn4P+hfEW55L/7ICtqr8vyiRPUtUVU/R71SlxV0nJkQg=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:01.582308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-31398aaf-901b-4dc2-8d96-f57791e31b22 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Getting quotas for project 1822d91d6cf3460fad42e5cd43038ebe. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:01:01.589232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-31398aaf-901b-4dc2-8d96-f57791e31b22 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Getting quotas for user c8e04609ba6040a09aaf10a77cf35cd1 and project 1822d91d6cf3460fad42e5cd43038ebe. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:01:01.676955 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31398aaf-901b-4dc2-8d96-f57791e31b22 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.127602 Oct 26 05:01:01.680744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 78/157] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:01:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:01:01.693385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9feb5742-8fa9-4291-a1c9-210ffdedb09d tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Calling method '.version_select at 0x7f470b4c4790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:01.709088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9feb5742-8fa9-4291-a1c9-210ffdedb09d tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-254075925?user_id=3990c78791364558ba01e4dfdc38a92e" status: 200 len: 511 microversion: 2.10 time: 0.021005 Oct 26 05:01:01.710162 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 80/158] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Oct 26 05:01:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-254075925?user_id=3990c78791364558ba01e4dfdc38a92e => generated 511 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:01.727354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f88b3491-474a-45d5-bb4b-2e761477e649 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Action: 'create', calling method: .version_select at 0x7f470b4ce310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-209229788", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZ1lZI58n7zI/V1qVRgdya0v21IFe4BdA2ZnAXrkVF9QLZfqB3+/qIjePEmJVpDy1Ucof1Rb7+t5f+g/Phi2FAxIVzno/xykSgzBwnJYWn3k/E4QMc0BbderDcVly5HEg=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:01.752250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-f88b3491-474a-45d5-bb4b-2e761477e649 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Getting quotas for project 1822d91d6cf3460fad42e5cd43038ebe. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:01:01.757577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-f88b3491-474a-45d5-bb4b-2e761477e649 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Getting quotas for user c8e04609ba6040a09aaf10a77cf35cd1 and project 1822d91d6cf3460fad42e5cd43038ebe. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:01:01.791947 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f88b3491-474a-45d5-bb4b-2e761477e649 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.070333 Oct 26 05:01:01.808954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a0cb5c6-8183-48c1-9828-e97c49727d24 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Calling method '.version_select at 0x7f470b4c4550>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:01.818266 n-d-862416-4 devstack@n-api.service[120586]: WARNING oslo_db.sqlalchemy.utils [None req-8a0cb5c6-8183-48c1-9828-e97c49727d24 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 05:01:01.818675 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 79/159] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:01:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:01:01.827023 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a0cb5c6-8183-48c1-9828-e97c49727d24 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=3990c78791364558ba01e4dfdc38a92e" status: 200 len: 725 microversion: 2.10 time: 0.024386 Oct 26 05:01:01.839182 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 81/160] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 26 05:01:01 2022] GET /compute/v2.1/os-keypairs?user_id=3990c78791364558ba01e4dfdc38a92e => generated 725 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:01.839583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16db73a7-84f4-404f-b3aa-32dd01deb045 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Calling method '.version_select at 0x7f470b268820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:01.885127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16db73a7-84f4-404f-b3aa-32dd01deb045 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-209229788" status: 204 len: 0 microversion: 2.10 time: 0.048493 Oct 26 05:01:01.886353 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 80/161] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Oct 26 05:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-209229788 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:01:01.897496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aebc7e77-b45a-43a5-b7f2-5708bbd5b4cb tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Calling method '.version_select at 0x7f470b3454c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:01.952759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aebc7e77-b45a-43a5-b7f2-5708bbd5b4cb tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343967144?user_id=3990c78791364558ba01e4dfdc38a92e" status: 204 len: 0 microversion: 2.10 time: 0.057409 Oct 26 05:01:01.954755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 82/162] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343967144?user_id=3990c78791364558ba01e4dfdc38a92e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:01:01.964194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c55b752-87ed-43d0-9a6f-319ac7dd2121 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] Calling method '.version_select at 0x7f470b1f24c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:01.992325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:02.014123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c55b752-87ed-43d0-9a6f-319ac7dd2121 tempest-KeyPairsV210TestJSON-1426991217 tempest-KeyPairsV210TestJSON-1426991217-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-254075925?user_id=3990c78791364558ba01e4dfdc38a92e" status: 204 len: 0 microversion: 2.10 time: 0.054510 Oct 26 05:01:02.016272 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 81/163] 10.222.0.16 () {60 vars in 1340 bytes} [Wed Oct 26 05:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-254075925?user_id=3990c78791364558ba01e4dfdc38a92e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:01:02.207703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:02.209018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:02.223400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:02.226411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:02.227028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:02.229534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:02.230177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:02.232984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:02.679528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:02.688771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc42d94f-5afa-4a0c-9592-0631ff80c969 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1339 microversion: 2.1 time: 0.485173 Oct 26 05:01:02.690216 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:02 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1339 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:03.715339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:03.716994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:03.723385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:03.724481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:03.726002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:03.727945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:03.728696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:03.729393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:04.051706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:04.061796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c1f65a8-bcac-4327-a513-18f3139878f1 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1489 microversion: 2.1 time: 0.350940 Oct 26 05:01:04.079333 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:03 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1489 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:04.088820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:04.089611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:04.098860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:04.099353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:04.100387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:04.101144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:04.101635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:04.102065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:04.866357 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1370de81-ef60-439d-b9b4-e8b47de95e2f tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1640 microversion: 2.1 time: 0.780702 Oct 26 05:01:04.869160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:04 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1640 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:04.898592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:04.900230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:04.926402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:04.927164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:04.929505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:04.931425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:04.934764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:04.936047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:05.031062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=79 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:05.036261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:01:05.285535 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-387d2c67-8471-429b-b135-5d4d4e253476 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 204 len: 0 microversion: 2.1 time: 0.392408 Oct 26 05:01:05.286733 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:01:04 2022] DELETE /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:01:05.297561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:05.298784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:05.310731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:05.312309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:05.313059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:05.316164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:05.316879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:05.319549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:05.736180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:05.750595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7666ba94-e044-4816-bd17-9e03f7ccb8fb tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1495 microversion: 2.1 time: 0.458050 Oct 26 05:01:05.752758 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:05 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1495 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:06.406780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9734f96-b486-490b-a615-2d6ecc818be0 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2142016232", "id": 2084669158, "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:06.437489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9734f96-b486-490b-a615-2d6ecc818be0 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.411426 Oct 26 05:01:06.439294 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 84/169] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:01:06 2022] POST /compute/v2.1/flavors => generated 468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:06.779537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:06.780952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:06.795474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:06.796817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:06.798819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:06.800002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:06.805700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:06.806663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:06.849436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d1b6693-2f37-44f1-872f-918d546be672 tempest-FlavorsV261TestJSON-1551434803 tempest-FlavorsV261TestJSON-1551434803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:06.869300 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d1b6693-2f37-44f1-872f-918d546be672 tempest-FlavorsV261TestJSON-1551434803 tempest-FlavorsV261TestJSON-1551434803-project] 10.222.0.16 "GET /compute/v2.1/flavors/2084669158" status: 200 len: 468 microversion: 2.61 time: 0.420430 Oct 26 05:01:06.885487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 86/170] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 26 05:01:06 2022] GET /compute/v2.1/flavors/2084669158 => generated 468 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:06.906509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7606ed39-f5dd-438d-b038-d9c5f245b739 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:07.027053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7606ed39-f5dd-438d-b038-d9c5f245b739 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/2084669158" status: 200 len: 469 microversion: 2.61 time: 0.138515 Oct 26 05:01:07.031556 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 87/171] 10.222.0.16 () {62 vars in 1219 bytes} [Wed Oct 26 05:01:06 2022] PUT /compute/v2.1/flavors/2084669158 => generated 469 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:07.043112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a695c56-45a5-4a10-82f9-9c48a2535108 tempest-FlavorsV261TestJSON-1551434803 tempest-FlavorsV261TestJSON-1551434803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:07.107615 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a695c56-45a5-4a10-82f9-9c48a2535108 tempest-FlavorsV261TestJSON-1551434803 tempest-FlavorsV261TestJSON-1551434803-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.066384 Oct 26 05:01:07.113967 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 88/172] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:01:07 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:01:07.139494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-907194cd-d124-4ab4-9bcc-b419c719f637 tempest-FlavorsV261TestJSON-1551434803 tempest-FlavorsV261TestJSON-1551434803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:07.207341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-907194cd-d124-4ab4-9bcc-b419c719f637 tempest-FlavorsV261TestJSON-1551434803 tempest-FlavorsV261TestJSON-1551434803-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.074584 Oct 26 05:01:07.210893 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 89/173] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Oct 26 05:01:07 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:01:07.228745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ae09a5c-4214-4066-9fb4-3ac91bbc781a tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:07.231910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:07.284064 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ae09a5c-4214-4066-9fb4-3ac91bbc781a tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2084669158" status: 202 len: 0 microversion: 2.61 time: 0.060299 Oct 26 05:01:07.285252 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 90/174] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 26 05:01:07 2022] DELETE /compute/v2.1/flavors/2084669158 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:01:07.294289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c570214-6488-482b-9ced-5d4a6737e388 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:07.357564 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c570214-6488-482b-9ced-5d4a6737e388 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.067081 Oct 26 05:01:07.359196 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 91/175] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:01:07 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:01:07.360922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c570214-6488-482b-9ced-5d4a6737e388 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:07.364664 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c570214-6488-482b-9ced-5d4a6737e388 tempest-FlavorsV261TestJSON-1422369198 tempest-FlavorsV261TestJSON-1422369198-project-admin] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003896 Oct 26 05:01:07.374155 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 92/176] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 26 05:01:07 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 05:01:07.483025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:07.492277 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b6cfa29-2d14-4431-b42f-3f0a79944859 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1495 microversion: 2.1 time: 0.718472 Oct 26 05:01:07.492867 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 85/177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:06 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1495 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:08.519444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:08.524756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:08.554948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:08.566053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:08.567118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:08.569026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:08.570148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:08.571185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:09.281130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:09.306342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a808ac6-9971-432e-846f-23657336ebaa tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1495 microversion: 2.1 time: 0.777091 Oct 26 05:01:09.309573 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:08 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1495 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:09.722469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-86227553-9d62-4377-8a51-3ae21dc7fcc6 req-5eba49db-923a-4aca-9e08-79344cee1472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13e941a-85ce-4cc9-b189-eb351014dee5", "name": "network-vif-deleted", "tag": "acdd3e18-5704-4776-b22f-1c0d306671c5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:09.770381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-86227553-9d62-4377-8a51-3ae21dc7fcc6 req-5eba49db-923a-4aca-9e08-79344cee1472 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:09.771528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-86227553-9d62-4377-8a51-3ae21dc7fcc6 req-5eba49db-923a-4aca-9e08-79344cee1472 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:09.773492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-86227553-9d62-4377-8a51-3ae21dc7fcc6 req-5eba49db-923a-4aca-9e08-79344cee1472 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:09.827782 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-86227553-9d62-4377-8a51-3ae21dc7fcc6 req-5eba49db-923a-4aca-9e08-79344cee1472 service nova] Creating event network-vif-deleted:acdd3e18-5704-4776-b22f-1c0d306671c5 for instance c13e941a-85ce-4cc9-b189-eb351014dee5 on n-h1-862416-4 Oct 26 05:01:09.839074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-86227553-9d62-4377-8a51-3ae21dc7fcc6 req-5eba49db-923a-4aca-9e08-79344cee1472 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120874 Oct 26 05:01:09.845523 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 94/179] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:10.058299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Action: 'update', calling method: .version_select at 0x7f470b216f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:10.337008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:10.337968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:10.346687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:10.350443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:10.351982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:10.358013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:10.358815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:10.359359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:10.424673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:10.425125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:10.425510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:10.425975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lazy-loading 'fault' on Instance uuid c13e941a-85ce-4cc9-b189-eb351014dee5 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:01:10.526891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf71dafe3d845bc9a68d90d9d729e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daef57793884543a153bbae8b6383b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:10.539839 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b45681a-a4cd-48ce-8d2b-d38183d07fee tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 200 len: 1329 microversion: 2.1 time: 0.203604 Oct 26 05:01:10.545687 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 95/180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:10 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 1329 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:10.920740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:10.921228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:10.921710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:10.922419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:10.922936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:10.923416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:11.005335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-397e8ef2-e4a8-43f2-b5e0-204bf14316ed tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4" status: 200 len: 148 microversion: 2.57 time: 1.517909 Oct 26 05:01:11.014411 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 86/181] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Oct 26 05:01:09 2022] PUT /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4 => generated 148 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:11.018239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Calling method '.version_select at 0x7f470b59c310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:11.345087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:11.345627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:11.346083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:11.347213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:11.347907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:11.348544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:11.374038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abfd9219-d882-4559-aa98-fb151b097589 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4/detail" status: 200 len: 463 microversion: 2.57 time: 0.359860 Oct 26 05:01:11.375245 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 96/182] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 26 05:01:11 2022] GET /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4/detail => generated 463 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:01:11.565248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:11.565928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:11.578352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:11.579949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:11.581800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:11.583874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:11.585152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:11.586569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:11.628894 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] HTTP exception thrown: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Request method failure captured: Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 HTTP/1.1 Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7vFTwdWRpH65n4AebetQZmTBvOE-ZNk_sJEbfb1I6fSWcaIeXe4R8KAS9s-4MY-BuZw8GVUZaEYLSw6BQnizEb2P-laFdnTkdAs3FalpfpTBB41pjE-Qlv48kIe3Qaatx6NRvpr7gbuEwqoWx1Lxm85XMGpAx-e5HI99-4HNfLvak Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3daef57793884543a153bbae8b6383b9 Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:11.637050 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3daef57793884543a153bbae8b6383b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3daef57793884543a153bbae8b6383b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3daef57793884543a153bbae8b6383b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3daef57793884543a153bbae8b6383b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3daef57793884543a153bbae8b6383b9 Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminTestJSON-87649983-project Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 8bf71dafe3d845bc9a68d90d9d729e81 Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminTestJSON-87649983-project Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:11.638358 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c13e941a-85ce-4cc9-b189-eb351014dee5'} Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:11.639042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:11.640173 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:11.649783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Returning 404 to user: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:11.656471 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2dee5fdb-bb1e-40d8-87fa-412bf39c7f63 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 404 len: 111 microversion: 2.1 time: 0.092043 Oct 26 05:01:11.659761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 87/183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:11 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:11.667393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f2a3d80-abf3-4721-ac60-5d0e8db29275 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:11.691944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d80-abf3-4721-ac60-5d0e8db29275 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:11.695511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d80-abf3-4721-ac60-5d0e8db29275 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:11.697160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d80-abf3-4721-ac60-5d0e8db29275 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:11.876981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Action: 'update', calling method: .version_select at 0x7f470b09b8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:12.579699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:12.583188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:12.583785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:12.585432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:12.591389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:12.592016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:12.678844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:12.679612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:12.680316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:12.681351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:12.681919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:12.682452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:12.816200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cd3e9deb-c1ce-4215-8046-7e1c016e39b9 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4?user_id=cb55b40fc42c4ae8adf09b37ee47187b" status: 200 len: 148 microversion: 2.57 time: 0.943637 Oct 26 05:01:12.820166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 88/184] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Oct 26 05:01:11 2022] PUT /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4?user_id=cb55b40fc42c4ae8adf09b37ee47187b => generated 148 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:12.832919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84974a73-3d5a-4995-8034-e47a2dfbf409 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] Calling method '.version_select at 0x7f470b035160>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:13.098762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f2a3d80-abf3-4721-ac60-5d0e8db29275 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 1.436079 Oct 26 05:01:13.102051 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 97/185] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:11 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:01:13.118568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-67d17145-ceb8-48f2-8e31-f8b37a1a09dd tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:13.170694 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-67d17145-ceb8-48f2-8e31-f8b37a1a09dd tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.060227 Oct 26 05:01:13.171726 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 98/186] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:13 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 26 05:01:13.186308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fecf960-8228-4a28-90c3-3e67c0b848ff tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-510489063"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:13.194709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-1fecf960-8228-4a28-90c3-3e67c0b848ff tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid e28a4d83-9960-4bd4-908b-afbf715efe20 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:13.240020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fecf960-8228-4a28-90c3-3e67c0b848ff tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059386 Oct 26 05:01:13.242306 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 99/187] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:13.263999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c4bff831-6cc2-4986-b525-2e0a54637a6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:13.296915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4bff831-6cc2-4986-b525-2e0a54637a6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:13.297953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4bff831-6cc2-4986-b525-2e0a54637a6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:13.298543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4bff831-6cc2-4986-b525-2e0a54637a6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:13.583828 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c4bff831-6cc2-4986-b525-2e0a54637a6c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.335055 Oct 26 05:01:13.584979 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 100/188] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:13 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:13.596915 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-84974a73-3d5a-4995-8034-e47a2dfbf409 tempest-QuotasAdminTestV257-1350842900 tempest-QuotasAdminTestV257-1350842900-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4?user_id=cb55b40fc42c4ae8adf09b37ee47187b" status: 200 len: 190 microversion: 2.57 time: 0.767801 Oct 26 05:01:13.602938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 89/189] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 26 05:01:12 2022] GET /compute/v2.1/os-quota-sets/4562ca76221840c5a2f862067ad8c6d4?user_id=cb55b40fc42c4ae8adf09b37ee47187b => generated 190 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:01:13.606037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ea9b1d21-70fa-42a0-b719-2fe9f0d534f1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:13.644045 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ea9b1d21-70fa-42a0-b719-2fe9f0d534f1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.051268 Oct 26 05:01:13.653965 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 101/190] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:01:13 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:01:13.657217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-07827cdf-80b9-4de1-abe9-0928ebeea277 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:13.684196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07827cdf-80b9-4de1-abe9-0928ebeea277 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:13.684851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07827cdf-80b9-4de1-abe9-0928ebeea277 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:13.685753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07827cdf-80b9-4de1-abe9-0928ebeea277 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:13.933428 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-07827cdf-80b9-4de1-abe9-0928ebeea277 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.280364 Oct 26 05:01:13.934851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 90/191] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:13 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:13.952368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73198aaa-0eb3-4284-8353-eb79fcfebe03 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:14.024838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73198aaa-0eb3-4284-8353-eb79fcfebe03 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.081830 Oct 26 05:01:14.030829 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 102/192] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:13 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:14.035455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea8e6ef6-46a1-48c8-827f-59437005d0f3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2080657340"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:14.041556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-ea8e6ef6-46a1-48c8-827f-59437005d0f3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid c8731e8a-3f32-48e1-8e73-86e18cd709a0 for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:14.421498 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea8e6ef6-46a1-48c8-827f-59437005d0f3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.389745 Oct 26 05:01:14.427182 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 91/193] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:01:14.440353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3013f04b-2725-453a-9fc7-f157e25cda61 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:14.478521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3013f04b-2725-453a-9fc7-f157e25cda61 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:14.479302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3013f04b-2725-453a-9fc7-f157e25cda61 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:14.482489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3013f04b-2725-453a-9fc7-f157e25cda61 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:14.804444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3013f04b-2725-453a-9fc7-f157e25cda61 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.368331 Oct 26 05:01:14.812144 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 103/194] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:14.817375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-faf717d3-dbc6-47c9-90bd-d18423acedc3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:14.860175 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-faf717d3-dbc6-47c9-90bd-d18423acedc3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.044084 Oct 26 05:01:14.863156 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 92/195] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:01:14 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:01:14.877571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-011a073d-650f-41d8-af29-703f6fca97a3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:14.908934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-011a073d-650f-41d8-af29-703f6fca97a3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:14.910676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-011a073d-650f-41d8-af29-703f6fca97a3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:14.912686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-011a073d-650f-41d8-af29-703f6fca97a3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:15.167764 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-011a073d-650f-41d8-af29-703f6fca97a3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.296277 Oct 26 05:01:15.172312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 104/196] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:15.188018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bf5588a-e6ac-443d-a628-6a1098f691f3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:15.267962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bf5588a-e6ac-443d-a628-6a1098f691f3 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.087116 Oct 26 05:01:15.269184 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 93/197] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:15 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:15.282335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f0a04f2-2902-4f5b-a8d9-12af51729dd7 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-889277275"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:15.289205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-1f0a04f2-2902-4f5b-a8d9-12af51729dd7 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid 2c91e12d-4226-4fb6-bfe2-83f0c4749b1b for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:15.364751 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f0a04f2-2902-4f5b-a8d9-12af51729dd7 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.087177 Oct 26 05:01:15.367534 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 105/198] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:15 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:15.386366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d8465ff1-666e-419a-b212-b6022834c850 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:15.407428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8465ff1-666e-419a-b212-b6022834c850 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:15.408286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8465ff1-666e-419a-b212-b6022834c850 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:15.409608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8465ff1-666e-419a-b212-b6022834c850 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:15.759744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d8465ff1-666e-419a-b212-b6022834c850 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.384660 Oct 26 05:01:15.767698 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 94/199] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:15.773931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a2ead4a-ce64-482e-9f65-1f0ac65c1fc1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:15.804603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a2ead4a-ce64-482e-9f65-1f0ac65c1fc1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:15.805387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a2ead4a-ce64-482e-9f65-1f0ac65c1fc1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:15.805998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a2ead4a-ce64-482e-9f65-1f0ac65c1fc1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:15.858296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=93 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:16.059610 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a2ead4a-ce64-482e-9f65-1f0ac65c1fc1 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.291305 Oct 26 05:01:16.060995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 106/200] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:16.072829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa75e8ec-b883-443a-a190-fbc13e0033c4 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:16.161227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa75e8ec-b883-443a-a190-fbc13e0033c4 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.092004 Oct 26 05:01:16.169561 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 95/201] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:16 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:16.181771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8034ecb9-b8a4-4bc7-92db-99f3627026f2 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-530622101"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:16.190556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-8034ecb9-b8a4-4bc7-92db-99f3627026f2 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid 5bdace18-d119-44fe-863e-505c8715afae for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:16.248213 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8034ecb9-b8a4-4bc7-92db-99f3627026f2 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076889 Oct 26 05:01:16.262596 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 96/202] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:16 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:16.292687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ada2cf8a-e8f4-4fd7-a1bb-f375ce6a7544 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-566210595"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:16.297835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-ada2cf8a-e8f4-4fd7-a1bb-f375ce6a7544 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid 36826972-e058-4979-9e9a-cba2e7b8f563 for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:16.320829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:16.370228 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ada2cf8a-e8f4-4fd7-a1bb-f375ce6a7544 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.102921 Oct 26 05:01:16.373547 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 97/203] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:16 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:16.385962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-098db5ab-cc31-45ab-8958-480932a4dc1a tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:16.472856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Calling method '.version_select at 0x7f470b34b820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:16.486870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:16.487630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:16.488552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:16.490313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:16.492283 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-098db5ab-cc31-45ab-8958-480932a4dc1a tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.112601 Oct 26 05:01:16.496706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:16.497404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:16.497903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 98/204] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:16.504301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ae26d6a-668a-4d84-ab4a-753c4dacf2e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:16.532072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ae26d6a-668a-4d84-ab4a-753c4dacf2e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:16.532834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ae26d6a-668a-4d84-ab4a-753c4dacf2e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:16.533412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ae26d6a-668a-4d84-ab4a-753c4dacf2e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:16.561710 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3e298b14-d706-4129-8863-22af21378b1f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.457382 Oct 26 05:01:16.565052 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 107/205] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 26 05:01:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:01:16.578866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34efeee6-d5a3-428e-9fa1-151f1c9c8176 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:16.596624 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-34efeee6-d5a3-428e-9fa1-151f1c9c8176 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34efeee6-d5a3-428e-9fa1-151f1c9c8176 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Request method failure captured: Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7y_kc4TADLUScnT4gb0TirQ3LcyfBehl2NLKcOS7cfjrMq6CJW5T9rDvSmHaAQm6wU5okaGzEGH_GPON1oY9qTCWUypECRTUgR38EcucmJALuSl1ZPPISrlXZUsgrc-4ze7q5JznGUOoXS9F7c5Uv3rjMFOSYw7LDZDNtwk2Y8dv8 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:16.600353 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a32c99320488459280497ac33be3c2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a32c99320488459280497ac33be3c2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3de78b4a24e44c5c8dc8a12940cf1370 Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: exception: Aggregate 5 could not be found. Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '5'} Oct 26 05:01:16.601946 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.602784 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 26 05:01:16.603828 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.606882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34efeee6-d5a3-428e-9fa1-151f1c9c8176 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:16.608039 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34efeee6-d5a3-428e-9fa1-151f1c9c8176 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041714 Oct 26 05:01:16.609112 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 108/206] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:01:16 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:16.828121 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ae26d6a-668a-4d84-ab4a-753c4dacf2e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.325910 Oct 26 05:01:16.828993 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 99/207] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:16.837291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab87bf61-460d-45e9-92c2-3e6a1aaee8af tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:16.872667 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-ab87bf61-460d-45e9-92c2-3e6a1aaee8af tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab87bf61-460d-45e9-92c2-3e6a1aaee8af tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Request method failure captured: Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7y_kc4TADLUScnT4gb0TirQ3LcyfBehl2NLKcOS7cfjrMq6CJW5T9rDvSmHaAQm6wU5okaGzEGH_GPON1oY9qTCWUypECRTUgR38EcucmJALuSl1ZPPISrlXZUsgrc-4ze7q5JznGUOoXS9F7c5Uv3rjMFOSYw7LDZDNtwk2Y8dv8 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:16.875254 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a32c99320488459280497ac33be3c2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a32c99320488459280497ac33be3c2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3de78b4a24e44c5c8dc8a12940cf1370 Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: exception: Aggregate 5 could not be found. Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '5'} Oct 26 05:01:16.876519 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:16.877334 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.878358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab87bf61-460d-45e9-92c2-3e6a1aaee8af tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab87bf61-460d-45e9-92c2-3e6a1aaee8af tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.046874 Oct 26 05:01:16.879473 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 100/208] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:16.885783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:16.901837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:16.902515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:16.903181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:16.936727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-862416-4. Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 39 Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:16.944887 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: {"add_host": {"host": "n-h1-862416-4"}} Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:16.946101 n-d-862416-4 devstack@n-api.service[120585]: exception: Aggregate 6 already has host n-h1-862416-4. Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-862416-4'}}} Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result.read() Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 05:01:16.946849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-862416-4-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi session.flush() Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 05:01:16.948494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 05:01:16.949734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 05:01:16.952409 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result.read() Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-862416-4-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 26, 5, 1, 16, 925398), 'updated_at': None, 'host': 'n-h1-862416-4', 'aggregate_id': 6}] Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.955290 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-862416-4. Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.958568 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-862416-4. Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:16.963156 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:16.966608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-862416-4. Oct 26 05:01:16.966608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.966608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-862416-4. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:16.966608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91ce17ff-5969-433a-88cf-4fdcc57fa0d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.067889 Oct 26 05:01:16.966608 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 101/209] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 26 05:01:16.966608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-413b766d-2fa4-454e-9610-b9a4c78b6166 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1023927186", "name": "tempest-test_aggregate-1897594312"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:16.976586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffeadcc2-6043-416a-ae49-5ebde87ecf5b tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Calling method '.version_select at 0x7f470b34b280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:16.984816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffeadcc2-6043-416a-ae49-5ebde87ecf5b tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '4b9fbcdb6dc04b1593bc57c1c651046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404729143afe43ddbdf9f4331864b84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffeadcc2-6043-416a-ae49-5ebde87ecf5b tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Request method failure captured: Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8Zhf13f1MTXr8Fsm7XxriN0mFxwNAZ1IJy1Gt-qjsbnqzN7gphtEJf8M0eHME2P7uaLy_VtUq5O5jcK1K68VGa8hSIfTSpN16wtgBMXE9pIO-V-g0svdTOmQKJeULLVbyIno62pGtsv_M9uDtM82SZU6lY58Uko8gaNyg2Ia4kvzg Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:16.988629 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_404729143afe43ddbdf9f4331864b84d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4b9fbcdb6dc04b1593bc57c1c651046b Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:01:16.990051 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:16.991100 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 26 05:01:16.992146 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:16.993202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffeadcc2-6043-416a-ae49-5ebde87ecf5b tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:16.993202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffeadcc2-6043-416a-ae49-5ebde87ecf5b tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.379784 Oct 26 05:01:16.993202 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 109/210] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 26 05:01:16 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:16.999320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f79c9d1-b1f5-47b9-8ca5-4ccf01924f3d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:17.014282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f79c9d1-b1f5-47b9-8ca5-4ccf01924f3d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:17.014854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f79c9d1-b1f5-47b9-8ca5-4ccf01924f3d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:17.015387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f79c9d1-b1f5-47b9-8ca5-4ccf01924f3d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:17.064828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-413b766d-2fa4-454e-9610-b9a4c78b6166 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid 51b7988d-cdda-4c1d-8b7d-b18c5f780702 for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:17.170528 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-413b766d-2fa4-454e-9610-b9a4c78b6166 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.221824 Oct 26 05:01:17.178777 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 102/211] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 26 05:01:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:17.189027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f355e1d-9d9d-40c6-987c-ae342cd1940f tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Calling method '.version_select at 0x7f470b036e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.200821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f355e1d-9d9d-40c6-987c-ae342cd1940f tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '4b9fbcdb6dc04b1593bc57c1c651046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404729143afe43ddbdf9f4331864b84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f355e1d-9d9d-40c6-987c-ae342cd1940f tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Request method failure captured: Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-hosts/n-d-862416-4/reboot HTTP/1.1 Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Zhf13f1MTXr8Fsm7XxriN0mFxwNAZ1IJy1Gt-qjsbnqzN7gphtEJf8M0eHME2P7uaLy_VtUq5O5jcK1K68VGa8hSIfTSpN16wtgBMXE9pIO-V-g0svdTOmQKJeULLVbyIno62pGtsv_M9uDtM82SZU6lY58Uko8gaNyg2Ia4kvzg Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:17.214490 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_404729143afe43ddbdf9f4331864b84d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 4b9fbcdb6dc04b1593bc57c1c651046b Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'n-d-862416-4'} Oct 26 05:01:17.215711 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.216423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 26 05:01:17.217448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.218350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f355e1d-9d9d-40c6-987c-ae342cd1940f tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.218350 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f355e1d-9d9d-40c6-987c-ae342cd1940f tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862416-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.035995 Oct 26 05:01:17.218350 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 103/212] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/n-d-862416-4/reboot => generated 111 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:17.237066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e4c3a73-30c3-4f11-8d1f-1bf2f6795cc0 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.268132 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f79c9d1-b1f5-47b9-8ca5-4ccf01924f3d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.273341 Oct 26 05:01:17.269397 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 110/213] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:17.278601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94979225-eb59-492d-8331-9315e77b2d9f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Calling method '.version_select at 0x7f470b34bdc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.306881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e4c3a73-30c3-4f11-8d1f-1bf2f6795cc0 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.088885 Oct 26 05:01:17.308480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-94979225-eb59-492d-8331-9315e77b2d9f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94979225-eb59-492d-8331-9315e77b2d9f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:17.310969 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'nonexistent_hostname'} Oct 26 05:01:17.312184 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:17.312922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 26 05:01:17.313958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.315254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.317698 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 104/214] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:17 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:17.317698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-35c6c5ab-7e34-4fa1-9ef4-47c7712dbbbf tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.320052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94979225-eb59-492d-8331-9315e77b2d9f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.321480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-94979225-eb59-492d-8331-9315e77b2d9f tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.050966 Oct 26 05:01:17.322824 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 111/215] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:17.333070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-033010fa-81d5-4a96-8162-482333a6e944 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.346587 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-033010fa-81d5-4a96-8162-482333a6e944 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-033010fa-81d5-4a96-8162-482333a6e944 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Request method failure captured: Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7y_kc4TADLUScnT4gb0TirQ3LcyfBehl2NLKcOS7cfjrMq6CJW5T9rDvSmHaAQm6wU5okaGzEGH_GPON1oY9qTCWUypECRTUgR38EcucmJALuSl1ZPPISrlXZUsgrc-4ze7q5JznGUOoXS9F7c5Uv3rjMFOSYw7LDZDNtwk2Y8dv8 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:17.351078 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a32c99320488459280497ac33be3c2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a32c99320488459280497ac33be3c2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3de78b4a24e44c5c8dc8a12940cf1370 Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: exception: Aggregate 7 could not be found. Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7'} Oct 26 05:01:17.352912 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.354087 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 26 05:01:17.355583 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.360872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-033010fa-81d5-4a96-8162-482333a6e944 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.362227 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-033010fa-81d5-4a96-8162-482333a6e944 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.038100 Oct 26 05:01:17.363617 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 112/216] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:17.376263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d05d0e44-c27c-41f3-bfc1-dbc41690179d tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Calling method '.version_select at 0x7f470b34b5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.391778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-35c6c5ab-7e34-4fa1-9ef4-47c7712dbbbf tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.079164 Oct 26 05:01:17.394084 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 105/217] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:17 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:17.399252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d05d0e44-c27c-41f3-bfc1-dbc41690179d tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '4b9fbcdb6dc04b1593bc57c1c651046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404729143afe43ddbdf9f4331864b84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d05d0e44-c27c-41f3-bfc1-dbc41690179d tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Request method failure captured: Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts/n-d-862416-4 HTTP/1.1 Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8Zhf13f1MTXr8Fsm7XxriN0mFxwNAZ1IJy1Gt-qjsbnqzN7gphtEJf8M0eHME2P7uaLy_VtUq5O5jcK1K68VGa8hSIfTSpN16wtgBMXE9pIO-V-g0svdTOmQKJeULLVbyIno62pGtsv_M9uDtM82SZU6lY58Uko8gaNyg2Ia4kvzg Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:17.399997 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_404729143afe43ddbdf9f4331864b84d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4b9fbcdb6dc04b1593bc57c1c651046b Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'n-d-862416-4'} Oct 26 05:01:17.401178 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.402106 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 26 05:01:17.403143 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.405247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d05d0e44-c27c-41f3-bfc1-dbc41690179d tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.405247 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d05d0e44-c27c-41f3-bfc1-dbc41690179d tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862416-4" status: 403 len: 109 microversion: 2.1 time: 0.036274 Oct 26 05:01:17.405247 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 113/218] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/n-d-862416-4 => generated 109 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:17.411160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48a62a1b-e3c1-41de-a668-50c6e5779c25 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1702617899"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:17.416435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-48a62a1b-e3c1-41de-a668-50c6e5779c25 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid e88fbfce-1c63-439b-bdeb-5b326bb849ac for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:17.425333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21291759-ee80-4947-89e1-d6a5f599e0d5 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.436466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=11,nova_api:INSERT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:17.455317 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48a62a1b-e3c1-41de-a668-50c6e5779c25 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051012 Oct 26 05:01:17.456274 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 114/219] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:17.463864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8509fa73-8800-4cb0-9262-313e189a4e4a tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Calling method '.version_select at 0x7f470b3b7f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.476492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8509fa73-8800-4cb0-9262-313e189a4e4a tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8509fa73-8800-4cb0-9262-313e189a4e4a tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:17.478284 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'nonexistent_hostname'} Oct 26 05:01:17.479550 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.480288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.481341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.482418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8509fa73-8800-4cb0-9262-313e189a4e4a tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.482418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8509fa73-8800-4cb0-9262-313e189a4e4a tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022649 Oct 26 05:01:17.482418 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 115/220] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:17.488222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b02f0dfa-2912-48fe-b693-8639f35f7580 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-712202895"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:17.492179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-b02f0dfa-2912-48fe-b693-8639f35f7580 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Generated uuid a8f2a789-ab78-4f56-a472-636aa814d8c7 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:17.494427 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-21291759-ee80-4947-89e1-d6a5f599e0d5 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21291759-ee80-4947-89e1-d6a5f599e0d5 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Request method failure captured: Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7y_kc4TADLUScnT4gb0TirQ3LcyfBehl2NLKcOS7cfjrMq6CJW5T9rDvSmHaAQm6wU5okaGzEGH_GPON1oY9qTCWUypECRTUgR38EcucmJALuSl1ZPPISrlXZUsgrc-4ze7q5JznGUOoXS9F7c5Uv3rjMFOSYw7LDZDNtwk2Y8dv8 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:17.499786 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a32c99320488459280497ac33be3c2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a32c99320488459280497ac33be3c2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a32c99320488459280497ac33be3c2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a32c99320488459280497ac33be3c2c2 Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1515379078 Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3de78b4a24e44c5c8dc8a12940cf1370 Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminTestJSON-1515379078-project-admin Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: exception: Aggregate 7 could not be found. Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7'} Oct 26 05:01:17.501026 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:17.502551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.503612 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.504833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.504833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:17.504833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:17.504833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 26 05:01:17.504833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.512898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21291759-ee80-4947-89e1-d6a5f599e0d5 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.514773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21291759-ee80-4947-89e1-d6a5f599e0d5 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.111138 Oct 26 05:01:17.524774 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 106/221] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:17 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:17.537613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b02f0dfa-2912-48fe-b693-8639f35f7580 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.050801 Oct 26 05:01:17.538440 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 116/222] 10.222.0.16 () {62 vars in 1205 bytes} [Wed Oct 26 05:01:17 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:17.544860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-869924c6-54e5-4782-8866-aaa1191bfbc7 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Calling method '.version_select at 0x7f470b4d9160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.552497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-869924c6-54e5-4782-8866-aaa1191bfbc7 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '4b9fbcdb6dc04b1593bc57c1c651046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404729143afe43ddbdf9f4331864b84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-869924c6-54e5-4782-8866-aaa1191bfbc7 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Request method failure captured: Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts/n-d-862416-4/shutdown HTTP/1.1 Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8Zhf13f1MTXr8Fsm7XxriN0mFxwNAZ1IJy1Gt-qjsbnqzN7gphtEJf8M0eHME2P7uaLy_VtUq5O5jcK1K68VGa8hSIfTSpN16wtgBMXE9pIO-V-g0svdTOmQKJeULLVbyIno62pGtsv_M9uDtM82SZU6lY58Uko8gaNyg2Ia4kvzg Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:17.558530 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_404729143afe43ddbdf9f4331864b84d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4b9fbcdb6dc04b1593bc57c1c651046b Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'n-d-862416-4'} Oct 26 05:01:17.560056 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.560966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 26 05:01:17.562221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.565473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-869924c6-54e5-4782-8866-aaa1191bfbc7 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.568220 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-869924c6-54e5-4782-8866-aaa1191bfbc7 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862416-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027111 Oct 26 05:01:17.570332 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 117/223] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/n-d-862416-4/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:17.580807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49421bff-5c4f-46bd-8cfb-54c99780709c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-86934245"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:17.595118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-49421bff-5c4f-46bd-8cfb-54c99780709c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid a3e07d52-a3b6-475c-9401-e6e85abecd4f for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:17.635565 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49421bff-5c4f-46bd-8cfb-54c99780709c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.061318 Oct 26 05:01:17.643118 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 118/224] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:17.764352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43b15634-4518-4fe7-87ab-6a06afecbceb tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:17.770788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Calling method '.version_select at 0x7f470b3afd30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.773944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43b15634-4518-4fe7-87ab-6a06afecbceb tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2a984eef67c04f629171e23169bd3a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1e4d380f2749e0b4d65251821d49de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43b15634-4518-4fe7-87ab-6a06afecbceb tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Request method failure captured: Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 39 Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7xrEcgImJpVTlElK2HXNl5UpabhYZheZrvcvX78ezisPRok6kkgcxYtFoCukwLnIP0cI9y6-ZKDUnhi30VxNzYvP8QgyCLoQVAAbOhizLy2TFMEg6U7SaungslRHUOiaFs1xoKYyZTt6gqTd2nHGEgxWgQdMwZirG1tO0kRdjpFPs Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:17.781092 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2a984eef67c04f629171e23169bd3a05 Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: {"add_host": {"host": "n-h1-862416-4"}} Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:17.782730 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-862416-4'}}} Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.783727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 26 05:01:17.784851 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.789257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43b15634-4518-4fe7-87ab-6a06afecbceb tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.791123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43b15634-4518-4fe7-87ab-6a06afecbceb tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.265028 Oct 26 05:01:17.800699 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 107/225] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 26 05:01:17 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 275 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:17.813560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eeca3355-7fb0-46d4-8fc8-a26e6718a120 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-807152183"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:17.859211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:01:17.861238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Neutron security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:01:17.861867 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] HTTP exception thrown: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.861867 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Request method failure captured: Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/6bfd49c7-c168-4089-a5d4-01e4b1658e7a HTTP/1.1 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8dN9H2X8VwyXmq6AtEnwQwwcWWpdkeej6iZuTdYR-gYF_62hHS61Nu09khMFSvbIKlThmgrW9iuUkabLlmx2JF3evPUtjrZayMcUZhTHNFMH0YvDQDRsZ3XtI9oKO66eZmM1PyszrGWGy2NOy-G3Hz9c6XVrP8T0TXyo5VcflREP4 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:17.877415 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 07a623cd2f4d4c00af761e342ae95663 Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] Oct 26 05:01:17.878949 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '6bfd49c7-c168-4089-a5d4-01e4b1658e7a'} Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:17.879918 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:01:17.881597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.883682 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Returning 404 to user: Security group 6bfd49c7-c168-4089-a5d4-01e4b1658e7a does not exist Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-9e1f8f17-2b43-407b-a490-b585fd663d5f'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3541288e-3f64-4de5-9417-0a98f6b7ded4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6bfd49c7-c168-4089-a5d4-01e4b1658e7a" status: 404 len: 194 microversion: 2.1 time: 0.234617 Oct 26 05:01:17.886327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 119/226] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:01:17 2022] DELETE /compute/v2.1/os-security-groups/6bfd49c7-c168-4089-a5d4-01e4b1658e7a => generated 194 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:17.891407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88658eeb-1aec-4633-84fd-ab09ecffb3dc tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Calling method '.version_select at 0x7f470b178ca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.918576 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-88658eeb-1aec-4633-84fd-ab09ecffb3dc tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88658eeb-1aec-4633-84fd-ab09ecffb3dc tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:17.921932 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'nonexistent_hostname'} Oct 26 05:01:17.923244 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:17.924091 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 26 05:01:17.925126 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88658eeb-1aec-4633-84fd-ab09ecffb3dc tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:17.926197 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88658eeb-1aec-4633-84fd-ab09ecffb3dc tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037052 Oct 26 05:01:17.932554 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 120/227] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:17.942219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f8236ef-c675-4ffd-be13-fe4e04030eee tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.969761 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f8236ef-c675-4ffd-be13-fe4e04030eee tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 226 microversion: 2.1 time: 0.035994 Oct 26 05:01:17.972811 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 121/228] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-aggregates/10 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:17.983004 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eeca3355-7fb0-46d4-8fc8-a26e6718a120 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 298 microversion: 2.41 time: 0.180929 Oct 26 05:01:17.983922 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 108/229] 10.222.0.16 () {62 vars in 1210 bytes} [Wed Oct 26 05:01:17 2022] PUT /compute/v2.1/os-aggregates/9 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:17.990810 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2543fb62-a90b-450a-b728-35206f539a98 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004179 Oct 26 05:01:17.991982 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 109/230] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 26 05:01:17 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 05:01:17.997565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2b77bd7-d1b4-4347-b819-88997a80adb2 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Calling method '.version_select at 0x7f470b036040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:17.999830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d2b77bd7-d1b4-4347-b819-88997a80adb2 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '4b9fbcdb6dc04b1593bc57c1c651046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404729143afe43ddbdf9f4331864b84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:18.000284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bd83895-5f4c-4086-bf11-0d7ca1a29cde tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2b77bd7-d1b4-4347-b819-88997a80adb2 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Request method failure captured: Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-hosts/n-d-862416-4/startup HTTP/1.1 Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8Zhf13f1MTXr8Fsm7XxriN0mFxwNAZ1IJy1Gt-qjsbnqzN7gphtEJf8M0eHME2P7uaLy_VtUq5O5jcK1K68VGa8hSIfTSpN16wtgBMXE9pIO-V-g0svdTOmQKJeULLVbyIno62pGtsv_M9uDtM82SZU6lY58Uko8gaNyg2Ia4kvzg Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:18.003135 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_404729143afe43ddbdf9f4331864b84d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 4b9fbcdb6dc04b1593bc57c1c651046b Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'n-d-862416-4'} Oct 26 05:01:18.004361 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:18.005244 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 26 05:01:18.007349 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.012463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2b77bd7-d1b4-4347-b819-88997a80adb2 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:18.013905 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d2b77bd7-d1b4-4347-b819-88997a80adb2 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862416-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.020594 Oct 26 05:01:18.014678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 110/231] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 26 05:01:17 2022] GET /compute/v2.1/os-hosts/n-d-862416-4/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:18.019981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03c21bcf-4206-419a-a220-da27c87bc002 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.053174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7bd83895-5f4c-4086-bf11-0d7ca1a29cde tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.077203 Oct 26 05:01:18.061145 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 122/232] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:17 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:18.074168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08d5b51f-8c51-4c38-b3da-450bb93136b6 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.081574 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03c21bcf-4206-419a-a220-da27c87bc002 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 264 microversion: 2.1 time: 0.065575 Oct 26 05:01:18.082196 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 111/233] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:01:18 2022] POST /compute/v2.1/os-aggregates/10/action => generated 264 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:18.099078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08d5b51f-8c51-4c38-b3da-450bb93136b6 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 298 microversion: 2.41 time: 0.031249 Oct 26 05:01:18.100275 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 123/234] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 26 05:01:18 2022] GET /compute/v2.1/os-aggregates/9 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:18.106946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73b0c10d-fb66-429c-b97b-d373c8d3a4fb tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Calling method '.version_select at 0x7f470b036d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.108209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd8d474e-8866-4ec7-bd58-90b69d6ec723 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Calling method '.version_select at 0x7f470b34b8b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.123136 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-dd8d474e-8866-4ec7-bd58-90b69d6ec723 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd8d474e-8866-4ec7-bd58-90b69d6ec723 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:18.126739 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'nonexistent_hostname'} Oct 26 05:01:18.127968 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:18.128736 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 26 05:01:18.129804 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:18.133464 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.136162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd8d474e-8866-4ec7-bd58-90b69d6ec723 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:18.137678 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd8d474e-8866-4ec7-bd58-90b69d6ec723 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.036134 Oct 26 05:01:18.138735 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 124/235] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 26 05:01:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:18.146184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a01278fd-f27c-4b34-bc73-63ed4074e3d2 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1010258642"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.157667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-a01278fd-f27c-4b34-bc73-63ed4074e3d2 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid dbe5a8b4-b2e0-47a0-a8c7-2657158b1a0a for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:18.201761 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a01278fd-f27c-4b34-bc73-63ed4074e3d2 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061549 Oct 26 05:01:18.212766 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 125/236] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:18.229357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5a54e1c-8dea-46e0-8ff7-1a0481157daf tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.250479 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5a54e1c-8dea-46e0-8ff7-1a0481157daf tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 240 microversion: 2.1 time: 0.034270 Oct 26 05:01:18.254745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 126/237] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:18 2022] GET /compute/v2.1/os-aggregates/10 => generated 240 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:18.259584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16c93ae0-8022-46a6-a16c-d8b21a89f8ec tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.293265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16c93ae0-8022-46a6-a16c-d8b21a89f8ec tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:18.295111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16c93ae0-8022-46a6-a16c-d8b21a89f8ec tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:18.295879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16c93ae0-8022-46a6-a16c-d8b21a89f8ec tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:18.546081 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16c93ae0-8022-46a6-a16c-d8b21a89f8ec tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 313 microversion: 2.41 time: 0.290212 Oct 26 05:01:18.547716 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 127/238] 10.222.0.16 () {62 vars in 1232 bytes} [Wed Oct 26 05:01:18 2022] POST /compute/v2.1/os-aggregates/9/action => generated 313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:18.561083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1401c5f4-13fe-4ccd-95a0-43625d1911f3 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Action: 'update', calling method: .version_select at 0x7f470b34b550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1401c5f4-13fe-4ccd-95a0-43625d1911f3 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-hosts/n-d-862416-4 HTTP/1.1 Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 51 Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:18.578335 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: {"status": "enable", "maintenance_mode": "invalid"} Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:18.579622 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'n-d-862416-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'disable', Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'Enable', Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'Disable', Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance: Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.580341 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.581825 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1401c5f4-13fe-4ccd-95a0-43625d1911f3 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1401c5f4-13fe-4ccd-95a0-43625d1911f3 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862416-4" status: 400 len: 199 microversion: 2.1 time: 0.031239 Oct 26 05:01:18.582864 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 128/239] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:01:18 2022] PUT /compute/v2.1/os-hosts/n-d-862416-4 => generated 199 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:01:18.597025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-384621799"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.632220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:18.634676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:18.635348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:18.658019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:18.658939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:18.659594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:18.671962 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-384621799 could not be found. Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 57 Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:18.674654 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: {"add_host": {"host": "tempest-nonexist_host-384621799"}} Oct 26 05:01:18.675938 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: exception: Compute host tempest-nonexist_host-384621799 could not be found. Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-384621799'}}} Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-384621799' is not mapped to any cell Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.676664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 26 05:01:18.679456 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-384621799 could not be found. Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-384621799 could not be found. Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.680577 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-384621799 could not be found. Oct 26 05:01:18.682928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.686243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-384621799 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:18.687368 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aade267a-f4e0-4e05-a4b0-7879d81adc8a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.104589 Oct 26 05:01:18.688284 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 129/240] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:01:18 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:18.695878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4698ef79-fbe2-4826-ac63-76c296876b89 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.739395 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4698ef79-fbe2-4826-ac63-76c296876b89 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.049584 Oct 26 05:01:18.740936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 130/241] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:18 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:18.748572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7481c6bf-3a63-4e00-946f-955d14e46126 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.762383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7481c6bf-3a63-4e00-946f-955d14e46126 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:18.763913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7481c6bf-3a63-4e00-946f-955d14e46126 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:18.764586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7481c6bf-3a63-4e00-946f-955d14e46126 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:18.822008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73b0c10d-fb66-429c-b97b-d373c8d3a4fb tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.727525 Oct 26 05:01:18.822592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 112/242] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:01:18 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:18.827224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d4dd1f0-d7c3-4517-bf4a-df7cec7713de tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Action: 'update', calling method: .version_select at 0x7f470b046f70>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d4dd1f0-d7c3-4517-bf4a-df7cec7713de tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/os-hosts/n-d-862416-4 HTTP/1.1 Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 51 Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:18.835384 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: {"status": "invalid", "maintenance_mode": "enable"} Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:18.836815 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'n-d-862416-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'disable', Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'Enable', Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'Disable', Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance: Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.837606 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:18.838990 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:18.840010 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:18.840010 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:01:18.840010 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:01:18.840010 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 26 05:01:18.840010 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:18.842109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d4dd1f0-d7c3-4517-bf4a-df7cec7713de tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:18.851062 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d4dd1f0-d7c3-4517-bf4a-df7cec7713de tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862416-4" status: 400 len: 189 microversion: 2.1 time: 0.021696 Oct 26 05:01:18.851771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 113/243] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:01:18 2022] PUT /compute/v2.1/os-hosts/n-d-862416-4 => generated 189 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:01:18.869166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b5bb083-7a42-4249-8d74-d6e255df881a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:18.928173 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b5bb083-7a42-4249-8d74-d6e255df881a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.068907 Oct 26 05:01:18.929109 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 114/244] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:18 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:18.934231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee911225-cffd-497f-9968-bab7ce1d4a2d tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1454434088", "availability_zone": "tempest-test_az-461082806"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:18.942391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-ee911225-cffd-497f-9968-bab7ce1d4a2d tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid d0e2a5cc-883f-4e0e-9448-bde36eb803d8 for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:18.996324 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee911225-cffd-497f-9968-bab7ce1d4a2d tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.065853 Oct 26 05:01:18.997614 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 115/245] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 26 05:01:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:19.001408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7481c6bf-3a63-4e00-946f-955d14e46126 tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 298 microversion: 2.41 time: 0.258971 Oct 26 05:01:19.001962 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 131/246] 10.222.0.16 () {62 vars in 1232 bytes} [Wed Oct 26 05:01:18 2022] POST /compute/v2.1/os-aggregates/9/action => generated 298 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:19.010973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d8d56d0b-3838-4c00-b916-708c124637bf tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Calling method '.version_select at 0x7f470b268790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:19.019693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63e17212-1fab-4390-832e-b39b55d11159 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Action: 'update', calling method: .version_select at 0x7f470b178ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.039019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63e17212-1fab-4390-832e-b39b55d11159 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '4b9fbcdb6dc04b1593bc57c1c651046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404729143afe43ddbdf9f4331864b84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63e17212-1fab-4390-832e-b39b55d11159 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Request method failure captured: Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-hosts/n-d-862416-4 HTTP/1.1 Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 50 Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8Zhf13f1MTXr8Fsm7XxriN0mFxwNAZ1IJy1Gt-qjsbnqzN7gphtEJf8M0eHME2P7uaLy_VtUq5O5jcK1K68VGa8hSIfTSpN16wtgBMXE9pIO-V-g0svdTOmQKJeULLVbyIno62pGtsv_M9uDtM82SZU6lY58Uko8gaNyg2Ia4kvzg Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:19.045457 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_404729143afe43ddbdf9f4331864b84d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/404729143afe43ddbdf9f4331864b84d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 404729143afe43ddbdf9f4331864b84d Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1533538816 Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4b9fbcdb6dc04b1593bc57c1c651046b Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1533538816-project Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: {"status": "enable", "maintenance_mode": "enable"} Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 26 05:01:19.046937 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'n-d-862416-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:19.047785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 26 05:01:19.049223 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.053492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63e17212-1fab-4390-832e-b39b55d11159 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.059058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63e17212-1fab-4390-832e-b39b55d11159 tempest-HostsAdminNegativeTestJSON-1533538816 tempest-HostsAdminNegativeTestJSON-1533538816-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862416-4" status: 403 len: 111 microversion: 2.1 time: 0.045503 Oct 26 05:01:19.059869 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 132/247] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:01:19 2022] PUT /compute/v2.1/os-hosts/n-d-862416-4 => generated 111 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:19.070377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-504ed8ab-c39a-4f9d-a51c-a301c63073a1 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-504ed8ab-c39a-4f9d-a51c-a301c63073a1 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 283 Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:19.082260 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:19.084381 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:01:19.085253 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.085988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.088233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.089099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:01:19.089099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:01:19.089099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:01:19.089099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.093412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-504ed8ab-c39a-4f9d-a51c-a301c63073a1 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.096146 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-504ed8ab-c39a-4f9d-a51c-a301c63073a1 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035127 Oct 26 05:01:19.100555 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 133/248] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 26 05:01:19 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:01:19.118455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a508297-0aab-457a-aa57-b46d838a765c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1454434088_new", "availability_zone": "tempest-test_az-461082806_new"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.256292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-d8d56d0b-3838-4c00-b916-708c124637bf tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:01:19.257257 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d8d56d0b-3838-4c00-b916-708c124637bf tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 26 05:01:19.257257 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d8d56d0b-3838-4c00-b916-708c124637bf tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Request method failure captured: Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-security-groups/5a51bf54-b610-4012-a298-f871f3922f3e HTTP/1.1 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8dN9H2X8VwyXmq6AtEnwQwwcWWpdkeej6iZuTdYR-gYF_62hHS61Nu09khMFSvbIKlThmgrW9iuUkabLlmx2JF3evPUtjrZayMcUZhTHNFMH0YvDQDRsZ3XtI9oKO66eZmM1PyszrGWGy2NOy-G3Hz9c6XVrP8T0TXyo5VcflREP4 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:19.262492 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 07a623cd2f4d4c00af761e342ae95663 Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: exception: Insufficient rights for removing default security group. Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] Oct 26 05:01:19.263980 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '5a51bf54-b610-4012-a298-f871f3922f3e'} Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:19.264866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 26 05:01:19.266206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.267448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d8d56d0b-3838-4c00-b916-708c124637bf tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-b8839621-5f33-4271-816b-b295b0996ed3'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.268856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d8d56d0b-3838-4c00-b916-708c124637bf tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5a51bf54-b610-4012-a298-f871f3922f3e" status: 400 len: 182 microversion: 2.1 time: 0.268795 Oct 26 05:01:19.269992 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 116/249] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:01:18 2022] DELETE /compute/v2.1/os-security-groups/5a51bf54-b610-4012-a298-f871f3922f3e => generated 182 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:01:19.284234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f805a6be-78ac-4b56-bcab-4ec5961a754d tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:19.370617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f805a6be-78ac-4b56-bcab-4ec5961a754d tempest-AggregatesAdminTestV241-828323496 tempest-AggregatesAdminTestV241-828323496-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.093455 Oct 26 05:01:19.376178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 117/250] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 05:01:19 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:19.406144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c118898b-8408-4216-ad44-98c9d0c300fe tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Action: 'update', calling method: .version_select at 0x7f470af554c0>, body: {"status": null, "maintenance_mode": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c118898b-8408-4216-ad44-98c9d0c300fe tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/os-hosts/n-d-862416-4 HTTP/1.1 Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 42 Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:19.427527 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: {"status": null, "maintenance_mode": null} Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 26 05:01:19.429444 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'n-d-862416-4', 'body': {'status': None, 'maintenance_mode': None}} Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'disable', Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'Enable', Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'Disable', Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance: Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi None Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.430403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.432100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.433440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:01:19.433440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:01:19.433440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 26 05:01:19.433440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.439999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c118898b-8408-4216-ad44-98c9d0c300fe tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.442841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c118898b-8408-4216-ad44-98c9d0c300fe tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862416-4" status: 400 len: 127 microversion: 2.1 time: 0.060627 Oct 26 05:01:19.457956 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 118/251] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:01:19 2022] PUT /compute/v2.1/os-hosts/n-d-862416-4 => generated 127 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:01:19.479428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dda43c2a-ab74-4f3a-a2f7-3d3c1ffe4f0f tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dda43c2a-ab74-4f3a-a2f7-3d3c1ffe4f0f tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 27 Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:19.502867 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: {"aggregate": {"name": ""}} Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:19.504390 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi '' Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.505269 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:01:19.506668 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.512057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dda43c2a-ab74-4f3a-a2f7-3d3c1ffe4f0f tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.515912 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dda43c2a-ab74-4f3a-a2f7-3d3c1ffe4f0f tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.060658 Oct 26 05:01:19.520180 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 119/252] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:19 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:01:19.533262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Calling method '.version_select at 0x7f470af5e670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:19.554381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a508297-0aab-457a-aa57-b46d838a765c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:19.554972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a508297-0aab-457a-aa57-b46d838a765c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:19.555490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a508297-0aab-457a-aa57-b46d838a765c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:19.631213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a508297-0aab-457a-aa57-b46d838a765c tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.526201 Oct 26 05:01:19.633643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 134/253] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 26 05:01:19 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:19.645270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40233f31-e972-4a89-974d-9f00d7a83653 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Action: 'update', calling method: .version_select at 0x7f470b135e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.657672 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.hosts [None req-40233f31-e972-4a89-974d-9f00d7a83653 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Enabling host nonexistent_hostname. Oct 26 05:01:19.688390 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-40233f31-e972-4a89-974d-9f00d7a83653 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40233f31-e972-4a89-974d-9f00d7a83653 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Request method failure captured: Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 50 Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8bgIeiCIB2XbumYN6CQ1JRS6OKdukw2w7Hg8I3fPKKBAQKar_QgfbTFregSI5ztk2JWtFd9vEK3CQTmmVaNXd8dK4dYfA-49yYi1TXpBwuwidl7pvf5QF7aad_39d14Y-UZ3v5UhvhsjxnNA6y0-bDFOYmiqq4ocP97Q9DbY56GiE Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:19.693157 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0178b24b38b4df9b4f0afaf334e202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b0178b24b38b4df9b4f0afaf334e202d Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1469934478 Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 80d2afde7c17446ca940ff8ed39abfd9 Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1469934478-project-admin Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: {"status": "enable", "maintenance_mode": "enable"} Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:19.694666 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:19.695719 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:19.696836 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 26 05:01:19.698139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.702705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40233f31-e972-4a89-974d-9f00d7a83653 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.703732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-40233f31-e972-4a89-974d-9f00d7a83653 tempest-HostsAdminNegativeTestJSON-1469934478 tempest-HostsAdminNegativeTestJSON-1469934478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.068135 Oct 26 05:01:19.713480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 135/254] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Oct 26 05:01:19 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:19.722351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-578d1ddd-8468-4f89-9db3-0db2df77c5c5 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-675498272"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.731890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-578d1ddd-8468-4f89-9db3-0db2df77c5c5 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2a984eef67c04f629171e23169bd3a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1e4d380f2749e0b4d65251821d49de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-578d1ddd-8468-4f89-9db3-0db2df77c5c5 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Request method failure captured: Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 59 Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7xrEcgImJpVTlElK2HXNl5UpabhYZheZrvcvX78ezisPRok6kkgcxYtFoCukwLnIP0cI9y6-ZKDUnhi30VxNzYvP8QgyCLoQVAAbOhizLy2TFMEg6U7SaungslRHUOiaFs1xoKYyZTt6gqTd2nHGEgxWgQdMwZirG1tO0kRdjpFPs Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:19.744436 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2a984eef67c04f629171e23169bd3a05 Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: {"aggregate": {"name": "tempest-test_aggregate-675498272"}} Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:19.745927 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-675498272'}}} Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:19.746796 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:19.748012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 26 05:01:19.749240 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:19.750954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-578d1ddd-8468-4f89-9db3-0db2df77c5c5 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:19.755192 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-578d1ddd-8468-4f89-9db3-0db2df77c5c5 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.040376 Oct 26 05:01:19.762984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 136/255] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:19 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:19.778565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-699868d0-9cdb-49ae-8628-ca79103ff700 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:19.800273 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-699868d0-9cdb-49ae-8628-ca79103ff700 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.034909 Oct 26 05:01:19.800863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 137/256] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:01:19 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:19.816918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1999f50c-d9ac-4ffc-b85c-e5bd993bc8c8 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214882806"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:19.847470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-1999f50c-d9ac-4ffc-b85c-e5bd993bc8c8 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid 2d1d542f-fc2c-462f-b4f4-efd676037b51 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:19.902330 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1999f50c-d9ac-4ffc-b85c-e5bd993bc8c8 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087088 Oct 26 05:01:19.921571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 138/257] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:19.926283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d5660efa-af18-486e-9267-ff9838329cc8 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:19.982991 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d5660efa-af18-486e-9267-ff9838329cc8 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.060241 Oct 26 05:01:19.983491 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 139/258] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:19 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:19.994028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe03baa4-f329-4087-b26f-44dc14e2bc49 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214882806"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.009786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-fe03baa4-f329-4087-b26f-44dc14e2bc49 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid c1900a0e-c8f7-4e04-85fb-5e87be93f34b for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:20.028584 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-fe03baa4-f329-4087-b26f-44dc14e2bc49 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1214882806 already exists. Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe03baa4-f329-4087-b26f-44dc14e2bc49 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 60 Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:01:20.043794 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: {"aggregate": {"name": "tempest-test_aggregate-1214882806"}} Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:20.045185 n-d-862416-4 devstack@n-api.service[120586]: exception: Aggregate tempest-test_aggregate-1214882806 already exists. Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1214882806'}}} Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 26 05:01:20.046296 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1214882806 already exists. Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:20.047349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1214882806 already exists. Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1214882806 already exists. Oct 26 05:01:20.048437 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.050707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe03baa4-f329-4087-b26f-44dc14e2bc49 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1214882806 already exists. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.051981 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe03baa4-f329-4087-b26f-44dc14e2bc49 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.063277 Oct 26 05:01:20.056142 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 140/259] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:19 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:20.064464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-999c8a49-eb6e-466a-af1d-2d64444d9fe9 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-798127035"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.074011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-999c8a49-eb6e-466a-af1d-2d64444d9fe9 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Generated uuid 125e13b9-ab26-4777-ada7-06c6bd0e2532 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:20.132221 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-999c8a49-eb6e-466a-af1d-2d64444d9fe9 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071093 Oct 26 05:01:20.133833 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 141/260] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:20.140489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7eb2ccc-b09d-4043-8f95-bad499799871 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.156485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:01:20.157219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Neutron security group 24182896-5410-49f8-be6a-f0c645e6b06c not found {{(pid=120585) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:01:20.157993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] HTTP exception thrown: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.157993 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Request method failure captured: Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-security-groups/24182896-5410-49f8-be6a-f0c645e6b06c HTTP/1.1 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8dN9H2X8VwyXmq6AtEnwQwwcWWpdkeej6iZuTdYR-gYF_62hHS61Nu09khMFSvbIKlThmgrW9iuUkabLlmx2JF3evPUtjrZayMcUZhTHNFMH0YvDQDRsZ3XtI9oKO66eZmM1PyszrGWGy2NOy-G3Hz9c6XVrP8T0TXyo5VcflREP4 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:20.160433 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 07a623cd2f4d4c00af761e342ae95663 Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] Oct 26 05:01:20.162020 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '24182896-5410-49f8-be6a-f0c645e6b06c'} Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.163046 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:01:20.164572 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.165805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Returning 404 to user: Security group 24182896-5410-49f8-be6a-f0c645e6b06c does not exist Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-c09b21f0-f12a-4e5a-b12d-7f0e47f3930f'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.167328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd30f445-f722-4e99-8c0c-2dc43c83dc5d tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/24182896-5410-49f8-be6a-f0c645e6b06c" status: 404 len: 194 microversion: 2.1 time: 0.637242 Oct 26 05:01:20.171139 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 120/261] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:01:19 2022] GET /compute/v2.1/os-security-groups/24182896-5410-49f8-be6a-f0c645e6b06c => generated 194 bytes in 645 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.180234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb63f545-b9f4-48ad-8bcc-37f3e9c57670 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.190079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7eb2ccc-b09d-4043-8f95-bad499799871 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.054908 Oct 26 05:01:20.198852 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 142/262] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:20.207066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Action: 'update', calling method: .version_select at 0x7f470b1194c0>, body: {"security_group": {"name": "tempest-sg-1522850243", "description": "tempest-description-372048541"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.216079 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb63f545-b9f4-48ad-8bcc-37f3e9c57670 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.043484 Oct 26 05:01:20.223627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 121/263] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:01:20 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:20.233827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20dfbb1e-3fa7-429a-99db-b421f6aedc1a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1970442039"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.237099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-20dfbb1e-3fa7-429a-99db-b421f6aedc1a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid 55ea7540-2021-4c93-b51b-2c6490c4688f for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:20.301622 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20dfbb1e-3fa7-429a-99db-b421f6aedc1a tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069344 Oct 26 05:01:20.311869 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 122/264] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:20.325493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ecebb87-fd00-4da5-a6f6-50acad8aad70 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.359370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:01:20.360203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Neutron security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:01:20.360909 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] HTTP exception thrown: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.360909 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Request method failure captured: Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-security-groups/9b71ed16-d1cb-4bd0-8e15-ee9f29b683de HTTP/1.1 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 101 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8dN9H2X8VwyXmq6AtEnwQwwcWWpdkeej6iZuTdYR-gYF_62hHS61Nu09khMFSvbIKlThmgrW9iuUkabLlmx2JF3evPUtjrZayMcUZhTHNFMH0YvDQDRsZ3XtI9oKO66eZmM1PyszrGWGy2NOy-G3Hz9c6XVrP8T0TXyo5VcflREP4 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:20.363017 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bbbcdc132374a9f938a30acdc3a4291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3bbbcdc132374a9f938a30acdc3a4291 Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586 Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 07a623cd2f4d4c00af761e342ae95663 Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1863966586-project Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: {"security_group": {"name": "tempest-sg-1522850243", "description": "tempest-description-372048541"}} Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:01:20.364572 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9b71ed16-d1cb-4bd0-8e15-ee9f29b683de', 'body': {'security_group': {'name': 'tempest-sg-1522850243', 'description': 'tempest-description-372048541'}}} Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:01:20.366068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:01:20.367252 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] Oct 26 05:01:20.368404 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] Returning 404 to user: Security group 9b71ed16-d1cb-4bd0-8e15-ee9f29b683de does not exist Oct 26 05:01:20.371346 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-4d925cfe-faea-403a-8cf4-3e8044e363ad'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.372241 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6b6961a3-c2d7-4526-8748-c1817190c2d4 tempest-SecurityGroupsNegativeTestJSON-1863966586 tempest-SecurityGroupsNegativeTestJSON-1863966586-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/9b71ed16-d1cb-4bd0-8e15-ee9f29b683de" status: 404 len: 194 microversion: 2.1 time: 0.170928 Oct 26 05:01:20.372992 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 143/265] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Oct 26 05:01:20 2022] PUT /compute/v2.1/os-security-groups/9b71ed16-d1cb-4bd0-8e15-ee9f29b683de => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.383946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90ec1c5d-ee57-4ea8-8ce4-618cf9f7919e tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.386595 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ecebb87-fd00-4da5-a6f6-50acad8aad70 tempest-AggregatesAdminTestJSON-1515379078 tempest-AggregatesAdminTestJSON-1515379078-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.071518 Oct 26 05:01:20.387559 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 123/266] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:20.396050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90ec1c5d-ee57-4ea8-8ce4-618cf9f7919e tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2a984eef67c04f629171e23169bd3a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1e4d380f2749e0b4d65251821d49de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:20.404683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90ec1c5d-ee57-4ea8-8ce4-618cf9f7919e tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Request method failure captured: Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7xrEcgImJpVTlElK2HXNl5UpabhYZheZrvcvX78ezisPRok6kkgcxYtFoCukwLnIP0cI9y6-ZKDUnhi30VxNzYvP8QgyCLoQVAAbOhizLy2TFMEg6U7SaungslRHUOiaFs1xoKYyZTt6gqTd2nHGEgxWgQdMwZirG1tO0kRdjpFPs Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:20.406448 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2a984eef67c04f629171e23169bd3a05 Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 26 05:01:20.407696 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '15'} Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:20.408387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 26 05:01:20.409446 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.410331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:20.415986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90ec1c5d-ee57-4ea8-8ce4-618cf9f7919e tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.417120 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90ec1c5d-ee57-4ea8-8ce4-618cf9f7919e tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.037704 Oct 26 05:01:20.417861 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 144/267] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.425438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:20.426153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:20.426668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:20.427387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:20.428653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:20.429093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:20.437077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-27816f09-ed1b-4f06-ad80-7eeeb162c506 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.475990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] HTTP exception thrown: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Request method failure captured: Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 HTTP/1.1 Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7vFTwdWRpH65n4AebetQZmTBvOE-ZNk_sJEbfb1I6fSWcaIeXe4R8KAS9s-4MY-BuZw8GVUZaEYLSw6BQnizEb2P-laFdnTkdAs3FalpfpTBB41pjE-Qlv48kIe3Qaatx6NRvpr7gbuEwqoWx1Lxm85XMGpAx-e5HI99-4HNfLvak Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3daef57793884543a153bbae8b6383b9 Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:20.492724 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3daef57793884543a153bbae8b6383b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3daef57793884543a153bbae8b6383b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3daef57793884543a153bbae8b6383b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3daef57793884543a153bbae8b6383b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3daef57793884543a153bbae8b6383b9 Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminTestJSON-87649983-project Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 8bf71dafe3d845bc9a68d90d9d729e81 Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminTestJSON-87649983-project Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.496502 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c13e941a-85ce-4cc9-b189-eb351014dee5'} Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.497385 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.498503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.501203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Returning 404 to user: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.502328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cdce6749-f489-4411-a989-277034efc900 tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 404 len: 111 microversion: 2.1 time: 0.109642 Oct 26 05:01:20.502439 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-27816f09-ed1b-4f06-ad80-7eeeb162c506 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.077818 Oct 26 05:01:20.503628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 124/268] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.506387 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 145/269] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:20.512525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66c21ab4-ddae-4a5e-9c04-cb5e396d2d27 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.526399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.531060 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-66c21ab4-ddae-4a5e-9c04-cb5e396d2d27 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 26 05:01:20.531648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] [instance: c13e941a-85ce-4cc9-b189-eb351014dee5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66c21ab4-ddae-4a5e-9c04-cb5e396d2d27 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:20.534878 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: exception: Aggregate -1 could not be found. Oct 26 05:01:20.536327 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '-1'} Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 05:01:20.537154 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.538423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.539841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.539841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.539841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.539841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.539841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 26 05:01:20.539841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.543476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66c21ab4-ddae-4a5e-9c04-cb5e396d2d27 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.543853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=80,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:20.544859 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66c21ab4-ddae-4a5e-9c04-cb5e396d2d27 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035979 Oct 26 05:01:20.549880 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 125/270] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:20.560266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eac62fbf-ea7c-4ed8-95c5-23ec9ca939d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-985951980"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.563098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:20.563894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:20.564035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:20.571774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:20.572298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:20.574605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:20.583048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-eac62fbf-ea7c-4ed8-95c5-23ec9ca939d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid b30ec5a9-88aa-496a-aa2b-acfe7d1b7ecd for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:20.620444 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eac62fbf-ea7c-4ed8-95c5-23ec9ca939d5 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064481 Oct 26 05:01:20.621938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 126/271] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:20.629208 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] HTTP exception thrown: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Request method failure captured: Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 HTTP/1.1 Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7vFTwdWRpH65n4AebetQZmTBvOE-ZNk_sJEbfb1I6fSWcaIeXe4R8KAS9s-4MY-BuZw8GVUZaEYLSw6BQnizEb2P-laFdnTkdAs3FalpfpTBB41pjE-Qlv48kIe3Qaatx6NRvpr7gbuEwqoWx1Lxm85XMGpAx-e5HI99-4HNfLvak Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3daef57793884543a153bbae8b6383b9 Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:20.631621 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3daef57793884543a153bbae8b6383b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3daef57793884543a153bbae8b6383b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3daef57793884543a153bbae8b6383b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3daef57793884543a153bbae8b6383b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3daef57793884543a153bbae8b6383b9 Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-87649983 Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminTestJSON-87649983-project Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 8bf71dafe3d845bc9a68d90d9d729e81 Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminTestJSON-87649983-project Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.633031 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c13e941a-85ce-4cc9-b189-eb351014dee5'} Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.633755 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. Oct 26 05:01:20.634851 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.635841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] Returning 404 to user: Instance c13e941a-85ce-4cc9-b189-eb351014dee5 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.635841 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2011f48a-7888-4973-975e-fd014b35bf1b tempest-AggregatesAdminTestJSON-87649983 tempest-AggregatesAdminTestJSON-87649983-project] 10.222.0.16 "GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5" status: 404 len: 111 microversion: 2.1 time: 0.123794 Oct 26 05:01:20.635841 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 146/272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:20 2022] GET /compute/v2.1/servers/c13e941a-85ce-4cc9-b189-eb351014dee5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.640174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-140dcaf6-848c-452f-aea2-648082b4ec4f tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.641820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-140dcaf6-848c-452f-aea2-648082b4ec4f tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2a984eef67c04f629171e23169bd3a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1e4d380f2749e0b4d65251821d49de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-140dcaf6-848c-452f-aea2-648082b4ec4f tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Request method failure captured: Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7xrEcgImJpVTlElK2HXNl5UpabhYZheZrvcvX78ezisPRok6kkgcxYtFoCukwLnIP0cI9y6-ZKDUnhi30VxNzYvP8QgyCLoQVAAbOhizLy2TFMEg6U7SaungslRHUOiaFs1xoKYyZTt6gqTd2nHGEgxWgQdMwZirG1tO0kRdjpFPs Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:20.643449 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2a984eef67c04f629171e23169bd3a05 Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 26 05:01:20.644655 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '16'} Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:20.645369 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.646534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-140dcaf6-848c-452f-aea2-648082b4ec4f tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.647573 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-140dcaf6-848c-452f-aea2-648082b4ec4f tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015788 Oct 26 05:01:20.654319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd407b79-d60e-4943-9e78-6dd19eaa27e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.654900 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 127/273] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:20 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.700471 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd407b79-d60e-4943-9e78-6dd19eaa27e6 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.050627 Oct 26 05:01:20.701707 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 147/274] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:20.711789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ebb2291-578d-4229-926a-b11ad4fbe4aa tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.726211 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1ebb2291-578d-4229-926a-b11ad4fbe4aa tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ebb2291-578d-4229-926a-b11ad4fbe4aa tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:20.727626 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: exception: Aggregate -1 could not be found. Oct 26 05:01:20.729121 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '-1'} Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.730008 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 26 05:01:20.732142 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.740462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ebb2291-578d-4229-926a-b11ad4fbe4aa tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.741645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ebb2291-578d-4229-926a-b11ad4fbe4aa tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034362 Oct 26 05:01:20.742410 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 128/275] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:01:20 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:20.753921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed7d389d-d77e-4b54-b93d-940dd8bd6392 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:20.756559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed7d389d-d77e-4b54-b93d-940dd8bd6392 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2a984eef67c04f629171e23169bd3a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1e4d380f2749e0b4d65251821d49de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed7d389d-d77e-4b54-b93d-940dd8bd6392 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Request method failure captured: Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL7xrEcgImJpVTlElK2HXNl5UpabhYZheZrvcvX78ezisPRok6kkgcxYtFoCukwLnIP0cI9y6-ZKDUnhi30VxNzYvP8QgyCLoQVAAbOhizLy2TFMEg6U7SaungslRHUOiaFs1xoKYyZTt6gqTd2nHGEgxWgQdMwZirG1tO0kRdjpFPs Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:01:20.759081 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2a984eef67c04f629171e23169bd3a05 Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 26 05:01:20.760307 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:20.760975 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 26 05:01:20.762058 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:01:20.765246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed7d389d-d77e-4b54-b93d-940dd8bd6392 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:20.766578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed7d389d-d77e-4b54-b93d-940dd8bd6392 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018264 Oct 26 05:01:20.771614 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 148/276] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:01:20 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:20.783701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee62b0e4-c38b-4e41-b5ab-9e572d41bb43 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1191834267"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.788064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.aggregate [None req-ee62b0e4-c38b-4e41-b5ab-9e572d41bb43 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid 85bd2cce-a7e4-4c26-b7ff-edc629767463 for aggregate {{(pid=120585) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:20.812212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=12,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:20.832645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee62b0e4-c38b-4e41-b5ab-9e572d41bb43 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053883 Oct 26 05:01:20.833591 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 129/277] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:20.846464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-754d936f-4a4b-4597-b4c5-839649f36c67 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:20.870743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754d936f-4a4b-4597-b4c5-839649f36c67 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:20.872372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754d936f-4a4b-4597-b4c5-839649f36c67 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:20.873602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754d936f-4a4b-4597-b4c5-839649f36c67 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:21.073647 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-754d936f-4a4b-4597-b4c5-839649f36c67 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.232105 Oct 26 05:01:21.075260 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 149/278] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:01:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:21.087946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d547dce7-e5d0-415f-8b0d-cc8fa94bf039 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:21.097091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d547dce7-e5d0-415f-8b0d-cc8fa94bf039 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2a984eef67c04f629171e23169bd3a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1e4d380f2749e0b4d65251821d49de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d547dce7-e5d0-415f-8b0d-cc8fa94bf039 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Request method failure captured: Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 42 Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7xrEcgImJpVTlElK2HXNl5UpabhYZheZrvcvX78ezisPRok6kkgcxYtFoCukwLnIP0cI9y6-ZKDUnhi30VxNzYvP8QgyCLoQVAAbOhizLy2TFMEg6U7SaungslRHUOiaFs1xoKYyZTt6gqTd2nHGEgxWgQdMwZirG1tO0kRdjpFPs Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:01:21.099317 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1e4d380f2749e0b4d65251821d49de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a1e4d380f2749e0b4d65251821d49de Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706 Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2a984eef67c04f629171e23169bd3a05 Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2094808706-project Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: {"remove_host": {"host": "n-h1-862416-4"}} Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:21.100594 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-862416-4'}}} Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:21.101359 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 26 05:01:21.102418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.104975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d547dce7-e5d0-415f-8b0d-cc8fa94bf039 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:21.106078 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d547dce7-e5d0-415f-8b0d-cc8fa94bf039 tempest-AggregatesAdminNegativeTestJSON-2094808706 tempest-AggregatesAdminNegativeTestJSON-2094808706-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.022960 Oct 26 05:01:21.107197 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 130/279] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:01:21 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:01:21.117053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17d2abfc-a187-48a3-900e-3da3be9880de tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:21.130624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17d2abfc-a187-48a3-900e-3da3be9880de tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:21.131984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17d2abfc-a187-48a3-900e-3da3be9880de tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:21.132739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17d2abfc-a187-48a3-900e-3da3be9880de tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:21.316414 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-17d2abfc-a187-48a3-900e-3da3be9880de tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.204609 Oct 26 05:01:21.317685 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 150/280] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:01:21 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:21.330360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1b84a22-2783-4041-9052-0b905a658627 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:21.375899 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1b84a22-2783-4041-9052-0b905a658627 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.049347 Oct 26 05:01:21.376848 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 131/281] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:21 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:21.384513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:21.388894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-495a8723-c05a-47db-b92f-4ccae1d95bf7 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-580633196"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:21.392483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-495a8723-c05a-47db-b92f-4ccae1d95bf7 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Generated uuid d5dc79f3-10ba-437c-a221-646e8dd1c394 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:01:21.445537 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-495a8723-c05a-47db-b92f-4ccae1d95bf7 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061779 Oct 26 05:01:21.451851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 151/282] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:01:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:21.468584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:21.488689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:21.489181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:21.489652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:21.522212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:21.522711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:21.523156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:21.560964 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.compute.aggregates [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 26 05:01:21.564908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Request method failure captured: Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 42 Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL7zSUQ4JiDo2D8gAiZIWoIVl-m_XlHEdTjVi2jdHZSXMEcCUl26H5T29YL1-pnq0zBJj54xK_XeL2KO_U2BtlrUDOOPYY625Gog9-ZVvXY95MuXA1S4mGusLegKaHyYXiVd8ZZwITozeutvp0n5XFCuqK063GHj-27INFlNdOQz88M Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:01:21.575243 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f94396ec53742949f75d4a13922d77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f94396ec53742949f75d4a13922d77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f94396ec53742949f75d4a13922d77e Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852 Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e2b533a67c01459aa21403a1151c9c63 Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: {"remove_host": {"host": "nonexist_host"}} Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:01:21.576542 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 26 05:01:21.577283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 26 05:01:21.578439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.579636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:01:21.580887 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:01:21.580887 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:01:21.580887 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:01:21.580887 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:01:21.580887 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 26 05:01:21.580887 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:01:21.583591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:01:21.585219 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2a86032-53a8-46cd-b702-208bee25db5d tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.120478 Oct 26 05:01:21.586154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 132/283] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:01:21 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:01:21.595653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92b818bf-b930-4a7e-85c6-7b5ccf7fe365 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:21.631893 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92b818bf-b930-4a7e-85c6-7b5ccf7fe365 tempest-AggregatesAdminNegativeTestJSON-1929768852 tempest-AggregatesAdminNegativeTestJSON-1929768852-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.040544 Oct 26 05:01:21.633928 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 152/284] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:21 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:32.215478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=36 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.217672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.218656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=9 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.219568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.646830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71337331-0bf4-4fc3-8b67-1080b9d82c26 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1151331570", "ram": 512, "vcpus": 1, "disk": 10, "id": 1013017774, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:32.672383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.674221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=29 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.675169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:32.700543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71337331-0bf4-4fc3-8b67-1080b9d82c26 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.485727 Oct 26 05:01:32.704906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 133/285] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:01:32 2022] POST /compute/v2.1/flavors => generated 416 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:32.718311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f4b8d67-f0cf-4f38-bd34-ca09a86ed228 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:32.826993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f4b8d67-f0cf-4f38-bd34-ca09a86ed228 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.112352 Oct 26 05:01:32.831353 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 134/286] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 26 05:01:32 2022] POST /compute/v2.1/flavors/1013017774/os-extra_specs => generated 66 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:32.848506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Action: 'update', calling method: .version_select at 0x7f470b144ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:33.104788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d834e6f1-604b-4104-aa9b-91903bb0f13e tempest-FlavorsExtraSpecsTestJSON-1257261550 tempest-FlavorsExtraSpecsTestJSON-1257261550-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.150760 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d834e6f1-604b-4104-aa9b-91903bb0f13e tempest-FlavorsExtraSpecsTestJSON-1257261550 tempest-FlavorsExtraSpecsTestJSON-1257261550-project] 10.222.0.16 "GET /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.313986 Oct 26 05:01:33.154242 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 135/287] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 26 05:01:32 2022] GET /compute/v2.1/flavors/1013017774/os-extra_specs => generated 66 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:01:33.165117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab4c872f-3d1a-4fd7-a53b-b4e2b886ab55 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:33.228635 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab4c872f-3d1a-4fd7-a53b-b4e2b886ab55 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068134 Oct 26 05:01:33.233282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 136/288] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 26 05:01:33 2022] POST /compute/v2.1/flavors/1013017774/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.246450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b874353-34d2-46a3-bf40-b9155da26173 tempest-FlavorsExtraSpecsTestJSON-1257261550 tempest-FlavorsExtraSpecsTestJSON-1257261550-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.262831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b874353-34d2-46a3-bf40-b9155da26173 tempest-FlavorsExtraSpecsTestJSON-1257261550 tempest-FlavorsExtraSpecsTestJSON-1257261550-project] 10.222.0.16 "GET /compute/v2.1/flavors/1013017774/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.027356 Oct 26 05:01:33.263996 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 137/289] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:01:33 2022] GET /compute/v2.1/flavors/1013017774/os-extra_specs/hw:numa_nodes => generated 22 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.294652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-18a71e37-019a-4b42-87d5-543ab22d8b9a tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:33.365646 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-18a71e37-019a-4b42-87d5-543ab22d8b9a tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.086944 Oct 26 05:01:33.367573 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 138/290] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 26 05:01:33 2022] POST /compute/v2.1/flavors/1013017774/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.382408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c13653fb-a58c-41eb-86ed-9dfa7a1b0c7e tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.393275 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c13653fb-a58c-41eb-86ed-9dfa7a1b0c7e tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020338 Oct 26 05:01:33.394669 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 139/291] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 26 05:01:33 2022] GET /compute/v2.1/flavors/1013017774/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.398131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:33.402277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:33.408766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:33.411587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:33.418489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:33.418879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:33.421248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e8c2a1e-8e94-4e59-b281-3988130f0d60 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:33.540717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e8c2a1e-8e94-4e59-b281-3988130f0d60 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1013017774/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.137936 Oct 26 05:01:33.543406 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 140/292] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 26 05:01:33 2022] PUT /compute/v2.1/flavors/1013017774/os-extra_specs/hw:numa_nodes => generated 22 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.555216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c8442e7-8ed5-4efc-92c3-6f48f75982b5 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.575874 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c8442e7-8ed5-4efc-92c3-6f48f75982b5 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026275 Oct 26 05:01:33.577190 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 141/293] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 26 05:01:33 2022] GET /compute/v2.1/flavors/1013017774/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.588328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4b5ba1f-33a4-4eb0-9ca4-267ac51c0e9a tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.660892 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30497342-1b4c-4ec6-88da-87382598422a tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5" status: 200 len: 240 microversion: 2.36 time: 0.977253 Oct 26 05:01:33.663252 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 153/294] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Oct 26 05:01:32 2022] PUT /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5 => generated 240 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:01:33.671591 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4b5ba1f-33a4-4eb0-9ca4-267ac51c0e9a tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1013017774/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.088758 Oct 26 05:01:33.672164 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 142/295] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:01:33 2022] DELETE /compute/v2.1/flavors/1013017774/os-extra_specs/hw:numa_nodes => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:33.693582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8648dd0b-450e-4d6d-a75b-ecb3ef4b3b0e tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.696941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Calling method '.version_select at 0x7f470b135dc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.753658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8648dd0b-450e-4d6d-a75b-ecb3ef4b3b0e tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1013017774/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.072906 Oct 26 05:01:33.754252 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 143/296] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:01:33 2022] DELETE /compute/v2.1/flavors/1013017774/os-extra_specs/hw:cpu_policy => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:01:33.782490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d96be247-7afe-4ea0-9d46-9a8fc7c25f03 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.802802 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d96be247-7afe-4ea0-9d46-9a8fc7c25f03 tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1013017774/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025144 Oct 26 05:01:33.818417 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 144/297] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 26 05:01:33 2022] GET /compute/v2.1/flavors/1013017774/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:33.824318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-400c44dd-4b26-480d-ad2a-246fceee0a9c tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.870270 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-400c44dd-4b26-480d-ad2a-246fceee0a9c tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1013017774" status: 202 len: 0 microversion: 2.1 time: 0.050334 Oct 26 05:01:33.874457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 145/298] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:01:33 2022] DELETE /compute/v2.1/flavors/1013017774 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:01:33.885776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0371968e-354f-4670-acfc-2dfe5d402b4d tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:33.925559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0371968e-354f-4670-acfc-2dfe5d402b4d tempest-FlavorsExtraSpecsTestJSON-1712048449 tempest-FlavorsExtraSpecsTestJSON-1712048449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049890 Oct 26 05:01:33.960754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 146/299] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:01:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:34.241606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:34.242111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:34.244745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:34.247081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:34.247578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:34.249784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:34.296197 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d8747cb-6caa-4524-86a2-d644cd76801e tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5/detail" status: 200 len: 672 microversion: 2.36 time: 0.610882 Oct 26 05:01:34.303161 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 154/300] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 26 05:01:33 2022] GET /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5/detail => generated 672 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:01:34.940224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-503250548", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:35.023713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Action: 'update', calling method: .version_select at 0x7f470b3afaf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:35.051578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:01:35.678282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:35.680727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:35.681459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:35.683857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:35.687166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:35.687853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:35.822730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:35.825118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:35.826063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:35.828255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:35.830348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:35.831070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:36.002846 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-687a109f-69a5-4fe8-aeb7-75c8b493ee99 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5?user_id=647d6cfd610a4148a8fa101c4e6b506a" status: 200 len: 240 microversion: 2.36 time: 0.993794 Oct 26 05:01:36.014378 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 155/301] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Oct 26 05:01:35 2022] PUT /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5?user_id=647d6cfd610a4148a8fa101c4e6b506a => generated 240 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:36.021140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8cb80a4-afd1-432b-ad02-8b4622793cd1 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] Calling method '.version_select at 0x7f470b1621f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:36.485246 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8cb80a4-afd1-432b-ad02-8b4622793cd1 tempest-QuotasAdminTestV236-338947604 tempest-QuotasAdminTestV236-338947604-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5?user_id=647d6cfd610a4148a8fa101c4e6b506a" status: 200 len: 282 microversion: 2.36 time: 0.468592 Oct 26 05:01:36.485891 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 156/302] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 26 05:01:36 2022] GET /compute/v2.1/os-quota-sets/99f5c8765632413482f1fddfb2780ef5?user_id=647d6cfd610a4148a8fa101c4e6b506a => generated 282 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:01:36.791968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:01:36.792632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:01:36.793112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:01:36.793598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:01:36.794007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:01:36.835329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:36.837068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:36.840001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:36.842606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:36.843825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:36.844878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:36.909822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Getting quotas for project 965954d969624da4bfa8d8c5153abbcf. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:01:36.922393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Getting quotas for user 53b1b64963ee47d98f03ae09a7ff9f57 and project 965954d969624da4bfa8d8c5153abbcf. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:01:36.962032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:01:36.968304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:01:37.118088 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-99b57921-e7cf-4c3d-8260-1f0fdc9aba9d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.756804 Oct 26 05:01:37.125063 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 147/303] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:01:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:01:37.142138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9dd5107a-8c9d-43fb-8ec6-69c8a365b824 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:37.143354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9dd5107a-8c9d-43fb-8ec6-69c8a365b824 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:37.605961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9dd5107a-8c9d-43fb-8ec6-69c8a365b824 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:37.635442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9dd5107a-8c9d-43fb-8ec6-69c8a365b824 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1219 microversion: 2.1 time: 0.507783 Oct 26 05:01:37.636034 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 157/304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:37 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1219 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:01:38.659590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a36005d3-9d41-4f95-afb0-5522bd822da5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:38.660947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a36005d3-9d41-4f95-afb0-5522bd822da5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:38.664397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:39.002630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a36005d3-9d41-4f95-afb0-5522bd822da5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:39.015340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a36005d3-9d41-4f95-afb0-5522bd822da5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1219 microversion: 2.1 time: 0.360177 Oct 26 05:01:39.029459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 148/305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:38 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1219 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:40.064779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:40.065283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:40.095855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:40.097436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:40.102307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:40.104867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:40.111452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:40.118549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:40.348195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:40.364838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0fdb63dc-2315-4888-92e7-e88203fbe1be tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1289 microversion: 2.1 time: 0.317607 Oct 26 05:01:40.385792 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 158/306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:40 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1289 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:41.395281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:41.404886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:41.422440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:41.423437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:41.424136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:41.426280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:41.427417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:41.429115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:41.812879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:41.846582 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2960dc3e-0b8e-49e7-aa9b-6a0aa06b9f8d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.450891 Oct 26 05:01:41.850381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 149/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:41 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:42.871306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:42.872426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:42.883835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:42.888655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:42.889065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:42.896644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:42.906099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:42.908859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:43.209034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:43.222281 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca08d02f-09f2-4619-9e88-57ca5b1471f7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.352401 Oct 26 05:01:43.240017 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 159/308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:42 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:43.829275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470b09baf0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:43.835012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:43.837023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:43.837023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:43.837994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:43.838782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:43.839508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:43.883129 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57ac1383-5b99-4f87-b2b7-81d3407f142c tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.282599 Oct 26 05:01:43.884232 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 150/309] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 26 05:01:43 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:43.897111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470b0e0280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:43.900832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:43.901337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:43.901980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:43.902694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:43.903472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:43.904064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:43.953087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92f1cf89-ad45-4c29-849f-23e4c70eb7e1 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.058251 Oct 26 05:01:43.955537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 160/310] 10.222.0.16 () {58 vars in 1139 bytes} [Wed Oct 26 05:01:43 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:43.968912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470af97e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:43.975035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:43.975882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:43.976653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:43.978042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:43.978824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:43.979440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.016817 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-78c8379e-d495-48d9-a10f-649af24e4935 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.053105 Oct 26 05:01:44.017940 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 151/311] 10.222.0.16 () {58 vars in 1145 bytes} [Wed Oct 26 05:01:43 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:01:44.030009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470b0e00d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:44.034602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.035337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.035965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.037853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.038923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.039538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.072047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e9fdc03-ac34-42c9-9964-d55eddd05887 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.046259 Oct 26 05:01:44.073392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 161/312] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 26 05:01:44 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:44.091573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470af5e940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:44.099611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.100311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.100923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.102026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.102687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.103656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.147620 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7fd151ba-3161-4654-84bf-136a92dd43e7 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.067245 Oct 26 05:01:44.148757 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 152/313] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:01:44 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:44.160427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470b0b8f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:44.164051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.165281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.165937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.166998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.167616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.168206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.219570 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d132d8c3-a14c-470a-82c3-a4ba751d0369 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.063463 Oct 26 05:01:44.226010 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 162/314] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 26 05:01:44 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:44.235561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470af97ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:44.253268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:44.254081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:44.266595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.269636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.275038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.278960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.282188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.287669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.289092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.296079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.298024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.312130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.316416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.317044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.331838 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46112a0d-76f9-497d-acc5-a01e4d708226 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-862416-4" status: 200 len: 332 microversion: 2.1 time: 0.101135 Oct 26 05:01:44.332968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 153/315] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:01:44 2022] GET /compute/v2.1/os-hosts/n-h1-862416-4 => generated 332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:44.351084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Calling method '.version_select at 0x7f470af5edc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:44.362494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.363272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.363877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.386345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:44.387163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:44.388194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:44.444746 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-113baa1a-aa61-45ee-9cb2-0549e3e800e4 tempest-HostsAdminTestJSON-842789930 tempest-HostsAdminTestJSON-842789930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-862416-4" status: 200 len: 467 microversion: 2.1 time: 0.093560 Oct 26 05:01:44.459424 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:01:44 2022] GET /compute/v2.1/os-hosts/n-h2-862416-4 => generated 467 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:44.662301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:44.687005 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a6a9596-77e1-4f73-b3bb-8ade4b7006f4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.438806 Oct 26 05:01:44.690464 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 163/317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:44 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:01:45.718406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:45.719444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:45.734818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:45.739123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:45.740518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:45.744613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:45.745719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:45.746279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:46.006165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:46.023455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fce82123-6c0a-459f-a4cd-249ee1027be6 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.310051 Oct 26 05:01:46.024468 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 155/318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:45 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:47.046703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:47.047323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:47.059782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:47.064708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:47.065539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:47.066293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:47.066865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:47.068433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:47.424191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:47.448101 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a61fbeb3-52f4-47ad-8ef6-c24c0312b9e7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.402233 Oct 26 05:01:47.448940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 164/319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:47 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:48.474297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:48.475719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:48.490956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:48.491450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:48.491913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:48.492630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:48.493089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:48.493726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:48.565806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=28 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:48.830863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-154652638", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:48.975097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:01:49.007514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:49.201438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:49.232123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58be5421-f2e6-47c7-b6b4-f18fe384a7bf tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.760172 Oct 26 05:01:49.234947 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:48 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:50.261498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:50.262138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:50.289051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:50.291526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:50.292000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:50.300592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:50.301096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:50.303841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:50.654716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:50.670630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e3d3fcde-2031-40b5-8f55-a5689406c1d1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.414101 Oct 26 05:01:50.672017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 157/321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:50 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:51.095303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:01:51.096010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:01:51.096578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:01:51.097082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:01:51.097843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:01:51.108907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:51.109940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:51.110644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:51.111626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:51.112308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:51.112953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:51.131909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Getting quotas for project b27808642e3a4e089823c56242eddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:01:51.136356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Getting quotas for user 7cc07d881f794f6f8a8516aabbfdb1fd and project b27808642e3a4e089823c56242eddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:01:51.153231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:01:51.160004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:01:51.287492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2ddd5cb-ffe7-47d6-9a8a-8b183f81c0f9 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.737977 Oct 26 05:01:51.289835 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 165/322] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:01:51.301750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09c616e7-f577-4e64-9b65-d63659238964 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:51.302721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09c616e7-f577-4e64-9b65-d63659238964 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:51.549533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09c616e7-f577-4e64-9b65-d63659238964 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:51.562652 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09c616e7-f577-4e64-9b65-d63659238964 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1221 microversion: 2.1 time: 0.264835 Oct 26 05:01:51.579029 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 158/323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:51 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1221 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:51.701830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:51.707590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:51.721145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:51.727090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:51.731187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:51.731807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:51.732287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:51.732714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:52.099144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:52.117986 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6438dd21-ed63-4122-baf4-62e483de6383 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.411797 Oct 26 05:01:52.119222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 166/324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:51 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:52.593901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:52.595193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:52.605573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:52.608187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:52.610744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:52.612178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:52.619023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:52.620940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:53.076243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:53.088094 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-944a1324-c080-4d35-8d94-a0824337e8bb tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1217 microversion: 2.1 time: 0.498315 Oct 26 05:01:53.088678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 159/325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:52 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1217 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:53.152377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:53.156091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:53.203173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:53.204470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:53.206411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:53.218278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:53.221048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:53.224394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:53.676171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:53.693966 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92c796d2-eb3c-4500-8d43-fe109245f8c3 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1277 microversion: 2.1 time: 0.543276 Oct 26 05:01:53.696440 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 167/326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:53 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1277 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:54.118410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:54.124159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:54.124771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:54.140519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:54.141620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:54.142415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:54.143352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:54.143961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:54.144658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:54.853911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ea4563b-0ce9-471b-9d5c-48037a6f466d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Action: 'create', calling method: .version_select at 0x7f470b0b8700>, body: {"keypair": {"name": "tempest-keypair-443406264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxXqJJAHJYVYbl9nFuys+MXMgQTstY61q4/n5JfUp/iuu6P/5Gm7RY8Uce3ljLuYJ12INkyzhsoMVTHoCU9C7Y2dlffKkYsH40neoYBekU/hAeLKqrnFIwGmWkGzRVoxg=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:54.883903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-2ea4563b-0ce9-471b-9d5c-48037a6f466d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Getting quotas for project 9d7502893a23432b9fc6c62e0bc16bd8. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:01:54.900500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-2ea4563b-0ce9-471b-9d5c-48037a6f466d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Getting quotas for user 22789122ff404e5289a9efef34bec9c0 and project 9d7502893a23432b9fc6c62e0bc16bd8. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:01:54.907003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:01:54.958678 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ea4563b-0ce9-471b-9d5c-48037a6f466d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.522803 Oct 26 05:01:54.965442 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 168/327] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:01:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:01:54.975986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:54.977969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:54.992979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:54.993506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:54.993957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:54.994669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:55.000891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:55.001382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:55.172525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:55.182687 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24cc7bba-4ed5-40f7-ae60-8b822af37de7 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1279 microversion: 2.1 time: 1.071281 Oct 26 05:01:55.190154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 160/328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:54 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1279 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:55.856965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:55.875162 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e1970f1-ff6b-4dfe-8cdd-a5c1968d563c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 0.908240 Oct 26 05:01:55.875754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 169/329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:54 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:56.210341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:56.211606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:56.228356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:56.228859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:56.229302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:56.230045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:56.230501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:56.231102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:56.661193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:56.671645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f952efe4-602e-4cf9-939d-e8158c3ef10b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1279 microversion: 2.1 time: 0.465106 Oct 26 05:01:56.682484 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 161/330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:56 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1279 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:56.901910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:56.904616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:56.924060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:56.924764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:56.925602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:56.927097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:56.928018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:56.928617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:57.711368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:57.711882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:57.729929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:57.735019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:57.735566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:57.741138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:57.747031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:57.748970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:58.512347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:58.521988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffab4ef8-b621-4282-b0ff-2421de0ceb15 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 1.626276 Oct 26 05:01:58.526283 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 170/331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:56 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:58.544578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-262009215", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f129fa6d-2f4b-4c28-a189-c1be9342ea85"}], "security_groups": [{"name": "tempest-securitygroup--1617166990"}], "key_name": "tempest-keypair-443406264", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:01:59.147883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:01:59.162387 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2ce9b7b-7796-4e06-9b10-f136451cf210 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1279 microversion: 2.1 time: 1.457710 Oct 26 05:01:59.162980 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 162/332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:57 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1279 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:01:59.554886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:01:59.555499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:01:59.592328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:59.592843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:59.593457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:01:59.594262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:01:59.600956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:01:59.601631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:00.375394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] validate_networks() for [('f129fa6d-2f4b-4c28-a189-c1be9342ea85', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:01.123251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=17 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:01.554532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:02.148062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:02.155790 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-180899f1-aa52-4ec2-a216-fd58259c15ad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 2.605974 Oct 26 05:02:02.156361 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 163/333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:01:59 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 2607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:02.160921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:02.170260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:02.182149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:02.182646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:02.183078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:02.184678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:02.187518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:02.190699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:02.992950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:02.995264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=77 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:03.008844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af9a96b6-6b5b-4383-837b-9c697762106c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 0.851384 Oct 26 05:02:03.010774 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:02 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:03.425878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-130543117", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:03.512291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:04.207064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Getting quotas for project 9d7502893a23432b9fc6c62e0bc16bd8. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:04.217261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Getting quotas for user 22789122ff404e5289a9efef34bec9c0 and project 9d7502893a23432b9fc6c62e0bc16bd8. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:04.236932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:04.237773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:04.238995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:04.239635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:04.240267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:04.251137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:04.252801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:04.253694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:04.255196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:04.255871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:04.256517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:04.268831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=66 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:04.287865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Getting quotas for project 9d7502893a23432b9fc6c62e0bc16bd8. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:04.294316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Getting quotas for user 22789122ff404e5289a9efef34bec9c0 and project 9d7502893a23432b9fc6c62e0bc16bd8. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:04.308219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:04.311409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:04.396882 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cca255ef-485b-441b-a62d-543a025b8505 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 5.867980 Oct 26 05:02:04.399686 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 171/335] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:01:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 5872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:02:04.545002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1330742890", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:04.636436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:04.636870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:04.637375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:04.637792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:04.638208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:04.660165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:04.661175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:04.662012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:04.662920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:04.663794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:04.664399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:04.699014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Getting quotas for project 0afdd3fab56f4868850ef5e796d1039b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:04.706894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Getting quotas for user acd47aa3aeb74072b6a7e91206732719 and project 0afdd3fab56f4868850ef5e796d1039b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:04.723607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:04.727658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:04.791099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:04.791603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:04.792022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:04.795073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:04.795776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:04.857355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:04.862257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:04.862740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:04.867400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:04.867944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:04.868392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:04.936418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:04.943764 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0e947b2-4a6a-4256-9be8-3f2f8570c8f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.541682 Oct 26 05:02:04.944459 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 172/336] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:02:04.953864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for user 5e48790bfe71452288c91f49586a624e and project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:04.968353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-98fe84cb-885b-4692-a2d8-5b7e82e9ca22 req-c0f4ad90-c83b-4efd-a142-18a3ec0cc0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc4f2b7-fece-4f86-8263-7b736049adc6", "tag": "a57ce4e6-9606-4bb8-beab-246b2f4f2757"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:04.980333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:04.985122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:05.024454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-98fe84cb-885b-4692-a2d8-5b7e82e9ca22 req-c0f4ad90-c83b-4efd-a142-18a3ec0cc0d2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:05.024947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-98fe84cb-885b-4692-a2d8-5b7e82e9ca22 req-c0f4ad90-c83b-4efd-a142-18a3ec0cc0d2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:05.025483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-98fe84cb-885b-4692-a2d8-5b7e82e9ca22 req-c0f4ad90-c83b-4efd-a142-18a3ec0cc0d2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:05.083752 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-98fe84cb-885b-4692-a2d8-5b7e82e9ca22 req-c0f4ad90-c83b-4efd-a142-18a3ec0cc0d2 service nova] Creating event network-changed:a57ce4e6-9606-4bb8-beab-246b2f4f2757 for instance afc4f2b7-fece-4f86-8263-7b736049adc6 on n-h2-862416-4 Oct 26 05:02:05.088443 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6fa3e215-1c6f-4b3d-9182-44455c39b080 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074323 Oct 26 05:02:05.097035 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 165/337] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:02:05.103007 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-98fe84cb-885b-4692-a2d8-5b7e82e9ca22 req-c0f4ad90-c83b-4efd-a142-18a3ec0cc0d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152689 Oct 26 05:02:05.104094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:05.105150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:05.108361 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 173/338] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:05.113947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:05.114748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:05.115458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:05.116436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:05.117259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:05.117886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:05.337477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-197181259", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bc063782-2e7c-4930-8052-d7ca13d54283"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:05.474380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] validate_networks() for [('bc063782-2e7c-4930-8052-d7ca13d54283', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:06.604209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:06.647559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82782874-d9a0-4ca1-a750-347e2973e91d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 1.542843 Oct 26 05:02:06.665340 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 166/339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:05 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:06.673711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:06.673711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:06.686460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:06.687349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:06.687991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:06.693053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:06.693787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:06.694430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.127493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:07.136940 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d0a10100-4342-4c62-863a-8f67fa98ce21 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 0.482822 Oct 26 05:02:07.137849 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 167/340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:06 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:07.167609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:07.168909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:07.185357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.185971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.186718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.187442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.187910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.188339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.374486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:07.375453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:07.376082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:07.376637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:07.377217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:07.391323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.391827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.392272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.393019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.404838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.405444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.436529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:07.447379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:07.448920 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3eede3ef-6db8-47cb-b974-893b443b9f3d tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1264 microversion: 2.1 time: 0.290634 Oct 26 05:02:07.454203 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 168/341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:07 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1264 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:07.458439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for user b36c8ac2dee24d33b680608a740463bb and project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:07.459509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:07.462009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:07.482655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.483157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.483603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.483809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:07.484318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.484778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.485209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.490736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:07.599728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00367c0c-3d3d-433c-b0f1-95ce759f462c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.482358 Oct 26 05:02:07.601032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 174/342] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:02:07.609224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:07.610463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:07.625101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.626271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.626886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.628495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.631852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.632832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.797930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:07.811053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e7000d1-11d2-490f-be35-d2e9724e0728 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1216 microversion: 2.1 time: 0.205137 Oct 26 05:02:07.811666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 175/343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:07 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1216 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:07.828554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-cdc3e12e-296a-4945-ad29-c3510b36a443 req-4248f4d8-0d8a-4b6f-90cb-7da852acf8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8ffcad-160b-4442-a101-a3cbda282f28", "tag": "d997e858-1a7f-4971-9079-dc1e0001a924"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:07.845949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:07.858622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cdc3e12e-296a-4945-ad29-c3510b36a443 req-4248f4d8-0d8a-4b6f-90cb-7da852acf8d3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.859613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cdc3e12e-296a-4945-ad29-c3510b36a443 req-4248f4d8-0d8a-4b6f-90cb-7da852acf8d3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.860933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cdc3e12e-296a-4945-ad29-c3510b36a443 req-4248f4d8-0d8a-4b6f-90cb-7da852acf8d3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.874104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:07.890294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:07.892919 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-cdc3e12e-296a-4945-ad29-c3510b36a443 req-4248f4d8-0d8a-4b6f-90cb-7da852acf8d3 service nova] Creating event network-changed:d997e858-1a7f-4971-9079-dc1e0001a924 for instance bb8ffcad-160b-4442-a101-a3cbda282f28 on n-h1-862416-4 Oct 26 05:02:07.909001 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-cdc3e12e-296a-4945-ad29-c3510b36a443 req-4248f4d8-0d8a-4b6f-90cb-7da852acf8d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091299 Oct 26 05:02:07.910012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 176/344] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:07.923177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0b4db37-d81a-41fa-a46b-5dc083262710 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:07.923891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0b4db37-d81a-41fa-a46b-5dc083262710 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:07.925821 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d361113e-48c0-4ed7-b2ab-59f2dd05c940 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "PUT /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1363 microversion: 2.75 time: 0.470137 Oct 26 05:02:07.931059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 169/345] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Oct 26 05:02:07 2022] PUT /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:07.941913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:07.949551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:07.964820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.966246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.966977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:07.970684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:07.972503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:07.973340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:08.123499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a0b4db37-d81a-41fa-a46b-5dc083262710 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:08.135384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a0b4db37-d81a-41fa-a46b-5dc083262710 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:08.145945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a0b4db37-d81a-41fa-a46b-5dc083262710 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:08.147539 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0b4db37-d81a-41fa-a46b-5dc083262710 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1261 microversion: 2.25 time: 0.235226 Oct 26 05:02:08.160804 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 177/346] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:07 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:08.174800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:08.178079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:08.194488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:08.195628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:08.196840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:08.198113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:08.199964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:08.201380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:08.798978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:08.814602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:08.821160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:08.841304 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd5cf76f-eb11-4578-9699-6cebdda01674 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1363 microversion: 2.75 time: 0.678880 Oct 26 05:02:08.841920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 178/347] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:08 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1363 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:08.868175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:08.869699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:08.877707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:08.878374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:08.879557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:08.880464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:08.881096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:08.881718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:09.113286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:09.128865 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-beb3b2e7-b73e-4e19-9695-777b9a8e2e3c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 1.195150 Oct 26 05:02:09.165515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 170/348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:07 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:09.177236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:09.177905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:09.179974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:09.209293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:09.216295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:09.216773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:09.217558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:09.218016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:09.227113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:09.803795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:09.814137 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d36a4634-081a-44c3-9dc3-0183ab4acf9e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1320 microversion: 2.1 time: 0.646814 Oct 26 05:02:09.831578 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 171/349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:09 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1320 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:09.831578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:09.832253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:09.851100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:09.856851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:09.857339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:09.858109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:09.858724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:09.859007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:09.935506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:09.946118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f7c4299-c2d6-496b-badd-d702db47560a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 1.091184 Oct 26 05:02:09.946643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 179/350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:08 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:09.955815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:09.966227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:09.979614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:09.980280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:09.980835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:09.981695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:09.982276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:09.982821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.131917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.140741 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d4c5be6-b53f-4e24-a16d-e15bfb58d971 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1208 microversion: 2.1 time: 0.322226 Oct 26 05:02:10.141210 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 172/351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:09 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1208 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:10.311563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.321057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.322810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.324185 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ab7ef2a-3e2e-41ab-a23b-a4850982bab0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1257 microversion: 2.25 time: 0.375882 Oct 26 05:02:10.325077 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 180/352] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:09 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1257 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:10.330338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:10.331222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:10.343431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:10.345288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:10.356719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.357591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:10.358089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:10.366955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.473400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4fe99e6-a428-4e4f-82fe-cef32e99d34f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Action: 'create', calling method: .version_select at 0x7f470ae95af0>, body: {"keypair": {"name": "tempest-keypair-1796051392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/zuVYWpDmXnMAdc0jG2Enx8/IyUEWU8l7s+u14egDWgrryBxTxSnhdJMBoWmJfR0BoiD3FTx6h0eUc1TZu58OC2zBgViocEaNCvnRb3Qivw6qRUwFEI7y6z4rTq1kl9w=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:10.507016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e4fe99e6-a428-4e4f-82fe-cef32e99d34f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Getting quotas for project bc3201d6ec664f51a56170294f242a6c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:10.511931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e4fe99e6-a428-4e4f-82fe-cef32e99d34f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Getting quotas for user dd5ce89745564263bab98d4227858c97 and project bc3201d6ec664f51a56170294f242a6c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:10.526365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.542488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.548121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.556078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a63a0dd-6af2-44d8-b972-513540a50b07 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1419 microversion: 2.75 time: 0.229600 Oct 26 05:02:10.564192 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 181/353] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:10 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1419 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:10.584436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:10.585762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:10.592886 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4fe99e6-a428-4e4f-82fe-cef32e99d34f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446124 Oct 26 05:02:10.593052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:10.593569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:10.594022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.595048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:10.595183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:10.595901 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 173/354] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:02:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:10.596026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.844098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:10.845343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:10.855374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:10.856103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:10.865501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.866960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:10.867606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:10.868206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:10.982031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:10.999161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c81e396-3d2f-4a9b-931f-34496ed10ddb tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 0.433426 Oct 26 05:02:11.002362 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 182/355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:10 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:11.008857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:11.010986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:11.028742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.029515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.033151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.034209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.034928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.036290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.041976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.057598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43fd0391-47e5-448a-894c-1047015f7b8a tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1326 microversion: 2.1 time: 0.218810 Oct 26 05:02:11.058802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 174/356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:10 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1326 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:11.166753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:11.169115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:11.183472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.184345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.185036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.186907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.187697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.188356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.303192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.327232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed7679f9-bfa0-45bb-9687-e9745b4ca53a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1264 microversion: 2.1 time: 0.164870 Oct 26 05:02:11.333939 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 175/357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:11 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:11.357698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:11.358321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:11.367741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.370779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.371385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.374426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.375030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.376170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.638435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.649052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.650807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.652244 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9dbc3b2-d9f4-4a93-a3d0-fb6ad2dba5f9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1313 microversion: 2.25 time: 0.301733 Oct 26 05:02:11.666149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 176/358] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:11 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:11.678158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:11.679111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:11.685954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.686691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.687616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.688481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:11.689103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:11.689707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:11.720759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.732734 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-213a51e6-0de5-4df8-98dd-efe84f9dad99 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 0.729016 Oct 26 05:02:11.733671 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 183/359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:11 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:11.849669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.861605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.866930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:11.874191 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67ab600c-0a65-4bb7-a0d8-820c8404faed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1417 microversion: 2.75 time: 0.206603 Oct 26 05:02:11.890120 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 177/360] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:11 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1417 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:12.026059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:12.027534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:12.034510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.034996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.035726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.036423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.037247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.037702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.093838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:12.094488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:12.101492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.101980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.102621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.103355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.103805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.104225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.484886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:12.501191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f63d2f7-c877-4b29-ba12-f89eb8124796 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 0.478180 Oct 26 05:02:12.502443 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 184/361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:12 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:12.510403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:12.511486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:12.518726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.520773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.521635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.523422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.524574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.525238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.644648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:12.653040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:12.670243 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6dcb2033-ae98-4477-8225-e4c1b5c8587e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.587955 Oct 26 05:02:12.671190 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 178/362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:12 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:12.674184 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5104ad96-784f-4aaf-8080-ac8abf608fc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1272 microversion: 2.1 time: 0.167639 Oct 26 05:02:12.678080 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 185/363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:12 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:12.696607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:12.697571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:12.715821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.716673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.717360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.718322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.718992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.719618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.759246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:12.759870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:12.768953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.770362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.771586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:12.773358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:12.773832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:12.774274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.027926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.037953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.039694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.040844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e360d51-aac1-4051-a06e-cc52f81b7e78 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1313 microversion: 2.25 time: 0.349438 Oct 26 05:02:13.041424 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 179/364] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:12 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:13.046319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:13.047109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:13.053296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.054001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.054460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.055149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.055895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.056534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.475420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.492974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.495505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.503591 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37c47743-54b8-4d81-99c5-a5707f524627 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1417 microversion: 2.75 time: 0.460213 Oct 26 05:02:13.505028 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 180/365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:13 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1417 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:13.526622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4cbac50c-dc64-44c8-8e1a-3e289af9412a req-07bc84ed-1e69-4978-864f-a2e594fc353b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc4f2b7-fece-4f86-8263-7b736049adc6", "name": "network-vif-plugged", "status": "completed", "tag": "a57ce4e6-9606-4bb8-beab-246b2f4f2757"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:13.538877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4cbac50c-dc64-44c8-8e1a-3e289af9412a req-07bc84ed-1e69-4978-864f-a2e594fc353b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.539364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4cbac50c-dc64-44c8-8e1a-3e289af9412a req-07bc84ed-1e69-4978-864f-a2e594fc353b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.539883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4cbac50c-dc64-44c8-8e1a-3e289af9412a req-07bc84ed-1e69-4978-864f-a2e594fc353b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.555741 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4cbac50c-dc64-44c8-8e1a-3e289af9412a req-07bc84ed-1e69-4978-864f-a2e594fc353b service nova] Creating event network-vif-plugged:a57ce4e6-9606-4bb8-beab-246b2f4f2757 for instance afc4f2b7-fece-4f86-8263-7b736049adc6 on n-h2-862416-4 Oct 26 05:02:13.564087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4cbac50c-dc64-44c8-8e1a-3e289af9412a req-07bc84ed-1e69-4978-864f-a2e594fc353b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041412 Oct 26 05:02:13.565865 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 181/366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:13.574133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:13.575715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:13.583443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.584280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.584879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.585806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.586571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.587157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.604250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:13.622098 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ceaf1ce5-0436-40c5-819b-08624e480bb8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 0.869053 Oct 26 05:02:13.622851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 186/367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:12 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:13.693927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:13.695597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:13.701304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:13.709524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.710373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.711688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:13.713479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:13.714215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:13.714864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.104512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.114355 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15a46ad6-624b-4b9f-8f4d-e09dc14d0aaa tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 0.545831 Oct 26 05:02:14.115387 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 182/368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:13 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:14.120755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:14.121609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:14.131818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.132560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.133212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.134176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.135250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.135898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.180517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.191145 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a54ee89e-b5eb-4f2b-b53b-e9c3763e31f7 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.502471 Oct 26 05:02:14.199860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 187/369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:13 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:14.208657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:14.213707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:14.227697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.229010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.230149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.231123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.231739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.232321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.333784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.340854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:14.355744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cdac1e4-e2c5-45f9-b6d3-f4802b2f130b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1270 microversion: 2.1 time: 0.238534 Oct 26 05:02:14.358242 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 183/370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:14 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:14.367349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.381678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.384003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.385210 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8a88982-f7c6-4aea-b80d-aacda23eacdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1313 microversion: 2.25 time: 0.184114 Oct 26 05:02:14.394151 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 188/371] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:14 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:14.538516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:14.539672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:14.571725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.572905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.573673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.574914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.576086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.576851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.646858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:14.647695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:14.658183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.659084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.660340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.662027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:14.662734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:14.664615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:14.784102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.797095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.799530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:14.806426 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44bc3fd3-fb86-407f-8b68-28d573a621f4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1417 microversion: 2.75 time: 0.275629 Oct 26 05:02:14.836825 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 184/372] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:14 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1417 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:15.105864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:15.114663 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59326aa9-5bb1-4225-af05-3f64b1ce32ca tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 0.471815 Oct 26 05:02:15.117570 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 189/373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:14 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:15.141334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:15.142554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:15.152717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:15.158719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.159590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.163575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:15.164737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.166123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.167869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:15.219394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:15.220021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:15.231197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.231716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.232161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:15.235685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.236268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.236711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:15.825234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:15.837103 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bec4e070-e817-40fc-9974-b1d085c1cc6e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1319 microversion: 2.1 time: 0.697676 Oct 26 05:02:15.837835 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 185/374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:15 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1319 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:15.906188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-31217f41-57a6-4702-911e-391395c28dd5 req-b01e8dab-2f16-4ea8-a350-12d156672197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ced283-dea4-4e31-b42c-609fe3c75d6c", "tag": "89f86040-f030-4c1a-93a5-8c432edf2d93"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:15.918791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-31217f41-57a6-4702-911e-391395c28dd5 req-b01e8dab-2f16-4ea8-a350-12d156672197 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.919785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-31217f41-57a6-4702-911e-391395c28dd5 req-b01e8dab-2f16-4ea8-a350-12d156672197 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.920550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-31217f41-57a6-4702-911e-391395c28dd5 req-b01e8dab-2f16-4ea8-a350-12d156672197 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:15.938114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-31217f41-57a6-4702-911e-391395c28dd5 req-b01e8dab-2f16-4ea8-a350-12d156672197 service nova] Creating event network-changed:89f86040-f030-4c1a-93a5-8c432edf2d93 for instance 31ced283-dea4-4e31-b42c-609fe3c75d6c on n-h2-862416-4 Oct 26 05:02:15.946550 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-31217f41-57a6-4702-911e-391395c28dd5 req-b01e8dab-2f16-4ea8-a350-12d156672197 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106841 Oct 26 05:02:15.948572 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 186/375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:15.954944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:15.960122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:15.971890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:15.978302 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35b40264-64d1-4141-948d-9e3ad94eac80 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.760975 Oct 26 05:02:15.989346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 190/376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:15 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:15.990432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.990432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.995253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:15.995253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:15.995516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:15.995516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:15.995516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:15.995516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.005884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:16.006653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:16.008738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.009765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:16.010535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:16.011148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.107613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.122503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.127728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.131282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd6fa7ae-0878-43bd-9769-5bef0cd8abfe tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1319 microversion: 2.25 time: 0.147037 Oct 26 05:02:16.132174 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 191/377] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:15 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:16.159807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:16.161220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:16.167489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.182751 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e6b0eb56-97aa-408a-b8f0-09cc0103f913 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1270 microversion: 2.1 time: 0.232232 Oct 26 05:02:16.183454 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 187/378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:15 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:16.185276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:16.190035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1741052151", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d5f82c62-9aad-46b0-8705-97aed5ee80ce"}], "security_groups": [{"name": "tempest-securitygroup--1297776000"}], "key_name": "tempest-keypair-1796051392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:16.190785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:16.191425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.192268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:16.192844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:16.193415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.262046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:16.335822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.370603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.372305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.388203 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b81c5e1-be87-438e-afc6-428c106ed0ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1438 microversion: 2.75 time: 0.244863 Oct 26 05:02:16.390294 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 192/379] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:16 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1438 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:16.402444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:16.403408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:16.418127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:16.419194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:16.419673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.420453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:16.420944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:16.427733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:16.476853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] validate_networks() for [('d5f82c62-9aad-46b0-8705-97aed5ee80ce', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:16.794844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:16.809888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d0b29b97-e5a6-4fd4-b0a3-be74660d602d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1321 microversion: 2.1 time: 0.416972 Oct 26 05:02:16.821338 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 193/380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:16 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:17.010675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9fb201cb-a7c4-4724-a7a9-dea73ec9b68b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:17.032562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9fb201cb-a7c4-4724-a7a9-dea73ec9b68b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.214976 Oct 26 05:02:17.033267 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 194/381] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:02:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:17.055142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-23fac3af-cdb1-454f-96a3-727872ed1495 req-8d297f71-f52e-43f7-b679-b4b0c1d7a623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8ffcad-160b-4442-a101-a3cbda282f28", "name": "network-vif-plugged", "status": "completed", "tag": "d997e858-1a7f-4971-9079-dc1e0001a924"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:17.083225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-23fac3af-cdb1-454f-96a3-727872ed1495 req-8d297f71-f52e-43f7-b679-b4b0c1d7a623 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.083740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-23fac3af-cdb1-454f-96a3-727872ed1495 req-8d297f71-f52e-43f7-b679-b4b0c1d7a623 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.084201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-23fac3af-cdb1-454f-96a3-727872ed1495 req-8d297f71-f52e-43f7-b679-b4b0c1d7a623 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.099187 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-23fac3af-cdb1-454f-96a3-727872ed1495 req-8d297f71-f52e-43f7-b679-b4b0c1d7a623 service nova] Creating event network-vif-plugged:d997e858-1a7f-4971-9079-dc1e0001a924 for instance bb8ffcad-160b-4442-a101-a3cbda282f28 on n-h1-862416-4 Oct 26 05:02:17.107413 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-23fac3af-cdb1-454f-96a3-727872ed1495 req-8d297f71-f52e-43f7-b679-b4b0c1d7a623 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062776 Oct 26 05:02:17.108351 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 195/382] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:17.117727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:17.120729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:17.133586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.134479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.135015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.135750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.145056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.153158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.342205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:17.345907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:17.346523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:17.347038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:17.348798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:17.422575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:17.586385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:17.588770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:17.589513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:17.590057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:17.590682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:17.593017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:17.601979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.602500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.602950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.608358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.610318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.611042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.630572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.631394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.632007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.632925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.633579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.634352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.660806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Getting quotas for project bc3201d6ec664f51a56170294f242a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:17.667200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Getting quotas for user dd5ce89745564263bab98d4227858c97 and project bc3201d6ec664f51a56170294f242a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:17.688099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:17.692501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:17.762514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:17.775498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:17.777608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:17.787383 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4bf42ef8-aa8f-4cb9-b02a-01b2786aa534 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "POST /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4/action" status: 202 len: 1495 microversion: 2.75 time: 0.677801 Oct 26 05:02:17.804122 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 196/383] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:02:17 2022] POST /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4/action => generated 1495 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 05:02:17.821272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:17.821953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:17.829137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.829924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.830556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.831440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.832467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.833066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.842073 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3bc55f10-ff31-4a93-b5f0-fff1dd2678e7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.655544 Oct 26 05:02:17.842747 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 188/384] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:02:17.874625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:17.875269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:17.893074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.893608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.895200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:17.896235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:17.910665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:17.912053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.076638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.086407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c85a1f0d-7f84-4f69-80d1-e97b8ed69502 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1469 microversion: 2.1 time: 0.281087 Oct 26 05:02:18.104899 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 197/385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:17 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:18.131524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=34 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:18.198948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.224055 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bbe99cf-c6d1-441a-80f1-ec036633eb78 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.369346 Oct 26 05:02:18.225688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 189/386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:17 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:18.230934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:18.232001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:18.232668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-219699ee-2e0c-4b55-a42c-33aafd4b2d70 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1474016633", "id": 1728521196, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:18.239592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.240308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.240943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.242167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.242698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.243187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.270776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-219699ee-2e0c-4b55-a42c-33aafd4b2d70 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.164548 Oct 26 05:02:18.271821 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 198/387] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:18 2022] POST /compute/v2.1/flavors => generated 425 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:18.277174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:18.278064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:18.285668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.286834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.287579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.288713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.289347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.289923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.571958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.586208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.591681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.595975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-335c4465-1b62-4674-b79e-2869d5e43745 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.368013 Oct 26 05:02:18.596787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 190/388] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:18 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:18.603140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:18.603736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:18.623432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.624305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.624910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.631408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.632714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.634953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.640315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.652474 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ba39412-5b9a-42b3-bcda-4228ee2c059f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.379286 Oct 26 05:02:18.653392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 199/389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:18 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:18.659602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:18.661098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:18.673842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.674346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.674791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.675551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.676061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.676500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.851172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.863355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.865368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:18.888900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9052d942-7a81-4f9e-ba7c-e2be2735b695 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.289332 Oct 26 05:02:18.889976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 191/390] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:18 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:18.897581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:18.899194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:18.906375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.907078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.907662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:18.917082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:18.918323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:18.918775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.015895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:19.025909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:19.027495 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3592ec0-e4d6-4ec0-acdd-5e51a2ea0c3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1238 microversion: 2.1 time: 0.135986 Oct 26 05:02:19.036907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3202815b-5bb7-440c-8d4c-9465081e8f4d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1471 microversion: 2.1 time: 0.382464 Oct 26 05:02:19.040357 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 192/391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:18 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1238 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:19.045471 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 200/392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:18 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:19.061434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1c7c01c-069e-4f71-b653-f3071084fcc2 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:19.072993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1c7c01c-069e-4f71-b653-f3071084fcc2 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024863 Oct 26 05:02:19.073936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 201/393] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 26 05:02:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:02:19.257007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:19.257753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:19.266802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:19.267398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:19.267932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.268729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:19.269925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:19.270680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.289619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b846031-ea78-4d93-ba23-8925f2bb2946 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:19.290728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b846031-ea78-4d93-ba23-8925f2bb2946 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] [instance: 688f0de4-b3f9-4aba-bc19-a50a9a375dc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:19.307026 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0b846031-ea78-4d93-ba23-8925f2bb2946 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] HTTP exception thrown: Instance 688f0de4-b3f9-4aba-bc19-a50a9a375dc2 could not be found. Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b846031-ea78-4d93-ba23-8925f2bb2946 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Request method failure captured: Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/688f0de4-b3f9-4aba-bc19-a50a9a375dc2/action HTTP/1.1 Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 15 Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL88X0WG6Da2bgMSeRHcyO8A8rFyaCEzVmJ7Yw0kyqnXSmF3vnVSzQOzglWlvsvV49_-0EhZPa9PF3X62LmY07t8hmzL7INRTfd8jD4qm-yGdX9jhAVlh1UymFXmmPJFPiD5UU2rnIw7OHayx2eUet5Rs7MypPcA1GLowKzM9iF244M Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:02:19.310305 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 78ec4e37dfe7473f895ddd48b4782ce7 Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: {"migrate": {}} Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:19.311697 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 688f0de4-b3f9-4aba-bc19-a50a9a375dc2 could not be found. Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '688f0de4-b3f9-4aba-bc19-a50a9a375dc2', 'body': {'migrate': {}}} Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688f0de4-b3f9-4aba-bc19-a50a9a375dc2 could not be found. Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:19.312753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688f0de4-b3f9-4aba-bc19-a50a9a375dc2 could not be found. Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688f0de4-b3f9-4aba-bc19-a50a9a375dc2 could not be found. Oct 26 05:02:19.314096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:19.318514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b846031-ea78-4d93-ba23-8925f2bb2946 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Returning 404 to user: Instance 688f0de4-b3f9-4aba-bc19-a50a9a375dc2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:19.319783 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b846031-ea78-4d93-ba23-8925f2bb2946 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/688f0de4-b3f9-4aba-bc19-a50a9a375dc2/action" status: 404 len: 111 microversion: 2.1 time: 0.244518 Oct 26 05:02:19.321087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 202/394] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:19 2022] POST /compute/v2.1/servers/688f0de4-b3f9-4aba-bc19-a50a9a375dc2/action => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:19.325890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-570850e8-3bf8-48ef-89ca-0c2ad7677343 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1959202348", "id": 708446982, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:19.349747 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-570850e8-3bf8-48ef-89ca-0c2ad7677343 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.027268 Oct 26 05:02:19.351672 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 203/395] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:19 2022] POST /compute/v2.1/flavors => generated 422 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:19.357414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:19.358330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:19.366674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:19.367793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:19.368517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.378414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:19.380010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:19.380709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.390261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:02:19.573546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-311f1e73-6244-4e4e-832e-3091b2971785 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 204 len: 0 microversion: 2.1 time: 0.531513 Oct 26 05:02:19.578145 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 193/396] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:02:19 2022] DELETE /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:02:19.585997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4d145a8-2db1-4899-be45-3be7198479c0 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:19.586885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:19.598182 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-758f88dd-8eac-406c-a2e7-c2fb2c74ccc0 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.244684 Oct 26 05:02:19.599353 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 204/397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:19 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:19.605379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-950159089", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:19.617538 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4d145a8-2db1-4899-be45-3be7198479c0 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037708 Oct 26 05:02:19.618342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 194/398] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 26 05:02:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:02:19.632378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:19.634047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:19.645096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:19.646174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:19.647258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.648374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:19.649130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:19.649960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:19.713419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:20.070110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.078154 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5bdeb4ee-4636-4551-9826-e9b4be8f2e5c tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1475 microversion: 2.1 time: 0.458827 Oct 26 05:02:20.078971 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 195/399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:19 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:20.088403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fdf8a13b-bd93-4537-9534-0d8692cd2f87 req-f52f3e1c-c7fe-4a75-b509-97699d8e1e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799dd620-87a8-4e32-9c1a-772b54ecb883", "tag": "ce571795-111e-46ca-80eb-a9eabfa95f90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:20.105633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fdf8a13b-bd93-4537-9534-0d8692cd2f87 req-f52f3e1c-c7fe-4a75-b509-97699d8e1e95 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.106379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fdf8a13b-bd93-4537-9534-0d8692cd2f87 req-f52f3e1c-c7fe-4a75-b509-97699d8e1e95 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.106969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fdf8a13b-bd93-4537-9534-0d8692cd2f87 req-f52f3e1c-c7fe-4a75-b509-97699d8e1e95 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.120500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fdf8a13b-bd93-4537-9534-0d8692cd2f87 req-f52f3e1c-c7fe-4a75-b509-97699d8e1e95 service nova] Creating event network-changed:ce571795-111e-46ca-80eb-a9eabfa95f90 for instance 799dd620-87a8-4e32-9c1a-772b54ecb883 on n-h2-862416-4 Oct 26 05:02:20.125189 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fdf8a13b-bd93-4537-9534-0d8692cd2f87 req-f52f3e1c-c7fe-4a75-b509-97699d8e1e95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044650 Oct 26 05:02:20.125842 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 196/400] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:20.133020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:20.133769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:20.141560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.142065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.142499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.143203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.143651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.144067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.170023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:20.170710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:20.172485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:20.173172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:20.182840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:20.205462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.206303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.207588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.208585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.209154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.209857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.228862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Getting quotas for project b27808642e3a4e089823c56242eddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:20.234036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Getting quotas for user 7cc07d881f794f6f8a8516aabbfdb1fd and project b27808642e3a4e089823c56242eddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:20.247240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:20.250302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:20.311452 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a437181-2a31-4bad-9a0e-573745effb84 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710078 Oct 26 05:02:20.312108 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 205/401] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:02:20.322580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb55577f-012b-4e1f-a855-f1e5720b909f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Action: 'create', calling method: .version_select at 0x7f470afcc5e0>, body: {"keypair": {"name": "tempest-keypair-1483760941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyKdCfyRqHMSz1zj09934VWywNwX50lCJCYjxu2TDKrEkMzflwvpmETwtMzrQeaCZ6rcNKsbuaIaaz7soCl3OUtTCgeOIBmd9trffoAB/lxP4I8JMfG1/aWlz/Pf5rYfg=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:20.349594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb55577f-012b-4e1f-a855-f1e5720b909f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Getting quotas for project 0d91a2576da84ef6984dae45db8b8543. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:20.354862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb55577f-012b-4e1f-a855-f1e5720b909f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Getting quotas for user 43735d2f58ca41b699f15ffc645aba3f and project 0d91a2576da84ef6984dae45db8b8543. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:20.387692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb55577f-012b-4e1f-a855-f1e5720b909f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074210 Oct 26 05:02:20.396482 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 206/402] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:02:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:20.402046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:20.403795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:20.412931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.413741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.414191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.414913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.415377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.415873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.479597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.489637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.492643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.493971 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-adfa4f11-8d31-485f-8a5c-d0466f62869d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.366832 Oct 26 05:02:20.494667 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 197/403] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:20 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:20.517390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:20.518186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:20.524846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.525372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.525825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.526558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.526996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.527539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.665833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.683001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.688344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.710924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-677057b7-658d-41a1-87e9-d0a91c778032 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.201266 Oct 26 05:02:20.725543 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 198/404] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:20 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:20.725543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:20.725543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:20.738817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.740365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.742060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.743052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.744336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.745301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.850331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.858895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d2a252f-5bec-4fa2-acd9-502a1ed9e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.461066 Oct 26 05:02:20.877372 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 207/405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:20 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:20.877372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f90eadb-3078-462a-926a-aab3cb1b1777 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:20.877372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f90eadb-3078-462a-926a-aab3cb1b1777 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:20.915531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:20.926907 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f2f2ff3-6248-438d-9527-2e73e4c85274 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1300 microversion: 2.1 time: 0.213946 Oct 26 05:02:20.927973 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 199/406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:20 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:20.944964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:20.949302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:20.957108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:20.970316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.970865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.971295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:20.971964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:20.972945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:20.973422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:21.012034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f90eadb-3078-462a-926a-aab3cb1b1777 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:21.022911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f90eadb-3078-462a-926a-aab3cb1b1777 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1221 microversion: 2.1 time: 0.155549 Oct 26 05:02:21.023853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 208/407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:20 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:21.106961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:21.107433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:21.116851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:21.117374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:21.117819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:21.118730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:21.119338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:21.119906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:21.570014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:21.578226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:21.590629 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2ff76390-89c2-408c-a01e-5b5ef9b728b3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.661359 Oct 26 05:02:21.601613 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 200/408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:20 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:21.601799 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-446c01b3-b13b-4d96-b478-8594fca4c8d5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1475 microversion: 2.1 time: 0.488843 Oct 26 05:02:21.601890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:21.601890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:21.610873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 209/409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:21 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1475 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:21.617557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:21.618062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:21.618495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:21.619218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:21.619659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:21.620322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:21.740786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:21.741979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:21.749819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:21.750680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:21.751460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:21.752449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:21.753983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:21.754532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.065274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.078876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.087484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.093269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07ef7a7c-8309-4fd7-9900-e3614ab18455 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.357369 Oct 26 05:02:22.094509 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 210/410] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:21 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:22.100360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:22.101252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:22.107941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.108728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.109518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.110445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.111112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.111760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.501599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.512049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:22.515612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.518122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.520017 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f529867-5ebd-4628-a3be-ec13f0646a88 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.927521 Oct 26 05:02:22.521413 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 201/411] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:21 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:22.527110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:22.528066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:22.540769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.542493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.544267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.545948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.547349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.548162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.768079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.779721 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd2795ed-968a-4963-9b33-4a4d588c62fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.683331 Oct 26 05:02:22.794275 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 211/412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:22 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:22.803003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:22.804250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:22.810875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.811607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.812205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.813080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.813741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.814719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.944092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:22.953675 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-27f5199f-44f7-493b-ae4c-0c19da87def8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1279 microversion: 2.1 time: 0.158041 Oct 26 05:02:22.970124 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 212/413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:22 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:22.970124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-00517ace-6bbc-44b7-a1ff-9d41fb8850cf req-c65142cd-82ff-47c1-8551-fd9f6ee3575f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79855693-370b-458d-b7dc-6a777007e914", "tag": "d7959dec-6be1-405b-8ba4-aefe5e3be104"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:22.976406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-00517ace-6bbc-44b7-a1ff-9d41fb8850cf req-c65142cd-82ff-47c1-8551-fd9f6ee3575f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:22.977003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-00517ace-6bbc-44b7-a1ff-9d41fb8850cf req-c65142cd-82ff-47c1-8551-fd9f6ee3575f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:22.977328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-00517ace-6bbc-44b7-a1ff-9d41fb8850cf req-c65142cd-82ff-47c1-8551-fd9f6ee3575f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:22.989333 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-00517ace-6bbc-44b7-a1ff-9d41fb8850cf req-c65142cd-82ff-47c1-8551-fd9f6ee3575f service nova] Creating event network-changed:d7959dec-6be1-405b-8ba4-aefe5e3be104 for instance 79855693-370b-458d-b7dc-6a777007e914 on n-h2-862416-4 Oct 26 05:02:22.994398 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-00517ace-6bbc-44b7-a1ff-9d41fb8850cf req-c65142cd-82ff-47c1-8551-fd9f6ee3575f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038317 Oct 26 05:02:22.995008 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 213/414] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:23.000313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:23.001000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:23.007848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.008542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.009154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.010022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.010624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.011200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.062971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:23.077438 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32e8fea0-c215-4fa9-b285-fc698f51208d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.551890 Oct 26 05:02:23.078685 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 202/415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:22 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:23.087851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:23.088822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:23.095422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.096879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.098152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.099097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.100349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.101042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.568321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:23.578263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9b68078-307c-4d06-a517-94cd7fbf1c42 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.582069 Oct 26 05:02:23.594410 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 214/416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:22 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:23.609233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:23.611302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:23.622494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.623073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.624325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.625084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.627324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.627958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.653494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:23.665350 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3bb868f-74ae-45f1-acdc-c11fd1fb0fb7 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1475 microversion: 2.1 time: 0.584017 Oct 26 05:02:23.665622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:23.666446 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 203/417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:23 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1475 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:23.672488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-24d9fe0a-4b37-42a2-b85a-e7bdee6894ac req-68e5e338-ecc0-4589-b20d-d04e48944317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ced283-dea4-4e31-b42c-609fe3c75d6c", "name": "network-vif-plugged", "status": "completed", "tag": "89f86040-f030-4c1a-93a5-8c432edf2d93"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:23.684227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-24d9fe0a-4b37-42a2-b85a-e7bdee6894ac req-68e5e338-ecc0-4589-b20d-d04e48944317 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.685150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-24d9fe0a-4b37-42a2-b85a-e7bdee6894ac req-68e5e338-ecc0-4589-b20d-d04e48944317 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.685866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-24d9fe0a-4b37-42a2-b85a-e7bdee6894ac req-68e5e338-ecc0-4589-b20d-d04e48944317 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.711517 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-24d9fe0a-4b37-42a2-b85a-e7bdee6894ac req-68e5e338-ecc0-4589-b20d-d04e48944317 service nova] Creating event network-vif-plugged:89f86040-f030-4c1a-93a5-8c432edf2d93 for instance 31ced283-dea4-4e31-b42c-609fe3c75d6c on n-h2-862416-4 Oct 26 05:02:23.718569 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-24d9fe0a-4b37-42a2-b85a-e7bdee6894ac req-68e5e338-ecc0-4589-b20d-d04e48944317 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050436 Oct 26 05:02:23.721714 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 204/418] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:23.729573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:23.730501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:23.739139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.739826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.740265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.741212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.743965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.744109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.780262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:23.791322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:23.793537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:23.805650 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-70898093-25fe-4d3e-9747-4a27602c78b7 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.209865 Oct 26 05:02:23.806803 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 215/419] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:23 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:23.816637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-66498807-f5dc-4f73-8f9c-ba463a8d2858 req-47d9fd71-fc30-434e-9453-7ffd57193e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc4f2b7-fece-4f86-8263-7b736049adc6", "name": "network-vif-deleted", "tag": "a57ce4e6-9606-4bb8-beab-246b2f4f2757"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:23.822427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:23.829759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66498807-f5dc-4f73-8f9c-ba463a8d2858 req-47d9fd71-fc30-434e-9453-7ffd57193e53 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.830237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66498807-f5dc-4f73-8f9c-ba463a8d2858 req-47d9fd71-fc30-434e-9453-7ffd57193e53 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.830664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66498807-f5dc-4f73-8f9c-ba463a8d2858 req-47d9fd71-fc30-434e-9453-7ffd57193e53 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.843315 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-66498807-f5dc-4f73-8f9c-ba463a8d2858 req-47d9fd71-fc30-434e-9453-7ffd57193e53 service nova] Creating event network-vif-deleted:a57ce4e6-9606-4bb8-beab-246b2f4f2757 for instance afc4f2b7-fece-4f86-8263-7b736049adc6 on n-h2-862416-4 Oct 26 05:02:23.850055 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-66498807-f5dc-4f73-8f9c-ba463a8d2858 req-47d9fd71-fc30-434e-9453-7ffd57193e53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041914 Oct 26 05:02:23.850658 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 216/420] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:23.856297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:23.857021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:23.863071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.863665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.864104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:23.864927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:23.865409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:23.866023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.334577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:24.343683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:24.345157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:24.346339 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eaf59997-7f85-4820-b35b-c319b39cbad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.621705 Oct 26 05:02:24.364832 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 205/421] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:23 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:24.371744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:24.372964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:24.380745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.381888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.382565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.383684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.384588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.385238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.460973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:24.476830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98fd306b-1452-4de6-8245-bd7ad00f110b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.624760 Oct 26 05:02:24.477757 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 217/422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:23 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:24.485196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:24.485846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:24.501986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.502476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.502915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.504525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.505231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.510074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.922923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:24.933082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-526389ac-c839-4f2f-9503-0415a2700de5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.454252 Oct 26 05:02:24.933920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 218/423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:24 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:24.939272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:24.940112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:24.946657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.947866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.948505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.949281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.949770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.950194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.958543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:24.966657 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4509823d-1bca-4f4a-8bff-cf58a91d7a5c tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.605987 Oct 26 05:02:24.968251 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 206/424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:24 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:24.973308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:24.974062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:24.980155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.980758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.981339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:24.982139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:24.982742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:24.983265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.081514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.090896 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b95147e7-dca0-4afc-b7d5-d60dbc2120bc tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1304 microversion: 2.1 time: 0.119977 Oct 26 05:02:25.090896 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 207/425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:24 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:25.106609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:25.107291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:25.113984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.114478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.114923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.115626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.116081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.116517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.172489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.180894 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d247efac-29d5-4db6-bd46-d948e6bc56c4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.245714 Oct 26 05:02:25.181504 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 219/426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:24 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:25.186545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1681128111", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "708446982", "adminPass": "***", "networks": [{"uuid": "4be33af3-280f-4042-952a-fca147220c98"}], "security_groups": [{"name": "tempest-securitygroup--1953852765"}], "key_name": "tempest-keypair-1483760941", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:25.189281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.198492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.199956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.204769 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89022c9f-1281-4262-ac88-5fb4dfec8896 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.113649 Oct 26 05:02:25.205513 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 208/427] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:25 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:25.213571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f8280f17-825f-4caf-8fac-54fd63283893 req-0ba4a33c-fea5-40a9-8d0c-a3823a3ce6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a5b66d-28fe-4e03-907d-f17c0f6e9295", "tag": "eb42081e-4a36-4f7a-a726-ab4e9f2374dd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:25.223588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f8280f17-825f-4caf-8fac-54fd63283893 req-0ba4a33c-fea5-40a9-8d0c-a3823a3ce6b5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.225536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f8280f17-825f-4caf-8fac-54fd63283893 req-0ba4a33c-fea5-40a9-8d0c-a3823a3ce6b5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.226008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f8280f17-825f-4caf-8fac-54fd63283893 req-0ba4a33c-fea5-40a9-8d0c-a3823a3ce6b5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.237029 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f8280f17-825f-4caf-8fac-54fd63283893 req-0ba4a33c-fea5-40a9-8d0c-a3823a3ce6b5 service nova] Creating event network-changed:eb42081e-4a36-4f7a-a726-ab4e9f2374dd for instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 on n-h1-862416-4 Oct 26 05:02:25.242536 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f8280f17-825f-4caf-8fac-54fd63283893 req-0ba4a33c-fea5-40a9-8d0c-a3823a3ce6b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035934 Oct 26 05:02:25.243111 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 209/428] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:25.293907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] validate_networks() for [('4be33af3-280f-4042-952a-fca147220c98', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:25.373846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:25.374668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:25.381085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.381714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.382165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.382863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.383321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.383871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.599175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.607746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.609446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.610553 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3aa0b487-4ee9-403b-981b-f0d177fb97fd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.241150 Oct 26 05:02:25.611110 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 210/429] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:25 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:25.620135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:25.620747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:25.626876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.627113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.627547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.628235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.628740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.629203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.826259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:25.827081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:25.827338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:25.827836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:25.828386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:25.849080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.849599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.850029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.850774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.851239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.851828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.863717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:25.872830 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a07eb172-c61d-41bb-9886-3a46e88461d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.256341 Oct 26 05:02:25.873408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Getting quotas for project 0d91a2576da84ef6984dae45db8b8543. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:25.874973 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 211/430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:25 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:25.878112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Getting quotas for user 43735d2f58ca41b699f15ffc645aba3f and project 0d91a2576da84ef6984dae45db8b8543. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:25.893581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:25.902518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e64562c1-9cc4-4f21-bb4a-5fd80aad1c26 req-a83082dd-89ca-4952-bfd7-a875f2021f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d592cac-0cd1-4090-9d22-a64f8689a08c", "tag": "f42ca225-bc17-488a-a326-71240a1747c0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:25.905285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:25.913492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e64562c1-9cc4-4f21-bb4a-5fd80aad1c26 req-a83082dd-89ca-4952-bfd7-a875f2021f08 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.914133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e64562c1-9cc4-4f21-bb4a-5fd80aad1c26 req-a83082dd-89ca-4952-bfd7-a875f2021f08 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.914400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e64562c1-9cc4-4f21-bb4a-5fd80aad1c26 req-a83082dd-89ca-4952-bfd7-a875f2021f08 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.928533 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e64562c1-9cc4-4f21-bb4a-5fd80aad1c26 req-a83082dd-89ca-4952-bfd7-a875f2021f08 service nova] Creating event network-changed:f42ca225-bc17-488a-a326-71240a1747c0 for instance 0d592cac-0cd1-4090-9d22-a64f8689a08c on n-h1-862416-4 Oct 26 05:02:25.933446 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e64562c1-9cc4-4f21-bb4a-5fd80aad1c26 req-a83082dd-89ca-4952-bfd7-a875f2021f08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034945 Oct 26 05:02:25.934267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 212/431] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:02:25.957999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:25.958973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:25.967043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.967874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.968472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.969346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:25.969964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:25.970557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:25.974638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f2f10fe-57ec-4b5c-bceb-9d2b400f6791 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.792039 Oct 26 05:02:25.975752 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 220/432] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:02:25.990859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf7aa041-1087-4dca-a1f1-c0a5a7ae3ef5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:25.991871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf7aa041-1087-4dca-a1f1-c0a5a7ae3ef5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.134037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf7aa041-1087-4dca-a1f1-c0a5a7ae3ef5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.144062 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf7aa041-1087-4dca-a1f1-c0a5a7ae3ef5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1263 microversion: 2.1 time: 0.160392 Oct 26 05:02:26.145330 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 221/433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:25 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:26.150691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:26.151949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.163723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.164424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.165034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.165977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.166616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.167144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.398126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.408566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eec8e8b0-16e5-4bef-88cf-6ed84a1b5798 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.455626 Oct 26 05:02:26.421626 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 213/434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:25 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:26.425886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:26.426739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.436911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.437444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.442104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.442972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.443470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.443919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.447584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.464611 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c2b64c0-938f-4656-856f-eb705c961b5a tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.316288 Oct 26 05:02:26.465222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 222/435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:26 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:26.476138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:26.476754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.494074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.494926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.496314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.497553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.498320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.498963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.578529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.591911 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27cd628c-c76c-40b5-b6e5-02367e26950d tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1304 microversion: 2.1 time: 0.178898 Oct 26 05:02:26.592572 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 214/436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:26 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:26.609945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:26.610842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.618647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.619379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.620000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.620934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.621867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.623169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.733947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.746648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.750169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.756178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df3a0406-6e75-4daf-a630-fbae4d8760a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.162381 Oct 26 05:02:26.766126 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 215/437] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:26 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:26.774848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:26.775879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.783352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.786009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.786528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.787441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.788020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.788762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.794027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:26.804835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a84d3193-5d36-44ef-9d93-a1f77f517226 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.338340 Oct 26 05:02:26.807829 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 223/438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:26 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:26.896948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:26.897699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:26.903564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.904058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.904496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:26.905198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:26.906693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:26.907128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.010928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.020069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.021768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.022961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f8bbba8-6d67-4b76-9188-d464ec774071 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.256021 Oct 26 05:02:27.023802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 216/439] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:26 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:27.054885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.062446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cef37e5-47ba-4552-bc3f-422fa2734fa4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.169418 Oct 26 05:02:27.063006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 224/440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:26 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:27.170300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:27.171069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:27.177131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.177658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.178100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.178801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.179259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.179690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.260535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.270332 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b84441e-4168-49da-9d2a-cc1f5e3966a5 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1267 microversion: 2.1 time: 0.103383 Oct 26 05:02:27.271165 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 217/441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:27 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:27.433941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:27.434706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:27.449858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.450618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.451285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.452162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.454563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.455088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.489378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:27.490239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:27.502506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.503032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.503513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.504890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.507017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.510870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.659993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:27.678045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=16 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:27.683810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.697632 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d4c9b0b-1d04-4a44-ac46-b4d09714fcdd tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.267684 Oct 26 05:02:27.708105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 225/442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:27 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:27.711548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.723203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:27.723967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:27.724832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d87ed8d0-d8d3-403f-9a23-9b640aa7239d tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.239569 Oct 26 05:02:27.725897 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 218/443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:27 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:27.743525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.747892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.748758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.749582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.750119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.750725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.795946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:27.797041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:27.805968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.806890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.807529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.808189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid afc4f2b7-fece-4f86-8263-7b736049adc6 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:27.811948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.813267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.815572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.817802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.818506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.819119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.865095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.881147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57916436-8668-4d4b-8492-c0a3e58f2366 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 200 len: 1309 microversion: 2.1 time: 0.171624 Oct 26 05:02:27.882090 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 226/444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:27 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:27.887131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:27.887976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:27.894484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.895507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.896115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.897164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:27.897809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:27.898397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:27.929330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.947016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.948595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:27.964510 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f75c63a-a843-4221-92fb-5b6c14bce225 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.172344 Oct 26 05:02:27.966553 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 219/445] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:27 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:28.048082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.049389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:28.058442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.059299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.060059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.061883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.062628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.064323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.099292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:28.121301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.131771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e27a9f0-e177-41fa-980b-dbf0ca2a5562 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1394 microversion: 2.1 time: 0.248197 Oct 26 05:02:28.133475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 227/446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:27 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1394 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:28.139199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.140084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:28.146709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.147683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.148339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.149282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.150095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.150735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.319755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.338072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.341039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.344204 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-78dbeae2-ecb2-48ce-af53-5e8f9924fe9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.298653 Oct 26 05:02:28.345378 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 220/447] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:28.349270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.357821 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3920edf0-c186-4c9d-a07c-03911df01b95 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.222751 Oct 26 05:02:28.358756 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 228/448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:28.369167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.370245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:28.379659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.380451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.380970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.381834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.382308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.382938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.487940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.497649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4da5b8b-58e7-42c8-9172-282a6d30f568 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1259 microversion: 2.1 time: 0.150883 Oct 26 05:02:28.498924 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 221/449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:28.730330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.730939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:28.737641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.738323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.739508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.740258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.740720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.741157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.749988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.751015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:28.764512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.765140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.765740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.766523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.767047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.767609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.948927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.959029 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ac178fd-4f8c-4872-9031-cf271197b6f5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.230976 Oct 26 05:02:28.960004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 229/450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:28.966939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.968137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:28.975209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:28.979169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.979697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.980144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.980820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:28.981281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:28.981769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:28.984224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c93c605-5456-47c1-a425-34622d0fd8cf tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.238765 Oct 26 05:02:28.985162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 222/451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:28.995235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:28.996175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:29.003247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.004753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.005656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.006732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.007349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.007805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.010204 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] HTTP exception thrown: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Request method failure captured: Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 HTTP/1.1 Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8sf7n3DF4VOERk-V1FatJrcOGHhjyJmbtQ3AioZF2uO8fBlJqWxNKhgUtWnUXmc-fpR13luM7eu-Njk3VamNm14Ck-BHEeOMM1x_OPRDfsWRLnVtUN1MNrJu0beS9juGe6WQWWSArQuVEdxkyDnXdGyWPMhZLuYPJgr1V6-J9wrpY Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:29.012190 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53b1b64963ee47d98f03ae09a7ff9f57 Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:29.013791 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'afc4f2b7-fece-4f86-8263-7b736049adc6'} Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:29.014584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:29.015737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:29.018024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Returning 404 to user: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:29.019028 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f85c01a0-e116-43fb-890c-4af24f5a24d4 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 404 len: 111 microversion: 2.1 time: 0.057805 Oct 26 05:02:29.020400 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 230/452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:29.106647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.117591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.119762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.126450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-564b4df3-348e-45b9-a7fa-b3d0a57c20d2 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.136749 Oct 26 05:02:29.135633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 223/453] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:28 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:29.156281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1143158831", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:29.163932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:29.164604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:29.171601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.172098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.172544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.173525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.174264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.174853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.212468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:29.641592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.650931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b74d925-caa4-40f0-987f-77ca9f164148 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1575 microversion: 2.1 time: 0.492117 Oct 26 05:02:29.672583 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 224/454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:29 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1575 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:29.678937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:29.680185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:29.687449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.688214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.688850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.689857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.690507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.691130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.775124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:29.775750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:29.776245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:29.776658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:29.777077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:29.794925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.796594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.797456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.798451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.799921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.801472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.866348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Getting quotas for project 965954d969624da4bfa8d8c5153abbcf. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:29.871544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Getting quotas for user 53b1b64963ee47d98f03ae09a7ff9f57 and project 965954d969624da4bfa8d8c5153abbcf. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:29.886070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:29.888459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:29.921844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.933228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.934234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:29.935555 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7859dbdf-1387-423e-b217-91c6794d2656 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.261279 Oct 26 05:02:29.936340 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 225/455] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:29 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:29.940789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:29.941419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:29.948182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.948679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.949121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.950308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:29.950774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:29.951206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:29.997153 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0f880a6-da98-4a0d-b666-274a8d80d9e2 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845505 Oct 26 05:02:29.998603 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 231/456] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:02:30.004282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:30.005382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:30.012219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.013492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.014319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.016223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.017251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.018041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.256516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:30.270520 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4f9004c-dbbb-4db8-aeff-a4fc05e603d4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.332337 Oct 26 05:02:30.271207 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 226/457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:29 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:30.281638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4d781a13-0f24-4ac2-926e-2f3e5482fbd8 req-dbd631a3-9288-40d1-a63c-8485ab3dccdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79855693-370b-458d-b7dc-6a777007e914", "name": "network-vif-plugged", "status": "completed", "tag": "d7959dec-6be1-405b-8ba4-aefe5e3be104"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:30.297667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4d781a13-0f24-4ac2-926e-2f3e5482fbd8 req-dbd631a3-9288-40d1-a63c-8485ab3dccdc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.298156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4d781a13-0f24-4ac2-926e-2f3e5482fbd8 req-dbd631a3-9288-40d1-a63c-8485ab3dccdc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.298590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4d781a13-0f24-4ac2-926e-2f3e5482fbd8 req-dbd631a3-9288-40d1-a63c-8485ab3dccdc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.323531 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4d781a13-0f24-4ac2-926e-2f3e5482fbd8 req-dbd631a3-9288-40d1-a63c-8485ab3dccdc service nova] Creating event network-vif-plugged:d7959dec-6be1-405b-8ba4-aefe5e3be104 for instance 79855693-370b-458d-b7dc-6a777007e914 on n-h2-862416-4 Oct 26 05:02:30.331059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:30.339301 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2b704512-62e5-44be-905f-0e176028f950 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.339405 Oct 26 05:02:30.353545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4d781a13-0f24-4ac2-926e-2f3e5482fbd8 req-dbd631a3-9288-40d1-a63c-8485ab3dccdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080817 Oct 26 05:02:30.355490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 227/458] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:30.355794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 232/459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:29 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:30.360835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:30.362012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:30.369433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.369936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.370435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.371092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.371552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.371979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.383122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:30.386733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:30.400534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.401098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.401573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.402296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.402752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.403179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.591640 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b2307008-ec56-4f6f-ae4d-f1623d22d0bd tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234325 Oct 26 05:02:30.592393 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:02:30 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:30.597728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:30.598881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:30.612212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.612689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.613166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.618873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.620031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.623320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.906070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:30.915282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ece4e19-07df-4ea3-a732-0ac99a338a4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.558343 Oct 26 05:02:30.916134 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 233/461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:30 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:30.922827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:30.923808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:30.931150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.932006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.933381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:30.933757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:30.934473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:30.935119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.055455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.070053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a64b27b-030d-4512-903a-c00389aba4a8 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1216 microversion: 2.1 time: 0.151871 Oct 26 05:02:31.071222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 234/462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:30 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:31.078319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:31.079526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:31.090709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.091561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.093254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.094441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.094955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.095623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.110257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.115702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:31.118667 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10249357-fd80-4534-bde6-ebc7e33efef8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.524980 Oct 26 05:02:31.119466 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 229/463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:30 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:31.126636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:31.127243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:31.145367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.147477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.149596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.150704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.153662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.154287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.244322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.256145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.257626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.272066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e26780ef-832c-4305-9b43-377a13896871 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.199225 Oct 26 05:02:31.272673 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 235/464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:31 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:31.304178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:31.307280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:31.325114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.327596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.328425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.330873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.335111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.336252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.518426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.531515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.533539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.534867 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a5aa896-753b-4d3f-a992-40fa10a1c2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1361 microversion: 2.25 time: 0.414707 Oct 26 05:02:31.536600 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 230/465] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:31 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:31.541624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:31.542239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:31.548428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.549086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.549541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.550478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.551987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.552633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.889615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.906444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6565a59-61fe-4b59-84fb-8eace37e32cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.611581 Oct 26 05:02:31.909258 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 236/466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:31 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:31.916894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c17d94cf-1f29-4f1a-941d-e6e8d0cb37da req-4e6a6b13-61ba-4c4c-af90-e52b7918c2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7433cab3-8fe8-4104-8a57-52413f45846d", "tag": "d5590cdb-d128-41c4-a340-5b750260bc85"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:31.921396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:31.930366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c17d94cf-1f29-4f1a-941d-e6e8d0cb37da req-4e6a6b13-61ba-4c4c-af90-e52b7918c2dc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.931086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c17d94cf-1f29-4f1a-941d-e6e8d0cb37da req-4e6a6b13-61ba-4c4c-af90-e52b7918c2dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.931984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c17d94cf-1f29-4f1a-941d-e6e8d0cb37da req-4e6a6b13-61ba-4c4c-af90-e52b7918c2dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.936841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d56a4c5b-e761-4b24-b8df-54598342ce9e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.399162 Oct 26 05:02:31.937470 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 231/467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:31 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:31.953401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:31.954220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:31.960548 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c17d94cf-1f29-4f1a-941d-e6e8d0cb37da req-4e6a6b13-61ba-4c4c-af90-e52b7918c2dc service nova] Creating event network-changed:d5590cdb-d128-41c4-a340-5b750260bc85 for instance 7433cab3-8fe8-4104-8a57-52413f45846d on n-h1-862416-4 Oct 26 05:02:31.964783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.965281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.965841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:31.966590 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c17d94cf-1f29-4f1a-941d-e6e8d0cb37da req-4e6a6b13-61ba-4c4c-af90-e52b7918c2dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055658 Oct 26 05:02:31.967355 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 237/468] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:31.967994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:31.968462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:31.968895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.094451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:32.095446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:32.102169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.102806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.103477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.104256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.104955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.105609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.225859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.235631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b725339-c306-4f81-a8fa-e4efdfc7cbed tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1278 microversion: 2.1 time: 0.145287 Oct 26 05:02:32.236221 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 238/469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:32 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:32.242811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:32.243650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:32.247041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.256997 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fac8db05-1553-4625-8625-d18f18cbdf54 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.307781 Oct 26 05:02:32.257190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.257691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.258196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.258659 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 232/470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:31 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:32.259117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.260262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.260861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.306682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:32.307713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:32.314186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.314921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.315574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.316510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.317207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.317862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.589625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.599937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.601614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.610975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f6c6f56-caa4-4681-9332-50a8b356e96f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.308234 Oct 26 05:02:32.625342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 233/471] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:32 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:32.632296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a5b66d-28fe-4e03-907d-f17c0f6e9295", "name": "network-vif-plugged", "status": "completed", "tag": "eb42081e-4a36-4f7a-a726-ab4e9f2374dd"}, {"server_uuid": "799dd620-87a8-4e32-9c1a-772b54ecb883", "name": "network-vif-plugged", "status": "completed", "tag": "ce571795-111e-46ca-80eb-a9eabfa95f90"}, {"server_uuid": "0d592cac-0cd1-4090-9d22-a64f8689a08c", "name": "network-vif-plugged", "status": "completed", "tag": "f42ca225-bc17-488a-a326-71240a1747c0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:32.647624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.648763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.649501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.669619 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Creating event network-vif-plugged:eb42081e-4a36-4f7a-a726-ab4e9f2374dd for instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 on n-h1-862416-4 Oct 26 05:02:32.670603 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Creating event network-vif-plugged:ce571795-111e-46ca-80eb-a9eabfa95f90 for instance 799dd620-87a8-4e32-9c1a-772b54ecb883 on n-h2-862416-4 Oct 26 05:02:32.673973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] Creating event network-vif-plugged:f42ca225-bc17-488a-a326-71240a1747c0 for instance 0d592cac-0cd1-4090-9d22-a64f8689a08c on n-h1-862416-4 Oct 26 05:02:32.694961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b489ed98-8191-4749-9db5-c419e83c11e7 req-25a25349-9232-4de8-977d-d241e008b62e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074828 Oct 26 05:02:32.695833 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 234/472] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:32.701940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:32.703537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:32.710811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.711434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.712107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.714113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.715193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.715341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.727170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.735294 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f75c5a45-f445-417b-a8f3-72edbf705501 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.497827 Oct 26 05:02:32.749356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 239/473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:32 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:32.934850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:32.935472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:32.942999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.943721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.944164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.945021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:32.945709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:32.946142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:32.952115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.965842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.967316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:32.968513 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-044502b4-3753-49c6-91c5-db9589cad2aa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1557 microversion: 2.25 time: 0.271659 Oct 26 05:02:32.971418 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 235/474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:32 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1557 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:32.997256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:32.997948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.012890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.013426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.013867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.014581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.015038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.026062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.170377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:33.178640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-611ae39d-3d57-4f4d-8697-62012c7ca6a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.247581 Oct 26 05:02:33.193767 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 240/475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:32 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:33.220792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:33.231052 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d01d2548-6058-4af8-85dc-8a26892ca507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.258527 Oct 26 05:02:33.232253 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 236/476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:32 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:33.237482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:33.238643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.246016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.246816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.247529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.248631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.249597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.250666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.258604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:33.259441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.265838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.266559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.267188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.268062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.268674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.269261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.542974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:33.546738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 79855693-370b-458d-b7dc-6a777007e914 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:33.551840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-33285448-83d7-4e44-afd1-61faed8c18f3 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1575 microversion: 2.1 time: 0.317744 Oct 26 05:02:33.556009 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 237/477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:33 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1575 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:33.568757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-df607736-d6a6-4b88-853d-a5966ff26fa3 req-020e9239-cee2-4a19-ade3-01f239f73d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ced283-dea4-4e31-b42c-609fe3c75d6c", "tag": "89f86040-f030-4c1a-93a5-8c432edf2d93"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:33.587891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-df607736-d6a6-4b88-853d-a5966ff26fa3 req-020e9239-cee2-4a19-ade3-01f239f73d54 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.588784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-df607736-d6a6-4b88-853d-a5966ff26fa3 req-020e9239-cee2-4a19-ade3-01f239f73d54 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.589507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-df607736-d6a6-4b88-853d-a5966ff26fa3 req-020e9239-cee2-4a19-ade3-01f239f73d54 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.611233 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-df607736-d6a6-4b88-853d-a5966ff26fa3 req-020e9239-cee2-4a19-ade3-01f239f73d54 service nova] Creating event network-changed:89f86040-f030-4c1a-93a5-8c432edf2d93 for instance 31ced283-dea4-4e31-b42c-609fe3c75d6c on n-h2-862416-4 Oct 26 05:02:33.626028 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-df607736-d6a6-4b88-853d-a5966ff26fa3 req-020e9239-cee2-4a19-ade3-01f239f73d54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068551 Oct 26 05:02:33.627109 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 238/478] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:33.636449 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-67ec622b-2e76-4ddd-b8be-9445d867bea1 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 2049 microversion: 2.25 time: 0.440742 Oct 26 05:02:33.637543 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 241/479] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:33 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 2049 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:33.637667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:33.638289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.644083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:33.645556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.650033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.650531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.650973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.651684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.652131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.653798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.654464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.655080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.656025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.656537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.657164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.661062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.674601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:33.865702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:33.877587 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b452216e-acba-4cc7-8040-134b881ce6eb tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.235555 Oct 26 05:02:33.877881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:33.888521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cc92ba3-0c91-41f5-8ece-e955f1d60fad tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.259854 Oct 26 05:02:33.890559 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 239/480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:33 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:33.893536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 242/481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:33 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:33.895889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:33.896695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.898406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:33.899209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:33.905346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.905842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.906280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.907258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.907598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.908085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.909501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.910957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.911436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:33.912129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:33.913783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:33.914238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.008441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:34.022696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:34.024159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:34.031048 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d56a17a-3a80-4a92-b909-c880769c86a9 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.139191 Oct 26 05:02:34.041522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 240/482] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:33 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:34.041522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:34.041522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:34.048427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.049629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.050094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.051012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.051413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.051848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.168158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 79855693-370b-458d-b7dc-6a777007e914 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:34.213775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dadee29-281c-423e-a179-ae4968c08e96 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 2049 microversion: 2.25 time: 0.319001 Oct 26 05:02:34.241303 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 243/483] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:33 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 2049 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:34.250257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:34.253069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:34.258371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:34.265202 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ada15b63-63b4-40da-a8de-b168d0b6b8e0 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1321 microversion: 2.1 time: 0.231980 Oct 26 05:02:34.271451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.273491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.274080 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 241/484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:34 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:34.276280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.277597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.278232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.280545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.290270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:34.296092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.296815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.297779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.298691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.299331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.299771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.327957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee170f41-5f2e-4217-8f0c-4a464a20099f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041628 Oct 26 05:02:34.328565 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 242/485] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 26 05:02:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:02:34.341497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:34.342599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:34.345539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:34.351409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.352453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.353109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.354089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.354698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.355524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.528577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:34.539414 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1dc5064f-1768-4dd2-abd6-b1dda5f0b9ec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1312 microversion: 2.1 time: 0.296881 Oct 26 05:02:34.540577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 244/486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:34 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:34.545586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862416-4", "block_migration": "auto"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:34.551481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:34.562854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.563576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.564752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.565684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.566325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.567564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.586071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:34.594887 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4ec07b5-bbce-493e-b5cd-c42ca92b0050 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.265094 Oct 26 05:02:34.597523 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 243/487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:34 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:34.666804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'flavor' on Instance uuid 79855693-370b-458d-b7dc-6a777007e914 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:34.714358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 79855693-370b-458d-b7dc-6a777007e914] Going to try to live migrate instance to n-h1-862416-4 {{(pid=120586) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:02:34.901372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:34.902033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:34.908175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.910660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.910660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:34.910834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:34.911832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:34.911832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.073460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.083243 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e72405ee-fe8d-41fd-b3d2-c20d176eae79 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1368 microversion: 2.1 time: 0.186793 Oct 26 05:02:35.084150 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 244/488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:34 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:35.088925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:35.089626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:35.103268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.103769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.104371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.105348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.105742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.106939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.284585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.293886 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a74e91cf-20f7-447f-85af-a58bd21e03bd tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.208694 Oct 26 05:02:35.294977 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:35 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:35.299739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:35.300345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:35.307271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.308041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.308746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.309853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.310546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.311043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.391414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.400549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.402033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.407356 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83e364b6-d760-471f-a859-1e87b302a908 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.111206 Oct 26 05:02:35.407933 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 246/490] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:35 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:35.418371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-05b0a98c-bb5d-4d3c-9aeb-6a6fdc9ffbf9 req-a4a81659-f617-49c4-863b-486b35122119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3953486d-caea-4259-a426-efbc8dc98ab3", "tag": "54d02c86-3292-40a3-9b82-7278b3e4da26"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:35.428793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05b0a98c-bb5d-4d3c-9aeb-6a6fdc9ffbf9 req-a4a81659-f617-49c4-863b-486b35122119 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.429642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05b0a98c-bb5d-4d3c-9aeb-6a6fdc9ffbf9 req-a4a81659-f617-49c4-863b-486b35122119 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.429989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05b0a98c-bb5d-4d3c-9aeb-6a6fdc9ffbf9 req-a4a81659-f617-49c4-863b-486b35122119 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.442686 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-05b0a98c-bb5d-4d3c-9aeb-6a6fdc9ffbf9 req-a4a81659-f617-49c4-863b-486b35122119 service nova] Creating event network-changed:54d02c86-3292-40a3-9b82-7278b3e4da26 for instance 3953486d-caea-4259-a426-efbc8dc98ab3 on n-h1-862416-4 Oct 26 05:02:35.447826 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-05b0a98c-bb5d-4d3c-9aeb-6a6fdc9ffbf9 req-a4a81659-f617-49c4-863b-486b35122119 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038599 Oct 26 05:02:35.448415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 247/491] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:35.453638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:35.454425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:35.461816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.462304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.463039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.463745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.464205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.464637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.627439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.637601 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8fd87e9c-5a98-4896-ba7c-b57ce615b149 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1471 microversion: 2.1 time: 0.187740 Oct 26 05:02:35.638505 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 248/492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:35 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:35.649064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:35.649846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:35.656192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.656724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.657201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.657951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.658406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.658834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.848290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:35.856881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b2b1656-63fe-40db-8c40-e0b7f48a95b9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1462 microversion: 2.1 time: 0.216895 Oct 26 05:02:35.857676 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 249/493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:35 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1462 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:35.861991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:35.862591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:35.869602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.870083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.870520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:35.871219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:35.871669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:35.872092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.020923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:36.028866 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f02c8a4-4cde-4e58-9586-999d5af3459f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.170369 Oct 26 05:02:36.044988 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 250/494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:35 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:36.049781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:36.050318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.056962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.057488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.057938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.058636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.059095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.059705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.083583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lazy-loading 'flavor' on Instance uuid e3a5b66d-28fe-4e03-907d-f17c0f6e9295 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:36.195841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-184e0b38-3ee2-4330-a993-7cc023add116 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295/action" status: 202 len: 0 microversion: 2.1 time: 0.149503 Oct 26 05:02:36.196688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 251/495] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:36 2022] POST /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:02:36.315306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:36.316105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.324928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.325555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.326070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.327008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.327672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.328246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.517846 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d0c3220-d4f6-44be-bbdf-52de89e1b41c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914/action" status: 202 len: 0 microversion: 2.25 time: 1.975264 Oct 26 05:02:36.522463 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 245/496] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:02:34 2022] POST /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914/action => generated 0 bytes in 1981 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:02:36.528136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:36.528757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.536064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.536568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.537399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.538435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.539089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.539785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.586272 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f314509-7a7d-47c4-bff9-5a90495d58db tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1613 microversion: 2.1 time: 0.388541 Oct 26 05:02:36.587512 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 252/497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:36 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1613 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:36.593180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:36.593808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.599773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.600582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.601007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.601719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.602224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.602643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.732584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:36.740389 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e14b60b-b641-4c86-9e87-8248975b627f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1558 microversion: 2.1 time: 0.216483 Oct 26 05:02:36.740971 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 246/498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:36 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:36.745560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:36.746375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.749354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:36.752759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.753253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.753854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.754864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.755220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.755404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.948401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-945f1196-adab-448d-94e9-f3baa4240b8a tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1630 microversion: 2.1 time: 0.357750 Oct 26 05:02:36.950773 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 253/499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:36 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1630 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:36.952910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:36.956728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:36.958897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.965645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.966560 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9853fe36-1ced-4327-8baa-643cef241aa9 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.221135 Oct 26 05:02:36.967268 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 247/500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:36 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:36.967929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.968709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.970199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.970823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.971467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.972311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:36.973621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:36.980645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.981146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.981660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:36.982509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:36.983041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:36.983615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.057718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.066077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.068233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.073858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-774c9727-9f52-4238-8330-98adbb0ed6ed tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.121918 Oct 26 05:02:37.074740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 254/501] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:36 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:37.079951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:37.080696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:37.087120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.088013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.088731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.089605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.090469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.091046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.152065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.161955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.164387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.165915 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b12c7c4b-31b8-4022-95a1-0d138ac2c96e tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.197453 Oct 26 05:02:37.170755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 248/502] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:36 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:37.172056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:37.172775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:37.179649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.180277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.180820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.181661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.182217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.182767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.195244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b012e8793cfd4ebf9121fdcab58605b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b6f2581d23493896cc3f2142bc9765', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.195855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] flavor_id is None. Assuming migration. {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 05:02:37.196297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:02:37.199512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:37.269120 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e6aebe0-f038-4950-bfde-66804b89df4e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100955 Oct 26 05:02:37.270013 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 249/503] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:02:37 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:37.278089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:37.278089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:37.282956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.283662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.285968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.286809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.287638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.288427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.318273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:37.403392 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-13e1954a-ae1d-45e6-a656-df75a87c1d88 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883/action" status: 202 len: 0 microversion: 2.1 time: 0.327207 Oct 26 05:02:37.407777 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 255/504] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:37 2022] POST /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:02:37.415676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:37.417143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:37.425092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.427482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.428294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.430057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:37.430813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:37.431402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:37.450923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.460750 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0467b555-acc7-4cc2-9d08-5246f4f6b5bb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.189256 Oct 26 05:02:37.461376 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 250/505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:37 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:37.608978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:37.618455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b0ac3ce-692f-4bd0-85a4-75f397d04f84 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1471 microversion: 2.1 time: 0.209254 Oct 26 05:02:37.622629 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 256/506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:37 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:37.980680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:37.981602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:37.994270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:37.996428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.000557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.001413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.002045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.002925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.006390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.007021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.008958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.010711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.012395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.020424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.021171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.021741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.267986 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7932ffc8-c544-4af6-82a9-29bca71d184d tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1613 microversion: 2.1 time: 0.297269 Oct 26 05:02:38.270709 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 251/507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:37 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1613 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:38.279745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-cf0f22df-68ff-4e54-809f-376e8e7dfdf1 req-fa336542-c7b2-4779-9bca-d09e9e0523ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7433cab3-8fe8-4104-8a57-52413f45846d", "name": "network-vif-plugged", "status": "completed", "tag": "d5590cdb-d128-41c4-a340-5b750260bc85"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:38.298533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cf0f22df-68ff-4e54-809f-376e8e7dfdf1 req-fa336542-c7b2-4779-9bca-d09e9e0523ad service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.299072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cf0f22df-68ff-4e54-809f-376e8e7dfdf1 req-fa336542-c7b2-4779-9bca-d09e9e0523ad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.299550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.300281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cf0f22df-68ff-4e54-809f-376e8e7dfdf1 req-fa336542-c7b2-4779-9bca-d09e9e0523ad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.309987 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1756818c-5422-408b-adc7-2af2f4204833 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.322960 Oct 26 05:02:38.311079 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 257/508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:37 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:38.314174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-cf0f22df-68ff-4e54-809f-376e8e7dfdf1 req-fa336542-c7b2-4779-9bca-d09e9e0523ad service nova] Creating event network-vif-plugged:d5590cdb-d128-41c4-a340-5b750260bc85 for instance 7433cab3-8fe8-4104-8a57-52413f45846d on n-h1-862416-4 Oct 26 05:02:38.321002 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-cf0f22df-68ff-4e54-809f-376e8e7dfdf1 req-fa336542-c7b2-4779-9bca-d09e9e0523ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047114 Oct 26 05:02:38.324852 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 252/509] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:38.327943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:38.328558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.330255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:38.330974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.338538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.339037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.339658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.340533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.341286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.341928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.344889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.345398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.346007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.346845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.347625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.349444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.466030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.492237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.494356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.508918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-581979e6-f39c-4e11-ba21-929bff134a72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.196585 Oct 26 05:02:38.509545 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 258/510] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:38 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:38.525498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:38.525498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.538584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.541561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.542152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.542602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.544469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.544937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.545394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.552203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.553848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.555323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dbfb889f-5da3-4372-9d5c-92fbadb8e9ef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.229165 Oct 26 05:02:38.556124 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 253/511] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:38 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:38.565542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:38.565542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.576430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.576430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.576430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.576430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.576840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.576840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.581153 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] HTTP exception thrown: Cannot 'migrate' instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 while it is in vm_state suspended Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Request method failure captured: Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295/action HTTP/1.1 Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 15 Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL88X0WG6Da2bgMSeRHcyO8A8rFyaCEzVmJ7Yw0kyqnXSmF3vnVSzQOzglWlvsvV49_-0EhZPa9PF3X62LmY07t8hmzL7INRTfd8jD4qm-yGdX9jhAVlh1UymFXmmPJFPiD5UU2rnIw7OHayx2eUet5Rs7MypPcA1GLowKzM9iF244M Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:02:38.583205 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 78ec4e37dfe7473f895ddd48b4782ce7 Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: {"migrate": {}} Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:38.584738 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'migrate' instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 while it is in vm_state suspended Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e3a5b66d-28fe-4e03-907d-f17c0f6e9295', 'body': {'migrate': {}}} Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 in vm_state suspended. Cannot resize while the instance is in this state. Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.585716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 while it is in vm_state suspended Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.587126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.588478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:38.588478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:38.588478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 while it is in vm_state suspended Oct 26 05:02:38.588478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.588478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Returning 409 to user: Cannot 'migrate' instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 while it is in vm_state suspended {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:38.588478 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95c2cbfe-72f8-4061-9760-97e88992f55c tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295/action" status: 409 len: 148 microversion: 2.1 time: 0.072331 Oct 26 05:02:38.593665 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 259/512] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:38 2022] POST /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295/action => generated 148 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:02:38.599461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2c1485e-3282-41e6-ae03-4c3d89c82acd tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2c1485e-3282-41e6-ae03-4c3d89c82acd tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Request method failure captured: Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28/action HTTP/1.1 Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 39 Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL88X0WG6Da2bgMSeRHcyO8A8rFyaCEzVmJ7Yw0kyqnXSmF3vnVSzQOzglWlvsvV49_-0EhZPa9PF3X62LmY07t8hmzL7INRTfd8jD4qm-yGdX9jhAVlh1UymFXmmPJFPiD5UU2rnIw7OHayx2eUet5Rs7MypPcA1GLowKzM9iF244M Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:02:38.603405 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 78ec4e37dfe7473f895ddd48b4782ce7 Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: {"os-resetState": {"state": "invalid"}} Oct 26 05:02:38.605054 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'bb8ffcad-160b-4442-a101-a3cbda282f28', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.605971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:02:38.607575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 26 05:02:38.609099 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.610176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2c1485e-3282-41e6-ae03-4c3d89c82acd tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:38.611166 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2c1485e-3282-41e6-ae03-4c3d89c82acd tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28/action" status: 400 len: 144 microversion: 2.1 time: 0.016311 Oct 26 05:02:38.616405 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 260/513] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:38 2022] POST /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28/action => generated 144 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:02:38.628933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de09aef0-0b58-4d47-a3dc-25f2d43b3632 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de09aef0-0b58-4d47-a3dc-25f2d43b3632 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Request method failure captured: Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28/action HTTP/1.1 Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 31 Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL88X0WG6Da2bgMSeRHcyO8A8rFyaCEzVmJ7Yw0kyqnXSmF3vnVSzQOzglWlvsvV49_-0EhZPa9PF3X62LmY07t8hmzL7INRTfd8jD4qm-yGdX9jhAVlh1UymFXmmPJFPiD5UU2rnIw7OHayx2eUet5Rs7MypPcA1GLowKzM9iF244M Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:02:38.638460 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 78ec4e37dfe7473f895ddd48b4782ce7 Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: {"os-resetState": {"state": 1}} Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:38.640126 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'bb8ffcad-160b-4442-a101-a3cbda282f28', 'body': {'os-resetState': {'state': 1}}} Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 1 Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:38.641098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 26 05:02:38.642786 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.645912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de09aef0-0b58-4d47-a3dc-25f2d43b3632 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:38.646938 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-de09aef0-0b58-4d47-a3dc-25f2d43b3632 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28/action" status: 400 len: 120 microversion: 2.1 time: 0.021965 Oct 26 05:02:38.650835 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 261/514] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:38 2022] POST /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28/action => generated 120 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:02:38.674800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:38.675771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.683718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.684314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.684760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.685626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.686107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.687272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.751072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.761286 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7a29483-4dae-424f-ba8e-560a92acc116 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.203592 Oct 26 05:02:38.764880 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 254/515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:38 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:38.769813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de9443db-8802-4bbe-ad87-5b30122f9319 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:38.782068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de9443db-8802-4bbe-ad87-5b30122f9319 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Failed to fetch instance by id 999 {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:02:38.782853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-de9443db-8802-4bbe-ad87-5b30122f9319 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de9443db-8802-4bbe-ad87-5b30122f9319 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Request method failure captured: Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 37 Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL88X0WG6Da2bgMSeRHcyO8A8rFyaCEzVmJ7Yw0kyqnXSmF3vnVSzQOzglWlvsvV49_-0EhZPa9PF3X62LmY07t8hmzL7INRTfd8jD4qm-yGdX9jhAVlh1UymFXmmPJFPiD5UU2rnIw7OHayx2eUet5Rs7MypPcA1GLowKzM9iF244M Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:02:38.792178 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4a90b89db57483d844f2ded403eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a4a90b89db57483d844f2ded403eaff5 Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-153150539 Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 78ec4e37dfe7473f895ddd48b4782ce7 Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdminNegativeTestJSON-153150539-project-admin Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: {"os-resetState": {"state": "error"}} Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:38.793744 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 999 could not be found. Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:02:38.794591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de9443db-8802-4bbe-ad87-5b30122f9319 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:38.799099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de9443db-8802-4bbe-ad87-5b30122f9319 tempest-ServersAdminNegativeTestJSON-153150539 tempest-ServersAdminNegativeTestJSON-153150539-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031885 Oct 26 05:02:38.806327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 255/516] 10.222.0.16 () {60 vars in 1179 bytes} [Wed Oct 26 05:02:38 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:02:38.816672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:38.817707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.835082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.835764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.836303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.837419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.837982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.838505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.867899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:02:38.889217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:38.898772 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-07823edc-ea13-4ed1-8a88-59872761908d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1471 microversion: 2.1 time: 0.246567 Oct 26 05:02:38.899608 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 262/517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:38 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:38.952045 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79a427fa-4f1b-4260-8eb5-a5feb66d23b5 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 204 len: 0 microversion: 2.1 time: 0.144464 Oct 26 05:02:38.952635 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 256/518] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:02:38 2022] DELETE /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:02:38.960658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:38.961267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:38.967875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.968368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.968806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:38.969543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:38.969998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:38.970425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.102269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.110305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3e9965a1-e6e3-44be-9efb-ddd1447be6a8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1468 microversion: 2.1 time: 0.153537 Oct 26 05:02:39.110886 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 263/519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:38 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1468 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:39.334290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:39.335192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:39.341989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.342515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.342955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.343660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.344121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.344549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.486897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.495254 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46e2ca89-bd67-4b20-9505-61173a71c5f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.165204 Oct 26 05:02:39.495832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 257/520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:39 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:39.539717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:39.540317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:39.546171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.546650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.547143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.547834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.548283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.548703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.584138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:39.584813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:39.591198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.591874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.592477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.593406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.593866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.594401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.616950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.627273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.630588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.639049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f969fa0-27e6-4d45-b8ba-9a76155d008f tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.104689 Oct 26 05:02:39.639818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 264/521] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:39 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:39.649677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e5d95d3c-91a1-436d-8a64-4f86f76b1414 req-8581d389-224e-4f19-8d7b-c02c08d106b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d592cac-0cd1-4090-9d22-a64f8689a08c", "tag": "f42ca225-bc17-488a-a326-71240a1747c0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:39.661093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e5d95d3c-91a1-436d-8a64-4f86f76b1414 req-8581d389-224e-4f19-8d7b-c02c08d106b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.661698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e5d95d3c-91a1-436d-8a64-4f86f76b1414 req-8581d389-224e-4f19-8d7b-c02c08d106b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.662234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e5d95d3c-91a1-436d-8a64-4f86f76b1414 req-8581d389-224e-4f19-8d7b-c02c08d106b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.673613 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e5d95d3c-91a1-436d-8a64-4f86f76b1414 req-8581d389-224e-4f19-8d7b-c02c08d106b6 service nova] Creating event network-changed:f42ca225-bc17-488a-a326-71240a1747c0 for instance 0d592cac-0cd1-4090-9d22-a64f8689a08c on n-h1-862416-4 Oct 26 05:02:39.679436 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e5d95d3c-91a1-436d-8a64-4f86f76b1414 req-8581d389-224e-4f19-8d7b-c02c08d106b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038035 Oct 26 05:02:39.680780 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 265/522] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:39.753141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.762578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.764042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.765234 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd6172ac-1cdf-4718-af1b-9064cf93ad40 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.185644 Oct 26 05:02:39.765849 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 258/523] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:39 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:39.790800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:39.791513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:39.798024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.798520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.798961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.799673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.800131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.800563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.923314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:39.923931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:39.926649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:39.927703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=26 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:39.933872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.934373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.934811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.935836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:39.935963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:39.936810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:39.947649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:39.957552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db4d3fe3-4b80-4028-b318-8d2451db22fe tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.171387 Oct 26 05:02:39.958136 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 266/524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:39 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:40.073347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.081084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e868400-e228-46f7-88ce-5f6b4edb50eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1471 microversion: 2.1 time: 0.161576 Oct 26 05:02:40.081696 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 259/525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:39 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:40.133904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:40.135121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:40.140953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.142230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.142230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.142835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.143392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.143885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.287226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.295469 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8a589b1-3994-439d-9b99-cf3982523495 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1468 microversion: 2.1 time: 0.165750 Oct 26 05:02:40.296180 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 267/526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:40 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:40.347364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-23ea5beb-c778-4059-bd61-deaab4df0eda req-a7048759-df84-41b8-812f-fd47db2a3807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3953486d-caea-4259-a426-efbc8dc98ab3", "name": "network-vif-plugged", "status": "completed", "tag": "54d02c86-3292-40a3-9b82-7278b3e4da26"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:40.360761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-23ea5beb-c778-4059-bd61-deaab4df0eda req-a7048759-df84-41b8-812f-fd47db2a3807 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.361356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-23ea5beb-c778-4059-bd61-deaab4df0eda req-a7048759-df84-41b8-812f-fd47db2a3807 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.361859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-23ea5beb-c778-4059-bd61-deaab4df0eda req-a7048759-df84-41b8-812f-fd47db2a3807 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.377769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-23ea5beb-c778-4059-bd61-deaab4df0eda req-a7048759-df84-41b8-812f-fd47db2a3807 service nova] Creating event network-vif-plugged:54d02c86-3292-40a3-9b82-7278b3e4da26 for instance 3953486d-caea-4259-a426-efbc8dc98ab3 on n-h1-862416-4 Oct 26 05:02:40.385529 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-23ea5beb-c778-4059-bd61-deaab4df0eda req-a7048759-df84-41b8-812f-fd47db2a3807 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041958 Oct 26 05:02:40.386646 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 260/527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:40.517651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:40.518250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:40.525050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.525551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.525985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.526674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.527121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.527542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.656756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.665810 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64a47f4c-9175-4f54-a57f-7ea7659f35b1 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.151989 Oct 26 05:02:40.666457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 268/528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:40 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:40.669061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:40.669607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:40.678824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.679315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.679756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.680449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.680933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.681397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.753092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.764136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.765697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.771895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6c5e1b4-c37c-42ac-99dc-eddab8cd77e0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.107344 Oct 26 05:02:40.772818 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 261/529] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:40 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:40.791951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:40.792936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:40.799081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.799701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.800236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.802406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.803080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.803581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.977257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.983275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:40.984007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:40.993380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.994114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.994279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.994765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.995823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:40.995965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:40.996540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:40.997018 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-51af0210-4235-4063-870e-b7ad8c41b1c5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.209512 Oct 26 05:02:40.997209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:40.997615 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 269/530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:40 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:41.105286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:41.106388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:41.117103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.121351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.121959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.124034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.124500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.124932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.258487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:41.272346 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c592e917-4a5e-4348-8372-587c7954485e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1389 microversion: 2.1 time: 0.294975 Oct 26 05:02:41.274184 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 262/531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:40 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1389 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:41.321532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:41.322389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:41.332142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.335268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.335831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.336677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.339123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.343597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.495231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:41.504368 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b8f02fb8-f27b-4ddc-99e4-5bf58ba897e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1471 microversion: 2.1 time: 0.403067 Oct 26 05:02:41.521406 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 270/532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:41 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:41.584398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:41.592876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-11328487-1bb7-4559-b28a-b5cc3b6ef804 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1468 microversion: 2.1 time: 0.277511 Oct 26 05:02:41.593867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 263/533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:41 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:41.690668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:41.692191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:41.722672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.723120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.723614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.724900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.725674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.726266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.795670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ec2d15d8-4565-428d-bada-0deb4bf3edf3 req-651ac59a-fee4-428d-9973-fd6000bf7e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79855693-370b-458d-b7dc-6a777007e914", "name": "network-vif-unplugged", "status": "completed", "tag": "d7959dec-6be1-405b-8ba4-aefe5e3be104"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:41.816825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec2d15d8-4565-428d-bada-0deb4bf3edf3 req-651ac59a-fee4-428d-9973-fd6000bf7e35 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.821442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec2d15d8-4565-428d-bada-0deb4bf3edf3 req-651ac59a-fee4-428d-9973-fd6000bf7e35 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.821925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec2d15d8-4565-428d-bada-0deb4bf3edf3 req-651ac59a-fee4-428d-9973-fd6000bf7e35 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.847030 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ec2d15d8-4565-428d-bada-0deb4bf3edf3 req-651ac59a-fee4-428d-9973-fd6000bf7e35 service nova] Creating event network-vif-unplugged:d7959dec-6be1-405b-8ba4-aefe5e3be104 for instance 79855693-370b-458d-b7dc-6a777007e914 on n-h2-862416-4 Oct 26 05:02:41.859287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ec2d15d8-4565-428d-bada-0deb4bf3edf3 req-651ac59a-fee4-428d-9973-fd6000bf7e35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066214 Oct 26 05:02:41.860234 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 264/534] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:02:41.871827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:41.873788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:41.892858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.893842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.895036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:41.896124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:41.896942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:41.906104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.018070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.022036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.031040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.031274 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ba98e08-7e6d-48e3-8018-7eedf69f2242 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1320 microversion: 2.1 time: 0.345165 Oct 26 05:02:42.034343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.044808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64b212c5-ae8d-4cb2-ac48-68895910b7b4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.181398 Oct 26 05:02:42.049467 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 271/535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:41 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:42.052501 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 265/536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:41 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:42.054651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:42.055426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:42.064966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.065799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.067300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.068248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.068881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.069348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.220943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.230811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.232431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.233863 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0db1c8b1-7e3e-449f-8c55-09705bf27546 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.186407 Oct 26 05:02:42.234813 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 272/537] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:42 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:42.308027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:42.308662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:42.320112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.320622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.321066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.321831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.322289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.322720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.534285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:42.534922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:42.545786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.546316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.554082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.554947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.555440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.555898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.558545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.585900 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1583aab0-a97c-4454-a6b8-5f5d9b0d4507 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1586 microversion: 2.1 time: 0.290286 Oct 26 05:02:42.589193 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 266/538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:42 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1586 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:42.614034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:42.614034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:42.622154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.626414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.628315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.629620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.630512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.631183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.753305 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c1ed382-bc83-4793-bd65-accc3019a59d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144935 Oct 26 05:02:42.754636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 267/539] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:02:42 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:02:42.757712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.764194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:42.768164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:42.768164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:42.768480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-908deb6c-1db1-485e-b3f8-55961b9bada6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1471 microversion: 2.1 time: 0.237106 Oct 26 05:02:42.768480 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 273/540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:42 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:42.773688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.774180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.774798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.775676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.776281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.776895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.826242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:42.826999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:42.827604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:42.828225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lazy-loading 'fault' on Instance uuid e3a5b66d-28fe-4e03-907d-f17c0f6e9295 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:42.835119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:42.885388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:42.895494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2688ba7e-71af-49b4-9e6b-54feed3619c2 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 200 len: 1311 microversion: 2.1 time: 0.139540 Oct 26 05:02:42.909613 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 268/541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:42 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 1311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:43.057243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.057998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.067744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.069036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.069715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.071055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.071680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.072108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.075917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.076534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.083517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.084019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.084459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.085174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.085781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.086085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.184977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.194276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.195743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.201237 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6fc05ebb-ef5e-4e76-aa0d-f7cf2ffdc2c5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.129341 Oct 26 05:02:43.202048 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 269/542] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:43.246772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.256008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-735651aa-5a8b-46fb-beac-695db2db3188 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1470 microversion: 2.1 time: 0.203231 Oct 26 05:02:43.256809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 274/543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:43.260728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.261522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.268105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.268780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.270040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.270864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.271429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.271960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.279248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:43.281595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.287789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.288541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.288973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.289883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.290338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.290764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.383563 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-45bdd725-984b-42f7-9ecd-255197e68d96 tempest-DeleteServersAdminTestJSON-1068750374 tempest-DeleteServersAdminTestJSON-1068750374-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3/action" status: 202 len: 0 microversion: 2.1 time: 0.107888 Oct 26 05:02:43.384560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 275/544] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:02:43 2022] POST /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:02:43.392856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.394014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.400387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.400874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.401329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.402194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.402651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.403078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.427223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.440008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.440851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.442063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.442775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid 3953486d-caea-4259-a426-efbc8dc98ab3 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:43.443481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.453505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.455437 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1cec2586-30b9-44f2-8c12-3603de7c113a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.198839 Oct 26 05:02:43.469341 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 270/545] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:43.574175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.585553 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee071602-15dd-49ae-a8c7-bd1ae820d586 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1453 microversion: 2.1 time: 0.197017 Oct 26 05:02:43.586129 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 276/546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:43.608914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.609900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.617286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.618054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.618553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.619252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.619703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.620288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.647735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:02:43.726972 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d7f8c87b-cbe9-4a56-a899-fb47815f177e tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 204 len: 0 microversion: 2.1 time: 0.121911 Oct 26 05:02:43.728038 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 271/547] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:02:43 2022] DELETE /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:02:43.738806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.739623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.745631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.746187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.746617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.747460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.747937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.748360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.781056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.781704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.781916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.782359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid 3953486d-caea-4259-a426-efbc8dc98ab3 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:43.791409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:43.792708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:43.800551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.801165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.801826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.802807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.803527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.804423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:43.952653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.961727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fbd36618-c1d1-4b0e-8941-8e6f788501ae tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1459 microversion: 2.1 time: 0.226937 Oct 26 05:02:43.962421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 277/548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1459 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:43.980228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:43.984175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a5b66d-28fe-4e03-907d-f17c0f6e9295", "name": "network-vif-deleted", "tag": "eb42081e-4a36-4f7a-a726-ab4e9f2374dd"}, {"name": "network-changed", "server_uuid": "79855693-370b-458d-b7dc-6a777007e914", "tag": "d7959dec-6be1-405b-8ba4-aefe5e3be104"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:43.991919 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c84cbd4f-42ce-4a0d-9cee-a87ebee670b7 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1471 microversion: 2.1 time: 0.205259 Oct 26 05:02:43.993626 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 272/549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:43.995592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:43.996078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:43.996546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.000093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.000848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: e3a5b66d-28fe-4e03-907d-f17c0f6e9295] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.007830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.008442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.008913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.009629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.010222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.010648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.010847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] Creating event network-vif-deleted:eb42081e-4a36-4f7a-a726-ab4e9f2374dd for instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 on n-h1-862416-4 Oct 26 05:02:44.011351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] Creating event network-changed:d7959dec-6be1-405b-8ba4-aefe5e3be104 for instance 79855693-370b-458d-b7dc-6a777007e914 on n-h2-862416-4 Oct 26 05:02:44.020119 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-40ba5108-b106-491d-b9cb-5a2d655c32e3 req-84189cb3-af6b-4f58-a002-fb6d2b86fc6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044350 Oct 26 05:02:44.020714 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 278/550] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:44.027334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] HTTP exception thrown: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 could not be found. Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Request method failure captured: Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 HTTP/1.1 Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL86PXOR2SAQCqoA9ifGf2DqwvvX3QAGfszU5d3DDJJYdiSFA8LK1kP-ky-MawONOay_wQs9LcJeIAttrU_Ll_B9wb43unNy4-cs99CkvCCd6L6KPiKjFK9sYVgbkt1mQJmkLuJ431MKD-cfoPaFcvOIu-kgmJvk99Qgbrs8v0w4_hE Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b27808642e3a4e089823c56242eddaee Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-925455120 Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:44.029613 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b27808642e3a4e089823c56242eddaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b27808642e3a4e089823c56242eddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b27808642e3a4e089823c56242eddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b27808642e3a4e089823c56242eddaee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdminNegativeTestJSON-925455120 Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b27808642e3a4e089823c56242eddaee Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-925455120 Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdminNegativeTestJSON-925455120-project Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 7cc07d881f794f6f8a8516aabbfdb1fd Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdminNegativeTestJSON-925455120-project Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 could not be found. Oct 26 05:02:44.031258 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e3a5b66d-28fe-4e03-907d-f17c0f6e9295'} Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 could not be found. Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:44.032205 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 could not be found. Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 could not be found. Oct 26 05:02:44.033654 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:44.035067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Returning 404 to user: Instance e3a5b66d-28fe-4e03-907d-f17c0f6e9295 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:44.035067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cbbf609f-cdd3-47e1-a9e9-bd0a6571cd9b tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295" status: 404 len: 111 microversion: 2.1 time: 0.036513 Oct 26 05:02:44.035067 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 273/551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:43 2022] GET /compute/v2.1/servers/e3a5b66d-28fe-4e03-907d-f17c0f6e9295 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:44.043443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.044039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.051193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.051763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.052226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.053119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.053765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.054355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.081446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:02:44.195612 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5a7461ed-9fca-4030-b540-5782d71f2641 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 204 len: 0 microversion: 2.1 time: 0.155942 Oct 26 05:02:44.199425 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 279/552] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:02:44 2022] DELETE /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:02:44.209039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.210228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.221261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.222025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.222560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.223278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.223722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.224150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.229278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.231676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.237759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.238855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.238855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.240010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.240469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.240894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.307889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:44.374598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.385641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.387237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.392571 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-18131946-87a6-4500-87b2-f84a6fafe83a tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.167596 Oct 26 05:02:44.393452 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 280/553] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:44 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:44.482328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.483082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.489893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.490391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.490836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.491549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.492027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.492444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.506356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.519390 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c93a848-7867-437d-988d-65111c363cce tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1477 microversion: 2.1 time: 0.317867 Oct 26 05:02:44.519971 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 274/554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:44 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:44.598178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.598797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.604913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.605427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.606291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.607210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.607890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.608510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.752226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.761126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.762872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.764112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63384cb0-29ec-4b72-8b48-af08c156e684 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.285801 Oct 26 05:02:44.777670 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 281/555] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:44 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:44.839986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:44.848032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3955051-4b98-40b9-b764-5606d576e37a tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 200 len: 1586 microversion: 2.1 time: 0.253618 Oct 26 05:02:44.848722 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 275/556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:44 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 1586 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:44.987591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:44.988925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:44.994894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.995372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.995804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:44.996497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:44.996947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:44.997396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.017119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:45.017959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:45.024242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.024744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.025191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.025932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.026400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.027622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.032866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.032866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.032866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.033147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid 3953486d-caea-4259-a426-efbc8dc98ab3 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:45.218428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:45.221948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:45.226288 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a3988b68-0cd4-48f0-9c32-e3662835eaab tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1459 microversion: 2.1 time: 0.242459 Oct 26 05:02:45.227054 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 282/557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:44 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1459 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:45.230382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a27f84c-e7fe-440b-9525-20fe2430d4e8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.217408 Oct 26 05:02:45.231095 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 276/558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:45 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:45.421115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:45.421854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:45.423795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:45.429118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.429645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.430090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.430798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.431255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.431683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.498466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:45.507419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:45.508920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:45.514374 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a07b30c7-6b26-4109-b514-73bd2daa6015 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.097228 Oct 26 05:02:45.514949 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 283/559] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:45 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:45.544254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:45.544872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:45.552649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.553140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.553609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.554312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.554772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.555201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.688142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:45.696820 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60762156-7ae3-4ad2-b95c-af7455d9cdae tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1477 microversion: 2.1 time: 0.156381 Oct 26 05:02:45.697436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 277/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:45 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:45.791500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:45.792107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:45.798476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.799089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.799592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:45.801280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:45.801528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:45.801955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.057743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-00c15bc2-e344-4e1c-97fd-a6d27a684a7b req-6ea82159-bbba-4747-b25b-cff6d438bf21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7433cab3-8fe8-4104-8a57-52413f45846d", "tag": "d5590cdb-d128-41c4-a340-5b750260bc85"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:46.068054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-00c15bc2-e344-4e1c-97fd-a6d27a684a7b req-6ea82159-bbba-4747-b25b-cff6d438bf21 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.068634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-00c15bc2-e344-4e1c-97fd-a6d27a684a7b req-6ea82159-bbba-4747-b25b-cff6d438bf21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.069546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-00c15bc2-e344-4e1c-97fd-a6d27a684a7b req-6ea82159-bbba-4747-b25b-cff6d438bf21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.080993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-00c15bc2-e344-4e1c-97fd-a6d27a684a7b req-6ea82159-bbba-4747-b25b-cff6d438bf21 service nova] Creating event network-changed:d5590cdb-d128-41c4-a340-5b750260bc85 for instance 7433cab3-8fe8-4104-8a57-52413f45846d on n-h1-862416-4 Oct 26 05:02:46.087132 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-00c15bc2-e344-4e1c-97fd-a6d27a684a7b req-6ea82159-bbba-4747-b25b-cff6d438bf21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032968 Oct 26 05:02:46.090995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 278/561] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:02:46.192470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.200496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.201975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.203114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-52b20f7d-c746-493b-945c-26250e63cd65 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.415757 Oct 26 05:02:46.203670 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 284/562] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:45 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:46.250162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:46.250869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:46.253106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:46.253776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:46.257424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.257922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.258379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.259082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.259473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.259602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.259948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.260071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.260378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.261056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.261537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.261955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.292183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.292671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.293135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.293610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid 3953486d-caea-4259-a426-efbc8dc98ab3 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:46.454801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.459416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.467918 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-722113f9-6529-46e6-952a-8c2dea2d8387 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1459 microversion: 2.1 time: 0.222057 Oct 26 05:02:46.468505 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 279/563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:46 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1459 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:46.471560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4ab7ed7-9839-438f-b3ff-a0456b784f20 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.219730 Oct 26 05:02:46.471560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 285/564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:46 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:46.542458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:46.543084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:46.549683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.550164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.551261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.551948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.552405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.552827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.618000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.626952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.628978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.634790 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e766923b-92e2-4e09-a3f1-757f05cb23e1 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.096431 Oct 26 05:02:46.635870 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 280/565] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:46 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:46.719953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:46.720596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:46.727128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.727607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.728034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.728731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:46.729170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:46.729615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:46.866290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:46.870064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:46.875903 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-831cef58-5934-49c5-aa3c-2f9c763056dd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1477 microversion: 2.1 time: 0.159778 Oct 26 05:02:46.876481 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 286/566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:46 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:47.228205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:47.228826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:47.235025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.235516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.235957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.236663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.237124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.237579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.373539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.382278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.383306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.384460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41cdac15-3226-471f-8970-c84918a66c4c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.160215 Oct 26 05:02:47.385477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 281/567] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:47 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:47.492876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:47.493434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:47.493672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:47.493785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:47.500364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.500484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.500986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.501201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.501669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.501830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.502595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.502853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.503172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.503472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.503706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.503913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.537183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.537801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.538554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.539094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid 3953486d-caea-4259-a426-efbc8dc98ab3 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:47.709183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.716167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.722880 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7beb8ca3-ed80-48a7-ae7f-4907f90f16b0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.234082 Oct 26 05:02:47.723470 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 287/568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:47 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:47.728578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:47.733278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:47.735216 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa7d96c3-dfe6-4599-9f68-986a3524d747 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1459 microversion: 2.1 time: 0.246810 Oct 26 05:02:47.741024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.741772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.742377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.743238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.743839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.744420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.747960 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 282/569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:47 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1459 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:47.812400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.820728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.822220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.827306 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34912991-6894-4f5a-8915-70077f013748 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.102565 Oct 26 05:02:47.827879 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 288/570] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:47 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:47.900899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:47.901629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:47.907647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.908133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.908711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.909424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:47.910609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:47.911039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:47.983925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:47.996324 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ebe65c5c-b915-4c85-afb5-511cab712cd6 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1435 microversion: 2.1 time: 0.098770 Oct 26 05:02:47.997610 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 283/571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:47 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1435 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:48.103690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8ffcad-160b-4442-a101-a3cbda282f28", "name": "network-vif-deleted", "tag": "d997e858-1a7f-4971-9079-dc1e0001a924"}, {"server_uuid": "3953486d-caea-4259-a426-efbc8dc98ab3", "name": "network-vif-deleted", "tag": "54d02c86-3292-40a3-9b82-7278b3e4da26"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:48.115504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.116162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.116630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.130555 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] Creating event network-vif-deleted:d997e858-1a7f-4971-9079-dc1e0001a924 for instance bb8ffcad-160b-4442-a101-a3cbda282f28 on n-h1-862416-4 Oct 26 05:02:48.131499 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] Creating event network-vif-deleted:54d02c86-3292-40a3-9b82-7278b3e4da26 for instance 3953486d-caea-4259-a426-efbc8dc98ab3 on n-h1-862416-4 Oct 26 05:02:48.137757 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0a841c26-ddb3-43b1-8d69-1c335ce8f94b req-8d9be588-fe6e-4a4b-a0a5-0cdd0a0b98a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037896 Oct 26 05:02:48.142184 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 289/572] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:48.408881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:48.410323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:48.417623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.418755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.419210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.419932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.420401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.420836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.425289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:48.659663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:48.676409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:48.678890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:48.680480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-518bd24d-4cf6-4c3f-97c1-42094c028f2d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.275792 Oct 26 05:02:48.681485 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 284/573] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:48 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:48.751755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:48.752588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:48.760894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.761778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.762403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.763332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.764004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.764165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:48.764734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.764959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:48.769896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:48.779715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.781855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.782497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.785915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.786951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.787683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.838035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.838544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.839191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.839952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lazy-loading 'fault' on Instance uuid 3953486d-caea-4259-a426-efbc8dc98ab3 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:48.906350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b1b64963ee47d98f03ae09a7ff9f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965954d969624da4bfa8d8c5153abbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:48.915650 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f83e893-2eab-42e3-b560-aa7b5ea2be05 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 200 len: 1310 microversion: 2.1 time: 0.157323 Oct 26 05:02:48.922489 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 285/574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:48 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:48.927193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:48.927794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:48.937604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.938907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.939631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:48.940623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:48.942206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:48.942879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.058938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.064340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.069257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.070792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.076302 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8bac7d3-01b2-4d93-b4fd-5490eac7c208 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.158136 Oct 26 05:02:49.076958 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 286/575] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:48 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:49.082720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:49.083335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:49.089450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.089997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.090505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.091240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.091705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.092220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.095621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa2767a4-a670-44b7-af24-dc97b7a12eff tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.340899 Oct 26 05:02:49.100262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 290/576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:48 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:49.130473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.130960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.131709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.131923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lazy-loading 'fault' on Instance uuid bb8ffcad-160b-4442-a101-a3cbda282f28 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:49.212833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc07d881f794f6f8a8516aabbfdb1fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27808642e3a4e089823c56242eddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.224633 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-58962e57-8cce-4d2e-a491-f4182fe43cdd tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 200 len: 1311 microversion: 2.1 time: 0.146541 Oct 26 05:02:49.231648 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 287/577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:49 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:49.711384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:49.712726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:49.719983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.720760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.721487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.722873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.723573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.724079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.861878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.871306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.873485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:49.875371 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0a2a72a-cb3b-4187-b7c1-e25c468b7874 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1567 microversion: 2.25 time: 0.171656 Oct 26 05:02:49.876008 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 291/578] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:49 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:49.941970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:49.942612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:49.949681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.950514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.950956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.951666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.952742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.953178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.968511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] HTTP exception thrown: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Request method failure captured: Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 HTTP/1.1 Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8sf7n3DF4VOERk-V1FatJrcOGHhjyJmbtQ3AioZF2uO8fBlJqWxNKhgUtWnUXmc-fpR13luM7eu-Njk3VamNm14Ck-BHEeOMM1x_OPRDfsWRLnVtUN1MNrJu0beS9juGe6WQWWSArQuVEdxkyDnXdGyWPMhZLuYPJgr1V6-J9wrpY Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:49.970269 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53b1b64963ee47d98f03ae09a7ff9f57 Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:49.971968 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3953486d-caea-4259-a426-efbc8dc98ab3'} Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:49.973529 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:49.975514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:49.977688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Returning 404 to user: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:49.977688 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba807d8e-84ae-4722-a762-2fa352668db0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 404 len: 111 microversion: 2.1 time: 0.033775 Oct 26 05:02:49.977688 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 288/579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:49 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:49.984233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:49.984806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:49.992401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.992892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.993340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:49.994061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:49.994511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:49.994932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.011767 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] HTTP exception thrown: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Request method failure captured: Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 HTTP/1.1 Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8sf7n3DF4VOERk-V1FatJrcOGHhjyJmbtQ3AioZF2uO8fBlJqWxNKhgUtWnUXmc-fpR13luM7eu-Njk3VamNm14Ck-BHEeOMM1x_OPRDfsWRLnVtUN1MNrJu0beS9juGe6WQWWSArQuVEdxkyDnXdGyWPMhZLuYPJgr1V6-J9wrpY Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:50.013571 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 53b1b64963ee47d98f03ae09a7ff9f57 Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.014944 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3953486d-caea-4259-a426-efbc8dc98ab3'} Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:50.015771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.016996 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.018226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Returning 404 to user: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:50.018226 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ef52b50-6bcb-4be7-a40d-ebbca54ff474 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 404 len: 111 microversion: 2.1 time: 0.034550 Oct 26 05:02:50.018226 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 292/580] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:02:49 2022] DELETE /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:50.024816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.025484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: 3953486d-caea-4259-a426-efbc8dc98ab3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.031769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.032659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.033323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.034095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.034826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.035513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.053260 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] HTTP exception thrown: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Request method failure captured: Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 HTTP/1.1 Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8sf7n3DF4VOERk-V1FatJrcOGHhjyJmbtQ3AioZF2uO8fBlJqWxNKhgUtWnUXmc-fpR13luM7eu-Njk3VamNm14Ck-BHEeOMM1x_OPRDfsWRLnVtUN1MNrJu0beS9juGe6WQWWSArQuVEdxkyDnXdGyWPMhZLuYPJgr1V6-J9wrpY Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:50.054835 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53b1b64963ee47d98f03ae09a7ff9f57 Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.056211 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3953486d-caea-4259-a426-efbc8dc98ab3'} Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:50.057063 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. Oct 26 05:02:50.058294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.061224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Returning 404 to user: Instance 3953486d-caea-4259-a426-efbc8dc98ab3 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:50.061224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cecae1d-0d90-4510-b154-b49502517588 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3" status: 404 len: 111 microversion: 2.1 time: 0.035535 Oct 26 05:02:50.061224 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 289/581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:50 2022] GET /compute/v2.1/servers/3953486d-caea-4259-a426-efbc8dc98ab3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:50.065305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.066031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.072749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.073239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.073714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.074415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.074874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.075289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.090649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] HTTP exception thrown: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Request method failure captured: Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 HTTP/1.1 Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL8sf7n3DF4VOERk-V1FatJrcOGHhjyJmbtQ3AioZF2uO8fBlJqWxNKhgUtWnUXmc-fpR13luM7eu-Njk3VamNm14Ck-BHEeOMM1x_OPRDfsWRLnVtUN1MNrJu0beS9juGe6WQWWSArQuVEdxkyDnXdGyWPMhZLuYPJgr1V6-J9wrpY Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:50.092363 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 53b1b64963ee47d98f03ae09a7ff9f57 Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.093974 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'afc4f2b7-fece-4f86-8263-7b736049adc6'} Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:50.094868 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.096338 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.098035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Returning 404 to user: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:50.098035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9cbe9114-0a52-4ad5-a470-3594d54a30f5 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "DELETE /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 404 len: 111 microversion: 2.1 time: 0.032490 Oct 26 05:02:50.099888 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 293/582] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:02:50 2022] DELETE /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:50.104783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.104783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] [instance: afc4f2b7-fece-4f86-8263-7b736049adc6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.110210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.110607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.110746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.111132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.111620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.111811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.112271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.113277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.120922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.121681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.122368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.123692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.124880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.125603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.150253 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] HTTP exception thrown: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Request method failure captured: Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 HTTP/1.1 Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8sf7n3DF4VOERk-V1FatJrcOGHhjyJmbtQ3AioZF2uO8fBlJqWxNKhgUtWnUXmc-fpR13luM7eu-Njk3VamNm14Ck-BHEeOMM1x_OPRDfsWRLnVtUN1MNrJu0beS9juGe6WQWWSArQuVEdxkyDnXdGyWPMhZLuYPJgr1V6-J9wrpY Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:50.151861 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/965954d969624da4bfa8d8c5153abbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 965954d969624da4bfa8d8c5153abbcf Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624773924 Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53b1b64963ee47d98f03ae09a7ff9f57 Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624773924-project Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.153232 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'afc4f2b7-fece-4f86-8263-7b736049adc6'} Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:50.154211 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. Oct 26 05:02:50.155548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.156645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] Returning 404 to user: Instance afc4f2b7-fece-4f86-8263-7b736049adc6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:50.156645 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e42b53b-b01b-4970-9c71-c80869d332f0 tempest-DeleteServersAdminTestJSON-1624773924 tempest-DeleteServersAdminTestJSON-1624773924-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6" status: 404 len: 111 microversion: 2.1 time: 0.053818 Oct 26 05:02:50.157176 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 290/583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:50 2022] GET /compute/v2.1/servers/afc4f2b7-fece-4f86-8263-7b736049adc6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:50.164929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.165830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.172519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.173270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.174665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.177281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.183874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.184231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.226604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:50.241072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:50.242568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:50.255874 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d76c5bc-6727-4954-a602-e910be20e9a6 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.149100 Oct 26 05:02:50.270658 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 294/584] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:50 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:50.284355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.285347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] [instance: bb8ffcad-160b-4442-a101-a3cbda282f28] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.292134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.292801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.293426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.294289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.294894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.295491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.311112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] HTTP exception thrown: Instance bb8ffcad-160b-4442-a101-a3cbda282f28 could not be found. Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Request method failure captured: Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 HTTP/1.1 Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL86PXOR2SAQCqoA9ifGf2DqwvvX3QAGfszU5d3DDJJYdiSFA8LK1kP-ky-MawONOay_wQs9LcJeIAttrU_Ll_B9wb43unNy4-cs99CkvCCd6L6KPiKjFK9sYVgbkt1mQJmkLuJ431MKD-cfoPaFcvOIu-kgmJvk99Qgbrs8v0w4_hE Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b27808642e3a4e089823c56242eddaee Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-925455120 Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:50.312770 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b27808642e3a4e089823c56242eddaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b27808642e3a4e089823c56242eddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b27808642e3a4e089823c56242eddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b27808642e3a4e089823c56242eddaee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminNegativeTestJSON-925455120 Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b27808642e3a4e089823c56242eddaee Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-925455120 Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminNegativeTestJSON-925455120-project Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7cc07d881f794f6f8a8516aabbfdb1fd Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminNegativeTestJSON-925455120-project Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance bb8ffcad-160b-4442-a101-a3cbda282f28 could not be found. Oct 26 05:02:50.314358 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'bb8ffcad-160b-4442-a101-a3cbda282f28'} Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8ffcad-160b-4442-a101-a3cbda282f28 could not be found. Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:50.315285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8ffcad-160b-4442-a101-a3cbda282f28 could not be found. Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8ffcad-160b-4442-a101-a3cbda282f28 could not be found. Oct 26 05:02:50.316800 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:50.318361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] Returning 404 to user: Instance bb8ffcad-160b-4442-a101-a3cbda282f28 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:50.318736 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f6147ffe-4adf-46b4-85ab-d3534571f9f8 tempest-ServersAdminNegativeTestJSON-925455120 tempest-ServersAdminNegativeTestJSON-925455120-project] 10.222.0.16 "GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28" status: 404 len: 111 microversion: 2.1 time: 0.045970 Oct 26 05:02:50.322553 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 295/585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:50 2022] GET /compute/v2.1/servers/bb8ffcad-160b-4442-a101-a3cbda282f28 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:50.381015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:50.393413 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65abd7c1-8a21-4a3d-8561-d10cc8497bc5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.234931 Oct 26 05:02:50.394101 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 291/586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:50 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:50.901813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:50.902530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:50.909447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.910601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.911376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:50.912267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:50.912794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:50.913675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.082030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.091949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.094257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.095803 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-509522a7-4834-4018-898d-3985cc6eae06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1557 microversion: 2.25 time: 0.198881 Oct 26 05:02:51.096783 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 296/587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:50 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1557 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:51.122035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b64eafe-3f81-4436-8530-c995857db7e3 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '.version_select at 0x7f470ad53e50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:51.125792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b64eafe-3f81-4436-8530-c995857db7e3 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.126290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b64eafe-3f81-4436-8530-c995857db7e3 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.126738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b64eafe-3f81-4436-8530-c995857db7e3 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.143771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b64eafe-3f81-4436-8530-c995857db7e3 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.025510 Oct 26 05:02:51.144426 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 292/588] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 26 05:02:51 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:51.158962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:51.160521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:51.167450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.167939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.168374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.169068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.169555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.169978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.288271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:51.289012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:51.299064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.299896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.301189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.302948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.303856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.304532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.360484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 79855693-370b-458d-b7dc-6a777007e914 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:51.397397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.408600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.411234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.420218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cdc37a1f-0b54-4b30-b45d-634664a48354 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.136500 Oct 26 05:02:51.432162 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 293/589] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:51 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:51.436807 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5d0bd14-5cf0-4c41-b387-034e614aeed0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 2049 microversion: 2.25 time: 0.281529 Oct 26 05:02:51.437409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 297/590] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:51 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 2049 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:51.460096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:51.460096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:51.467005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.467512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.467954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.469647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:51.470308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:51.471531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:51.578239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-735788040", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bc063782-2e7c-4930-8052-d7ca13d54283"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:51.631660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:51.635837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] validate_networks() for [('bc063782-2e7c-4930-8052-d7ca13d54283', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:51.639762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ea3c9cc-4a95-4a0f-8dd6-c6e1fd2cb36b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.194917 Oct 26 05:02:51.640336 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 294/591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:51 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:52.140492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:52.140984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:52.141561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:52.141983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:52.142398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:52.151733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:52.152461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:52.153013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:52.154047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:52.154739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:52.155510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:52.178385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:02:52.182908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for user b36c8ac2dee24d33b680608a740463bb and project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:02:52.196376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:02:52.199548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:02:52.259383 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec06e829-4b47-4f23-b606-12465ec9b730 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.685187 Oct 26 05:02:52.266078 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 298/592] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 26 05:02:52.278602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ecbfcacc-80c7-46c1-beb6-e47672399573 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:52.279163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ecbfcacc-80c7-46c1-beb6-e47672399573 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:52.353298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ecbfcacc-80c7-46c1-beb6-e47672399573 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.362338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ecbfcacc-80c7-46c1-beb6-e47672399573 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.367444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ecbfcacc-80c7-46c1-beb6-e47672399573 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.368923 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ecbfcacc-80c7-46c1-beb6-e47672399573 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1261 microversion: 2.25 time: 0.099953 Oct 26 05:02:52.369848 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 295/593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:52 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:52.454465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:52.455268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:52.467201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:52.467926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:52.468332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:52.469059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:52.470528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:52.471127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:52.564684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.575734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.577551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.586878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fcf9b0ce-5bf4-4cd5-bd06-133656403860 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1447 microversion: 2.75 time: 0.136650 Oct 26 05:02:52.595457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 299/594] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:52 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:52.665620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:52.666305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:52.673556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:52.674520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:52.675848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:52.676754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:52.677423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:52.678013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:52.882797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:52.892526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e4575659-30eb-44e8-9396-22a9d1fb255d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.232655 Oct 26 05:02:52.897447 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 296/595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:52 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:53.395036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:53.395796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:53.402086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:53.402783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:53.403438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:53.404321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:53.404776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:53.405204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:53.491326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:53.501469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:53.504017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:53.505339 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28a0e59e-faec-456f-a6ce-c2e8c0b8489f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1313 microversion: 2.25 time: 0.114819 Oct 26 05:02:53.506438 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 300/596] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:53 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1313 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:53.618181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:53.619799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:53.629155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:53.631075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:53.631885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:53.633423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:53.634056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:53.634834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:53.732705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:53.752128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:53.757046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:53.778269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4f611ee-6823-4858-bd74-c9ccd6acb979 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1453 microversion: 2.75 time: 0.165953 Oct 26 05:02:53.781511 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 297/597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:53 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:53.905126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-76bf0e10-21a1-42de-af0a-fbec57d3e7bb tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-676663587", "ram": 512, "vcpus": 1, "disk": 10, "id": 1378951218, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:53.917707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:53.919824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:53.927343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:53.927943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:53.928640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:53.929697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:53.930214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:53.930911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:53.942866 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-76bf0e10-21a1-42de-af0a-fbec57d3e7bb tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.228408 Oct 26 05:02:53.944018 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 301/598] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:53 2022] POST /compute/v2.1/flavors => generated 415 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:54.103083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a64adf6-555a-45c2-906f-eb2bc6fdf293 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.112041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1a64adf6-555a-45c2-906f-eb2bc6fdf293 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] HTTP exception thrown: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a64adf6-555a-45c2-906f-eb2bc6fdf293 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Request method failure captured: Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/flavors/1378951218/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL98S7LcQCN8AcBY7yUwG1zdA4JHvjdIdU8UJESLLTjsqi0pIxSpZjq6JWHlrNPBO-DJiCQzX0CxHBY1NkB8PBInS8r0Bxlfuv3zEk100Z5-_Gi65mNtgzs_2fibQWKAFt2uPM5PnXOlWIpuELWscOleiSTTN-wb70YkX2a0MYppg1c Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:54.114111 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 36d96d5fa8004879bb859f8bd13e7b6b Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:54.115845 n-d-862416-4 devstack@n-api.service[120585]: exception: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'flavor_id': '1378951218', 'id': 'hw:cpu_thread_policy'} Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.116727 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.118419 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.119907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a64adf6-555a-45c2-906f-eb2bc6fdf293 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Returning 404 to user: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.121099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a64adf6-555a-45c2-906f-eb2bc6fdf293 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] 10.222.0.16 "GET /compute/v2.1/flavors/1378951218/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.168049 Oct 26 05:02:54.121970 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 302/599] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:02:53 2022] GET /compute/v2.1/flavors/1378951218/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:54.136204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4242d556-997e-4ffd-b64d-99d249ec12a2 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:54.140559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4242d556-997e-4ffd-b64d-99d249ec12a2 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '36d96d5fa8004879bb859f8bd13e7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760a03aa65e2499e912086986cc1f5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4242d556-997e-4ffd-b64d-99d249ec12a2 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Request method failure captured: Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/flavors/1378951218/os-extra_specs HTTP/1.1 Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 66 Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL98S7LcQCN8AcBY7yUwG1zdA4JHvjdIdU8UJESLLTjsqi0pIxSpZjq6JWHlrNPBO-DJiCQzX0CxHBY1NkB8PBInS8r0Bxlfuv3zEk100Z5-_Gi65mNtgzs_2fibQWKAFt2uPM5PnXOlWIpuELWscOleiSTTN-wb70YkX2a0MYppg1c Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:54.143046 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 36d96d5fa8004879bb859f8bd13e7b6b Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 26 05:02:54.145654 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'flavor_id': '1378951218', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:54.146570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 26 05:02:54.148140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.150147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4242d556-997e-4ffd-b64d-99d249ec12a2 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.151291 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4242d556-997e-4ffd-b64d-99d249ec12a2 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] 10.222.0.16 "POST /compute/v2.1/flavors/1378951218/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023455 Oct 26 05:02:54.156880 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 303/600] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 26 05:02:54 2022] POST /compute/v2.1/flavors/1378951218/os-extra_specs => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:02:54.169992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-191b6538-7dcb-442d-91f5-32c205d725d4 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:54.209431 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-191b6538-7dcb-442d-91f5-32c205d725d4 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1378951218/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051136 Oct 26 05:02:54.210386 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 304/601] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 26 05:02:54 2022] POST /compute/v2.1/flavors/1378951218/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:02:54.220466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0637f957-e566-407c-915e-8116f22d2b39 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.222846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0637f957-e566-407c-915e-8116f22d2b39 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '36d96d5fa8004879bb859f8bd13e7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760a03aa65e2499e912086986cc1f5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0637f957-e566-407c-915e-8116f22d2b39 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Request method failure captured: Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL98S7LcQCN8AcBY7yUwG1zdA4JHvjdIdU8UJESLLTjsqi0pIxSpZjq6JWHlrNPBO-DJiCQzX0CxHBY1NkB8PBInS8r0Bxlfuv3zEk100Z5-_Gi65mNtgzs_2fibQWKAFt2uPM5PnXOlWIpuELWscOleiSTTN-wb70YkX2a0MYppg1c Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:54.224820 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 36d96d5fa8004879bb859f8bd13e7b6b Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:54.232655 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'flavor_id': '1378951218', 'id': 'hw:numa_nodes'} Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:54.233556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.235110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0637f957-e566-407c-915e-8116f22d2b39 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.236377 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0637f957-e566-407c-915e-8116f22d2b39 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010379 Oct 26 05:02:54.236377 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 305/602] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:02:54 2022] DELETE /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:54.238551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0010bb4f-f22b-4015-8105-7c1f6b87ee49 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:54.247287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.259956 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-290e4790-e4a3-4de2-a137-da6c592c1b86 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.347793 Oct 26 05:02:54.261327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 298/603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:53 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:54.272769 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0010bb4f-f22b-4015-8105-7c1f6b87ee49 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1378951218/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039042 Oct 26 05:02:54.279476 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 306/604] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 26 05:02:54 2022] POST /compute/v2.1/flavors/1378951218/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:02:54.285153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab809f84-9896-452a-9d14-5f3c39bbe22f tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:54.289852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab809f84-9896-452a-9d14-5f3c39bbe22f tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '36d96d5fa8004879bb859f8bd13e7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760a03aa65e2499e912086986cc1f5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab809f84-9896-452a-9d14-5f3c39bbe22f tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Request method failure captured: Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 22 Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL98S7LcQCN8AcBY7yUwG1zdA4JHvjdIdU8UJESLLTjsqi0pIxSpZjq6JWHlrNPBO-DJiCQzX0CxHBY1NkB8PBInS8r0Bxlfuv3zEk100Z5-_Gi65mNtgzs_2fibQWKAFt2uPM5PnXOlWIpuELWscOleiSTTN-wb70YkX2a0MYppg1c Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:54.291885 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/760a03aa65e2499e912086986cc1f5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 760a03aa65e2499e912086986cc1f5cd Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 36d96d5fa8004879bb859f8bd13e7b6b Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: {"hw:numa_nodes": "1"} Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:54.293438 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'flavor_id': '1378951218', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:54.294354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 26 05:02:54.295657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.297627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab809f84-9896-452a-9d14-5f3c39bbe22f tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.299131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab809f84-9896-452a-9d14-5f3c39bbe22f tempest-FlavorsExtraSpecsNegativeTestJSON-245494377 tempest-FlavorsExtraSpecsNegativeTestJSON-245494377-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018495 Oct 26 05:02:54.300026 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 299/605] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 26 05:02:54 2022] PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:54.310553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d369860b-54bf-4135-9fbc-2c46e93aedf7 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.319648 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d369860b-54bf-4135-9fbc-2c46e93aedf7 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] HTTP exception thrown: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d369860b-54bf-4135-9fbc-2c46e93aedf7 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Request method failure captured: Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/flavors/1378951218/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL99PSip-DcXbsQDQZ6LD4FkwzvSxMV33d8mAqx9L-As1FFw10kBOkeRV6-7ixDvADE8v9554hOKI_gQBfybs-L5Cx1hrES5XcLJ2UcOPclR63m-quJ_cz-kR2F4ustUwVPYaluh9VhXG0WEH3qUq7I92G3oeIZ-3_BlKJ4O1OaKSAs Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 61bfdd35cc114cc689ee0507ef78fb32 Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:02:54.321303 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 61bfdd35cc114cc689ee0507ef78fb32 Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: d0cfb376fea64b108a8b3bee8c54f1f9 Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:54.322920 n-d-862416-4 devstack@n-api.service[120585]: exception: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'flavor_id': '1378951218', 'id': 'hw:cpu_thread_policy'} Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.323765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.325356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d369860b-54bf-4135-9fbc-2c46e93aedf7 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Returning 404 to user: Flavor 1378951218 has no extra specs with key hw:cpu_thread_policy. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.325869 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d369860b-54bf-4135-9fbc-2c46e93aedf7 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1378951218/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019784 Oct 26 05:02:54.326356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 307/606] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:02:54 2022] DELETE /compute/v2.1/flavors/1378951218/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:02:54.337886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7869c191-1b14-429d-a983-54c1ad56a4e8 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:54.342103 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7869c191-1b14-429d-a983-54c1ad56a4e8 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7869c191-1b14-429d-a983-54c1ad56a4e8 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Request method failure captured: Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 27 Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL99PSip-DcXbsQDQZ6LD4FkwzvSxMV33d8mAqx9L-As1FFw10kBOkeRV6-7ixDvADE8v9554hOKI_gQBfybs-L5Cx1hrES5XcLJ2UcOPclR63m-quJ_cz-kR2F4ustUwVPYaluh9VhXG0WEH3qUq7I92G3oeIZ-3_BlKJ4O1OaKSAs Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 61bfdd35cc114cc689ee0507ef78fb32 Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:02:54.343916 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 61bfdd35cc114cc689ee0507ef78fb32 Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: d0cfb376fea64b108a8b3bee8c54f1f9 Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: {"hw:cpu_policy": "shared"} Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:02:54.345215 n-d-862416-4 devstack@n-api.service[120586]: exception: Request body and URI mismatch Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'flavor_id': '1378951218', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.346037 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.348073 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:02:54.348073 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:02:54.348073 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 26 05:02:54.348073 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.348073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7869c191-1b14-429d-a983-54c1ad56a4e8 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.348073 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7869c191-1b14-429d-a983-54c1ad56a4e8 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013291 Oct 26 05:02:54.352186 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 300/607] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 26 05:02:54 2022] PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:02:54.358177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71a89ce7-9854-4a8a-bd3a-87ea447bf865 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71a89ce7-9854-4a8a-bd3a-87ea447bf865 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Request method failure captured: Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 49 Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL99PSip-DcXbsQDQZ6LD4FkwzvSxMV33d8mAqx9L-As1FFw10kBOkeRV6-7ixDvADE8v9554hOKI_gQBfybs-L5Cx1hrES5XcLJ2UcOPclR63m-quJ_cz-kR2F4ustUwVPYaluh9VhXG0WEH3qUq7I92G3oeIZ-3_BlKJ4O1OaKSAs Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 61bfdd35cc114cc689ee0507ef78fb32 Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:02:54.364322 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61bfdd35cc114cc689ee0507ef78fb32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 61bfdd35cc114cc689ee0507ef78fb32 Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: d0cfb376fea64b108a8b3bee8c54f1f9 Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 26 05:02:54.366268 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'flavor_id': '1378951218', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance: Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 26 05:02:54.367466 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.369155 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71a89ce7-9854-4a8a-bd3a-87ea447bf865 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:54.370467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71a89ce7-9854-4a8a-bd3a-87ea447bf865 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012317 Oct 26 05:02:54.370986 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 308/608] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 26 05:02:54 2022] PUT /compute/v2.1/flavors/1378951218/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:02:54.377635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9fbd7e11-4c86-4342-a9ab-b32a6569e456 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.399285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9fbd7e11-4c86-4342-a9ab-b32a6569e456 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1378951218" status: 202 len: 0 microversion: 2.1 time: 0.025652 Oct 26 05:02:54.399872 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 301/609] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:02:54 2022] DELETE /compute/v2.1/flavors/1378951218 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:02:54.408874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f42748ba-abc3-4139-a208-4dc1c7201870 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.435405 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f42748ba-abc3-4139-a208-4dc1c7201870 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998 tempest-FlavorsExtraSpecsNegativeTestJSON-308409998-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.030030 Oct 26 05:02:54.436253 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 309/610] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:02:54 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:54.536549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.537280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:54.545435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:54.546479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:54.547312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:54.548777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:54.549473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:54.551898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:54.811643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:54.812849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:54.821927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:54.825730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:54.826733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:54.828017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:54.829293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.830515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:54.833591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:54.844502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.848219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:54.851513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-502da512-1cae-4236-9a8c-811bb0f3a940 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.320161 Oct 26 05:02:54.854934 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 302/611] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:54 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:55.056276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:55.074206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:55.075657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:55.081242 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30e6483a-1c83-4b8f-92ef-c70fe5fabc08 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1453 microversion: 2.75 time: 0.273361 Oct 26 05:02:55.102282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 310/612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:54 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1453 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:55.284006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:55.284682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:55.292978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:55.293753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:55.294476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:55.295378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:55.296056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:55.296633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:55.674914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:55.685057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51fb6393-215c-47b8-bf1c-ec9ffd46db50 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.404921 Oct 26 05:02:55.686386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 303/613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:55 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:55.852048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-709e744d-757a-4fa5-8c6c-f7ff1a358db9 req-c24b46af-1449-49aa-bae7-e7efeddb4114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7463491c-3949-4199-adbb-2436a92672c6", "tag": "d08b8fb6-fb5b-44e3-b172-581589a3963b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:55.874631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-709e744d-757a-4fa5-8c6c-f7ff1a358db9 req-c24b46af-1449-49aa-bae7-e7efeddb4114 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:55.875490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-709e744d-757a-4fa5-8c6c-f7ff1a358db9 req-c24b46af-1449-49aa-bae7-e7efeddb4114 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:55.888823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:55.889665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:55.897907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-709e744d-757a-4fa5-8c6c-f7ff1a358db9 req-c24b46af-1449-49aa-bae7-e7efeddb4114 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:55.904744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:55.916021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:55.916610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:55.922169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:55.923569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:55.924274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:55.934346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-709e744d-757a-4fa5-8c6c-f7ff1a358db9 req-c24b46af-1449-49aa-bae7-e7efeddb4114 service nova] Creating event network-changed:d08b8fb6-fb5b-44e3-b172-581589a3963b for instance 7463491c-3949-4199-adbb-2436a92672c6 on n-h1-862416-4 Oct 26 05:02:55.946597 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-709e744d-757a-4fa5-8c6c-f7ff1a358db9 req-c24b46af-1449-49aa-bae7-e7efeddb4114 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106600 Oct 26 05:02:55.949712 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 311/614] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:02:56.121908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:56.123132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:56.132932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:56.135980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:56.136757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:56.141217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:56.142320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:56.142922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:56.367902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:56.372478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:56.383280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:56.385072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:56.386005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:56.386575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:56.387723 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-be0a6788-5976-4831-bd53-0a8f2abb8a13 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.510610 Oct 26 05:02:56.395974 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a3e2b577-03d2-44c2-902f-96762185d929 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1453 microversion: 2.75 time: 0.280649 Oct 26 05:02:56.397663 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 304/615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:55 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:56.419551 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 312/616] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:56 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1453 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:02:56.719999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:56.721005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:56.739940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:56.745126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:56.747213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:56.748956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:56.754848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:56.755573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:57.108277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.121486 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-581f9812-cb18-4e94-8f88-36392a2a9fa0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.408763 Oct 26 05:02:57.124354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 305/617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:56 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:57.414161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:57.415727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:57.418843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:57.432353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:57.433480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:57.446157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:57.460072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:57.464564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:57.465181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:57.466642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:57.467640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:57.469711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:57.470023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:57.471031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:57.471666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:57.477991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:57.478702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:57.635739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.638862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:57.653489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.655210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.666311 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dea3d9a7-76bd-4df3-944f-2116d786d5d4 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1438 microversion: 2.75 time: 0.238305 Oct 26 05:02:57.667531 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 306/618] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:57 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1438 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:57.791460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.805016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.810927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:57.817278 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7cdf246f-ee1a-4ca5-8ac8-dd01d893ad87 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.405841 Oct 26 05:02:57.818073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 313/619] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:57 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:58.026174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:58.029023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:58.042606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.044948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.047329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.048883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.051704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.052246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.150428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:58.151211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:58.165338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.166162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.166941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.168230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.168921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.169938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.210515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:02:58.211690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:02:58.212334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:02:58.212959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:02:58.213849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:02:58.313057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:58.319943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.320974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.321475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.322462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.322939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.323378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.548491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:58.554936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:58.570924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4ea6164-6108-488d-b5bd-29501cd27877 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.424878 Oct 26 05:02:58.575537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 314/620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:58 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:02:58.595356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fab07a40-d7d8-4152-993d-f5e9a8efd86d tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4/action" status: 202 len: 1942 microversion: 2.75 time: 0.900368 Oct 26 05:02:58.596371 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 307/621] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:02:57 2022] POST /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4/action => generated 1942 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 26 05:02:58.630371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:58.630972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:58.637427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.638116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.638703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.640263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.640721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.641146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.815257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:02:58.820061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:02:58.843616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-26037cf5-61ef-4a63-8513-8901af55c49f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.217194 Oct 26 05:02:58.845060 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 315/622] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:58 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:58.870170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:58.871370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:58.878037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.879271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.880029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:58.880917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:58.881572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:58.882166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.181045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.197156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.199218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.200504 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5430a12b-92ef-426a-a8f6-6c7c1fb5c8cc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.358967 Oct 26 05:02:59.204146 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 308/623] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:58 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:02:59.497821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a285ce9-5b7a-4894-b109-f518849b4df2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Calling method '.version_select at 0x7f470abb99d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.499609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a285ce9-5b7a-4894-b109-f518849b4df2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cb5cdda538574aa18ec8ae7527614561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0fc9a1ac2479f9e791edbc349b70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a285ce9-5b7a-4894-b109-f518849b4df2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Request method failure captured: Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-CQFJfgo2Hx7Z-twD3Dbkjd06uDGZvrHexsnQ-bFfUxLFP_qkLhNbMlzyxp8kSLqIvz0T0-M8KW8bB6YaihwX9TqU4CNxzc3HjYqDZ9kbohLjI0EhFT-Z-YSkj327uX3DyyApzG5XMetQYr-G1ncW4WhVNWlx0yHXXWjK26CJDvME Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:59.501300 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: cb5cdda538574aa18ec8ae7527614561 Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: action_args: {} Oct 26 05:02:59.502882 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:59.508957 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 26 05:02:59.510348 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.511715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a285ce9-5b7a-4894-b109-f518849b4df2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:59.511715 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a285ce9-5b7a-4894-b109-f518849b4df2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.276415 Oct 26 05:02:59.511715 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 316/624] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:59.515624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bc36278-e805-430a-a2be-70512dc1b998 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Calling method '.version_select at 0x7f470ad218b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.517913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6bc36278-e805-430a-a2be-70512dc1b998 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cb5cdda538574aa18ec8ae7527614561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0fc9a1ac2479f9e791edbc349b70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bc36278-e805-430a-a2be-70512dc1b998 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Request method failure captured: Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-CQFJfgo2Hx7Z-twD3Dbkjd06uDGZvrHexsnQ-bFfUxLFP_qkLhNbMlzyxp8kSLqIvz0T0-M8KW8bB6YaihwX9TqU4CNxzc3HjYqDZ9kbohLjI0EhFT-Z-YSkj327uX3DyyApzG5XMetQYr-G1ncW4WhVNWlx0yHXXWjK26CJDvME Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:59.519577 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: cb5cdda538574aa18ec8ae7527614561 Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:02:59.520895 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:59.526042 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 26 05:02:59.527379 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.528721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bc36278-e805-430a-a2be-70512dc1b998 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:59.528721 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6bc36278-e805-430a-a2be-70512dc1b998 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010937 Oct 26 05:02:59.528721 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 309/625] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:02:59.530983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e64a336-0c2d-49a7-8ec4-6951b54487d8 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Calling method '.version_select at 0x7f470ad5b670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.533272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4e64a336-0c2d-49a7-8ec4-6951b54487d8 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cb5cdda538574aa18ec8ae7527614561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0fc9a1ac2479f9e791edbc349b70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e64a336-0c2d-49a7-8ec4-6951b54487d8 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Request method failure captured: Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-CQFJfgo2Hx7Z-twD3Dbkjd06uDGZvrHexsnQ-bFfUxLFP_qkLhNbMlzyxp8kSLqIvz0T0-M8KW8bB6YaihwX9TqU4CNxzc3HjYqDZ9kbohLjI0EhFT-Z-YSkj327uX3DyyApzG5XMetQYr-G1ncW4WhVNWlx0yHXXWjK26CJDvME Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:02:59.535504 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: cb5cdda538574aa18ec8ae7527614561 Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: action_args: {} Oct 26 05:02:59.537114 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:59.538401 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 26 05:02:59.539743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.540844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e64a336-0c2d-49a7-8ec4-6951b54487d8 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:59.540844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e64a336-0c2d-49a7-8ec4-6951b54487d8 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010413 Oct 26 05:02:59.540844 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 317/626] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:59.606702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Calling method '.version_select at 0x7f470acf8430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.608696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.609588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.610195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.625618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.626128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.626559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.629228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-818591714", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "4f693b62-ce61-483f-bc9b-e7a64f16c7c9"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:02:59.637203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.637727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.638170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.644958 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f937c72-c25b-4b13-b805-9122178f3530 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102157 Oct 26 05:02:59.645575 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 310/627] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:02:59.650226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.653438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:59.659506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.660004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.660444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.661155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.661682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.662115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.687503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] validate_networks() for [('4f693b62-ce61-483f-bc9b-e7a64f16c7c9', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:02:59.920035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.928574 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ac1a723-9b4b-4499-b25a-c76851e0461e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.281789 Oct 26 05:02:59.944420 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 311/628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:02:59.949737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26c3dc2a-81e6-4948-9f68-8768318b6ae2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Calling method '.version_select at 0x7f470acf8670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.951823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-26c3dc2a-81e6-4948-9f68-8768318b6ae2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cb5cdda538574aa18ec8ae7527614561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0fc9a1ac2479f9e791edbc349b70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26c3dc2a-81e6-4948-9f68-8768318b6ae2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Request method failure captured: Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-CQFJfgo2Hx7Z-twD3Dbkjd06uDGZvrHexsnQ-bFfUxLFP_qkLhNbMlzyxp8kSLqIvz0T0-M8KW8bB6YaihwX9TqU4CNxzc3HjYqDZ9kbohLjI0EhFT-Z-YSkj327uX3DyyApzG5XMetQYr-G1ncW4WhVNWlx0yHXXWjK26CJDvME Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:02:59.953432 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: cb5cdda538574aa18ec8ae7527614561 Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '1'} Oct 26 05:02:59.954984 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:02:59.955964 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 26 05:02:59.957938 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:02:59.960539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26c3dc2a-81e6-4948-9f68-8768318b6ae2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:02:59.961602 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26c3dc2a-81e6-4948-9f68-8768318b6ae2 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015765 Oct 26 05:02:59.966218 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 312/629] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:02:59.967335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:02:59.968116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:02:59.977390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.978213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.978855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:02:59.979788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:02:59.980368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:02:59.980878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.332751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:00.358804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d0f0e7e-56c9-457c-86e6-d8883e24f637 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.395162 Oct 26 05:03:00.360625 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 313/630] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:02:59 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:00.373587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01c5e292-55d6-4c35-8046-46f57c94dda5 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Calling method '.version_select at 0x7f470b3b7280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.375462 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-01c5e292-55d6-4c35-8046-46f57c94dda5 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] HTTP exception thrown: Hypervisor with ID '81364d20-abbf-42ed-a9e2-456d73d64278' could not be found. Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01c5e292-55d6-4c35-8046-46f57c94dda5 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Request method failure captured: Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors/81364d20-abbf-42ed-a9e2-456d73d64278/uptime HTTP/1.1 Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-DC3HvBB_qN_RE_bN2kx92DKSQI_e5cj7BT3y_1Cb87jDgVfynj7rG3yqE4c9abfGe4At5uZLv7YXJTwMA6QL47DDloW2E6xk7elOer_RvDoZ3gL_yrg7-IiWzGVItAVjxJSkPNCx4miWLP8Z23ht6z0aDoCfu17CH7AzPBK6M8RU Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1d6c9b4ef02a4fbd903b379c678da53c Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1221702409 Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:03:00.388829 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1221702409 Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1d6c9b4ef02a4fbd903b379c678da53c Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1221702409 Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2ac0006ce25048138db4df87de860a56 Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: exception: Hypervisor with ID '81364d20-abbf-42ed-a9e2-456d73d64278' could not be found. Oct 26 05:03:00.390520 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '81364d20-abbf-42ed-a9e2-456d73d64278'} Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '81364d20-abbf-42ed-a9e2-456d73d64278' Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 26 05:03:00.391445 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '81364d20-abbf-42ed-a9e2-456d73d64278' could not be found. Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.393516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '81364d20-abbf-42ed-a9e2-456d73d64278' could not be found. Oct 26 05:03:00.396463 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.398309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01c5e292-55d6-4c35-8046-46f57c94dda5 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Returning 404 to user: Hypervisor with ID '81364d20-abbf-42ed-a9e2-456d73d64278' could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:00.399371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01c5e292-55d6-4c35-8046-46f57c94dda5 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/81364d20-abbf-42ed-a9e2-456d73d64278/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037514 Oct 26 05:03:00.400164 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 314/631] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/os-hypervisors/81364d20-abbf-42ed-a9e2-456d73d64278/uptime => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:00.406470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.407588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:00.415764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.416594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.417402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.418559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.419220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.419848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.529619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:00.530545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:00.531306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:00.531947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:00.533098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:00.548949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.549477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.550470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.551468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.551938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.552366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.571478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Getting quotas for project 804dd1c6eec6424e84f3aa345876c8cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:00.575997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Getting quotas for user 3ec9361cb6c24b7aadb704fd43576d7b and project 804dd1c6eec6424e84f3aa345876c8cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:00.597131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:00.602116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:00.604499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:00.607766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:00.620083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:00.624519 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c03e85f0-1d95-470d-a2c5-acced58904c2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.221948 Oct 26 05:03:00.625200 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 315/632] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:00.630990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Calling method '.version_select at 0x7f470acae430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.635193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.636381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.637364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.658067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.658652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.659170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.664841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67c9ecd5-4c3f-41bd-978a-91f992972857 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093321 Oct 26 05:03:00.665686 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 318/633] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:03:00.677148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5af13a34-61bf-4c3d-a284-d1f79fa3372e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.678016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5af13a34-61bf-4c3d-a284-d1f79fa3372e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:00.679020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.679526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.679979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.691398 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b7a1799b-3fc0-40d1-af32-a992d750c200 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064174 Oct 26 05:03:00.698262 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 316/634] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:00.703168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1698185-37d9-4e4c-b287-8870d10a9898 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Calling method '.version_select at 0x7f470acae670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.704956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1698185-37d9-4e4c-b287-8870d10a9898 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cb5cdda538574aa18ec8ae7527614561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0fc9a1ac2479f9e791edbc349b70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1698185-37d9-4e4c-b287-8870d10a9898 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Request method failure captured: Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-CQFJfgo2Hx7Z-twD3Dbkjd06uDGZvrHexsnQ-bFfUxLFP_qkLhNbMlzyxp8kSLqIvz0T0-M8KW8bB6YaihwX9TqU4CNxzc3HjYqDZ9kbohLjI0EhFT-Z-YSkj327uX3DyyApzG5XMetQYr-G1ncW4WhVNWlx0yHXXWjK26CJDvME Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:00.707097 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59c0fc9a1ac2479f9e791edbc349b70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 59c0fc9a1ac2479f9e791edbc349b70f Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-968088623 Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: cb5cdda538574aa18ec8ae7527614561 Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-968088623-project Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '1'} Oct 26 05:03:00.708594 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:03:00.709433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 26 05:03:00.710579 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.712032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1698185-37d9-4e4c-b287-8870d10a9898 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:00.712032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1698185-37d9-4e4c-b287-8870d10a9898 tempest-HypervisorAdminNegativeTestJSON-968088623 tempest-HypervisorAdminNegativeTestJSON-968088623-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.008965 Oct 26 05:03:00.712032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 317/635] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:00.720290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-218ba39e-c424-4f28-ad88-2d0e6a101be7 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Calling method '.version_select at 0x7f470acf8f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.722326 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-218ba39e-c424-4f28-ad88-2d0e6a101be7 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] HTTP exception thrown: Hypervisor with ID '58156c62-d87c-4d28-a4cc-62e9ecd3401b' could not be found. Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-218ba39e-c424-4f28-ad88-2d0e6a101be7 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Request method failure captured: Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-hypervisors/58156c62-d87c-4d28-a4cc-62e9ecd3401b HTTP/1.1 Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-DC3HvBB_qN_RE_bN2kx92DKSQI_e5cj7BT3y_1Cb87jDgVfynj7rG3yqE4c9abfGe4At5uZLv7YXJTwMA6QL47DDloW2E6xk7elOer_RvDoZ3gL_yrg7-IiWzGVItAVjxJSkPNCx4miWLP8Z23ht6z0aDoCfu17CH7AzPBK6M8RU Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1d6c9b4ef02a4fbd903b379c678da53c Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1221702409 Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:03:00.724030 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d6c9b4ef02a4fbd903b379c678da53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1221702409 Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1d6c9b4ef02a4fbd903b379c678da53c Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1221702409 Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2ac0006ce25048138db4df87de860a56 Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: exception: Hypervisor with ID '58156c62-d87c-4d28-a4cc-62e9ecd3401b' could not be found. Oct 26 05:03:00.725509 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '58156c62-d87c-4d28-a4cc-62e9ecd3401b'} Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '58156c62-d87c-4d28-a4cc-62e9ecd3401b' Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 26 05:03:00.726284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:03:00.727614 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '58156c62-d87c-4d28-a4cc-62e9ecd3401b' could not be found. Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '58156c62-d87c-4d28-a4cc-62e9ecd3401b' could not be found. Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-218ba39e-c424-4f28-ad88-2d0e6a101be7 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] Returning 404 to user: Hypervisor with ID '58156c62-d87c-4d28-a4cc-62e9ecd3401b' could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:00.729770 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-218ba39e-c424-4f28-ad88-2d0e6a101be7 tempest-HypervisorAdminNegativeTestJSON-1221702409 tempest-HypervisorAdminNegativeTestJSON-1221702409-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/58156c62-d87c-4d28-a4cc-62e9ecd3401b" status: 404 len: 123 microversion: 2.1 time: 0.008624 Oct 26 05:03:00.731192 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 318/636] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/os-hypervisors/58156c62-d87c-4d28-a4cc-62e9ecd3401b => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:00.736728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5af13a34-61bf-4c3d-a284-d1f79fa3372e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:00.748114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5af13a34-61bf-4c3d-a284-d1f79fa3372e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1215 microversion: 2.1 time: 0.075346 Oct 26 05:03:00.759935 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:00.959872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:00.961053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:00.969069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.970046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.970581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:00.972984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:00.973827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:00.974276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.163456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:01.175252 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45c771c8-4e59-4569-ab06-3b82f3b4e409 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.226808 Oct 26 05:03:01.175967 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 319/638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:00 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:01.392728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:01.394221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:01.406003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:01.406498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:01.406939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.408249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:01.409044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:01.410647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.523259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:01.564199 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7581cd99-4946-40d2-90d0-a10d2524a1d7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.175855 Oct 26 05:03:01.565781 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 320/639] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:01 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:01.657620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:01.658844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:01.666030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:01.666941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:01.667558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.668702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:01.669404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:01.670072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.780310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:01.781468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:01.792408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:01.793742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:01.794200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.794949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:01.795685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:01.796128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:01.844377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:01.854502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:01.856267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:01.857821 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b876951-5ce2-4dba-ba29-92512bb7ff20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.206943 Oct 26 05:03:01.858962 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 320/640] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:01 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:01.898748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:01.909685 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cab84024-c98b-4dff-ac5a-86697bc08cdc tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1267 microversion: 2.1 time: 0.141279 Oct 26 05:03:01.911099 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 321/641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:01 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:02.163684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7039e9c7-45f2-4bec-96e4-91e452f9ec48 req-90b810ab-dd62-427c-aaa5-92fbc30acc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7463491c-3949-4199-adbb-2436a92672c6", "name": "network-vif-plugged", "status": "completed", "tag": "d08b8fb6-fb5b-44e3-b172-581589a3963b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:02.202654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:02.203607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:02.210827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.211157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7039e9c7-45f2-4bec-96e4-91e452f9ec48 req-90b810ab-dd62-427c-aaa5-92fbc30acc1d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.216029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7039e9c7-45f2-4bec-96e4-91e452f9ec48 req-90b810ab-dd62-427c-aaa5-92fbc30acc1d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.217366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7039e9c7-45f2-4bec-96e4-91e452f9ec48 req-90b810ab-dd62-427c-aaa5-92fbc30acc1d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.218073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.218620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.219507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.221817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.223211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.247938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7039e9c7-45f2-4bec-96e4-91e452f9ec48 req-90b810ab-dd62-427c-aaa5-92fbc30acc1d service nova] Creating event network-vif-plugged:d08b8fb6-fb5b-44e3-b172-581589a3963b for instance 7463491c-3949-4199-adbb-2436a92672c6 on n-h1-862416-4 Oct 26 05:03:02.260533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7039e9c7-45f2-4bec-96e4-91e452f9ec48 req-90b810ab-dd62-427c-aaa5-92fbc30acc1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108732 Oct 26 05:03:02.263091 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 321/642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:02.542169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:02.556665 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c65cb724-f876-46ea-bafd-6cb4cb918a71 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.357764 Oct 26 05:03:02.558476 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:02 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:02.596255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:02.600255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:02.604823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:02.624009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.624710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.625544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.626635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.627530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.628792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.746055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:02.767221 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad880583-3550-4afd-9244-9cf808ff2fa2 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.176966 Oct 26 05:03:02.767819 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 322/644] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:02 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:02.887526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:02.888148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:02.906930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.907900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.908725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.911108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.912393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.913265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.935243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:02.935872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:02.946427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.946932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.947382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:02.948190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:02.948555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:02.948990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:03.086196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:03.095073 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dffb7035-ea8d-429a-b3e6-634e5edb85ac tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1273 microversion: 2.1 time: 0.163719 Oct 26 05:03:03.102392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:02 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:03.215693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:03.234369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:03.235859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:03.237185 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32ad8fbb-ba5c-4ba4-91cd-af2549377614 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1361 microversion: 2.25 time: 0.355659 Oct 26 05:03:03.238617 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 323/646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:02 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:03.580001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:03.580626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:03.590594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:03.591205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:03.591723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:03.592569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:03.593147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:03.593692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:03.796734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:03.797963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:03.807456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:03.807955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:03.808398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:03.809109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:03.811350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:03.811814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:03.893253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:03.902004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d742953-e202-48d3-a852-c063c8b3bb4d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.325754 Oct 26 05:03:03.902591 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 324/647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:03 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:03.953062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:03.977165 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4aeda193-bed6-4c2f-97bb-f9dc943dda06 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.184536 Oct 26 05:03:03.989816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 324/648] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:03 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:04.127292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.128727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:04.135827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.136331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.140975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.141778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.142257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.142693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.263308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.264404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:04.271751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.272569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.273257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.274362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.275010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.276221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.485994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:04.497764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:04.502260 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f703c088-5604-4a28-a4db-eba41d3fd9cf tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.378710 Oct 26 05:03:04.503951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 325/649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:04.510373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9175f29a-9d5c-4ae3-b107-d4931df50116 req-ae07c646-4ba8-4a9d-894b-227658a0a3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48012d75-f17e-4292-b384-99a59b70ad9c", "tag": "af805686-1093-459f-b16e-cf3233e5bd10"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:04.522977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:04.528369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9175f29a-9d5c-4ae3-b107-d4931df50116 req-ae07c646-4ba8-4a9d-894b-227658a0a3e3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.529723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9175f29a-9d5c-4ae3-b107-d4931df50116 req-ae07c646-4ba8-4a9d-894b-227658a0a3e3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.530494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9175f29a-9d5c-4ae3-b107-d4931df50116 req-ae07c646-4ba8-4a9d-894b-227658a0a3e3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.548812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9175f29a-9d5c-4ae3-b107-d4931df50116 req-ae07c646-4ba8-4a9d-894b-227658a0a3e3 service nova] Creating event network-changed:af805686-1093-459f-b16e-cf3233e5bd10 for instance 48012d75-f17e-4292-b384-99a59b70ad9c on n-h2-862416-4 Oct 26 05:03:04.560525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9175f29a-9d5c-4ae3-b107-d4931df50116 req-ae07c646-4ba8-4a9d-894b-227658a0a3e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054300 Oct 26 05:03:04.561190 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 326/650] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:04.614833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:04.624859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:04.626427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:04.627633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67c7c399-abb0-44d5-8a96-e963b72bc12c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1557 microversion: 2.25 time: 0.368311 Oct 26 05:03:04.628393 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 325/651] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1557 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:04.652303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.652922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:04.658721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.659821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.660259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.660956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.661440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.661867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.693732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35f274bd-5e23-443a-8419-768c1126c40f tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] Calling method '.version_select at 0x7f470ac96af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.707458 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35f274bd-5e23-443a-8419-768c1126c40f tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.144867 Oct 26 05:03:04.708028 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 327/652] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:03:04.719251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-61d7e818-4197-4335-8769-1bdf7453562a tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] Action: 'update', calling method: .version_select at 0x7f470ac2d9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:04.875208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 7463491c-3949-4199-adbb-2436a92672c6 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:04.889955 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1daaa691-a469-4082-8c44-6e42180b66fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 2049 microversion: 2.25 time: 0.241293 Oct 26 05:03:04.890684 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 326/653] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 2049 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:04.897006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-61d7e818-4197-4335-8769-1bdf7453562a tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.181564 Oct 26 05:03:04.897650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 328/654] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Oct 26 05:03:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:03:04.914283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b14279de-bd77-41ef-b13a-b487613a3c50 tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] Calling method '.version_select at 0x7f470ab9f940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.926590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.927382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:04.929276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b14279de-bd77-41ef-b13a-b487613a3c50 tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019001 Oct 26 05:03:04.936162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 327/655] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:03:04.936347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.936347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.936540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:04.936634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.937129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.937244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:04.937466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.937906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.944706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.945199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.945837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:04.946545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:04.947026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:04.947455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.133750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:05.137966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 7463491c-3949-4199-adbb-2436a92672c6 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:05.151379 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46fdb872-42e2-4937-b578-ce4877c6232b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.219534 Oct 26 05:03:05.151572 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c750531a-5dd2-42f0-9e4b-9a950a662115 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 2049 microversion: 2.25 time: 0.231818 Oct 26 05:03:05.152151 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 329/656] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 2049 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:05.165599 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 328/657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:04 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:05.165735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d13fe14-8229-461e-90b1-acee9fe55bd1 tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] Action: 'update', calling method: .version_select at 0x7f470ad7e670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:05.170022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:05.171000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:05.181661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.182203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.182645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.183359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.183850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.184353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.223494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d13fe14-8229-461e-90b1-acee9fe55bd1 tempest-QuotaClassesAdmin257Test-955890943 tempest-QuotaClassesAdmin257Test-955890943-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.070150 Oct 26 05:03:05.224089 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 330/658] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Oct 26 05:03:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:03:05.228406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:05.232264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.234261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.234261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.234261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.234592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.234817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.259958 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-228061cf-f49b-4b35-bb11-ad6324810090 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034798 Oct 26 05:03:05.260755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 331/659] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 26 05:03:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:03:05.263506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:05.272786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:05.273341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:05.280184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.280837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.281294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.281437 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-242665a7-f7b3-4027-bea6-998585c3198f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.125708 Oct 26 05:03:05.285579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.285775 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 329/660] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:05 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:05.285879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.285879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.349991 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-947f0588-3f00-417d-aaf4-dbab626fe62f tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6/action" status: 202 len: 0 microversion: 2.25 time: 0.080848 Oct 26 05:03:05.353621 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 332/661] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:03:05 2022] POST /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:03:05.368344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:05.368965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:05.375205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.375692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.376109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.376833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.377300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.378744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.518031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 7463491c-3949-4199-adbb-2436a92672c6 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:05.527518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:05.528279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:05.534571 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8379cd84-e5e4-40b1-8769-c83f0dde9bbd tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 2054 microversion: 2.25 time: 0.177628 Oct 26 05:03:05.535755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.536379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.537256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.538445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:05.539109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:05.540280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:05.550354 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 330/662] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:05 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 2054 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:05.690684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:05.698871 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c99083c-3274-4c6b-a98c-afa4ea1b3ac2 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.176094 Oct 26 05:03:05.699504 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 333/663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:05 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:06.181227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:06.182078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:06.190134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.190373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.191360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.192219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.192676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.193100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.311710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:06.313245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:06.322865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.324391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.326177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.328332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.329179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.329874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.385724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:06.395187 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-045b9184-da96-4b1b-b9ba-b52b6a5ecac4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.217748 Oct 26 05:03:06.395770 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 331/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:06 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:06.431978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:06.451843 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d2e14c5-5688-4250-bd39-47324f27dcf0 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.144315 Oct 26 05:03:06.452755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 334/665] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:06 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:06.561531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:06.562179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:06.569131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.569826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.570279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.570961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.571416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.571845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.701347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 7463491c-3949-4199-adbb-2436a92672c6 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:06.718906 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b7e0120-6c41-46cf-9a45-053fa3195e01 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 2034 microversion: 2.25 time: 0.157084 Oct 26 05:03:06.718906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 332/666] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:06 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 2034 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:06.722485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:06.723095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:06.729475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.729958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.730543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.731237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.731691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.732110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.742415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": "auto"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:06.745020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:06.751802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.752290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.753574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.754388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:06.754852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:06.755570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:06.828399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'flavor' on Instance uuid 7463491c-3949-4199-adbb-2436a92672c6 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:06.841112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Going to try to live migrate instance to n-h2-862416-4 {{(pid=120585) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:03:06.879029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:06.887361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:06.887911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ea16667-b336-4cac-9cec-002e019af176 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.169481 Oct 26 05:03:06.889192 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 335/667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:06 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:07.418730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:07.419339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:07.426165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:07.426653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:07.427087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:07.428084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:07.428897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:07.429349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:07.610520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:07.618457 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b909b6f-9667-4458-90fd-1e3c2face916 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.203477 Oct 26 05:03:07.619021 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 336/668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:07 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:07.623472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:07.624072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:07.630493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:07.631215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:07.631830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:07.632690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:07.633306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:07.633910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:07.876692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:07.893718 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3e91995a-86f2-4d9d-bffa-6c4f90c94805 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.273490 Oct 26 05:03:07.894729 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 337/669] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:07 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:07.914115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:07.914938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:07.921002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:07.921555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:07.922066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:07.922840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:07.923377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:07.923903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:08.056600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:08.064129 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64e42d79-7fed-49a1-a7a6-f1535cc142cd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.155126 Oct 26 05:03:08.064681 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 338/670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:07 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:08.182048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3542b978-ebcb-48bb-bf13-f260b035cc71 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '.version_select at 0x7f470ad2a790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:08.243562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3542b978-ebcb-48bb-bf13-f260b035cc71 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631" status: 200 len: 371 microversion: 2.1 time: 0.177578 Oct 26 05:03:08.244128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 339/671] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:03:08 2022] GET /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631 => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:08.256375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Action: 'update', calling method: .version_select at 0x7f470ac2d940>, body: {"quota_set": {"ram": "5120"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:08.316764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:08.317249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:08.317726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:08.318454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:08.318911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:08.319336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:08.365712 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb4326dd-f680-40ec-a90d-7ecc67941438 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631" status: 200 len: 328 microversion: 2.1 time: 0.113504 Oct 26 05:03:08.366477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 340/672] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:08 2022] PUT /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631 => generated 328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:08.377234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f4a7d02-f33d-4fe9-9213-87d19ad4ac33 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:08.385095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=14,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:08.392013 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f4a7d02-f33d-4fe9-9213-87d19ad4ac33 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631" status: 202 len: 0 microversion: 2.1 time: 0.018154 Oct 26 05:03:08.392565 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 341/673] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:03:08 2022] DELETE /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631 => generated 0 bytes in 19 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:03:08.400349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2413b9bd-98e7-485c-a668-3d8025ce3227 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '.version_select at 0x7f470ac2db80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:08.465306 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2413b9bd-98e7-485c-a668-3d8025ce3227 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631" status: 200 len: 371 microversion: 2.1 time: 0.068524 Oct 26 05:03:08.465924 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 342/674] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:03:08 2022] GET /compute/v2.1/os-quota-sets/b8db4ca264c24b10a877e602be6b6631 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:08.582738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce29f1f2-ad04-4a36-aeee-1d1ae1cecfdc tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '.version_select at 0x7f470ad2ae50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:08.782573 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce29f1f2-ad04-4a36-aeee-1d1ae1cecfdc tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.203422 Oct 26 05:03:08.783900 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 343/675] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:03:08 2022] GET /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd/defaults => generated 371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:08.789174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:08.790151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:08.797846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:08.798509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:08.799100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:08.800746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:08.801668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:08.802254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.349934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:09.360695 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5affa486-ca54-4e31-9ee7-5e1992f6356b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1476 microversion: 2.1 time: 0.575404 Oct 26 05:03:09.361515 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 344/676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:08 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1476 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:09.366828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:09.367778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:09.376158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.377129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.378246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.379168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.379739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.380277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.494145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:09.513424 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-129ac5a0-8e04-45fa-9380-cfe236f5e74e tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.150380 Oct 26 05:03:09.514337 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 345/677] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:09 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:09.530253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Action: 'update', calling method: .version_select at 0x7f470acae790>, body: {"quota_set": {"ram": "5120"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:09.710363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.711177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.711407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.712782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.713070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.713586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.771532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dfc0e1cb-d64e-4e49-8b5e-4c282e19ec5b tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d" status: 200 len: 328 microversion: 2.1 time: 0.256035 Oct 26 05:03:09.772937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 346/678] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:09 2022] PUT /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d => generated 328 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:09.778051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:09.778887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:09.786095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.786680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.787133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.788196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.788674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.789191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.816494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8f5dacb1-f134-40cc-9a30-9adfd536c768 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6/action" status: 202 len: 0 microversion: 2.25 time: 3.079257 Oct 26 05:03:09.827446 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 333/679] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:03:06 2022] POST /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6/action => generated 0 bytes in 3091 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:03:09.833104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '.version_select at 0x7f470aa8e670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:09.962568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:09.962931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.963599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.964101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.964916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:09.965411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:09.965844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:09.980232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19a28e69-bb56-4b47-83ac-be0b01f640bd tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.203470 Oct 26 05:03:09.983258 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 347/680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:09 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:09.993791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-874f3387-c9d7-4d4f-b86f-3821e9c885bb tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d/detail" status: 200 len: 916 microversion: 2.1 time: 0.158079 Oct 26 05:03:09.993791 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 334/681] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:03:09 2022] GET /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d/detail => generated 916 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:10.008007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799dd620-87a8-4e32-9c1a-772b54ecb883", "name": "network-vif-unplugged", "status": "completed", "tag": "ce571795-111e-46ca-80eb-a9eabfa95f90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:10.016749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:10.017406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:10.036174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.036683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.036813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.037134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.037261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.038054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.043512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.044013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.044465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.064054 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] Creating event network-vif-unplugged:ce571795-111e-46ca-80eb-a9eabfa95f90 for instance 799dd620-87a8-4e32-9c1a-772b54ecb883 on n-h1-862416-4 Oct 26 05:03:10.092398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:03:10.116227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2b69fca0-6797-4523-8049-494c1dcb6473 req-74ccf580-1e9f-4fe6-8033-75d084520c51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126345 Oct 26 05:03:10.116851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 335/682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:10.245289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Action: 'update', calling method: .version_select at 0x7f470aa96f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:10.339821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.340462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.341235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.342100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.342674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.343211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.346961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:10.366044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:10.367783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:10.368879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d56d40e-38c7-41f6-9255-f3add919fb84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.357487 Oct 26 05:03:10.381430 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 348/683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:10 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:10.396275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:10.396988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:10.405198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.406025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.406496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.407493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.407968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.408404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.423849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.424765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.425399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.426602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.427226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.427818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.499900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf9c9c29-a869-4f78-ab44-6b2b21d8fbc7 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d?user_id=801501e378604df4b8ec2e8252444460" status: 200 len: 328 microversion: 2.1 time: 0.259221 Oct 26 05:03:10.500538 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 336/684] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:03:10 2022] PUT /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d?user_id=801501e378604df4b8ec2e8252444460 => generated 328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:10.512689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfe1a679-9d86-4bba-874e-164c1bd99440 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '.version_select at 0x7f470a9f71f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:10.606541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:10.612545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfe1a679-9d86-4bba-874e-164c1bd99440 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d?user_id=801501e378604df4b8ec2e8252444460" status: 200 len: 370 microversion: 2.1 time: 0.102909 Oct 26 05:03:10.613368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 337/685] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Oct 26 05:03:10 2022] GET /compute/v2.1/os-quota-sets/797e33cfc21146f3bb4c687273e78e4d?user_id=801501e378604df4b8ec2e8252444460 => generated 370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:10.625041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:10.626075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:10.633891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.634513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.634958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.635672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:10.636127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:10.636557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:10.657945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:10.668490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:10.673191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fbb72d4d-6f20-4ecb-adfe-106c2530f5db tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1475 microversion: 2.1 time: 0.290537 Oct 26 05:03:10.675067 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 349/686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:10 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:10.729814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:10.755365 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1cd843fd-e1f6-4181-9304-5aa8e3befb99 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.134176 Oct 26 05:03:10.756499 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 338/687] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:10 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:10.998190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55bb5ace-4f30-4abc-94d3-2541dd214ca8 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Calling method '.version_select at 0x7f470ac2d940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:11.007811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:11.009298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:11.016236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.016831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.017352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.018291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.018916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.019496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.192789 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55bb5ace-4f30-4abc-94d3-2541dd214ca8 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.198792 Oct 26 05:03:11.193399 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 350/688] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:03:10 2022] GET /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd/defaults => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:11.204844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Action: 'update', calling method: .version_select at 0x7f470acf88b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:11.258335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:11.267039 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1cf57780-25f5-4eca-8875-95b7f2d524d7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.264395 Oct 26 05:03:11.267864 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 339/689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:11 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:11.268006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.268991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.269473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.270214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.270677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.271108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.385847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9344e3cd-f16c-462e-82b9-d3d977613edd req-a41b7467-8ed7-45f9-886a-838bc9604077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7463491c-3949-4199-adbb-2436a92672c6", "name": "network-vif-unplugged", "status": "completed", "tag": "d08b8fb6-fb5b-44e3-b172-581589a3963b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:11.398919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9344e3cd-f16c-462e-82b9-d3d977613edd req-a41b7467-8ed7-45f9-886a-838bc9604077 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.399419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9344e3cd-f16c-462e-82b9-d3d977613edd req-a41b7467-8ed7-45f9-886a-838bc9604077 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.400131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9344e3cd-f16c-462e-82b9-d3d977613edd req-a41b7467-8ed7-45f9-886a-838bc9604077 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.414765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9344e3cd-f16c-462e-82b9-d3d977613edd req-a41b7467-8ed7-45f9-886a-838bc9604077 service nova] Creating event network-vif-unplugged:d08b8fb6-fb5b-44e3-b172-581589a3963b for instance 7463491c-3949-4199-adbb-2436a92672c6 on n-h1-862416-4 Oct 26 05:03:11.421347 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9344e3cd-f16c-462e-82b9-d3d977613edd req-a41b7467-8ed7-45f9-886a-838bc9604077 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040598 Oct 26 05:03:11.422615 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 340/690] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:11.428851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:11.429664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:11.438176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.439012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.439141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.439870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.440563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.440787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.492981 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56191b40-b87b-4719-ad29-0cad3b90660f tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd" status: 200 len: 329 microversion: 2.1 time: 0.291523 Oct 26 05:03:11.497412 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 351/691] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Oct 26 05:03:11 2022] PUT /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd => generated 329 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:11.506881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Action: 'update', calling method: .version_select at 0x7f470ac54280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:11.594163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.594801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.595214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.596198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.597264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.598054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.661013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:11.672233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:11.674308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:11.675876 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1f19cd6-ce7d-44ae-9148-f4455ad7ff92 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.252369 Oct 26 05:03:11.693256 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 341/692] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:11 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:11.700522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7e86c630-7b8e-420a-84d1-8504aaecce1d req-8c5fda0a-fba1-4c83-aff8-e3ca46c6605a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48012d75-f17e-4292-b384-99a59b70ad9c", "name": "network-vif-plugged", "status": "completed", "tag": "af805686-1093-459f-b16e-cf3233e5bd10"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:11.701305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:11.712150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e86c630-7b8e-420a-84d1-8504aaecce1d req-8c5fda0a-fba1-4c83-aff8-e3ca46c6605a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.713143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e86c630-7b8e-420a-84d1-8504aaecce1d req-8c5fda0a-fba1-4c83-aff8-e3ca46c6605a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.713638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e86c630-7b8e-420a-84d1-8504aaecce1d req-8c5fda0a-fba1-4c83-aff8-e3ca46c6605a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.731081 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7e86c630-7b8e-420a-84d1-8504aaecce1d req-8c5fda0a-fba1-4c83-aff8-e3ca46c6605a service nova] Creating event network-vif-plugged:af805686-1093-459f-b16e-cf3233e5bd10 for instance 48012d75-f17e-4292-b384-99a59b70ad9c on n-h2-862416-4 Oct 26 05:03:11.731584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=20,nova_api:UPDATE=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:11.737534 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7e86c630-7b8e-420a-84d1-8504aaecce1d req-8c5fda0a-fba1-4c83-aff8-e3ca46c6605a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042846 Oct 26 05:03:11.739561 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 342/693] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:11.744548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:11.745374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:11.754728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.755408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.755858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.756590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.757230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.757606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.963784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9619f52-0dd3-4e23-8fca-38175712a160 tempest-QuotasAdminTestJSON-1005252740 tempest-QuotasAdminTestJSON-1005252740-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd" status: 200 len: 329 microversion: 2.1 time: 0.461147 Oct 26 05:03:11.972339 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 352/694] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Oct 26 05:03:11 2022] PUT /compute/v2.1/os-quota-sets/cdeeb440140b43448bb52078f653f0dd => generated 329 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:11.972553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:11.972701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:11.972701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:11.977155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91115868-b35a-4437-b66a-9cc9d93a0924 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1473 microversion: 2.1 time: 0.236582 Oct 26 05:03:11.978507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 343/695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:11 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:11.995714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.996751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.997485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:11.998197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:11.998651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:11.999070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:12.078111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:12.095568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-67ed4e1a-1ff9-4dfc-8ace-384c1336ee54 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.129512 Oct 26 05:03:12.095932 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 353/696] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:11 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:12.134013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799dd620-87a8-4e32-9c1a-772b54ecb883", "tag": "ce571795-111e-46ca-80eb-a9eabfa95f90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:12.143491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:12.143963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:12.144465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:12.155664 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] Creating event network-changed:ce571795-111e-46ca-80eb-a9eabfa95f90 for instance 799dd620-87a8-4e32-9c1a-772b54ecb883 on n-h1-862416-4 Oct 26 05:03:12.162156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:03:12.177416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6432b7c0-fed1-4826-8bda-6e3ab3da10b5 req-0f1ad5fa-79da-4357-aa14-655a7c9b07a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046924 Oct 26 05:03:12.178394 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 344/697] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:12.293007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:12.294183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:12.302938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:12.303838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:12.304345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:12.305113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:12.305846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:12.306833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:12.520479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:12.530793 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6bfe0e04-2d27-438c-8a6b-1742fde1d83a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1315 microversion: 2.1 time: 0.242540 Oct 26 05:03:12.539435 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 354/698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:12 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:12.705438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:12.706929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:12.713027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:12.713559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:12.714050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:12.715002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:12.715465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:12.716073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:12.857668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:12.869408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:12.871853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:12.873302 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a232801-1bdc-4549-a7e1-62ee05bdd7da tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.172267 Oct 26 05:03:12.875230 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 345/699] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:12 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:13.005613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:13.006866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:13.018363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.019127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.019737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.022469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.028227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.028819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.124172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:13.125163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:13.133897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.134928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.136717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.138423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.139092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.139860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.242297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:13.261650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48fa0644-063f-4e2d-8d69-d3b70e014b27 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.140672 Oct 26 05:03:13.262461 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 346/700] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:13 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:13.287353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:13.295604 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-02b024be-bf27-4a0f-ab73-09e96db01ec6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1473 microversion: 2.1 time: 0.295419 Oct 26 05:03:13.305335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 355/701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:12 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:13.454085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9aaffcdc-2df6-4c5d-abcf-06dc990e6e4d req-1a14d648-626c-43d1-9fac-c9d6cfde25e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7463491c-3949-4199-adbb-2436a92672c6", "tag": "d08b8fb6-fb5b-44e3-b172-581589a3963b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:13.466168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9aaffcdc-2df6-4c5d-abcf-06dc990e6e4d req-1a14d648-626c-43d1-9fac-c9d6cfde25e8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.467044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9aaffcdc-2df6-4c5d-abcf-06dc990e6e4d req-1a14d648-626c-43d1-9fac-c9d6cfde25e8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.467684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9aaffcdc-2df6-4c5d-abcf-06dc990e6e4d req-1a14d648-626c-43d1-9fac-c9d6cfde25e8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.490458 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9aaffcdc-2df6-4c5d-abcf-06dc990e6e4d req-1a14d648-626c-43d1-9fac-c9d6cfde25e8 service nova] Creating event network-changed:d08b8fb6-fb5b-44e3-b172-581589a3963b for instance 7463491c-3949-4199-adbb-2436a92672c6 on n-h1-862416-4 Oct 26 05:03:13.497021 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9aaffcdc-2df6-4c5d-abcf-06dc990e6e4d req-1a14d648-626c-43d1-9fac-c9d6cfde25e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046386 Oct 26 05:03:13.498044 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 347/702] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:13.554879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:13.555890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:13.563707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.564485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.564928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.566180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.566655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.567251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.714512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:13.724231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0fc16c09-9394-4c0e-bb5e-2fe7693de685 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1503 microversion: 2.1 time: 0.173140 Oct 26 05:03:13.724919 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 356/703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:13 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:13.748491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:13.749223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:13.757956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.758716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.759987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.761524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.762721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.763268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.792296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:03:13.885365 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a73163c7-eeb6-406e-a37e-bca0b34878f4 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 204 len: 0 microversion: 2.1 time: 0.141949 Oct 26 05:03:13.886031 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 348/704] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:03:13 2022] DELETE /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:03:13.894806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:13.895568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:13.902388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.903239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.903836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.905060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.905494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.906030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.907158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:13.907868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:13.914070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.914760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.915210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:13.916499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:13.917237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:13.918122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.120824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:14.132896 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-492e64ab-2643-452e-a625-d82a3b80d4ea tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1509 microversion: 2.1 time: 0.242689 Oct 26 05:03:14.145340 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 357/705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:13 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:14.163155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:14.173202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:14.177232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:14.177232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2f5996e-bc03-45e1-b2d3-0d958710f8f4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.280646 Oct 26 05:03:14.205338 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 349/706] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:13 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:14.290312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:14.290920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:14.297058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.297617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.298068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.298911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.299910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.301104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.320957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:14.321816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:14.328687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.329530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.329975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.331090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.331492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.331922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.380899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:14.406985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5633c3ea-8fe5-49bd-9180-60e5b6ff3241 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.120580 Oct 26 05:03:14.408098 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 358/707] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:14 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:14.495017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:14.503506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-76d41652-aa3f-4529-bd09-40b8f223e143 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1470 microversion: 2.1 time: 0.188056 Oct 26 05:03:14.504460 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 350/708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:14 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:14.527999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:14.528536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:14.535773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.536634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.537214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.538349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.538965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.539664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.629582 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de919a4a-1816-4e79-b965-7db324026f1a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883/action" status: 204 len: 0 microversion: 2.1 time: 0.105407 Oct 26 05:03:14.631056 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 359/709] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:03:14 2022] POST /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883/action => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:03:14.641742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:14.642489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:14.651533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.652879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.653947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.654957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:14.656350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:14.656943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:14.815229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:14.823168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-008f6782-4684-431b-9613-406764db8a3b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1470 microversion: 2.1 time: 0.187195 Oct 26 05:03:14.824047 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 351/710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:14 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:15.158205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:15.161365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:15.184743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.185506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.185852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.186636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.187166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.187669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.192278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:15.307507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f69078c-b49e-45b8-973c-5d9329d34076 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Calling method '.version_select at 0x7f470ad53700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:15.366400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:15.374861 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e6a9092-abaf-43c2-a4cc-b7679e3a2068 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1509 microversion: 2.1 time: 0.220401 Oct 26 05:03:15.375942 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 352/711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:15 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:15.381084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:15.381951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:15.388876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.389632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.390280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.391213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.391864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.392504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.405087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f69078c-b49e-45b8-973c-5d9329d34076 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 371 microversion: 2.1 time: 0.265509 Oct 26 05:03:15.406371 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 360/712] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:03:15 2022] GET /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:15.421738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Action: 'update', calling method: .version_select at 0x7f470ac2d310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:15.528892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.530118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.530592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.531472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.532122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.532650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.594811 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6698d850-b98b-4c48-9e2b-18e367d51d68 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 328 microversion: 2.1 time: 0.179002 Oct 26 05:03:15.598083 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 361/713] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:15 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:15.602707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:15.603530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:15.610969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.611631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.612707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.613665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.614262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.614813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.627856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:15.658474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:15.671235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:15.672448 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb2a64a6-c928-4f9b-8ad8-dbffa7463cb8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.295430 Oct 26 05:03:15.673300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 353/714] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:15 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:15.754136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:15.785483 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-194abae9-75af-4282-9a8b-d6b15d14dce3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.187839 Oct 26 05:03:15.786265 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 362/715] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:15 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:15.847226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:15.847904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:15.861587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.863085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.863528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.864244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:15.864709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:15.865139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:15.920561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1509716216", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:15.993076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:16.132158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:16.150110 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bced242d-ec05-4461-94e3-df10cc5718d3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1470 microversion: 2.1 time: 0.295253 Oct 26 05:03:16.150110 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 363/716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:15 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:16.225628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799dd620-87a8-4e32-9c1a-772b54ecb883", "name": "network-vif-plugged", "status": "completed", "tag": "ce571795-111e-46ca-80eb-a9eabfa95f90"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:16.256276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.257502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.258219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.296419 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] Creating event network-vif-plugged:ce571795-111e-46ca-80eb-a9eabfa95f90 for instance 799dd620-87a8-4e32-9c1a-772b54ecb883 on n-h1-862416-4 Oct 26 05:03:16.306705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:03:16.321389 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-85088204-c5f6-4d34-a63c-b3a82826916d req-418c7ee9-ab8e-429d-93f8-d71b80772767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101858 Oct 26 05:03:16.323972 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 364/717] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:16.400796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:16.401775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:16.417645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.418334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.418979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.419868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.420483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.421065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.614417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec9361cb6c24b7aadb704fd43576d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dd1c6eec6424e84f3aa345876c8cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:16.622324 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cde84bf5-e9d2-4fe6-a10a-85321f52ad4f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 200 len: 1467 microversion: 2.1 time: 0.225846 Oct 26 05:03:16.637844 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 365/718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:16 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 1467 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:16.644333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1440810e-8cfb-4917-b606-4a10cb33986c req-b74dd245-208b-4750-8a87-fd3830524da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48012d75-f17e-4292-b384-99a59b70ad9c", "name": "network-vif-deleted", "tag": "af805686-1093-459f-b16e-cf3233e5bd10"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:16.654643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1440810e-8cfb-4917-b606-4a10cb33986c req-b74dd245-208b-4750-8a87-fd3830524da7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.655126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1440810e-8cfb-4917-b606-4a10cb33986c req-b74dd245-208b-4750-8a87-fd3830524da7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.655563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1440810e-8cfb-4917-b606-4a10cb33986c req-b74dd245-208b-4750-8a87-fd3830524da7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.656448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:16.657487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:16.660487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:16.661130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:16.662364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:16.669114 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1440810e-8cfb-4917-b606-4a10cb33986c req-b74dd245-208b-4750-8a87-fd3830524da7 service nova] Creating event network-vif-deleted:af805686-1093-459f-b16e-cf3233e5bd10 for instance 48012d75-f17e-4292-b384-99a59b70ad9c on n-h2-862416-4 Oct 26 05:03:16.675335 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1440810e-8cfb-4917-b606-4a10cb33986c req-b74dd245-208b-4750-8a87-fd3830524da7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Oct 26 05:03:16.675898 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 366/719] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:16.683550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.684722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.685690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.688746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.689443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.691401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.707813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:16.708929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:16.710096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:16.717160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.717800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.718485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.719918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.720521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.721090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.746159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Getting quotas for project 814a1f0b96bb4e0083d3ed4997db5abe. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:16.757898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Getting quotas for user 0d0d2d47295245078647d07c58507ceb and project 814a1f0b96bb4e0083d3ed4997db5abe. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:16.795752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.utils [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] cores quota exceeded for 814a1f0b96bb4e0083d3ed4997db5abe, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120585) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 26 05:03:16.796835 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Request method failure captured: Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 145 Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-SimzZqiCMC0hyOV-A7Ib4LMUUyxCg9urNjF6nGsc7GkuPM3husKwd9AhfRnnTikIO6vAUCp74zPvcoiLsjv-Swk4gj7PUYElzqJLMqpnN57i8cpbdWJ7tY1QqHEcu0B_HfNR2gtk76I5dsVs9t9ZqKFWtJzdXPfvOsvhngeND5hU Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:03:16.802358 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0d0d2d47295245078647d07c58507ceb Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1509716216", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} Oct 26 05:03:16.804252 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1509716216', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452'}}} Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 05:03:16.805268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:16.806812 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.809186 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc807598-c0ab-4058-927a-4bb8d35ff6e9 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.987451 Oct 26 05:03:16.810780 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 354/720] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 989 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:16.845477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Action: 'update', calling method: .version_select at 0x7f470aa01af0>, body: {"quota_set": {"cores": 20}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:16.891018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:16.900084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:16.901560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:16.903122 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f4bd74b-72ff-4296-9fcc-882e72017c5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.199914 Oct 26 05:03:16.905427 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 367/721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:16 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:16.910010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:16.910775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:16.918330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.919039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.919650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.920575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.920800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.921225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.923116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.923907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.924710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.925573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:16.926255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:16.926831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:16.982730 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f6cf8d62-e3c5-4ff6-9752-d6f7eaae70e7 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 329 microversion: 2.1 time: 0.166068 Oct 26 05:03:16.983513 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 355/722] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:16 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 329 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:16.996498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a1d1b1ac-33ef-45e2-b46f-60a99140380a tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Calling method '.version_select at 0x7f470a9e0700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:16.998185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:17.001538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:17.017751 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a335b843-8f00-445f-8746-c672089b2946 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.112884 Oct 26 05:03:17.019235 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 368/723] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:16 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:17.061400 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a1d1b1ac-33ef-45e2-b46f-60a99140380a tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 371 microversion: 2.1 time: 0.068418 Oct 26 05:03:17.061938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 356/724] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:03:16 2022] GET /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:17.074038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Action: 'update', calling method: .version_select at 0x7f470ad539d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.135405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.135883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.136321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.137045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.137538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.137962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.152614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=10,nova_api:INSERT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:17.168836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:17.169556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.176664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.177443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.178121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.178792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.179384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.179826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.202860 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dbf96ad1-d5d2-45ff-9838-3ac53821b764 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 328 microversion: 2.1 time: 0.132449 Oct 26 05:03:17.203740 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 369/725] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:17 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:17.233989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d1f241-fd16-45b2-8e57-0b6c04fb4721"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.236550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.243241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.243949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.244552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.245470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.246287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.246885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.355179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:17.364493 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-098738fa-90c9-4ae6-8e82-261a83d924a4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1470 microversion: 2.1 time: 0.199809 Oct 26 05:03:17.365081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 357/726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:17 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:17.369728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-272607146", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.431625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:17.616223 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01d49dd7-2d4f-4479-8729-bf0f131a0c13 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "POST /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386041 Oct 26 05:03:17.617305 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 370/727] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:03:17 2022] POST /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:17.650612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:17.651328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.668593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.669097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.669572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.670313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.670780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.671213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.685875 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c HTTP/1.1 Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.701936 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.703719 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '48012d75-f17e-4292-b384-99a59b70ad9c'} Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.708687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.710155 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.711299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.711299 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fbe18878-2f3f-4594-9ca6-fc6349032f6b tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 404 len: 111 microversion: 2.1 time: 0.057122 Oct 26 05:03:17.711299 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 371/728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:17 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:17.712622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1832793380", "metadata": {"image_type": "test"}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.715083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.722076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.722451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.722892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.723698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.724161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.724588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.739935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c/action HTTP/1.1 Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 112 Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.741633 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1832793380", "metadata": {"image_type": "test"}}} Oct 26 05:03:17.743554 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '48012d75-f17e-4292-b384-99a59b70ad9c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1832793380', 'metadata': {'image_type': 'test'}}}} Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.744484 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.745712 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98f51439-0333-40f2-9df8-979d0940311a tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "POST /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c/action" status: 404 len: 111 microversion: 2.1 time: 0.034415 Oct 26 05:03:17.748053 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 372/729] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 26 05:03:17 2022] POST /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:17.758477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3973c86a-9561-49b6-8eb9-85e9f5cc127e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-352889752", "metadata": {"image_type": "test"}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.760869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3973c86a-9561-49b6-8eb9-85e9f5cc127e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Failed to fetch instance by id tempest-invalid-381531095 {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:03:17.761434 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3973c86a-9561-49b6-8eb9-85e9f5cc127e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance tempest-invalid-381531095 could not be found. Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3973c86a-9561-49b6-8eb9-85e9f5cc127e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/tempest-invalid-381531095/action HTTP/1.1 Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 111 Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.762992 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-352889752", "metadata": {"image_type": "test"}}} Oct 26 05:03:17.764655 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance tempest-invalid-381531095 could not be found. Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'tempest-invalid-381531095', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-352889752', 'metadata': {'image_type': 'test'}}}} Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-381531095 could not be found. Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.765545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-381531095 could not be found. Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-381531095 could not be found. Oct 26 05:03:17.766814 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.768166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3973c86a-9561-49b6-8eb9-85e9f5cc127e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance tempest-invalid-381531095 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.768166 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3973c86a-9561-49b6-8eb9-85e9f5cc127e tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-381531095/action" status: 404 len: 100 microversion: 2.1 time: 0.010071 Oct 26 05:03:17.768166 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 373/730] 10.222.0.16 () {60 vars in 1246 bytes} [Wed Oct 26 05:03:17 2022] POST /compute/v2.1/servers/tempest-invalid-381531095/action => generated 100 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:17.779238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e254252-ee4d-4f57-b8e7-5d0cde4a50e7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-554501248"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.800931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e254252-ee4d-4f57-b8e7-5d0cde4a50e7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:03:17.801851 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6e254252-ee4d-4f57-b8e7-5d0cde4a50e7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e254252-ee4d-4f57-b8e7-5d0cde4a50e7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 56 Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.803678 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "tempest-test-snap-554501248"}} Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.805021 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-554501248'}}} Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.805929 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.808306 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.817381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e254252-ee4d-4f57-b8e7-5d0cde4a50e7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.818591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e254252-ee4d-4f57-b8e7-5d0cde4a50e7 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.043919 Oct 26 05:03:17.821528 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 374/731] 10.222.0.16 () {60 vars in 1275 bytes} [Wed Oct 26 05:03:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:17.835104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-345ff2f9-5285-495b-bbc0-64531163eb2f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1579732915"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:17.837372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-345ff2f9-5285-495b-bbc0-64531163eb2f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:03:17.837899 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-345ff2f9-5285-495b-bbc0-64531163eb2f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-345ff2f9-5285-495b-bbc0-64531163eb2f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 57 Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.839465 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "tempest-test-snap-1579732915"}} Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.840883 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1579732915'}}} Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.841972 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 26 05:03:17.843729 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.845493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-345ff2f9-5285-495b-bbc0-64531163eb2f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.845493 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-345ff2f9-5285-495b-bbc0-64531163eb2f tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.014364 Oct 26 05:03:17.850084 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 375/732] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 26 05:03:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:17.857612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:17.858118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.866046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.866542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.866984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.867958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.868460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.869010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.877268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:17.879047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:17.879519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:17.879930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:17.880340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:17.885125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c HTTP/1.1 Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.886876 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.888233 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '48012d75-f17e-4292-b384-99a59b70ad9c'} Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.889082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.890845 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.893164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.893164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da1875ed-caa5-40e2-ae93-6b410ab29d93 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 404 len: 111 microversion: 2.1 time: 0.035893 Oct 26 05:03:17.893164 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 376/733] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:03:17 2022] DELETE /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:17.896973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.897775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.897948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.898118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:17.898706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.898818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] [instance: 48012d75-f17e-4292-b384-99a59b70ad9c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.899164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.899592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.904509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.904996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.905465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.906402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.907069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.907704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.931957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Getting quotas for project 814a1f0b96bb4e0083d3ed4997db5abe. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:17.932895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] HTTP exception thrown: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Request method failure captured: Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c HTTP/1.1 Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-D5fyQMnIhPScP3GXtUWJF5g2umkPEqSbF2cF8WCiwR3ki4bAfQJxytWCC_0Xxl_8ZSWnJeAh83cqfFasfFHS6HyCBKmQuVAs4MwGSzrexEKGRiembscy843SgjLnuFgWz9QwdX-amd2dLGk6MBtO5_CmIOcXC7T7FgAL36S1aNPc Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:17.934844 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/804dd1c6eec6424e84f3aa345876c8cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 804dd1c6eec6424e84f3aa345876c8cb Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1363965625 Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3ec9361cb6c24b7aadb704fd43576d7b Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesNegativeTestJSON-1363965625-project Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.936252 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '48012d75-f17e-4292-b384-99a59b70ad9c'} Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.936985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. Oct 26 05:03:17.938219 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.939411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] Returning 404 to user: Instance 48012d75-f17e-4292-b384-99a59b70ad9c could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.939411 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19ad3a21-e457-4932-8899-b70530ef54c0 tempest-ImagesNegativeTestJSON-1363965625 tempest-ImagesNegativeTestJSON-1363965625-project] 10.222.0.16 "GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c" status: 404 len: 111 microversion: 2.1 time: 0.043715 Oct 26 05:03:17.939411 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 377/734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:17 2022] GET /compute/v2.1/servers/48012d75-f17e-4292-b384-99a59b70ad9c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:17.944143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Getting quotas for user 0d0d2d47295245078647d07c58507ceb and project 814a1f0b96bb4e0083d3ed4997db5abe. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:17.944978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:17.945976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:17.954281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.955205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.955760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.956492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:17.956936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:17.957826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:17.959308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.utils [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] instances quota exceeded for 814a1f0b96bb4e0083d3ed4997db5abe, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120585) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 26 05:03:17.959924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Request method failure captured: Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 144 Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-SimzZqiCMC0hyOV-A7Ib4LMUUyxCg9urNjF6nGsc7GkuPM3husKwd9AhfRnnTikIO6vAUCp74zPvcoiLsjv-Swk4gj7PUYElzqJLMqpnN57i8cpbdWJ7tY1QqHEcu0B_HfNR2gtk76I5dsVs9t9ZqKFWtJzdXPfvOsvhngeND5hU Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:03:17.961993 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0d0d2d47295245078647d07c58507ceb Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-272607146", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} Oct 26 05:03:17.964164 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-272607146', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452'}}} Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 05:03:17.966639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.968884 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.970620 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-45b839e7-a529-4ddc-b046-158299d5f763 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.597624 Oct 26 05:03:17.973776 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 358/735] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:17 2022] POST /compute/v2.1/servers => generated 119 bytes in 599 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:17.980648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Action: 'update', calling method: .version_select at 0x7f470a9f71f0>, body: {"quota_set": {"instances": 10}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:18.068732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.069479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.070139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.071272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.072003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.072975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.124369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:18.149076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=63 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:18.158148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67b0f832-6e78-4cf1-89d0-5d3eff2b9211 tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 329 microversion: 2.1 time: 0.188114 Oct 26 05:03:18.159255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 359/736] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:17 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 329 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:18.165039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:18.182269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:18.189773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.191285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.191929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.192815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.193458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.194069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.320580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:18.352077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df67ac2a-245b-4593-a108-4baca2a3be6f tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.191576 Oct 26 05:03:18.352574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:18.353135 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 360/737] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:18 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:18.373897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-461bfe24-06a6-4cd7-bd1f-0957e683de9c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Calling method '.version_select at 0x7f470a9e0430>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:18.382749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:18.386455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:18.387685 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99355098-b4b9-47b5-8929-f1920e756799 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.448814 Oct 26 05:03:18.398336 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 378/738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:17 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:18.413684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:18.414589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:18.422627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.423369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.424079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.425234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.425931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.426524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.483390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-461bfe24-06a6-4cd7-bd1f-0957e683de9c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 371 microversion: 2.1 time: 0.122040 Oct 26 05:03:18.484668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 361/739] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:03:18 2022] GET /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:18.497027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Action: 'update', calling method: .version_select at 0x7f470a93e9d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:18.577208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.577978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.579151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.580119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.581357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.582045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.651955 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed3f1e01-95ee-4423-900b-0f29c4eed55e tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 325 microversion: 2.1 time: 0.158811 Oct 26 05:03:18.661513 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 362/740] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:18 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:18.710245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1638209788", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:18.740270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:18.754019 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8bb1117a-f82e-4c05-b0a1-d65a8640cc87 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1462 microversion: 2.1 time: 0.353897 Oct 26 05:03:18.755108 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 379/741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:18 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1462 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:18.777715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:18.778546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:18.779320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:18.787452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.788196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.788636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:18.789405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:18.789858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:18.790564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.221802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37d1cbb4-23b9-428b-bdb3-6c2d626406ad tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1613 microversion: 2.1 time: 0.446813 Oct 26 05:03:19.222747 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 380/742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:18 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1613 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:19.250083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-396f99ba-eac7-4f51-9224-e4ae1248b068 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '.version_select at 0x7f470c020a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:19.253586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-396f99ba-eac7-4f51-9224-e4ae1248b068 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.254078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-396f99ba-eac7-4f51-9224-e4ae1248b068 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.254520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-396f99ba-eac7-4f51-9224-e4ae1248b068 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.262924 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-396f99ba-eac7-4f51-9224-e4ae1248b068 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.016576 Oct 26 05:03:19.265780 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 381/743] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:03:19 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:19.373292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1833770308", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:19.403340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:19.404440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:19.405130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:19.405752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:19.406353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:19.418386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.419165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.419925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.421883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.422541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.423821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.453192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Getting quotas for project 814a1f0b96bb4e0083d3ed4997db5abe. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:19.466221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:19.469077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Getting quotas for user 0d0d2d47295245078647d07c58507ceb and project 814a1f0b96bb4e0083d3ed4997db5abe. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:19.483598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.utils [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] ram quota exceeded for 814a1f0b96bb4e0083d3ed4997db5abe, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120585) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 26 05:03:19.484136 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Request method failure captured: Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 145 Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-SimzZqiCMC0hyOV-A7Ib4LMUUyxCg9urNjF6nGsc7GkuPM3husKwd9AhfRnnTikIO6vAUCp74zPvcoiLsjv-Swk4gj7PUYElzqJLMqpnN57i8cpbdWJ7tY1QqHEcu0B_HfNR2gtk76I5dsVs9t9ZqKFWtJzdXPfvOsvhngeND5hU Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:03:19.486546 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0d0d2d47295245078647d07c58507ceb Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1638209788", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} Oct 26 05:03:19.488459 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1638209788', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452'}}} Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 05:03:19.489215 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:19.490346 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.491630 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f4f1035-3bf9-4b5f-935f-e9ce496693b8 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.788252 Oct 26 05:03:19.495085 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 363/744] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 789 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:19.500268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:19.501154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:19.507845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.508429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.508947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.509749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.510273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.510848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.660273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:19.678450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ace03e8d-bbea-4a6a-8f58-4de96920bd81 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.181814 Oct 26 05:03:19.685433 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 364/745] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:19 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:19.691545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:19.692385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:19.701127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.701673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.702102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:19.702803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:19.703304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:19.703710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:20.328426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:20.337056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:20.338669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:20.339944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0a1a982-c31d-483d-8c7e-3301ae673c0c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1567 microversion: 2.25 time: 0.653329 Oct 26 05:03:20.340596 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 365/746] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:19 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1567 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:20.361568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Action: 'update', calling method: .version_select at 0x7f470a93e0d0>, body: {"quota_set": {"ram": 51200}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:20.368166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:20.369301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:20.370243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:20.370870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:20.371507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:20.396432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:20.398683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:20.399180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:20.400003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:20.400827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:20.401268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:20.428549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:20.433921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for user 5e48790bfe71452288c91f49586a624e and project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:20.448011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:20.450675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:20.451730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:20.452753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:20.452959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:20.453833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:20.454387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:20.455308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:20.517854 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8276c760-75e8-4976-a408-ee9236eb0f77 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148354 Oct 26 05:03:20.519256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 382/747] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:03:20.521119 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69e2aa5d-51c7-4258-8a2f-459d17e0f77c tempest-QuotasAdminNegativeTest-1918050204 tempest-QuotasAdminNegativeTest-1918050204-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 200 len: 329 microversion: 2.1 time: 0.178997 Oct 26 05:03:20.521911 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 366/748] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:20 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 329 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:20.532760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d88f478c-d690-469c-9fec-3a9310857715 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:20.534083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d88f478c-d690-469c-9fec-3a9310857715 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:20.535911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-40921d49-1561-46a2-9cb7-0469e2c2c806 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Action: 'update', calling method: .version_select at 0x7f470a9768b0>, body: {"quota_set": {"ram": 0}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:20.542515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-40921d49-1561-46a2-9cb7-0469e2c2c806 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '0d0d2d47295245078647d07c58507ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814a1f0b96bb4e0083d3ed4997db5abe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-40921d49-1561-46a2-9cb7-0469e2c2c806 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Request method failure captured: Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe HTTP/1.1 Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 25 Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-SimzZqiCMC0hyOV-A7Ib4LMUUyxCg9urNjF6nGsc7GkuPM3husKwd9AhfRnnTikIO6vAUCp74zPvcoiLsjv-Swk4gj7PUYElzqJLMqpnN57i8cpbdWJ7tY1QqHEcu0B_HfNR2gtk76I5dsVs9t9ZqKFWtJzdXPfvOsvhngeND5hU Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:03:20.545081 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/814a1f0b96bb4e0083d3ed4997db5abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 814a1f0b96bb4e0083d3ed4997db5abe Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1108738825 Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0d0d2d47295245078647d07c58507ceb Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-QuotasAdminNegativeTest-1108738825-project Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: {"quota_set": {"ram": 0}} Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 26 05:03:20.546446 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '814a1f0b96bb4e0083d3ed4997db5abe', 'body': {'quota_set': {'ram': 0}}} Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:20.547319 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:20.549296 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:20.550766 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:20.550766 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:20.550766 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:03:20.550766 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:03:20.550766 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 26 05:03:20.550766 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:20.552944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-40921d49-1561-46a2-9cb7-0469e2c2c806 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:20.554029 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-40921d49-1561-46a2-9cb7-0469e2c2c806 tempest-QuotasAdminNegativeTest-1108738825 tempest-QuotasAdminNegativeTest-1108738825-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe" status: 403 len: 116 microversion: 2.1 time: 0.023113 Oct 26 05:03:20.555167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 367/749] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:03:20 2022] PUT /compute/v2.1/os-quota-sets/814a1f0b96bb4e0083d3ed4997db5abe => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:03:20.649970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d88f478c-d690-469c-9fec-3a9310857715 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:20.661359 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d88f478c-d690-469c-9fec-3a9310857715 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1213 microversion: 2.1 time: 0.134589 Oct 26 05:03:20.681413 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 383/750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:20 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:20.714541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:20.715773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:20.727988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:20.730151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:20.730710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:20.731859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:20.732546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:20.733224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:21.082357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:21.113137 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71d971de-8791-4212-a921-89de3a60f9fd tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.403638 Oct 26 05:03:21.125582 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 368/751] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:20 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:21.365890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:21.366425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:21.379391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:21.380092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:21.380504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:21.381229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:21.381798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:21.382235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:21.688642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:21.689422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:21.706847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:21.710696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:21.711438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:21.714630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:21.717978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:21.720063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:21.927377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:21.938128 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-68f41307-4602-4929-a898-edaad1a8c979 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1265 microversion: 2.1 time: 0.253571 Oct 26 05:03:21.943526 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 369/752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:21 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:22.003500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:22.012314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:22.019417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:22.021250 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb2afdb0-f5e8-4a3a-a31f-98226b135501 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1542 microversion: 2.25 time: 0.659709 Oct 26 05:03:22.022582 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 384/753] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:21 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1542 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:22.048897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ace4cc0-282a-47c3-b8f4-35f01e39b3fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '.version_select at 0x7f470a93e670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:22.053573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ace4cc0-282a-47c3-b8f4-35f01e39b3fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.054609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ace4cc0-282a-47c3-b8f4-35f01e39b3fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.055275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ace4cc0-282a-47c3-b8f4-35f01e39b3fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.108611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ace4cc0-282a-47c3-b8f4-35f01e39b3fc tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.064065 Oct 26 05:03:22.121725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 370/754] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 26 05:03:22 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:22.124654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:22.125364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:22.136718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.144650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:22.144860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.145270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:22.145443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.147511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.148284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.149286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.153775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.154505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.155105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.156057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.156749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.157357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.378084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:22.443130 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73351bd8-771e-4abe-866c-f70491da4185 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.303054 Oct 26 05:03:22.443946 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 371/755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:22 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:22.460382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:22.462756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:22.472789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.473509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.474082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.475155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.475802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.476525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.747662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 7463491c-3949-4199-adbb-2436a92672c6 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:22.819601 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf6bf308-7e5c-4fdb-8976-9c4147bf7d36 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 2034 microversion: 2.25 time: 0.698792 Oct 26 05:03:22.826958 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 385/756] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:22 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 2034 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:22.872268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fabbd492-a192-40c6-a6a3-4d028ec61d0f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Action: 'create', calling method: .version_select at 0x7f470ac0a430>, body: {"keypair": {"name": "tempest-keypair-1687105724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnrKUICg732gNtx6m1wwtg+H1BdDMJ+Z5UrJszWDuTcI0GmXw5LM4tnw52NiKGi8CL8cldPDWNddt3f8SC35ghloxQJf5Nm02zyJgIlpT3WqvMWxXlYQ86KwfvbvLrWtA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:22.890114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fabbd492-a192-40c6-a6a3-4d028ec61d0f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for project a891e93c2035474fb99ebafc3de91101. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:22.895947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fabbd492-a192-40c6-a6a3-4d028ec61d0f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for user b36c8ac2dee24d33b680608a740463bb and project a891e93c2035474fb99ebafc3de91101. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:22.929484 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fabbd492-a192-40c6-a6a3-4d028ec61d0f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.061090 Oct 26 05:03:22.936734 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 386/757] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:03:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:03:22.964817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:22.965190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:22.973943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.975646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.976717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.979328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:22.981102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:22.981748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:22.997974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:03:23.112311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:23.122755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f94cea50-88be-4ae7-87d7-3c8c921b8e62 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1271 microversion: 2.1 time: 0.161996 Oct 26 05:03:23.137652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 387/758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:22 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:23.238541 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cbf9092-4515-4131-94ed-1cb8aa6df8c4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 204 len: 0 microversion: 2.1 time: 0.788873 Oct 26 05:03:23.239504 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 372/759] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:03:22 2022] DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 0 bytes in 795 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:03:23.411416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-401466450", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "1728521196", "adminPass": "***", "networks": [{"uuid": "4be33af3-280f-4042-952a-fca147220c98"}], "security_groups": [{"name": "tempest-securitygroup--1953852765"}], "key_name": "tempest-keypair-1483760941", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:23.478806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:23.480225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:23.518092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:23.520136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:23.525384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:23.526561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:23.527048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:23.527484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:23.681064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] validate_networks() for [('4be33af3-280f-4042-952a-fca147220c98', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:23.715826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:23.718372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:23.760940 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6711c8d-9635-4490-bc98-d3167b968a2a tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.290260 Oct 26 05:03:23.761883 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 373/760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:23 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:24.153183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:24.155279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:24.170138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:24.171873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:24.175360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:24.177654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:24.178610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:24.179267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:24.293149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:24.306545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1aac3f3-e62c-44aa-bbf6-2a4cdb639488 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1271 microversion: 2.1 time: 0.161441 Oct 26 05:03:24.309245 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 374/761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:24 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:24.790481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:24.791356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:24.808208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:24.808755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:24.811854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:24.812652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:24.818125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:24.818617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:25.260371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:25.261560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:25.262911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:25.263629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:25.264296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:25.283574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:25.284714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:25.285862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:25.288059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:25.289053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:25.291203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:25.301812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:25.327096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Getting quotas for project 0d91a2576da84ef6984dae45db8b8543. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:25.333147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Getting quotas for user 43735d2f58ca41b699f15ffc645aba3f and project 0d91a2576da84ef6984dae45db8b8543. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:25.340592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-51fefaed-745e-4087-bc6c-2ed5f1d04fe3 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.554255 Oct 26 05:03:25.342845 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 375/762] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:24 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:25.348065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:25.348925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:25.357371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:25.358097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:25.358680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:25.360305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:25.360964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:25.362187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:25.371725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:25.385486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:25.514646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-be53f64b-acd0-4a41-bf62-1efe16afc033 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.114735 Oct 26 05:03:25.522506 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 388/763] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:03:25.531312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df29e6f6-d797-4ee3-ae31-6ea1a5424096 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:25.531949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df29e6f6-d797-4ee3-ae31-6ea1a5424096 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:25.781580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df29e6f6-d797-4ee3-ae31-6ea1a5424096 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:25.797248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df29e6f6-d797-4ee3-ae31-6ea1a5424096 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1264 microversion: 2.1 time: 0.272674 Oct 26 05:03:25.810449 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 389/764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:25 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:25.940938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:25.954799 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f2c7523-6697-4697-b760-7f940cd2fcde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.607660 Oct 26 05:03:25.957178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 376/765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:25 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:26.369861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:26.370481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:26.380900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.382610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.383395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:26.385918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.386756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.387201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:26.512626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:26.547165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-56ce75bc-b560-4b97-b996-0ca64f887be3 req-d6f4a3f6-aa66-49e8-b254-c046d2bf6aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8631070-27e5-49d8-9465-e295b5f8ccb8", "tag": "fe726bee-c752-416b-a2c0-0b2b35895ff4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:26.550969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ac5babd-5871-44bd-bdc4-ef0038a13a02 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.184764 Oct 26 05:03:26.551574 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 390/766] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:26 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:26.595094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-56ce75bc-b560-4b97-b996-0ca64f887be3 req-d6f4a3f6-aa66-49e8-b254-c046d2bf6aee service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.595493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-56ce75bc-b560-4b97-b996-0ca64f887be3 req-d6f4a3f6-aa66-49e8-b254-c046d2bf6aee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.596861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-56ce75bc-b560-4b97-b996-0ca64f887be3 req-d6f4a3f6-aa66-49e8-b254-c046d2bf6aee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:26.615932 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-56ce75bc-b560-4b97-b996-0ca64f887be3 req-d6f4a3f6-aa66-49e8-b254-c046d2bf6aee service nova] Creating event network-changed:fe726bee-c752-416b-a2c0-0b2b35895ff4 for instance a8631070-27e5-49d8-9465-e295b5f8ccb8 on n-h2-862416-4 Oct 26 05:03:26.639552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-56ce75bc-b560-4b97-b996-0ca64f887be3 req-d6f4a3f6-aa66-49e8-b254-c046d2bf6aee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095500 Oct 26 05:03:26.640321 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 377/767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:26.821132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:26.821786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:26.837599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.838108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.838560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:26.839279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.839931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.840530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:26.968407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:26.979481 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad0dcdce-a190-473d-bf7c-653a772da8fb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1260 microversion: 2.1 time: 0.162083 Oct 26 05:03:26.980296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:26.980937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 391/768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:26 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:26.981546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:26.988704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.989186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.994340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:26.996085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:26.997124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:26.997743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:27.231905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:27.255887 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df33c326-d9ed-4e43-bbbc-bda38f3db591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.280017 Oct 26 05:03:27.261513 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 378/769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:26 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:27.437685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d960c7b3-c75a-4c21-b1df-39a4d27393b2 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] Action: 'create', calling method: .version_select at 0x7f470abbb550>, body: {"security_group": {"name": "tempest-securitygroup-1559464819", "description": "tempest-description-196513854"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:27.589884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:27.590864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:27.610579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:27.611149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:27.612221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:27.613104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:27.613846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:27.615071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:27.757356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:27.807111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d5170f7-e866-415d-a499-3306a2c07ea8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.227345 Oct 26 05:03:27.809875 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 379/770] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:27 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:27.853511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d960c7b3-c75a-4c21-b1df-39a4d27393b2 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.610989 Oct 26 05:03:27.854325 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 392/771] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:03:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:27.867946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bcaae4c6-fe55-4f15-bfaf-be486770a03a tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] Action: 'create', calling method: .version_select at 0x7f470a9769d0>, body: {"security_group": {"name": "tempest-securitygroup-46546408", "description": "tempest-description-1927280767"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:28.006992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:28.010072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:28.020840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:28.022290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:28.022290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:28.022797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:28.023486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:28.024722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:28.065153 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bcaae4c6-fe55-4f15-bfaf-be486770a03a tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.200382 Oct 26 05:03:28.065925 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 380/772] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:03:27 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:28.117105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:28.131267 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8139e101-37b7-4cf3-8cdd-8cf5f5fd6974 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1322 microversion: 2.1 time: 0.125527 Oct 26 05:03:28.132229 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 393/773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:28 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1322 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:28.283681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:28.284615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:28.292552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:28.293855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:28.294341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:28.295071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:28.295687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:28.296134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:28.307379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fcf570f-3c3a-4072-a5f1-83dcb983a102 tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] Action: 'create', calling method: .version_select at 0x7f470aee84c0>, body: {"security_group": {"name": "tempest-securitygroup-680763322", "description": "tempest-description-1693079993"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:28.475433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:28.488902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a388ab7f-47c0-45ab-b969-678f1f9cda7c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.211955 Oct 26 05:03:28.490133 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 394/774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:28 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:28.646317 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fcf570f-3c3a-4072-a5f1-83dcb983a102 tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.571514 Oct 26 05:03:28.648098 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 381/775] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:03:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:28.660651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b609427d-8d93-4400-953a-8bf825298e6b tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] Action: 'create', calling method: .version_select at 0x7f470abb78b0>, body: {"security_group": {"name": "tempest-securitygroup-551264240", "description": "tempest-description-139870314"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:28.809887 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b609427d-8d93-4400-953a-8bf825298e6b tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.152589 Oct 26 05:03:28.811828 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 395/776] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:03:28 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:28.825558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-06e6cd19-4280-4882-829d-4ab6060dd1a0 tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] Calling method '.version_select at 0x7f470aa96040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:28.837148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:28.837931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:28.844251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:28.844896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:28.845590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:28.847719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:28.848380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:28.849017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:28.942369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:28.950133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:28.976898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:28.983056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-908599d9-c4eb-4820-bf7f-9fe23e7ff7e7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1929 microversion: 2.75 time: 0.150005 Oct 26 05:03:28.999772 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 396/777] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:28 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:29.155910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:29.156628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:29.165003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:29.176551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:29.177010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:29.177846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:29.178234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:29.178842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:29.342297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:29.351646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e469e23b-891c-47e8-88a0-693878d571ec tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1322 microversion: 2.1 time: 0.199587 Oct 26 05:03:29.373880 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 397/778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:29 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:29.380922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ce5b29f6-6566-43c7-8001-1aba6e7661f8 req-fd209108-3922-4ddd-946d-261191741e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7433cab3-8fe8-4104-8a57-52413f45846d", "name": "network-vif-deleted", "tag": "d5590cdb-d128-41c4-a340-5b750260bc85"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:29.401662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce5b29f6-6566-43c7-8001-1aba6e7661f8 req-fd209108-3922-4ddd-946d-261191741e2f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:29.402430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce5b29f6-6566-43c7-8001-1aba6e7661f8 req-fd209108-3922-4ddd-946d-261191741e2f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:29.402870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce5b29f6-6566-43c7-8001-1aba6e7661f8 req-fd209108-3922-4ddd-946d-261191741e2f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:29.424491 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce5b29f6-6566-43c7-8001-1aba6e7661f8 req-fd209108-3922-4ddd-946d-261191741e2f service nova] Creating event network-vif-deleted:d5590cdb-d128-41c4-a340-5b750260bc85 for instance 7433cab3-8fe8-4104-8a57-52413f45846d on n-h1-862416-4 Oct 26 05:03:29.438626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ce5b29f6-6566-43c7-8001-1aba6e7661f8 req-fd209108-3922-4ddd-946d-261191741e2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063477 Oct 26 05:03:29.440212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 398/779] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:29.514934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:29.515610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:29.524784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:29.529995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:29.530988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:29.531921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:29.532658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:29.533864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:29.797515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:29.809399 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56bd6da0-a1ec-47c1-b1af-3fb831b0e1ae tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.298475 Oct 26 05:03:29.810323 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 399/780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:29 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:29.821531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2128962975", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bc063782-2e7c-4930-8052-d7ca13d54283"}], "security_groups": [{"name": "tempest-securitygroup--950538456"}], "key_name": "tempest-keypair-1687105724", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:29.997149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] validate_networks() for [('bc063782-2e7c-4930-8052-d7ca13d54283', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:30.464950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=13 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:30.514977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=25 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:31.103895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:31.105118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:31.112977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:31.113776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:31.114440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:31.128630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.132110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.133058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.135893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.136876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.138887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.153238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=19 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:31.176015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:31.186705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for user b36c8ac2dee24d33b680608a740463bb and project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:31.206804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:31.210680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:31.304184 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31e7bba5-1a34-4a54-881e-03cbfa364f54 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.492709 Oct 26 05:03:31.304939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 400/781] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:03:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:03:31.320493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:31.321222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:31.329104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.329616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.333991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.335052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.335749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.336907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.468934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:31.528616 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b60624fd-5ff9-44db-bca8-3e5284bd0c62 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1935 microversion: 2.75 time: 0.212521 Oct 26 05:03:31.529222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 401/782] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:31 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1935 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:31.538652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:31.539277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:31.555878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.557094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.557790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.560290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.562026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.562483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.888115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:31.897759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f86a54ad-1981-4e70-b426-7bfe1788b05d tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.367362 Oct 26 05:03:31.898350 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 402/783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:31 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:31.919832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:31.920681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:31.928284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.928938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.929572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:31.930448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:31.930910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:31.931546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.169564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:32.187335 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a72c355-6882-409b-be96-a83ca3904ade tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.275673 Oct 26 05:03:32.191403 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 403/784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:31 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:32.196926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:32.197845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:32.204490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.205344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.206224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.207028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.207569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.208074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.294694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:32.310473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:32.311965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:32.313112 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5d4c481-5f08-49e0-a357-d6774b4f5e39 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1290 microversion: 2.25 time: 0.120331 Oct 26 05:03:32.314130 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 404/785] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:32 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:32.325666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-61211493-4525-49fd-bc20-2e2666679529 req-e4c644d3-64b4-4701-add0-e58d37122b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad81e86-6a28-45c7-a375-7bfb5be32303", "tag": "f55b1e9a-447f-4ad1-a8b6-680bd05742d7"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:32.337520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-61211493-4525-49fd-bc20-2e2666679529 req-e4c644d3-64b4-4701-add0-e58d37122b81 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.338266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-61211493-4525-49fd-bc20-2e2666679529 req-e4c644d3-64b4-4701-add0-e58d37122b81 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.338955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-61211493-4525-49fd-bc20-2e2666679529 req-e4c644d3-64b4-4701-add0-e58d37122b81 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.351376 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-61211493-4525-49fd-bc20-2e2666679529 req-e4c644d3-64b4-4701-add0-e58d37122b81 service nova] Creating event network-changed:f55b1e9a-447f-4ad1-a8b6-680bd05742d7 for instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 on n-h1-862416-4 Oct 26 05:03:32.357079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-61211493-4525-49fd-bc20-2e2666679529 req-e4c644d3-64b4-4701-add0-e58d37122b81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041589 Oct 26 05:03:32.358357 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 405/786] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:32.571961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:32.572822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:32.587710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.588258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.588704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.593620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.594267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.594623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.731976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:32.766189 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8b2db98-e44f-4a09-8149-049d660cf0d8 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1935 microversion: 2.75 time: 0.206629 Oct 26 05:03:32.785110 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 406/787] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:32 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1935 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:32.899947 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-06e6cd19-4280-4882-829d-4ab6060dd1a0 tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12914 microversion: 2.1 time: 4.078028 Oct 26 05:03:32.900552 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 382/788] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 26 05:03:28 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12914 bytes in 4079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:03:32.925279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:32.926101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:32.927526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf2fcc5c-c3c6-4884-80b3-07ce17e6b411 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] Calling method '.version_select at 0x7f470a937a60>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:32.940854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.941424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.941874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:32.943350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:32.944223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:32.945226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:33.187135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:33.197909 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-91b1dfdd-c82c-4990-af7d-78a9acb628d9 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.278322 Oct 26 05:03:33.214285 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 407/789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:32 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:33.221946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:33.222928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:33.231564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:33.232418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:33.233064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:33.234056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:33.234715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:33.235343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:33.266584 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf2fcc5c-c3c6-4884-80b3-07ce17e6b411 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.343445 Oct 26 05:03:33.267166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 383/790] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 26 05:03:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:33.280829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-628fa6bd-898f-48ae-845c-04f1f5db1d9c tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] Calling method '.version_select at 0x7f470acb25e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:33.497150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:33.516776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e3f722c0-a8fc-4de1-b791-2c36f6444503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.298894 Oct 26 05:03:33.520178 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 408/791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:33 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:33.531772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:33.532408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:33.571502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:33.577181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:33.577734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:33.583660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:33.586308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:33.589146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:33.918190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:33.937879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:33.942155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:33.944877 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77f49d43-a8e3-4d41-9178-8e0b3bf32dff tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1338 microversion: 2.25 time: 0.419817 Oct 26 05:03:33.950539 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 409/792] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:33 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1338 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:34.034704 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-628fa6bd-898f-48ae-845c-04f1f5db1d9c tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6cd75281-7ca0-4f9e-980c-595570f7835c" status: 202 len: 0 microversion: 2.1 time: 0.757419 Oct 26 05:03:34.039194 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 384/793] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:03:33 2022] DELETE /compute/v2.1/os-security-groups/6cd75281-7ca0-4f9e-980c-595570f7835c => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:03:34.057959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:34.058672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:34.067732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:34.071635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.072486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.072932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.073734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.074802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.075976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.181745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:34.193909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "95562cf4-b17c-4bbd-a54d-0d47538dfc50"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:34.196337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:34.202460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.202947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.203391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.204088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.204456 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fab9c2c9-97aa-4b9e-ac4b-909a60555099 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1935 microversion: 2.75 time: 0.163754 Oct 26 05:03:34.204569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.205058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.206560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 385/794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:34 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1935 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:34.211206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c4051e68-fc5c-40b0-8f15-0d2bdb7b4075 req-9789a9f2-8ada-4560-adbb-dff9413e7237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8631070-27e5-49d8-9465-e295b5f8ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "fe726bee-c752-416b-a2c0-0b2b35895ff4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:34.233678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4051e68-fc5c-40b0-8f15-0d2bdb7b4075 req-9789a9f2-8ada-4560-adbb-dff9413e7237 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.234291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4051e68-fc5c-40b0-8f15-0d2bdb7b4075 req-9789a9f2-8ada-4560-adbb-dff9413e7237 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.234830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4051e68-fc5c-40b0-8f15-0d2bdb7b4075 req-9789a9f2-8ada-4560-adbb-dff9413e7237 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.258639 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c4051e68-fc5c-40b0-8f15-0d2bdb7b4075 req-9789a9f2-8ada-4560-adbb-dff9413e7237 service nova] Creating event network-vif-plugged:fe726bee-c752-416b-a2c0-0b2b35895ff4 for instance a8631070-27e5-49d8-9465-e295b5f8ccb8 on n-h2-862416-4 Oct 26 05:03:34.264681 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c4051e68-fc5c-40b0-8f15-0d2bdb7b4075 req-9789a9f2-8ada-4560-adbb-dff9413e7237 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056812 Oct 26 05:03:34.265248 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 386/795] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:34.272892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbdc0205-2ea8-4def-95d8-9b959711d6fd tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] Calling method '.version_select at 0x7f470ad16ca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:34.498924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbdc0205-2ea8-4def-95d8-9b959711d6fd tempest-SecurityGroupsTestAdminJSON-1796209959 tempest-SecurityGroupsTestAdminJSON-1796209959-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0d3fa292-42de-4b7e-82b0-e5307da63d9f" status: 202 len: 0 microversion: 2.1 time: 0.231449 Oct 26 05:03:34.499918 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 387/796] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:03:34 2022] DELETE /compute/v2.1/os-security-groups/0d3fa292-42de-4b7e-82b0-e5307da63d9f => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:03:34.510080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:34.511088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:34.530432 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] HTTP exception thrown: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. Oct 26 05:03:34.534022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.535253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.536433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.538004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.538544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.538906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Request method failure captured: Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments/a4d1f241-fd16-45b2-8e57-0b6c04fb4721 HTTP/1.1 Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 74 Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9Rm_os8HCrUwJ5ryf4O-EbiXUr_KvUVPbwkJOGl62IMCTNsr0dUtiu4R_iK586HJZnYb6vMFpc-HGYqBjn4QzB-s37YjAEX2j2UumNl4Mzd5BgfjMuEYvgb6Ex9KAEy-WzRIZ7MUMWuuu6GSmE_I9MndpeLxiiGTi-Z-cuCBopeC8 Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 11f6449b36094aeca41c0be9edc8f60d Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesAdminNegativeTest-1763658268 Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:03:34.539690 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesAdminNegativeTest-1763658268 Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 11f6449b36094aeca41c0be9edc8f60d Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1763658268 Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesAdminNegativeTest-1763658268-project-admin Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b004617dfdea456a8ef57aedea54048a Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesAdminNegativeTest-1763658268-project-admin Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: {"volumeAttachment": {"volumeId": "95562cf4-b17c-4bbd-a54d-0d47538dfc50"}} Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:34.541015 n-d-862416-4 devstack@n-api.service[120586]: exception: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '0d592cac-0cd1-4090-9d22-a64f8689a08c', 'id': 'a4d1f241-fd16-45b2-8e57-0b6c04fb4721', 'body': {'volumeAttachment': {'volumeId': '95562cf4-b17c-4bbd-a54d-0d47538dfc50'}}} Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:03:34.541908 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. (HTTP 404) (Request-ID: req-9e3c2513-8973-404a-8df7-4a4168c16de4) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:03:34.542968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:34.544137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. Oct 26 05:03:34.545277 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:34.547866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Returning 400 to user: Volume 95562cf4-b17c-4bbd-a54d-0d47538dfc50 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:34.547866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d8c3811-2fac-47a9-97a5-aa63683d5bd0 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments/a4d1f241-fd16-45b2-8e57-0b6c04fb4721" status: 400 len: 107 microversion: 2.1 time: 0.589638 Oct 26 05:03:34.547866 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 410/797] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Oct 26 05:03:33 2022] PUT /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments/a4d1f241-fd16-45b2-8e57-0b6c04fb4721 => generated 107 bytes in 591 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:03:34.547866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31f84d3b-8640-4afe-b41f-c2cc14a9a644 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] Calling method '.version_select at 0x7f470b345790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:34.889087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:34.904811 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31f84d3b-8640-4afe-b41f-c2cc14a9a644 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2712934e-dd1e-4841-be37-112a51a89e2f" status: 202 len: 0 microversion: 2.1 time: 0.361256 Oct 26 05:03:34.905764 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 411/798] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:03:34 2022] DELETE /compute/v2.1/os-security-groups/2712934e-dd1e-4841-be37-112a51a89e2f => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:03:34.912029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:34.912906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:34.925337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.926050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.927135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.928826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.929065 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4d41bc4-8da2-4ca8-82d7-ef43ce09e54e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.416516 Oct 26 05:03:34.929762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.929937 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 388/799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:34 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:34.930640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.943381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:34.943890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:34.960560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.961070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.961557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:34.964823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:34.965335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:34.968206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.156591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:35.189985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffa11155-a23c-4311-80f8-d0a0a419996a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.283132 Oct 26 05:03:35.190576 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 412/800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:34 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:35.195759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dbe20da7-2e8b-4565-8cb0-eb0e715bc473 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] Calling method '.version_select at 0x7f470abbbdc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:35.243310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lazy-loading 'services' on Instance uuid 0d592cac-0cd1-4090-9d22-a64f8689a08c {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:35.424933 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-96c088bd-275d-45e4-83a7-a892d8e76bd9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments/a4d1f241-fd16-45b2-8e57-0b6c04fb4721" status: 202 len: 0 microversion: 2.1 time: 0.489141 Oct 26 05:03:35.426128 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 389/801] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:03:34 2022] DELETE /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments/a4d1f241-fd16-45b2-8e57-0b6c04fb4721 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:03:35.437273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:35.442003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:35.454209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.455810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.455967 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dbe20da7-2e8b-4565-8cb0-eb0e715bc473 tempest-SecurityGroupsTestAdminJSON-762447281 tempest-SecurityGroupsTestAdminJSON-762447281-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9d62afc7-5613-4fd3-9b59-47e9aea288a5" status: 202 len: 0 microversion: 2.1 time: 0.263843 Oct 26 05:03:35.456491 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 413/802] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:03:35 2022] DELETE /compute/v2.1/os-security-groups/9d62afc7-5613-4fd3-9b59-47e9aea288a5 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:03:35.461809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.463388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.464265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.464936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.474398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:35.478987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:35.493900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.494422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.494880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.496067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.498107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.499119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.621754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:35.640606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:35.646248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:35.647495 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-74bf9514-87f9-4bfa-a120-2a07593dea5f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1344 microversion: 2.25 time: 0.216397 Oct 26 05:03:35.648086 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 390/803] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:35 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:35.693297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:35.696361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:35.708208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.708725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.709370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.711452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.711948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.712454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.760864 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-461261fa-005d-4078-80f3-c3d99ae537ad tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079607 Oct 26 05:03:35.765822 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 391/804] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:35 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:35.927289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] Lazy-loading 'services' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:35.947141 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f4a1a87a-b0de-416a-af24-d3f37810b0b7 tempest-ServersAdmin275Test-712326317 tempest-ServersAdmin275Test-712326317-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1920 microversion: 2.75 time: 0.489343 Oct 26 05:03:35.948313 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 414/805] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:35 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1920 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:35.961560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:35.961560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:35.978721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.988604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:35.989125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:35.990432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.992410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.995708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.996176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.996606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.997223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.997854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.998302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:35.998924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:35.999542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:35.999674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.031221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:03:36.067536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:36.141334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9b65073-ec80-4d18-8813-06e3c5dd8d09 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 204 len: 0 microversion: 2.75 time: 0.158350 Oct 26 05:03:36.147715 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 415/806] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:03:35 2022] DELETE /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:03:36.154091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:36.158471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:36.167768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.169142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.170132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.171173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.172058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.172683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.341859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:36.353751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:36.360969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:36.364778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed6b46e8-070b-4be4-82aa-1d0289e4d177 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.416263 Oct 26 05:03:36.365387 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 392/807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:35 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:36.365789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:36.373024 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c0eec58-6dc2-4fa1-90dc-b5312ad6cad5 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1444 microversion: 2.75 time: 0.223730 Oct 26 05:03:36.374414 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 416/808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:36 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:36.398396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:36.399924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:36.409238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.410032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.410638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.411517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.412341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.413186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.597008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:36.605291 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bcc6c013-6d54-4281-b480-28dae7037591 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1313 microversion: 2.1 time: 0.234987 Oct 26 05:03:36.621100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 393/809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:36 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:36.678734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:36.679843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:36.702564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.703253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.704758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.705741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.709492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.709957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.774706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:36.776951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:36.788401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.797534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.797697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.799185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:36.799655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:36.800066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:36.879217 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43013485-fbdd-4134-b6bf-6f624bc33d10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108678 Oct 26 05:03:36.879821 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 394/810] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:36 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:36.990815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.001139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.004796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.006678 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9e391b2-888a-4750-868e-c20d0dace099 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.333420 Oct 26 05:03:37.007593 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 417/811] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:36 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:37.393272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:37.394997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:37.410297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:37.411571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:37.417945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.420827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.421596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.423257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.424541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.425557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.426350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.426894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.428965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.430910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.431647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.445179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.651848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.661183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.663307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.669179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1b11827-f541-4df6-82f5-4c11a17bddd3 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1444 microversion: 2.75 time: 0.263662 Oct 26 05:03:37.670773 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 418/812] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:37 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1444 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:37.677137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:37.678096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:37.691300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.698178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.699690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.701786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.703755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.704307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.717234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.727188 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ffba509-39b6-48ee-b9a4-be530b661a92 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.338996 Oct 26 05:03:37.728107 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 395/813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:37 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:37.896440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:37.899088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:37.917813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.920428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.921135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.924482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.925248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.928980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.937306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:37.941106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:37.949341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c0bc6410-40a7-428b-ae98-2c78a1a1ea23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1461 microversion: 2.1 time: 0.277152 Oct 26 05:03:37.961918 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 419/814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:37 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1461 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:37.975054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:37.977753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:37.984702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.985509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.986181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.987373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:37.988032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:37.988677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:37.999251 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c09f1402-db28-4b43-83ad-a16fd1a57d9e tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108411 Oct 26 05:03:38.006689 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 396/815] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:37 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:38.031060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:38.031767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:38.041190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.043196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.043736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.044662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.048419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.049900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.165942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:38.175427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Old instance type m1.heat2, new instance type m1.heat {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:03:38.187401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:38.187971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:38.188734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:38.189492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:38.190423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:38.368283 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd6674dc-6724-4b95-8b47-86a9c6ee2f8f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8/action" status: 202 len: 0 microversion: 2.1 time: 0.397914 Oct 26 05:03:38.372012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 420/816] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:03:37 2022] POST /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:03:38.388482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:38.390855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:38.409151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.422710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.422710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.422710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.422710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.425670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.735374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:38.750740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:38.758836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:38.761957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-606d6369-241f-4c95-aba7-c89a98b30269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.733662 Oct 26 05:03:38.764001 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 397/817] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:38 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:38.776783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:38.779947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:38.791992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.794383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.794848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.795585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.801023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.810329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.896449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:38.896937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:38.908426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:38.909123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lazy-loading 'fault' on Instance uuid aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:03:39.104556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:39.117418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80be60ea-7a23-46eb-b05d-53ddd724431c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1470 microversion: 2.1 time: 0.741645 Oct 26 05:03:39.126332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:39.154718 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 421/818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:38 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1470 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:39.161294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:39.166528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:39.167626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:39.172811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acd47aa3aeb74072b6a7e91206732719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afdd3fab56f4868850ef5e796d1039b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:39.180876 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ab19541-c304-4a4e-926a-e5da55be7bc0 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 200 len: 1449 microversion: 2.75 time: 0.415622 Oct 26 05:03:39.197410 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 398/819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:38 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 1449 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:39.197631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.197631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.197631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:39.197631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.198133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.198452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:39.212266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:39.216954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:39.227472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.228471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.229165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:39.230092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.230708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.234323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:39.328619 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a18aeaab-0be1-48ce-9671-37bdb390fb4d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131019 Oct 26 05:03:39.330926 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 399/820] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:39 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:39.397828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b2fff8b9-1243-4ddc-bf59-0bef9445f686 req-f9c5e293-6194-4877-a8a4-d884a226b5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07d8713-2b19-48a3-987e-27843e15111f", "tag": "895a25f8-b756-40d5-83d8-7c6eeaa273b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:39.423728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2fff8b9-1243-4ddc-bf59-0bef9445f686 req-f9c5e293-6194-4877-a8a4-d884a226b5cb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.425291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2fff8b9-1243-4ddc-bf59-0bef9445f686 req-f9c5e293-6194-4877-a8a4-d884a226b5cb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.426483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2fff8b9-1243-4ddc-bf59-0bef9445f686 req-f9c5e293-6194-4877-a8a4-d884a226b5cb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:39.480022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b2fff8b9-1243-4ddc-bf59-0bef9445f686 req-f9c5e293-6194-4877-a8a4-d884a226b5cb service nova] Creating event network-changed:895a25f8-b756-40d5-83d8-7c6eeaa273b0 for instance e07d8713-2b19-48a3-987e-27843e15111f on n-h1-862416-4 Oct 26 05:03:39.517843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b2fff8b9-1243-4ddc-bf59-0bef9445f686 req-f9c5e293-6194-4877-a8a4-d884a226b5cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108636 Oct 26 05:03:39.520855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 400/821] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:39.644301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:39.659959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-209e2b69-3e2c-4899-865e-f62e86954b55 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.503995 Oct 26 05:03:39.661873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 422/822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:39 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:39.794312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:39.795198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:39.806655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.808447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.809007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:39.811987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:39.813887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:39.814947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.156795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:40.197517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:40.200979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:40.204051 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0244f9d-6ce0-4b8e-92a1-8171b66ded84 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.414098 Oct 26 05:03:40.206869 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 401/823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:39 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:40.233204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.233872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:40.247771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.248277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.250978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.252273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.253439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.254086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.257249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Action: 'update', calling method: .version_select at 0x7f470ac96040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:40.261700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.262206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.262654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.307210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.307722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.308241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.353997 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] HTTP exception thrown: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Request method failure captured: Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca HTTP/1.1 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 56 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-rbs2OznGQis5KJygrHzxgmXcWUby-u2KlK5N_rpgabmUvMUh7x0651efPSCa0xKY8BuZRSwlraxxHVkkOByFTxX6XFdnRKKB4yIk87VOLrEVhdKQZhPHSni_zr_GOC_beWemx_O1pKZSwX_Z_-vmYZnVmcKjVCP_inS3FZwNyK0w Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 844f8d5dc8ae4e47b8821d8f89541669 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:03:40.358487 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 844f8d5dc8ae4e47b8821d8f89541669 Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2c4603927507473aa021f3c739350b8b Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:03:40.360229 n-d-862416-4 devstack@n-api.service[120586]: exception: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '5799d783-4e15-4a95-b9c4-a8677e80fbca', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.361827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.363468 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:40.364969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:40.364969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.364969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.370475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Returning 404 to user: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:40.371568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d0b5efb-e04f-4069-b278-da43b978fec0 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca" status: 404 len: 110 microversion: 2.53 time: 0.465384 Oct 26 05:03:40.374209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 423/824] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 26 05:03:39 2022] PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca => generated 110 bytes in 469 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:03:40.384944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.386027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] [instance: aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:40.397008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.399244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.399956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.400916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.403721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.404409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.421781 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] HTTP exception thrown: Instance aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 could not be found. Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Request method failure captured: Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 HTTP/1.1 Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9JfRoxlLKRM37iOTCXWdz9brP_EkAwaGTBq8KdAZJ8xScfO066EkF4YMxwGJa6vmuaMrMvzLB98jV3Zgf6Rc2n2vkrK9ODhQxilb8BqWSscOSAJHyq5XN1PEaMKWLKCgfOdR7iAmDyf50WuihoTSZz_Oi-OrFjMv5al-yihUMqgJo Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.75 Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 0afdd3fab56f4868850ef5e796d1039b Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdmin275Test-1402618741 Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:40.425684 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0afdd3fab56f4868850ef5e796d1039b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0afdd3fab56f4868850ef5e796d1039b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0afdd3fab56f4868850ef5e796d1039b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0afdd3fab56f4868850ef5e796d1039b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdmin275Test-1402618741 Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 0afdd3fab56f4868850ef5e796d1039b Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdmin275Test-1402618741 Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdmin275Test-1402618741-project Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: acd47aa3aeb74072b6a7e91206732719 Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdmin275Test-1402618741-project Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 could not be found. Oct 26 05:03:40.427093 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4'} Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 could not be found. Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:40.428022 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 could not be found. Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 could not be found. Oct 26 05:03:40.429274 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.432483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] Returning 404 to user: Instance aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:40.433735 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc38fc6b-b532-4609-87f4-c0c0567bed72 tempest-ServersAdmin275Test-1402618741 tempest-ServersAdmin275Test-1402618741-project] 10.222.0.16 "GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4" status: 404 len: 111 microversion: 2.75 time: 0.057621 Oct 26 05:03:40.435566 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 424/825] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/servers/aec31ca7-aa42-4ef1-afc1-23ea10eb6ad4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:03:40.448616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.463126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:40.478900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.479475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.480152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.480875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.481382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.481896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.536292 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ceef5e3-0179-4e11-acc1-00b313987a93 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099374 Oct 26 05:03:40.537502 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 425/826] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:40.543151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Action: 'update', calling method: .version_select at 0x7f470aae98b0>, body: {"status": "disabled"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:40.547901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.549490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.550414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.559204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.560086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.560831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.568429 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] HTTP exception thrown: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Request method failure captured: Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca HTTP/1.1 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 22 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-rbs2OznGQis5KJygrHzxgmXcWUby-u2KlK5N_rpgabmUvMUh7x0651efPSCa0xKY8BuZRSwlraxxHVkkOByFTxX6XFdnRKKB4yIk87VOLrEVhdKQZhPHSni_zr_GOC_beWemx_O1pKZSwX_Z_-vmYZnVmcKjVCP_inS3FZwNyK0w Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 844f8d5dc8ae4e47b8821d8f89541669 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:03:40.573235 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 844f8d5dc8ae4e47b8821d8f89541669 Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2c4603927507473aa021f3c739350b8b Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: {"status": "disabled"} Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: exception: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.575461 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '5799d783-4e15-4a95-b9c4-a8677e80fbca', 'body': {'status': 'disabled'}} Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.576593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:40.583884 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:40.587865 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.587865 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.588150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:40.588334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Returning 404 to user: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:40.588334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a34c59e5-5833-4eda-b482-a57d0fc3238e tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca" status: 404 len: 110 microversion: 2.53 time: 0.037698 Oct 26 05:03:40.588334 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 426/827] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 26 05:03:40 2022] PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:03:40.589552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9abc8664-96d1-4ecf-846d-50597e5feb58 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1470 microversion: 2.1 time: 0.380346 Oct 26 05:03:40.591636 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 402/828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:40.591816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Action: 'update', calling method: .version_select at 0x7f470aac8ee0>, body: {"status": "enabled"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:40.597824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.598373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.598868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.606087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.607717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.608183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.618803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-327e6665-2760-40ab-96e2-e8f4ece5a8e1 req-c4e2881b-5f28-42b1-b87e-18a0e975da3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad81e86-6a28-45c7-a375-7bfb5be32303", "name": "network-vif-plugged", "status": "completed", "tag": "f55b1e9a-447f-4ad1-a8b6-680bd05742d7"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:40.630632 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] HTTP exception thrown: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.633090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-327e6665-2760-40ab-96e2-e8f4ece5a8e1 req-c4e2881b-5f28-42b1-b87e-18a0e975da3e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Request method failure captured: Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca HTTP/1.1 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 21 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-rbs2OznGQis5KJygrHzxgmXcWUby-u2KlK5N_rpgabmUvMUh7x0651efPSCa0xKY8BuZRSwlraxxHVkkOByFTxX6XFdnRKKB4yIk87VOLrEVhdKQZhPHSni_zr_GOC_beWemx_O1pKZSwX_Z_-vmYZnVmcKjVCP_inS3FZwNyK0w Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 844f8d5dc8ae4e47b8821d8f89541669 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:03:40.635268 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/844f8d5dc8ae4e47b8821d8f89541669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 844f8d5dc8ae4e47b8821d8f89541669 Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955 Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2c4603927507473aa021f3c739350b8b Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: {"status": "enabled"} Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: exception: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.636775 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '5799d783-4e15-4a95-b9c4-a8677e80fbca', 'body': {'status': 'enabled'}} Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.638242 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:40.639530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:40.640733 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. Oct 26 05:03:40.640733 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:40.640733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Returning 404 to user: Service 5799d783-4e15-4a95-b9c4-a8677e80fbca could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:40.640733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-87208c29-9b82-4b63-90e2-9a25278b7ac8 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca" status: 404 len: 110 microversion: 2.53 time: 0.054489 Oct 26 05:03:40.641102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-327e6665-2760-40ab-96e2-e8f4ece5a8e1 req-c4e2881b-5f28-42b1-b87e-18a0e975da3e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.641706 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 427/829] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 26 05:03:40 2022] PUT /compute/v2.1/os-services/5799d783-4e15-4a95-b9c4-a8677e80fbca => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:03:40.646622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-327e6665-2760-40ab-96e2-e8f4ece5a8e1 req-c4e2881b-5f28-42b1-b87e-18a0e975da3e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.652877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.664983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.666212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.668043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.669470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.669813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.671900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.681840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-327e6665-2760-40ab-96e2-e8f4ece5a8e1 req-c4e2881b-5f28-42b1-b87e-18a0e975da3e service nova] Creating event network-vif-plugged:f55b1e9a-447f-4ad1-a8b6-680bd05742d7 for instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 on n-h1-862416-4 Oct 26 05:03:40.710085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-327e6665-2760-40ab-96e2-e8f4ece5a8e1 req-c4e2881b-5f28-42b1-b87e-18a0e975da3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094927 Oct 26 05:03:40.712968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 403/830] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:40.736652 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5390739-d4ce-430b-b9b1-62ed7e21838b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.084929 Oct 26 05:03:40.738404 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 428/831] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:03:40.752705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.755167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:40.769009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.770510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.771129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.772050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.773136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.777472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.777959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.790182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.790648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.796203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.797241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.797917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.798499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.856255 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab4e709c-53b8-4cdd-8d70-d5acdf98553b tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.098499 Oct 26 05:03:40.861821 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 429/832] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:40.878616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:40.892182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.893716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.894250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.899661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:40.900224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:40.900775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:40.965026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:40.982017 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c97d0b49-a4d1-45a2-9ac1-57d68cdcd9df tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.105849 Oct 26 05:03:40.982769 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 430/833] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:41.014524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.018937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.021411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.021916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.022691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.023161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.023591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.092341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d442263-a0fb-486b-a4e5-8dc1fe38eccb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862416-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.098949 Oct 26 05:03:41.100033 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 431/834] 10.222.0.16 () {60 vars in 1235 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/os-services?host=n-d-862416-4&binary=xxx => generated 16 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:41.105145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.123658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.124186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.124853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.125768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.126245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.127423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.180335 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-792b33e4-a100-4ea7-9842-0c6c566f99d6 tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.078733 Oct 26 05:03:41.192819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:41.193365 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 432/835] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 26 05:03:41 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:41.198067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.201665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.202494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.202945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.203692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.204158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.204587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.207931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19b5fa7a-1e04-4e9d-800d-4059ab78566e tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.483733 Oct 26 05:03:41.208556 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 404/836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:40 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:41.209709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=66 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:41.241216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.241896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:41.259651 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4bb23668-a8c3-4ce3-a475-933a58279acb tempest-ServicesAdminNegativeV253TestJSON-1244139955 tempest-ServicesAdminNegativeV253TestJSON-1244139955-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.065602 Oct 26 05:03:41.260795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.261539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.262144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.262292 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 433/837] 10.222.0.16 () {60 vars in 1239 bytes} [Wed Oct 26 05:03:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:41.263643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.265881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.266625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.657411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b15cc6ca-4175-43d7-b05e-8c3d16f8ad6a tempest-ServicesAdminNegativeV253TestJSON-1684415273 tempest-ServicesAdminNegativeV253TestJSON-1684415273-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.662925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b15cc6ca-4175-43d7-b05e-8c3d16f8ad6a tempest-ServicesAdminNegativeV253TestJSON-1684415273 tempest-ServicesAdminNegativeV253TestJSON-1684415273-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4fabd879102c4ae28114746e5d0ace59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd8313d65337478d9a701ac37d46e69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b15cc6ca-4175-43d7-b05e-8c3d16f8ad6a tempest-ServicesAdminNegativeV253TestJSON-1684415273 tempest-ServicesAdminNegativeV253TestJSON-1684415273-project] Request method failure captured: Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-qUW3FjhOdFwQDwsGDkq_4InuGKWGz_mNGgyx-Tx3SCOX6Xu4VowGP-1RZhqVKY23sNAPKD5Bo0k2cNl1SzdshMHtttTfb0R4uCPv-UFu1lfsrPUiEZb27NILlv4WhHJo5vAWd70lYUTqXPLOHHJDzoeWB8DSqZBsEAB7r61kRJr4 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.53 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: fd8313d65337478d9a701ac37d46e69b Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1684415273 Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:03:41.665041 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd8313d65337478d9a701ac37d46e69b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd8313d65337478d9a701ac37d46e69b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd8313d65337478d9a701ac37d46e69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd8313d65337478d9a701ac37d46e69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1684415273 Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: fd8313d65337478d9a701ac37d46e69b Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1684415273 Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1684415273-project Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4fabd879102c4ae28114746e5d0ace59 Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1684415273-project Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 05:03:41.666760 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:03:41.667690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 05:03:41.669122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:03:41.671750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b15cc6ca-4175-43d7-b05e-8c3d16f8ad6a tempest-ServicesAdminNegativeV253TestJSON-1684415273 tempest-ServicesAdminNegativeV253TestJSON-1684415273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:41.673513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b15cc6ca-4175-43d7-b05e-8c3d16f8ad6a tempest-ServicesAdminNegativeV253TestJSON-1684415273 tempest-ServicesAdminNegativeV253TestJSON-1684415273-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.398297 Oct 26 05:03:41.685060 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 434/838] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 26 05:03:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 409 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:03:41.705351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.714338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:41.734421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.736969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.737714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.738815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.741909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.743413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.744272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:41.761125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:41.768371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:41.769620 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3e6e48e8-db10-4f99-a13d-a11d57cdbd9b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.538167 Oct 26 05:03:41.775755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 405/839] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:41 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:41.796164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:41.796799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:41.809856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.815599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.818576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.820165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:41.820662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:41.821104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:41.843522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d49820a-6a18-4525-b66a-8cfa9fb7fad6 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153711 Oct 26 05:03:41.853733 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 435/840] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:41 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:42.237867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:42.241919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:42.245099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:42.261101 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a619b429-acbb-4a5b-932b-119342c455cd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1470 microversion: 2.1 time: 0.479036 Oct 26 05:03:42.278964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 406/841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:41 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:42.280410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:42.285927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:42.294018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:42.295079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:42.295757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:42.296411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:42.865914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-540779210", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "6bd1105c-8c6d-456c-9c51-070859af68ac"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:42.890312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:42.901099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8f91305-5154-4bed-865e-42557eb17580 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1390 microversion: 2.1 time: 0.668625 Oct 26 05:03:42.908228 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 436/842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:42 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1390 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:42.923811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:42.924703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:42.942654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:42.943161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:42.943607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:42.949807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:42.956786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:42.957844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:42.967839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] validate_networks() for [('6bd1105c-8c6d-456c-9c51-070859af68ac', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:43.406085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:43.410043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:43.419527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:43.425630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:43.426876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d4dca305-8e76-4195-8827-0fe5529e67c0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.515728 Oct 26 05:03:43.427659 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 437/843] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:42 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:43.460414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:43.463563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:43.472546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:43.485921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:43.486567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:43.487476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:43.488104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:43.488707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:43.523463 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5761324-0e78-4238-9013-5bb696bcbd02 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094490 Oct 26 05:03:43.524582 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 438/844] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:43 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:43.538593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:43.539565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:43.552145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:43.559543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:43.560162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:43.564007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:43.564711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:43.565512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:43.942966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:43.943986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:43.944899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:43.945566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:43.946163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:43.961349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:43.977189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:43.978955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:43.983157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:43.983828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:43.985870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.052641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for project 05ec452e1add45cdb311971b90e34200. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:44.064774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for user c496b6a683e147f8b41e82b2921454d6 and project 05ec452e1add45cdb311971b90e34200. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:44.066022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:44.075494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5438ad2-8174-4f90-b0b3-1031445d6825 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1470 microversion: 2.1 time: 0.549464 Oct 26 05:03:44.076074 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 439/845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:43 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1470 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:44.083039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:44.083863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:44.086522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:44.088855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:44.092652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.093391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.093992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.095099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.095891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.096469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.189419 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-856baee9-752f-4273-96e9-681dc81f9368 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479663 Oct 26 05:03:44.190685 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 407/846] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:03:44.224553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e986ca72-fe2e-415c-acde-f386a0a7d863 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:44.228016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e986ca72-fe2e-415c-acde-f386a0a7d863 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:44.354185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e986ca72-fe2e-415c-acde-f386a0a7d863 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:44.364617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e986ca72-fe2e-415c-acde-f386a0a7d863 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1224 microversion: 2.1 time: 0.163938 Oct 26 05:03:44.365202 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 408/847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:44 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1224 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:44.427897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:44.443544 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc8c6ce0-d4fb-4196-99f3-efaa6e0ac321 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1587 microversion: 2.1 time: 0.363774 Oct 26 05:03:44.443993 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 440/848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:44 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1587 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:44.466293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:44.466922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:44.471720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:44.472233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:44.476989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.477530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.477975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.478692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.479149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.479664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.482559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.483074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.483480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.487371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.487865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.491618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.802300 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc157530-2ce8-47fc-ba3d-9f46511504e2 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335594 Oct 26 05:03:44.804648 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 441/849] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:03:44 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:44.816474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:44.819312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:44.862414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.867127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.868654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:44.874148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:44.878406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:44.881281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:45.055841 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6250bc41-cb57-4224-a56d-4ac4aa49fc85 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249497 Oct 26 05:03:45.063849 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 442/850] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:44 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:45.108254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:45.109872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:45.123405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:45.124092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:45.126022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:45.128998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:45.129995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:45.130859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:45.165016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:45.199233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:45.202591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:45.204058 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-99cadedf-dfff-405c-936c-2dd866646aed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.745572 Oct 26 05:03:45.209404 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 409/851] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:44 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:45.397418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:45.398617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:45.421651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:45.424876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:45.430571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:45.449765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:45.451514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:45.453194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:45.648520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:45.677441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:45.683037 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bfd843d-8b11-4d80-8fdd-57ae3a0d52c4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1228 microversion: 2.1 time: 0.291318 Oct 26 05:03:45.686938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26bd92f7-8913-4bb9-8133-3a07bd9fa58b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.589550 Oct 26 05:03:45.687383 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 410/852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:45 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1228 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:45.692584 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 443/853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:45 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:46.070549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:46.074306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:46.083905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.084923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.085615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:46.091519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.093520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.094167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:46.147977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e89be085-3ce5-4357-8474-06bf699d219f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081594 Oct 26 05:03:46.149242 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 411/854] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:46 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:46.240208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:46.240834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:46.286256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.286750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.297611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:46.299118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.299608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.300149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:46.604438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0eb27c99-7df7-4310-b118-1806f480e432 req-4d5159ee-083a-4d46-a0fd-e6a7214de208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d8713-2b19-48a3-987e-27843e15111f", "name": "network-vif-plugged", "status": "completed", "tag": "895a25f8-b756-40d5-83d8-7c6eeaa273b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:46.621807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0eb27c99-7df7-4310-b118-1806f480e432 req-4d5159ee-083a-4d46-a0fd-e6a7214de208 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.622637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0eb27c99-7df7-4310-b118-1806f480e432 req-4d5159ee-083a-4d46-a0fd-e6a7214de208 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.623231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0eb27c99-7df7-4310-b118-1806f480e432 req-4d5159ee-083a-4d46-a0fd-e6a7214de208 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:46.653990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0eb27c99-7df7-4310-b118-1806f480e432 req-4d5159ee-083a-4d46-a0fd-e6a7214de208 service nova] Creating event network-vif-plugged:895a25f8-b756-40d5-83d8-7c6eeaa273b0 for instance e07d8713-2b19-48a3-987e-27843e15111f on n-h1-862416-4 Oct 26 05:03:46.680199 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0eb27c99-7df7-4310-b118-1806f480e432 req-4d5159ee-083a-4d46-a0fd-e6a7214de208 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079687 Oct 26 05:03:46.683567 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 412/855] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:46.710893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:46.711933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:46.732562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.737084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.737568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:46.738319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:46.742214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:46.743917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.123729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:47.134095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:47.135579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:47.141698 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1e9aa4d-9304-43e2-bea1-8fd2a7b3c46a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1411 microversion: 2.25 time: 0.905596 Oct 26 05:03:47.142784 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 444/856] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:46 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1411 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:47.152756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:47.154171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:47.158227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:47.167158 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f02aff64-56bb-45a0-bcb0-e4a6ba277b45 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1294 microversion: 2.1 time: 0.459539 Oct 26 05:03:47.170706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:47.171416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:47.172033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.172925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:47.175425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:47.176043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.187515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 413/857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:46 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1294 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:47.195070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:47.197525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:47.207278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:47.209078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:47.210770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.211512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:47.212000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:47.213802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.251163 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ba0d63b-b31a-464b-a1cc-4310f43fa7ba tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061949 Oct 26 05:03:47.252722 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 414/858] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:03:47 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:03:47.509797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:47.521667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-137253135", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d5f82c62-9aad-46b0-8705-97aed5ee80ce"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:47.523687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-deae1bf3-9c52-4e9f-b9ba-b7d46b4461d5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.378161 Oct 26 05:03:47.524458 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 445/859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:47 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:47.579721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:47.580742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:47.594703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:47.595746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:47.596385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.597106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:47.597695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:47.598322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:47.618763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] validate_networks() for [('d5f82c62-9aad-46b0-8705-97aed5ee80ce', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:48.088786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:48.097760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff884ed9-e31e-498d-ac20-7ba084a4d3a4 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1587 microversion: 2.1 time: 0.522153 Oct 26 05:03:48.103710 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 446/860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:47 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1587 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:48.108581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-31f7d8e0-97eb-4066-a383-9e5e247e005f req-1022c9d1-c2b8-49a3-95b2-76fe621efdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad81e86-6a28-45c7-a375-7bfb5be32303", "tag": "f55b1e9a-447f-4ad1-a8b6-680bd05742d7"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:48.131594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-31f7d8e0-97eb-4066-a383-9e5e247e005f req-1022c9d1-c2b8-49a3-95b2-76fe621efdaa service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:48.142170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-31f7d8e0-97eb-4066-a383-9e5e247e005f req-1022c9d1-c2b8-49a3-95b2-76fe621efdaa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:48.143010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-31f7d8e0-97eb-4066-a383-9e5e247e005f req-1022c9d1-c2b8-49a3-95b2-76fe621efdaa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:48.158898 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-31f7d8e0-97eb-4066-a383-9e5e247e005f req-1022c9d1-c2b8-49a3-95b2-76fe621efdaa service nova] Creating event network-changed:f55b1e9a-447f-4ad1-a8b6-680bd05742d7 for instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 on n-h1-862416-4 Oct 26 05:03:48.165084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-31f7d8e0-97eb-4066-a383-9e5e247e005f req-1022c9d1-c2b8-49a3-95b2-76fe621efdaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059911 Oct 26 05:03:48.166435 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 447/861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:48.334584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-753364619", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:48.429862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:03:48.436427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:48.437109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:48.437787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:48.438501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:48.439281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:48.454890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:48.455678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:48.456128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:48.456853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:48.457744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:48.462871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:48.504663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Getting quotas for project bc3201d6ec664f51a56170294f242a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:48.521630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Getting quotas for user dd5ce89745564263bab98d4227858c97 and project bc3201d6ec664f51a56170294f242a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:48.540563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:48.547602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:48.606269 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a302899a-5255-4d72-9f60-609f654997c5 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092115 Oct 26 05:03:48.614762 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 415/862] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:03:48.622474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:48.623135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:48.629599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:48.630385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:48.630814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:48.631522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:48.632133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:48.632771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.014213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:49.017909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:49.037254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:49.040908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:49.042157 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-753c3949-7fc8-478b-94a0-9c5cf7dec609 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1608 microversion: 2.25 time: 0.424757 Oct 26 05:03:49.075485 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 416/863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:03:48 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1608 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:03:49.089109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:49.090309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:49.119677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.120176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.129756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.130556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.131965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.132683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.203606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:03:49.204124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:03:49.204559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:03:49.205288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:03:49.205906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:03:49.223975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.229718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.230371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.231334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.231985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.232585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.273484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Getting quotas for project d384488592ca416395088f0ade0ffa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:03:49.285124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Getting quotas for user 322c1719106e43b186d41751779b6072 and project d384488592ca416395088f0ade0ffa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:03:49.327690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:03:49.330786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:03:49.372147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:49.396773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8520befb-e5ed-4015-a47e-59db92ca3a71 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1282 microversion: 2.1 time: 0.319633 Oct 26 05:03:49.399778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 417/864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:49 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1282 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:49.412355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:49.415822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:49.426527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:49.428189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.429361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.430309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.431644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.432358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.439103 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d475fb8c-51c5-418d-855a-c831ed70893f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271060 Oct 26 05:03:49.447466 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 448/865] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:03:49.459966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:49.461041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.467201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:49.480441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.482350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.484651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.485496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.487585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.490065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.602199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:49.614701 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af24e165-bb1c-46ee-a864-26d8c0fcf57f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1221 microversion: 2.1 time: 0.166033 Oct 26 05:03:49.615369 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 449/866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:49 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:49.630825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:49.630825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:49.639828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.641661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.643503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.644481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.646794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.647446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.861280 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca8b870b-b643-4512-b3bb-9e7427336125 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.244773 Oct 26 05:03:49.862547 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 450/867] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:03:49 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:03:49.868831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:49.882977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:49.883810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Searching by: {'deleted': False, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:03:49.911709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.912210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.912909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:49.920304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:49.920852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:49.921399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:50.003721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:50.024328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b26e577-4045-4881-8bd8-378bae8a411c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.611502 Oct 26 05:03:50.025054 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 418/868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:49 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:50.029861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f585e50-510b-4574-8fbf-b8411aef6bca tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:50.030450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f585e50-510b-4574-8fbf-b8411aef6bca tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:50.181934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:03:50.295841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f585e50-510b-4574-8fbf-b8411aef6bca tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:50.304617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f585e50-510b-4574-8fbf-b8411aef6bca tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1213 microversion: 2.1 time: 0.278448 Oct 26 05:03:50.305544 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 419/869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:50 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1213 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:50.409673 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-817bc054-7548-405a-b843-8f492af8a6a9 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.545634 Oct 26 05:03:50.423101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:50.429480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:50.429765 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 451/870] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:03:49 2022] GET /compute/v2.1/servers => generated 333 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:50.434055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Searching by: {'deleted': False, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:03:50.437926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:50.446565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:50.455480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:50.457835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:50.458394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:50.460189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:50.461205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:50.461937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:50.462638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:50.464392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:50.465008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:50.465794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:50.466262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:50.466695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:50.601149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:03:50.842047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:50.850550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:50.852112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:50.852569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.196869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:51.209732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-96596015-966f-488f-a454-175475a46bc0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.778561 Oct 26 05:03:51.226892 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 452/871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:50 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:51.232784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:51.233799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:51.242206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.243016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.243688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.244662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.249043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.249832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.369747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:51.379416 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75cdfd47-ac75-4b18-9b3a-47cbb698a32a tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1275 microversion: 2.1 time: 0.151320 Oct 26 05:03:51.380082 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 453/872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:51 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:51.390674 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3d1c76f-2b7f-4ce4-8bcf-4593ca75daed tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.971324 Oct 26 05:03:51.391576 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 420/873] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:03:50 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:51.396428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:51.397213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:51.404733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.405610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.406219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.407100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.408246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.408931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.409702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:51.410339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:51.417922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.418690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.419294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.420193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.420807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.421427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.526968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:51.544268 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b66bd43a-5601-4629-9970-53b857ba834d tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1265 microversion: 2.1 time: 0.148181 Oct 26 05:03:51.546137 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 421/874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:51 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:51.562006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47855b60-a4c5-444b-b9f2-63fd691071c1 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:51.574865 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47855b60-a4c5-444b-b9f2-63fd691071c1 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026903 Oct 26 05:03:51.575457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 422/875] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:51.889538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:51.890382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:51.900236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.900805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.901347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.902114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:51.902650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:51.903145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:51.935345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:03:52.047291 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-926b7b69-28f0-4a9d-84b9-e5282bbc5c1b tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 204 len: 0 microversion: 2.1 time: 0.160724 Oct 26 05:03:52.050314 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 423/876] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:03:51 2022] DELETE /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:03:52.062640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:52.063730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:52.072798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.073698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.074307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.075226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.076418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.077191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.097197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:52.113808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4db93af3-5987-486c-82d5-0e4642198ec8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.732207 Oct 26 05:03:52.114408 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 454/877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:51 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:52.233255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:52.233885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:52.255095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.255879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.256482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.257398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.258024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.258595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.573573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:52.584122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c45181e-c847-4656-8ff0-edd8c6a1c2ec tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1700 microversion: 2.1 time: 0.528989 Oct 26 05:03:52.597699 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 424/878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:52 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1700 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:52.603144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:52.603759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:52.622068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.622834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.623570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.624450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.627593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.628787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.787920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:52.803663 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e086fb2a-2e14-41f2-bd81-7e5eb5723a10 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1275 microversion: 2.1 time: 0.204580 Oct 26 05:03:52.804952 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 425/879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:52 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:52.828763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:52.829769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:52.833426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:52.849610 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2bc6c5e8-f1c1-4d77-8eb6-2423344c38b8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.617468 Oct 26 05:03:52.853618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 455/880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:52 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:52.870568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.871069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.871605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.872208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:52.875203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:52.875663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:52.988346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:53.002127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-758caf15-6d04-4bce-9340-c75af305c30a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1271 microversion: 2.1 time: 0.194622 Oct 26 05:03:53.003519 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 426/881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:52 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:53.138055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:53.139284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:53.164127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.164850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.165517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:53.166422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.167089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.167707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:53.182719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5bc7a02b-f369-4e8d-a5d2-99678752ba16 req-b8444edc-fa7d-486f-a5ed-38fb6d2ee460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75bf65a6-e1be-4a40-a1cb-29cfe1bf944b", "tag": "65dc91e0-6c38-4960-a692-8fe7863e2e2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:53.184714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:53.207232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5bc7a02b-f369-4e8d-a5d2-99678752ba16 req-b8444edc-fa7d-486f-a5ed-38fb6d2ee460 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.208963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5bc7a02b-f369-4e8d-a5d2-99678752ba16 req-b8444edc-fa7d-486f-a5ed-38fb6d2ee460 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.209742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5bc7a02b-f369-4e8d-a5d2-99678752ba16 req-b8444edc-fa7d-486f-a5ed-38fb6d2ee460 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:53.253497 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5bc7a02b-f369-4e8d-a5d2-99678752ba16 req-b8444edc-fa7d-486f-a5ed-38fb6d2ee460 service nova] Creating event network-changed:65dc91e0-6c38-4960-a692-8fe7863e2e2f for instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b on n-h2-862416-4 Oct 26 05:03:53.274949 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5bc7a02b-f369-4e8d-a5d2-99678752ba16 req-b8444edc-fa7d-486f-a5ed-38fb6d2ee460 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094032 Oct 26 05:03:53.278047 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 427/882] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:53.463042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:53.473241 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef80dcee-1560-4102-a844-431624238d90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.339014 Oct 26 05:03:53.474138 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 456/883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:53 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:53.611539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:53.613162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:53.622011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.627087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.628313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:53.629224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.630068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.630679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:53.834463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:53.835211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:53.851767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.852787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.856228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:53.859263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:53.859874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:53.863766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.142319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:54.151425 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af1f8b49-d950-4d1e-ab96-e1ec39936af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.323838 Oct 26 05:03:54.156390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 457/884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:53 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:54.164211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:54.176314 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e93a4d25-6536-431e-b800-aa3ba96ac259 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1700 microversion: 2.1 time: 0.565904 Oct 26 05:03:54.177210 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 428/885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:53 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1700 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:54.190010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:54.190900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:54.193947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:54.196157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:54.205794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:54.206832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:54.207958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.210852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:54.211051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:54.211542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:54.211971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.213252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:54.213603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.214673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:54.215295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:54.216325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.631187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:54.641409 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cd0a1ac6-6061-4b26-b43c-15a87daa3c49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.461979 Oct 26 05:03:54.657377 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 429/886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:54 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:54.657377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:54.657725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:54.682358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:54.682861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:54.683303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.684016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:54.684471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:54.685646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:54.697656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:54.711626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37e6eb95-bc0b-4ae0-abd9-412b65cd80ca tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.553508 Oct 26 05:03:54.714989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 458/887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:54 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:54.906611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:54.920098 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-175a8eb3-b4c9-4638-bf5c-cc5f54c2acb0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.270174 Oct 26 05:03:54.921564 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 430/888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:54 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:55.183478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:55.184184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:55.190898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.191688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.192137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.192856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.193358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.193778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.208890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:55.209554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:55.233472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.233972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.237453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.239075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.239775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.240548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.436441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:55.445632 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-558cc481-4046-46d1-a8a9-a2a87a808808 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.265767 Oct 26 05:03:55.447050 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 459/889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:55 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:55.452931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-43afe842-6751-4808-b72d-41071cd52734 req-8602fc24-4dfe-413e-b671-2cc1cc8a6296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07d8713-2b19-48a3-987e-27843e15111f", "tag": "895a25f8-b756-40d5-83d8-7c6eeaa273b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:55.459707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:55.464654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-43afe842-6751-4808-b72d-41071cd52734 req-8602fc24-4dfe-413e-b671-2cc1cc8a6296 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.465742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-43afe842-6751-4808-b72d-41071cd52734 req-8602fc24-4dfe-413e-b671-2cc1cc8a6296 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.466411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-43afe842-6751-4808-b72d-41071cd52734 req-8602fc24-4dfe-413e-b671-2cc1cc8a6296 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.469500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f584d34c-e3c1-4d05-9a31-8aec0180b1b6 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1700 microversion: 2.1 time: 0.266952 Oct 26 05:03:55.480784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-43afe842-6751-4808-b72d-41071cd52734 req-8602fc24-4dfe-413e-b671-2cc1cc8a6296 service nova] Creating event network-changed:895a25f8-b756-40d5-83d8-7c6eeaa273b0 for instance e07d8713-2b19-48a3-987e-27843e15111f on n-h1-862416-4 Oct 26 05:03:55.484238 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 431/890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:55 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1700 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:55.487361 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-43afe842-6751-4808-b72d-41071cd52734 req-8602fc24-4dfe-413e-b671-2cc1cc8a6296 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038838 Oct 26 05:03:55.488030 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 460/891] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:55.671547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:55.672697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:55.680458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.680956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.681493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.682196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.682833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.683403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.740586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:55.741292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:55.750237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.750732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.751774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.753159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.753646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.754081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.902589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:55.913937 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8635c465-6443-464f-93e8-6f77e7c166ba tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.246318 Oct 26 05:03:55.932479 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 432/892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:55 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:55.947540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:55.955192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:55.973884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.974477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.974988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:55.975777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:55.976641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:55.976916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.010033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:56.021868 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b77ac6fa-45c6-47b0-9789-979578a3295c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.287275 Oct 26 05:03:56.023078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 461/893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:55 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:56.195450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:56.198421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:56.207959 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec772642-ab5d-40e0-8ff6-6780606c352a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.267179 Oct 26 05:03:56.208472 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 433/894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:55 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:56.481280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:56.483046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:56.495062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:56.496179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:56.504898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.509095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.509517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.510132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.510797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.511808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.512542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.513009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.513471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.516972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.520149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.524947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.738716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:56.760287 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b218b90-614e-4937-9b29-a8d224fa0ae4 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1632 microversion: 2.1 time: 0.269822 Oct 26 05:03:56.761102 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 434/895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:56 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1632 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:56.791241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a28c4abe-3105-493e-b882-aae4d79c8397 req-6be6d7b1-d4b8-4463-913c-48968570f252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7392b49d-3e77-42f8-8de8-a5be23766ad8", "tag": "73da0280-5872-4070-9b28-46bdf2e2d6c6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:56.804917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a28c4abe-3105-493e-b882-aae4d79c8397 req-6be6d7b1-d4b8-4463-913c-48968570f252 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.805725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a28c4abe-3105-493e-b882-aae4d79c8397 req-6be6d7b1-d4b8-4463-913c-48968570f252 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.806504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a28c4abe-3105-493e-b882-aae4d79c8397 req-6be6d7b1-d4b8-4463-913c-48968570f252 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.819988 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a28c4abe-3105-493e-b882-aae4d79c8397 req-6be6d7b1-d4b8-4463-913c-48968570f252 service nova] Creating event network-changed:73da0280-5872-4070-9b28-46bdf2e2d6c6 for instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 on n-h2-862416-4 Oct 26 05:03:56.825384 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a28c4abe-3105-493e-b882-aae4d79c8397 req-6be6d7b1-d4b8-4463-913c-48968570f252 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037805 Oct 26 05:03:56.826990 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 435/896] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:03:56.878707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:56.890504 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55e70fdc-ffb4-44c1-a14d-a05b46c7f4a3 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.424809 Oct 26 05:03:56.891526 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 462/897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:56 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:56.940940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:56.942262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:56.950875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.951939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.952720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:56.954613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:56.955358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:56.956240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.047427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:57.048151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:57.055963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.056609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.057057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.057808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.059007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.060161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.186444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:57.200763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c233daf6-2b28-4650-a584-4c04a1a69006 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.265267 Oct 26 05:03:57.201543 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 436/898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:56 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:57.237513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:57.238234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:57.239833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:57.245660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.246718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.247460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.248422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.248934 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a7cd31ee-f3a6-465f-a59a-8bc6e32e8a29 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.206091 Oct 26 05:03:57.249381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.250022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.280900 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 463/899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:57 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:57.432086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:57.441638 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8980fd0d-4f75-4285-a0e4-b2354c93a039 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.209514 Oct 26 05:03:57.443195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 437/900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:57 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:03:57.784634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:57.785256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:57.792714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.793592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.794246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.795181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.795855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.796495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.870244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22789122ff404e5289a9efef34bec9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7502893a23432b9fc6c62e0bc16bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:57.881949 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f28756e4-cb8a-4260-b2f5-650786fc1d12 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 200 len: 1353 microversion: 2.1 time: 0.100512 Oct 26 05:03:57.882852 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 464/901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:57 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:57.916192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:57.916818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:57.923724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.924555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.925235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:57.926097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:57.926666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:57.927198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.101278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:58.110360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a42e4d51-4fff-424f-86c7-521ed1d05239 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.198088 Oct 26 05:03:58.126448 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 438/902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:57 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:58.224547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:58.225575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:58.231685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.232480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.233181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.234512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.235235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.236500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.279824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:58.280341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:58.287262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.288095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.288524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.289227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.289717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.290148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.575588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:58.586916 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc09980b-f4d7-4600-ae94-ffd0fa5259e1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.314637 Oct 26 05:03:58.592190 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 439/903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:58 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:58.598248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:58.615779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:58.617897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-974c33b1-ce0d-4a77-b470-1e4cb1cca60a tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.397656 Oct 26 05:03:58.619094 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 465/904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:58 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:58.630488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:58.638646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.643793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.644401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.659277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.660735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.664738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.854739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:58.868550 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5de5f2e3-47d8-4b87-b9a4-fbdb616ffc8a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.273873 Oct 26 05:03:58.877892 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 440/905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:58 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:58.892954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8272128a-d64b-4254-8b19-a1978fae2691 req-0d56c6e6-0e60-408e-a000-081fab3df4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ced283-dea4-4e31-b42c-609fe3c75d6c", "name": "network-vif-deleted", "tag": "89f86040-f030-4c1a-93a5-8c432edf2d93"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:58.909092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:58.909304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8272128a-d64b-4254-8b19-a1978fae2691 req-0d56c6e6-0e60-408e-a000-081fab3df4d1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.909684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8272128a-d64b-4254-8b19-a1978fae2691 req-0d56c6e6-0e60-408e-a000-081fab3df4d1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.910495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] [instance: 31ced283-dea4-4e31-b42c-609fe3c75d6c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:58.913387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8272128a-d64b-4254-8b19-a1978fae2691 req-0d56c6e6-0e60-408e-a000-081fab3df4d1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.919356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.920706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.921557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.924009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:58.924741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:58.925502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:58.940941 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8272128a-d64b-4254-8b19-a1978fae2691 req-0d56c6e6-0e60-408e-a000-081fab3df4d1 service nova] Creating event network-vif-deleted:89f86040-f030-4c1a-93a5-8c432edf2d93 for instance 31ced283-dea4-4e31-b42c-609fe3c75d6c on n-h2-862416-4 Oct 26 05:03:58.944069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] HTTP exception thrown: Instance 31ced283-dea4-4e31-b42c-609fe3c75d6c could not be found. Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Request method failure captured: Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c HTTP/1.1 Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9CyBglIThrHR2StkwrU1qehi1MTv4z-NgdQvPHnjaIZuvLrBszPe5WPvF8W9_yXl_9Krubfmhfs-_kt4U3cJhJ3fG5EWu6pPA17VWlXQB_iKV342R5TrsfbUT3C-HXp2I2tISOBH7VasxlPuLfh4cX_mplPm3GnhIh_Hyz_IzPRig Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 9d7502893a23432b9fc6c62e0bc16bd8 Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-596909752 Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:03:58.945925 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9d7502893a23432b9fc6c62e0bc16bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d7502893a23432b9fc6c62e0bc16bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d7502893a23432b9fc6c62e0bc16bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9d7502893a23432b9fc6c62e0bc16bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-596909752 Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 9d7502893a23432b9fc6c62e0bc16bd8 Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-596909752 Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-596909752-project Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 22789122ff404e5289a9efef34bec9c0 Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-596909752-project Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 31ced283-dea4-4e31-b42c-609fe3c75d6c could not be found. Oct 26 05:03:58.947484 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '31ced283-dea4-4e31-b42c-609fe3c75d6c'} Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ced283-dea4-4e31-b42c-609fe3c75d6c could not be found. Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:03:58.948325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ced283-dea4-4e31-b42c-609fe3c75d6c could not be found. Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ced283-dea4-4e31-b42c-609fe3c75d6c could not be found. Oct 26 05:03:58.950844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:03:58.953050 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8272128a-d64b-4254-8b19-a1978fae2691 req-0d56c6e6-0e60-408e-a000-081fab3df4d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058688 Oct 26 05:03:58.953050 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 466/906] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:03:58.955008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Returning 404 to user: Instance 31ced283-dea4-4e31-b42c-609fe3c75d6c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:03:58.956875 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a622257-8143-42eb-b3a6-d01c4db6ea3e tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c" status: 404 len: 111 microversion: 2.1 time: 0.052808 Oct 26 05:03:58.958070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 441/907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:58 2022] GET /compute/v2.1/servers/31ced283-dea4-4e31-b42c-609fe3c75d6c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:03:58.966957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2512ea40-bfc4-451f-94a0-8a5f590a3b16 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] Calling method '.version_select at 0x7f470a9a2040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:58.989715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2512ea40-bfc4-451f-94a0-8a5f590a3b16 tempest-ServersTestJSON-596909752 tempest-ServersTestJSON-596909752-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443406264" status: 202 len: 0 microversion: 2.1 time: 0.026808 Oct 26 05:03:58.994073 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 467/908] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443406264 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:03:59.135047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:59.135782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:59.142399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:59.142914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:59.143732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:59.144673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:59.145163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:59.145906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:59.317304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:03:59.330411 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f98af37e-d91b-4c42-91fc-1273eb59199c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.198282 Oct 26 05:03:59.331451 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 442/909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:59 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:03:59.420792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:03:59.473941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c2eb46f6-1ec3-4359-b3cf-733773a8b4d0 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Action: 'create', calling method: .version_select at 0x7f470aa8ea60>, body: {"pool": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:03:59.622989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:03:59.623616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:03:59.634055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:59.634977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:59.635577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:03:59.637084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:03:59.638217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:03:59.638801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.051455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=23 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:00.143796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:00.158824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c02e9d2-1ced-4d40-943c-25521e6c984b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.548090 Oct 26 05:04:00.174842 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 443/910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:03:59 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:00.183345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:00.185209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:00.192516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.193525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.194248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.195519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.227175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.228169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.499147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:00.532573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:00.542915 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d133f67b-5411-4586-bf3b-2f827082c941 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.366333 Oct 26 05:04:00.544399 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 444/911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:00 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:00.550602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:00.551488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:00.559351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.562481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.564092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.565824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.567257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.568093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.784645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:00.795893 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-accb6937-10e4-4545-b40a-04bc5aa1f497 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.250171 Oct 26 05:04:00.799278 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 445/912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:00 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:00.806978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4d958f6e-7e84-4b13-9ddf-1b4a33030d05 req-f9af7126-1fa5-4eb5-a413-bcaf62be8a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bf65a6-e1be-4a40-a1cb-29cfe1bf944b", "name": "network-vif-plugged", "status": "completed", "tag": "65dc91e0-6c38-4960-a692-8fe7863e2e2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:00.825548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4d958f6e-7e84-4b13-9ddf-1b4a33030d05 req-f9af7126-1fa5-4eb5-a413-bcaf62be8a21 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.827214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4d958f6e-7e84-4b13-9ddf-1b4a33030d05 req-f9af7126-1fa5-4eb5-a413-bcaf62be8a21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.827937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4d958f6e-7e84-4b13-9ddf-1b4a33030d05 req-f9af7126-1fa5-4eb5-a413-bcaf62be8a21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.844739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=18 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:00.848307 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4d958f6e-7e84-4b13-9ddf-1b4a33030d05 req-f9af7126-1fa5-4eb5-a413-bcaf62be8a21 service nova] Creating event network-vif-plugged:65dc91e0-6c38-4960-a692-8fe7863e2e2f for instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b on n-h2-862416-4 Oct 26 05:04:00.856507 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4d958f6e-7e84-4b13-9ddf-1b4a33030d05 req-f9af7126-1fa5-4eb5-a413-bcaf62be8a21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055270 Oct 26 05:04:00.857496 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 446/913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:00.865290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:00.866591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:00.875442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.876092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.877571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:00.878950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:00.879484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:00.879927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.139228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:01.148497 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ba6d9bb-7555-4e20-a6ff-0dfd510cd03f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.289781 Oct 26 05:04:01.151946 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 447/914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:00 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:01.169906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c4a3959c-610a-49fa-9d6b-15694fba8440 req-4e9799d8-a56f-431b-a379-568b928fbfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "007c6b12-defc-4163-b440-e464c7601c48", "tag": "1f313c7f-b1d3-41e8-ac33-bbf5e237dd8c"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:01.182511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4a3959c-610a-49fa-9d6b-15694fba8440 req-4e9799d8-a56f-431b-a379-568b928fbfb6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.183064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4a3959c-610a-49fa-9d6b-15694fba8440 req-4e9799d8-a56f-431b-a379-568b928fbfb6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.183867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4a3959c-610a-49fa-9d6b-15694fba8440 req-4e9799d8-a56f-431b-a379-568b928fbfb6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.196853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c4a3959c-610a-49fa-9d6b-15694fba8440 req-4e9799d8-a56f-431b-a379-568b928fbfb6 service nova] Creating event network-changed:1f313c7f-b1d3-41e8-ac33-bbf5e237dd8c for instance 007c6b12-defc-4163-b440-e464c7601c48 on n-h2-862416-4 Oct 26 05:04:01.202185 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c4a3959c-610a-49fa-9d6b-15694fba8440 req-4e9799d8-a56f-431b-a379-568b928fbfb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045612 Oct 26 05:04:01.203457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 448/915] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:01.209254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:01.210311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:01.220940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.221697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.223502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.224847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.226197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.226884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.576280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:01.585897 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d70e4478-339d-4735-8ffe-ec2e721698ce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.380636 Oct 26 05:04:01.586482 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 449/916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:01 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:01.592038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c2eb46f6-1ec3-4359-b3cf-733773a8b4d0 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.175710 Oct 26 05:04:01.593403 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 468/917] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:03:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:01.597214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:01.598158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:01.617404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a4e3040-9761-4758-9982-dac8e5cbba5e tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Calling method '.version_select at 0x7f470a94bca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:01.637094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.637625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.638066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.638795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.639254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.639686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.948408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a4e3040-9761-4758-9982-dac8e5cbba5e tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/f2374ab7-4cec-4e04-a241-1b4b8cfc0ef8" status: 200 len: 141 microversion: 2.1 time: 0.339114 Oct 26 05:04:01.949000 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 469/918] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:04:01 2022] GET /compute/v2.1/os-floating-ips/f2374ab7-4cec-4e04-a241-1b4b8cfc0ef8 => generated 141 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:01.954528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:01.955503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:01.965943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:01.974186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.974695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.975140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.975864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:01.976333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:01.976603 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1bed01a-c2d3-4cf6-8e16-674c6ebb6161 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.387198 Oct 26 05:04:01.976757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:01.978086 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 450/919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:01 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:01.982866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54c8b021-ee85-48d3-942e-ee09cdb8b782 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Calling method '.version_select at 0x7f470a785820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:02.261508 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54c8b021-ee85-48d3-942e-ee09cdb8b782 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.281883 Oct 26 05:04:02.262708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 451/920] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:04:01 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:02.277426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:02.280825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:02.298385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:02.300641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:02.301689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:02.302670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:02.303491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:02.304129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:02.377077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:02.385948 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5cdae0de-2f25-4e9b-8cf1-0df09145cfcf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.435860 Oct 26 05:04:02.386534 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 470/921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:01 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:02.391759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73fa57d0-38c4-4e64-9aa4-12a46136b704 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Calling method '.version_select at 0x7f470aa91f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:02.703536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:02.724268 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee5a8891-b4dd-4270-ac2f-a81a6f5e6edf tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.450534 Oct 26 05:04:02.726527 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 452/922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:02 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:02.765630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:02.766257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:02.799203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:02.800148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:02.801073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:02.803542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:02.804372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:02.805039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:03.194168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:03.205425 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f183d7c-078e-44f1-82dd-77c4aa28f3f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1324 microversion: 2.1 time: 0.464568 Oct 26 05:04:03.206420 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 453/923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:02 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:03.220640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:03.222145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:03.230132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:03.231237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:03.232073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:03.234652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:03.236529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:03.237940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:03.247218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:03.761804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:03.772988 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c9a091a1-9a55-4386-ad22-71f5c7257101 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.557661 Oct 26 05:04:03.774171 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 454/924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:03 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:03.784184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:03.785206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:03.794704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:03.795458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:03.795896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:03.796607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:03.797061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:03.798254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.399447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:04.408506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7e12b0b-e803-45e6-8d04-3c730abaf125 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.632349 Oct 26 05:04:04.409082 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 455/925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:03 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:04.414360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:04.415300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:04.421431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.422188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.423597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.425093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.425830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.426335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.561942 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73fa57d0-38c4-4e64-9aa4-12a46136b704 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f2374ab7-4cec-4e04-a241-1b4b8cfc0ef8" status: 202 len: 0 microversion: 2.1 time: 2.173640 Oct 26 05:04:04.564647 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 471/926] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:04:02 2022] DELETE /compute/v2.1/os-floating-ips/f2374ab7-4cec-4e04-a241-1b4b8cfc0ef8 => generated 0 bytes in 2177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:04.570177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ccaf1f41-f062-4a39-a0e1-21b8fd2e05b1 req-76149b04-fe34-40d4-ab3a-f67716233166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7392b49d-3e77-42f8-8de8-a5be23766ad8", "name": "network-vif-plugged", "status": "completed", "tag": "73da0280-5872-4070-9b28-46bdf2e2d6c6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:04.580580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ccaf1f41-f062-4a39-a0e1-21b8fd2e05b1 req-76149b04-fe34-40d4-ab3a-f67716233166 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.581071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ccaf1f41-f062-4a39-a0e1-21b8fd2e05b1 req-76149b04-fe34-40d4-ab3a-f67716233166 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.581535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ccaf1f41-f062-4a39-a0e1-21b8fd2e05b1 req-76149b04-fe34-40d4-ab3a-f67716233166 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.593667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ccaf1f41-f062-4a39-a0e1-21b8fd2e05b1 req-76149b04-fe34-40d4-ab3a-f67716233166 service nova] Creating event network-vif-plugged:73da0280-5872-4070-9b28-46bdf2e2d6c6 for instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 on n-h2-862416-4 Oct 26 05:04:04.598601 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ccaf1f41-f062-4a39-a0e1-21b8fd2e05b1 req-76149b04-fe34-40d4-ab3a-f67716233166 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 Oct 26 05:04:04.599210 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 472/927] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:04.605890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:04.606599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:04.609677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:04.614580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.615080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.615527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.616230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.616754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.617183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.756454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:04.764565 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eedc92a1-6fc8-4261-8310-757f3d7339a8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.354190 Oct 26 05:04:04.765211 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 456/928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:04 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:04.784813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c38f81a-a8b7-4c57-a254-99e28d7867a3 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Action: 'create', calling method: .version_select at 0x7f470a7851f0>, body: {"pool": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:04.958147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:04.967263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-915eda38-de3f-4fae-843c-9fe69ad0d257 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.365916 Oct 26 05:04:04.968291 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 473/929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:04 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:04.973828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:04.974437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:04.981222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.981951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.982562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:04.983433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:04.984041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:04.984618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:05.207965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:05.219088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a39bdfdf-3560-45f4-8ea0-c36a7cea87af tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.249561 Oct 26 05:04:05.220142 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 474/930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:04 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:05.225996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:05.227096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:05.234240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:05.234843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:05.235942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:05.236804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:05.237389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:05.238063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:05.474595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:05.484108 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7ac90d5-c52c-4958-a37b-441b208bc225 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.262644 Oct 26 05:04:05.499677 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 475/931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:05 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:05.512663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:05.513705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:05.523471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:05.526534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:05.529073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:05.530318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:05.530920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:05.533213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:05.821502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:05.854292 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23b83a59-3ea9-4fb9-9db5-2d438431d690 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.351239 Oct 26 05:04:05.856742 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 476/932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:05 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:05.867490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6055312f-132f-4a4c-907b-32cced56317f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1418288547", "metadata": {"": ""}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6055312f-132f-4a4c-907b-32cced56317f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action HTTP/1.1 Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 107 Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:05.874314 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1418288547", "metadata": {"": ""}}} Oct 26 05:04:05.876010 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1418288547', 'metadata': {'': ''}}}} Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'': ''} Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:05.876961 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.879094 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:05.881176 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:05.881176 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:05.881176 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:04:05.881176 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:04:05.881176 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:05.881176 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:05.882717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6055312f-132f-4a4c-907b-32cced56317f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:05.883831 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6055312f-132f-4a4c-907b-32cced56317f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action" status: 400 len: 170 microversion: 2.1 time: 0.026078 Oct 26 05:04:05.884675 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 477/933] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 26 05:04:05 2022] POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:04:05.889710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:05.890504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:05.898459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:05.899168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:05.899790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:05.900880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:05.902186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:05.903005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.141506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:06.151155 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-650b4ca1-32d0-4c8a-a9b6-431cefa49410 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.265080 Oct 26 05:04:06.152263 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 478/934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:05 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:06.158384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:06.159197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:06.166951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.167618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.168225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.169367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.169846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.170277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.499941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:06.504509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:06.509647 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19449704-8d26-4103-b182-73c8ec453fd7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.355738 Oct 26 05:04:06.510545 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 479/935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:06 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:06.515875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:06.517018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:06.523676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.524169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.524614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.525332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.525807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.526238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.618221 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c38f81a-a8b7-4c57-a254-99e28d7867a3 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.839696 Oct 26 05:04:06.622336 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 457/936] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:04:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:06.632585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:06.633203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:06.647146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.647891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.648676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.649578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.650255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.650846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.696965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:06.711517 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b047d72e-0f6d-4f56-aad3-c54d673a95fd tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.198715 Oct 26 05:04:06.712494 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 480/937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:06 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:06.718195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5eac008a-49e5-4d50-92b4-3e650a91e603 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Calling method '.version_select at 0x7f470a996e50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:06.915753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:06.924475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93bfefbb-3b08-45d4-8f4c-2b186fb9469c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.296525 Oct 26 05:04:06.925045 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 458/938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:06 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:06.930217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:06.930830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:06.936895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.937415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.937859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:06.939105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:06.939563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:06.939999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.197478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:07.207911 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-04102f67-2bbb-4f29-9a28-110c9413f8e5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.281729 Oct 26 05:04:07.208691 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 459/939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:06 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:07.220737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0abb3902-2759-4790-be35-a50af0c05ba0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2127878963", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0abb3902-2759-4790-be35-a50af0c05ba0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action HTTP/1.1 Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 619 Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:07.226918 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:07.228559 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:04:07.229333 n-d-862416-4 devstack@n-api.service[120585]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2127878963", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 26 05:04:07.229333 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:07.229333 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2127878963', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 26 05:04:07.229609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:07.230439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.231699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:07.232593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:07.232593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:07.232593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:04:07.232593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:04:07.232593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:04:07.232593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:07.233074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0abb3902-2759-4790-be35-a50af0c05ba0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:07.233074 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0abb3902-2759-4790-be35-a50af0c05ba0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action" status: 400 len: 938 microversion: 2.1 time: 0.017948 Oct 26 05:04:07.233074 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 460/940] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 26 05:04:07 2022] POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action => generated 938 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:04:07.235921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:07.236438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:07.247178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.247745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.248495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.249644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.250113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.251101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.468258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:07.482587 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95e32254-46d0-48a0-8289-7af235f10048 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1317 microversion: 2.1 time: 0.250986 Oct 26 05:04:07.484324 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 461/941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:07 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:07.490108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:07.490709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:07.498739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.499239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.499887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.500785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.501445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.502017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.704733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:07.713890 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28be44f5-8428-4f50-8e90-f80c5d82d128 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.227706 Oct 26 05:04:07.730379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 462/942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:07 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:07.751041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:07.756693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:07.764096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.764934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.765709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.767216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.769988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.770664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.780538 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5eac008a-49e5-4d50-92b4-3e650a91e603 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1" status: 202 len: 0 microversion: 2.1 time: 1.065793 Oct 26 05:04:07.784989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 481/943] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:04:06 2022] DELETE /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1 => generated 0 bytes in 1072 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:07.790912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:07.792590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:07.799241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.799910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.800482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:07.801283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:07.801764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:07.802187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.008843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:08.017165 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2309d19f-10fc-4142-9ca0-1eb38b3c4ffa tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.283585 Oct 26 05:04:08.017839 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 463/944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:07 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:08.022656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d7d5f00-e6f4-436d-b61d-09025f390b00 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Calling method '.version_select at 0x7f470a6f2ca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:08.090562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:08.093153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-4d7d5f00-e6f4-436d-b61d-09025f390b00 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35fd23a6-9d87-424d-9b01-321b40d125b1 could not be found", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:04:08.095357 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4d7d5f00-e6f4-436d-b61d-09025f390b00 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] HTTP exception thrown: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d7d5f00-e6f4-436d-b61d-09025f390b00 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Request method failure captured: Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1 HTTP/1.1 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-_utbre7blv0LM0yM7rKaCklaziPpnpoeDdFqOH3qlFgADJJ8VNfj9n_fcLFDjoaUvb4ca8DGEFe569XlvX4YRrK0oL_JMFAU51LQ52T8MTxpcmaVfaJarcrI5DePEyT-dGT08Vxvf6p7XGXEv9QZWLF7m0OdR6m_dk6EKkVKsgv0 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f899308192147e4b4ef51567f235fbe Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsTestJSON-714727971 Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:08.099102 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f899308192147e4b4ef51567f235fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f899308192147e4b4ef51567f235fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f899308192147e4b4ef51567f235fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f899308192147e4b4ef51567f235fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsTestJSON-714727971 Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f899308192147e4b4ef51567f235fbe Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsTestJSON-714727971 Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsTestJSON-714727971-project Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3d1abb6a44a245e29ce156a6c8ff928a Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsTestJSON-714727971-project Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: exception: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '35fd23a6-9d87-424d-9b01-321b40d125b1'} Oct 26 05:04:08.100747 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:04:08.102423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35fd23a6-9d87-424d-9b01-321b40d125b1 could not be found Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d2c653a-a9b3-4368-b6d1-74c36c55cdbf'] Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1. Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.103768 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:08.104991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:08.106339 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.106339 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.106480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ba1f68c-bf1e-43c7-9013-e0054df86f07 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.313521 Oct 26 05:04:08.106480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 482/945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:07 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:08.106480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-61b8da2e-28af-4204-b07a-a520fbd97702 req-27231e60-bf15-4f31-b4f6-38a773d2b06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007c6b12-defc-4163-b440-e464c7601c48", "name": "network-vif-plugged", "status": "completed", "tag": "1f313c7f-b1d3-41e8-ac33-bbf5e237dd8c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:08.107895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d7d5f00-e6f4-436d-b61d-09025f390b00 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Returning 404 to user: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:08.108856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d7d5f00-e6f4-436d-b61d-09025f390b00 tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1" status: 404 len: 111 microversion: 2.1 time: 0.089920 Oct 26 05:04:08.113580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 464/946] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:04:08 2022] GET /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:08.118542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-61b8da2e-28af-4204-b07a-a520fbd97702 req-27231e60-bf15-4f31-b4f6-38a773d2b06f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.119039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-61b8da2e-28af-4204-b07a-a520fbd97702 req-27231e60-bf15-4f31-b4f6-38a773d2b06f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.119499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-61b8da2e-28af-4204-b07a-a520fbd97702 req-27231e60-bf15-4f31-b4f6-38a773d2b06f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.120720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eef176ef-fbd5-4873-93af-cc619ee638ac tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Calling method '.version_select at 0x7f470a8d0040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:08.134152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-61b8da2e-28af-4204-b07a-a520fbd97702 req-27231e60-bf15-4f31-b4f6-38a773d2b06f service nova] Creating event network-vif-plugged:1f313c7f-b1d3-41e8-ac33-bbf5e237dd8c for instance 007c6b12-defc-4163-b440-e464c7601c48 on n-h2-862416-4 Oct 26 05:04:08.141044 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-61b8da2e-28af-4204-b07a-a520fbd97702 req-27231e60-bf15-4f31-b4f6-38a773d2b06f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038332 Oct 26 05:04:08.142320 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 483/947] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:08.147533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcfcc00c-68aa-4950-9829-8a1fb85d3587 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcfcc00c-68aa-4950-9829-8a1fb85d3587 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action HTTP/1.1 Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 285 Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:08.151561 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:04:08.153164 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:04:08.153925 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:04:08.154586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:04:08.155921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:04:08.156725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:04:08.156725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.156725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcfcc00c-68aa-4950-9829-8a1fb85d3587 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:08.156725 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bcfcc00c-68aa-4950-9829-8a1fb85d3587 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action" status: 400 len: 619 microversion: 2.1 time: 0.009860 Oct 26 05:04:08.157783 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 484/948] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 26 05:04:08 2022] POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:04:08.161623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:08.162353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:08.169405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.170071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.170524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.171317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.171772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.172283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.208951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-eef176ef-fbd5-4873-93af-cc619ee638ac tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35fd23a6-9d87-424d-9b01-321b40d125b1 could not be found", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:04:08.210729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-eef176ef-fbd5-4873-93af-cc619ee638ac tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] HTTP exception thrown: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eef176ef-fbd5-4873-93af-cc619ee638ac tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Request method failure captured: Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1 HTTP/1.1 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-_utbre7blv0LM0yM7rKaCklaziPpnpoeDdFqOH3qlFgADJJ8VNfj9n_fcLFDjoaUvb4ca8DGEFe569XlvX4YRrK0oL_JMFAU51LQ52T8MTxpcmaVfaJarcrI5DePEyT-dGT08Vxvf6p7XGXEv9QZWLF7m0OdR6m_dk6EKkVKsgv0 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4f899308192147e4b4ef51567f235fbe Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsTestJSON-714727971 Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:08.212674 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f899308192147e4b4ef51567f235fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f899308192147e4b4ef51567f235fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f899308192147e4b4ef51567f235fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f899308192147e4b4ef51567f235fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsTestJSON-714727971 Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4f899308192147e4b4ef51567f235fbe Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsTestJSON-714727971 Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsTestJSON-714727971-project Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3d1abb6a44a245e29ce156a6c8ff928a Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsTestJSON-714727971-project Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: exception: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '35fd23a6-9d87-424d-9b01-321b40d125b1'} Oct 26 05:04:08.214380 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:04:08.215366 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35fd23a6-9d87-424d-9b01-321b40d125b1 could not be found Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32b3d488-2f9f-4eff-817e-e62983158588'] Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1. Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.216748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:08.218423 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:08.220073 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 Oct 26 05:04:08.220073 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:08.220073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eef176ef-fbd5-4873-93af-cc619ee638ac tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] Returning 404 to user: Floating IP not found for ID 35fd23a6-9d87-424d-9b01-321b40d125b1 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:08.220073 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eef176ef-fbd5-4873-93af-cc619ee638ac tempest-FloatingIPsTestJSON-714727971 tempest-FloatingIPsTestJSON-714727971-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1" status: 404 len: 111 microversion: 2.1 time: 0.099297 Oct 26 05:04:08.220073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 465/949] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:04:08 2022] DELETE /compute/v2.1/os-floating-ips/35fd23a6-9d87-424d-9b01-321b40d125b1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:08.231960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:08.232669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:08.240043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.240730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.241237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.242077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.242599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.243090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.408494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:08.418056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-231da733-40d1-490a-bd56-7c72f650c1d8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.259693 Oct 26 05:04:08.418941 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 485/950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:08 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:08.454757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:08.456211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:08.464725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.465567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.466242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.467149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.468269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.468892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.564243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:08.572200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1d318e6-a97e-4ee2-ade0-4cd2ab1a72a5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.345091 Oct 26 05:04:08.572856 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 466/951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:08 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:08.577584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:08.578470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:08.585501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.585998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.586422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.587281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.587738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.588155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.732209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:08.741660 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c2d511a2-8396-4d9e-b868-7ee61ca322b7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.298084 Oct 26 05:04:08.742246 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 486/952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:08 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:08.768322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-527461814"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:08.770803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:08.777295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.777816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.778887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.779810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:08.780015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:08.780435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:08.806427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:08.819273 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6fdf6a8f-fa9b-4fe8-aaa5-089347b5b0f0 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1507 microversion: 2.1 time: 0.245101 Oct 26 05:04:08.833555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 467/953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:08 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:09.046619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:09.048415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:09.057051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:09.066675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.067466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.068841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.069194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad6abe4e-4043-47ea-93c6-212fd78fbdee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action" status: 202 len: 0 microversion: 2.1 time: 0.305698 Oct 26 05:04:09.070201 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 487/954] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:04:08 2022] POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 26 05:04:09.084163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.085184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.085886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.090124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-816965128"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:09.093144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:09.110773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.111272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.111709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.114538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.115026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.115661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.195745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Cannot 'createImage' instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b while it is in task_state image_snapshot_pending Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action HTTP/1.1 Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 84 Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:09.200939 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-816965128"}} Oct 26 05:04:09.202621 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'createImage' instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b while it is in task_state image_snapshot_pending Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-816965128'}}} Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:09.203548 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b while it is in task_state image_snapshot_pending Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b while it is in task_state image_snapshot_pending Oct 26 05:04:09.205141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:09.208592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 409 to user: Cannot 'createImage' instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b while it is in task_state image_snapshot_pending {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:09.209942 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d824082-45bb-42ae-937f-c8120c28cc64 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action" status: 409 len: 167 microversion: 2.1 time: 0.131016 Oct 26 05:04:09.210982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 488/955] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:04:09 2022] POST /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b/action => generated 167 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 26 05:04:09.226859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f02bbc4a-f73e-41fe-997d-f4da47686d74 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '.version_select at 0x7f470aa8eb80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:09.419562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:09.428616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-595f38aa-fe2b-42fc-81e8-d23ed389d7fc tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1313 microversion: 2.1 time: 0.387061 Oct 26 05:04:09.447228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 468/956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:09 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:09.510715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f02bbc4a-f73e-41fe-997d-f4da47686d74 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/images/74b4674f-f729-4c88-80af-a2f6429abf68" status: 204 len: 0 microversion: 2.1 time: 0.294875 Oct 26 05:04:09.511314 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 489/957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:09 2022] DELETE /compute/v2.1/images/74b4674f-f729-4c88-80af-a2f6429abf68 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:09.520591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:09.521589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:09.528693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.529726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.530922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.533192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.533880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.534484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.596637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:09.597257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:09.622285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.622784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.623220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:09.623927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:09.624383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:09.624828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:10.468939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:10.483195 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf60b810-84ac-4780-84c9-f573e8ee0400 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1532 microversion: 2.1 time: 0.967330 Oct 26 05:04:10.490223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 469/958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:09 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1532 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:10.506996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:10.507865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:10.516061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:10.518869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:10.519374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:10.520284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:10.521053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:10.521689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:10.522968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:10.533408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a27e28dd-029f-4ea7-9588-adf640697d34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.940931 Oct 26 05:04:10.541906 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 490/959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:09 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:10.849638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:10.860122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ace1018d-6cfb-4faa-b842-abdf11cdb067 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1463 microversion: 2.1 time: 0.368295 Oct 26 05:04:10.861508 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 470/960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:10 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1463 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:11.254670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Calling method '.version_select at 0x7f470a99f940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:11.273417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.273920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.274358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.318085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.319279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.320118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.349260 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aeb96ba5-3b84-4808-8fda-3c193383e278 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/d384488592ca416395088f0ade0ffa3c?start=2022-10-25T05%3A04%3A10.881598&end=2022-10-27T05%3A04%3A10.881598" status: 200 len: 694 microversion: 2.1 time: 0.463460 Oct 26 05:04:11.350409 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 491/961] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 26 05:04:10 2022] GET /compute/v2.1/os-simple-tenant-usage/d384488592ca416395088f0ade0ffa3c?start=2022-10-25T05%3A04%3A10.881598&end=2022-10-27T05%3A04%3A10.881598 => generated 694 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:11.365729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '.version_select at 0x7f470a768c10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:11.386307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.387084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.387841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.405223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.406110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.407254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.428356 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1227f59b-cf48-4f23-ac30-b4c3cbdb869e tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/d384488592ca416395088f0ade0ffa3c?start=2022-10-25T05%3A04%3A10.881598&end=2022-10-27T05%3A04%3A10.881598" status: 200 len: 694 microversion: 2.1 time: 0.065946 Oct 26 05:04:11.429301 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 471/962] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 26 05:04:11 2022] GET /compute/v2.1/os-simple-tenant-usage/d384488592ca416395088f0ade0ffa3c?start=2022-10-25T05%3A04%3A10.881598&end=2022-10-27T05%3A04%3A10.881598 => generated 694 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:11.444121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Calling method '.version_select at 0x7f470a9a2d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:11.457607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.458867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.459684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.483287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.484066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.486112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.508769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:11.509798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:11.526371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.527348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.529530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.530685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.533550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.534239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.570064 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b8a0e680-ba33-4b3f-913b-d7a59c41c280 tempest-TenantUsagesTestJSON-16329619 tempest-TenantUsagesTestJSON-16329619-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T05%3A04%3A10.881598&end=2022-10-27T05%3A04%3A10.881598&detailed=1" status: 200 len: 11053 microversion: 2.1 time: 0.129401 Oct 26 05:04:11.573200 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 492/963] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 26 05:04:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T05%3A04%3A10.881598&end=2022-10-27T05%3A04%3A10.881598&detailed=1 => generated 11053 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:04:11.579525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2d0a6036-6329-4e08-ba34-eba23a2515ee"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:11.591780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:11.598404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.599119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.599758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.600653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.601278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.601900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.656066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] HTTP exception thrown: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Request method failure captured: Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8/os-volume_attachments/66d85ba2-f1d1-47ba-8202-a1be70c986fd HTTP/1.1 Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 74 Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9Rm_os8HCrUwJ5ryf4O-EbiXUr_KvUVPbwkJOGl62IMCTNsr0dUtiu4R_iK586HJZnYb6vMFpc-HGYqBjn4QzB-s37YjAEX2j2UumNl4Mzd5BgfjMuEYvgb6Ex9KAEy-WzRIZ7MUMWuuu6GSmE_I9MndpeLxiiGTi-Z-cuCBopeC8 Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 11f6449b36094aeca41c0be9edc8f60d Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesAdminNegativeTest-1763658268 Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:04:11.659000 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11f6449b36094aeca41c0be9edc8f60d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesAdminNegativeTest-1763658268 Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 11f6449b36094aeca41c0be9edc8f60d Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1763658268 Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesAdminNegativeTest-1763658268-project-admin Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b004617dfdea456a8ef57aedea54048a Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesAdminNegativeTest-1763658268-project-admin Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: {"volumeAttachment": {"volumeId": "2d0a6036-6329-4e08-ba34-eba23a2515ee"}} Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:11.660739 n-d-862416-4 devstack@n-api.service[120586]: exception: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '7392b49d-3e77-42f8-8de8-a5be23766ad8', 'id': '66d85ba2-f1d1-47ba-8202-a1be70c986fd', 'body': {'volumeAttachment': {'volumeId': '2d0a6036-6329-4e08-ba34-eba23a2515ee'}}} Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:04:11.661807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. (HTTP 404) (Request-ID: req-0454bc86-ef2d-4196-9275-c41c0017eb4f) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:04:11.663411 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:11.664831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. Oct 26 05:04:11.666285 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:11.669358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] Returning 404 to user: Volume 66d85ba2-f1d1-47ba-8202-a1be70c986fd could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:11.669988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f9e8020-2b51-421a-9d82-8c79dc7a7831 tempest-VolumesAdminNegativeTest-1763658268 tempest-VolumesAdminNegativeTest-1763658268-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8/os-volume_attachments/66d85ba2-f1d1-47ba-8202-a1be70c986fd" status: 404 len: 109 microversion: 2.1 time: 0.094509 Oct 26 05:04:11.670867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 493/964] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Oct 26 05:04:11 2022] PUT /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8/os-volume_attachments/66d85ba2-f1d1-47ba-8202-a1be70c986fd => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:11.685774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:11.686510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:11.701862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.703326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.704877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.705088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:11.706469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:11.709222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:11.976061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:11.991650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:11.996699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f14839f5-10bd-4005-93be-ef3c0060b166 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1532 microversion: 2.1 time: 0.491940 Oct 26 05:04:12.001248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-994f2ec2-189f-4813-aa5b-862d2020a784 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.328553 Oct 26 05:04:12.015979 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 494/965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:11 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:12.017411 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 472/966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:11 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1532 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:12.030476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:12.031313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:12.042533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:12.044502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:12.045630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:12.048041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:12.049528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:12.050215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:12.090082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:04:12.270343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a031bed-f564-4d31-89bc-dd1f9bb7afe4 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "DELETE /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 204 len: 0 microversion: 2.1 time: 0.240801 Oct 26 05:04:12.274629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 495/967] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:12 2022] DELETE /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:12.285241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:12.286003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:12.298656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:12.306200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:12.306954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:12.309845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:12.310566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:12.314943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:12.635599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:12.646511 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-623ea157-6fcc-442e-b11c-2d338bcbbd2b tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1469 microversion: 2.1 time: 0.367548 Oct 26 05:04:12.647097 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 473/968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:12 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:13.028427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:13.029111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:13.029767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:13.031601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:13.042202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:13.044588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:13.046260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:13.049686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:13.050673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:13.052625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:13.053266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:13.053916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:13.054060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:13.054711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:13.058823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:13.067511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:13.436783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:13.453191 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae296153-2d3e-4cee-9dae-8582120cd910 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1475 microversion: 2.1 time: 0.428857 Oct 26 05:04:13.465335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 474/969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:13 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1475 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:13.465577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:13.472059 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62278baa-f3e6-4692-a226-b8546056f2ee tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1538 microversion: 2.1 time: 0.447592 Oct 26 05:04:13.476196 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 496/970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:13 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1538 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:13.674759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:13.676192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:13.691872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:13.692744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:13.695312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:13.698202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:13.698868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:13.700986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:13.761647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:14.330169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:14.346694 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b58b4c0-d20c-4470-ae13-3b3d598eaac3 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1469 microversion: 2.1 time: 0.676854 Oct 26 05:04:14.353801 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 475/971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:13 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1469 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:14.481233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:14.481936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:14.505110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:14.505750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:14.512841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:14.513362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:14.513809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:14.524255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:14.530288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:14.534213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:14.535462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:14.544576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:14.545030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:14.545808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:14.546263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:14.554387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:14.990404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:14.999556 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa1c3ad3-8349-4f9e-93a2-5e1b4f6b01cc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1538 microversion: 2.1 time: 0.499842 Oct 26 05:04:15.006570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:15.012828 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 476/972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:14 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1538 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:15.016617 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-699c2bcc-ef99-4b86-bd81-b552783a23ce tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1474 microversion: 2.1 time: 0.538927 Oct 26 05:04:15.018915 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 497/973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:14 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1474 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:15.386743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:15.387791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:15.421804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:15.422385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:15.422845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:15.423574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:15.424041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:15.424476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:15.651554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:15.660246 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f94fe5f5-6092-4d1c-aa97-085d105402c5 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1469 microversion: 2.1 time: 0.284931 Oct 26 05:04:15.660911 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 477/974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:15 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:16.035691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:16.036847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:16.044308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:16.045643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:16.055491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.055987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.056440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.061198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.062300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.063318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.063935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.064817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.065559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.067544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.068701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.072646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.560877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:16.564803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:16.574806 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77349bc7-7f01-4970-956d-5727d9d4704f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1533 microversion: 2.1 time: 0.544615 Oct 26 05:04:16.575995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 498/975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:16 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1533 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:16.581535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-bd75b07b-17aa-4d01-a244-bc7c0e058937 req-cc625576-a68c-44e2-93fc-0685c09d8aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bf65a6-e1be-4a40-a1cb-29cfe1bf944b", "name": "network-vif-plugged", "status": "completed", "tag": "65dc91e0-6c38-4960-a692-8fe7863e2e2f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:16.592564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bd75b07b-17aa-4d01-a244-bc7c0e058937 req-cc625576-a68c-44e2-93fc-0685c09d8aba service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.593048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bd75b07b-17aa-4d01-a244-bc7c0e058937 req-cc625576-a68c-44e2-93fc-0685c09d8aba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.593744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bd75b07b-17aa-4d01-a244-bc7c0e058937 req-cc625576-a68c-44e2-93fc-0685c09d8aba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.606715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-bd75b07b-17aa-4d01-a244-bc7c0e058937 req-cc625576-a68c-44e2-93fc-0685c09d8aba service nova] Creating event network-vif-plugged:65dc91e0-6c38-4960-a692-8fe7863e2e2f for instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b on n-h2-862416-4 Oct 26 05:04:16.614103 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-bd75b07b-17aa-4d01-a244-bc7c0e058937 req-cc625576-a68c-44e2-93fc-0685c09d8aba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036450 Oct 26 05:04:16.615376 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 499/976] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:16.649754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:16.651155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:16.657532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:16.670471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.671204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.671936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.673054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.673775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.674435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.678659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37b27fc0-375d-49f0-a599-998e61888f2d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1474 microversion: 2.1 time: 0.633391 Oct 26 05:04:16.681291 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 478/977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:16 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1474 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:16.704990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:16.705917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:16.740336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.740961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.741402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.742213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.742703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.743136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.758070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:04:16.909971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:16.923010 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0cd29fb-21e7-4fd7-8fd5-30552269dc48 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 204 len: 0 microversion: 2.1 time: 0.305305 Oct 26 05:04:16.924321 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 500/978] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:16 2022] DELETE /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:16.930853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce741305-6976-4914-ab02-3ef5c6f6c87c tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1427 microversion: 2.1 time: 0.245153 Oct 26 05:04:16.934627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 479/979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:16 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:16.936169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f26aeb70-f71b-4033-9d5c-09e8a04dcd8f req-d297c9e2-14f8-48ac-bb0b-53c024afa4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007c6b12-defc-4163-b440-e464c7601c48", "name": "network-vif-deleted", "tag": "1f313c7f-b1d3-41e8-ac33-bbf5e237dd8c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:16.952808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:16.958562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:16.963198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f26aeb70-f71b-4033-9d5c-09e8a04dcd8f req-d297c9e2-14f8-48ac-bb0b-53c024afa4d4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.963693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f26aeb70-f71b-4033-9d5c-09e8a04dcd8f req-d297c9e2-14f8-48ac-bb0b-53c024afa4d4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.964131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f26aeb70-f71b-4033-9d5c-09e8a04dcd8f req-d297c9e2-14f8-48ac-bb0b-53c024afa4d4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.973666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.980449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.989759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:16.990797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:16.992814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:16.997949 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f26aeb70-f71b-4033-9d5c-09e8a04dcd8f req-d297c9e2-14f8-48ac-bb0b-53c024afa4d4 service nova] Creating event network-vif-deleted:1f313c7f-b1d3-41e8-ac33-bbf5e237dd8c for instance 007c6b12-defc-4163-b440-e464c7601c48 on n-h2-862416-4 Oct 26 05:04:17.003365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.011282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f26aeb70-f71b-4033-9d5c-09e8a04dcd8f req-d297c9e2-14f8-48ac-bb0b-53c024afa4d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082530 Oct 26 05:04:17.019577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 501/980] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:17.265438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-530460282", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "a7d1b184-6b8a-4583-8168-a28912e8b985"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:17.322444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:17.334525 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc08bc8f-7ae5-4cae-8234-1ad4b5a6018b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1513 microversion: 2.1 time: 0.398587 Oct 26 05:04:17.335573 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 480/981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:16 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:17.370530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] validate_networks() for [('a7d1b184-6b8a-4583-8168-a28912e8b985', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:04:17.603915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:17.605215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:17.617492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:17.618422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:17.619067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.619946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:17.620613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:17.621196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.894490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:04:17.894922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:04:17.895404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:04:17.895819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:04:17.895958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:17.896240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:04:17.907952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:17.908704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:17.909374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.910336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:17.910981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:17.911434 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b4c5235-db72-45ad-840f-d1ff63ace3e0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1520 microversion: 2.1 time: 0.311558 Oct 26 05:04:17.911797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.913133 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 481/982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:17 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:17.918992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:17.919951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:17.927025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:17.927522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:17.929158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.929998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:17.931175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:17.931786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:17.945804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Getting quotas for project 3161351100b14f9680cf30081345ae8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:04:17.950948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Getting quotas for user 3fb943b45b774d9187356290ee4012e2 and project 3161351100b14f9680cf30081345ae8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:04:17.965791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:04:17.971823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:04:18.054128 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3521591-3955-4b13-b98f-5834b739d3c4 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022654 Oct 26 05:04:18.062851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 502/983] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:04:18.068363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:18.069113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:18.076901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.077761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.078969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.079875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.080638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.081232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.121562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:04:18.157882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:18.168186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1212c74-effc-40c3-a970-c6be0f897caf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1472 microversion: 2.1 time: 0.253953 Oct 26 05:04:18.169426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 482/984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:17 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:18.189845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:18.190903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:18.198447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.199281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.200002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.201266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.201963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.202496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.240392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.240888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.241347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.241822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lazy-loading 'fault' on Instance uuid 007c6b12-defc-4163-b440-e464c7601c48 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:18.269130 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2dc54b4d-a162-4e30-b21e-0745321499ef tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 204 len: 0 microversion: 2.1 time: 0.203033 Oct 26 05:04:18.272061 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 503/985] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:18 2022] DELETE /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:18.284564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-350a9272-85fb-42a8-b3ab-91b069f21b3e tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:18.285296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-350a9272-85fb-42a8-b3ab-91b069f21b3e tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:18.338721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:18.349161 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69512b06-29e5-4ce1-98a7-c80412c6b203 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1303 microversion: 2.1 time: 0.175925 Oct 26 05:04:18.349787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 483/986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:18 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:18.358820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:18.359437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:18.393667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.394173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.394612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.398195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.398668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.399053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.447934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-350a9272-85fb-42a8-b3ab-91b069f21b3e tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:18.456629 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-350a9272-85fb-42a8-b3ab-91b069f21b3e tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1224 microversion: 2.1 time: 0.183222 Oct 26 05:04:18.457816 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 504/987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:18 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1224 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:18.473471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:18.474198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:18.488188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.491968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.492533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.493451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.497340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.497907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.600345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:18.612248 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cba78571-b5f3-4f13-866a-906a9d5ebcec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1526 microversion: 2.1 time: 0.261398 Oct 26 05:04:18.628381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 484/988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:18 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1526 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:18.717468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:18.728406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8631070-27e5-49d8-9465-e295b5f8ccb8", "name": "network-vif-unplugged", "status": "completed", "tag": "fe726bee-c752-416b-a2c0-0b2b35895ff4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:18.730920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f72aa17e-3cb2-4586-b062-65aa38a5fc89 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1513 microversion: 2.1 time: 0.271975 Oct 26 05:04:18.731622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 505/989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:18 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:18.740317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:18.741045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:18.741676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:18.757159 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] Creating event network-vif-unplugged:fe726bee-c752-416b-a2c0-0b2b35895ff4 for instance a8631070-27e5-49d8-9465-e295b5f8ccb8 on n-h2-862416-4 Oct 26 05:04:18.763642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:04:18.772364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6b7699cc-e101-4d4c-bc78-204fcbc822bb req-4ef7a3c3-da2b-425a-9f6a-2888a2631d40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047309 Oct 26 05:04:18.773512 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 485/990] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:04:19.193786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:19.194403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:19.201763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.202506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.203357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.204321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.204945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.205565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.362765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:19.374022 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1cee0f56-470b-44c5-8015-9d51cf0c3765 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1472 microversion: 2.1 time: 0.184247 Oct 26 05:04:19.374632 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 506/991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:19 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:19.377496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:19.378730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:19.393885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.394376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.395000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.395701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.396304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.396883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.433968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.434698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.435289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.435916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lazy-loading 'fault' on Instance uuid 007c6b12-defc-4163-b440-e464c7601c48 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:19.482188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:19.483004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:19.483368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:19.490147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.491018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.491639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.492222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0fdf6a2e-a25e-432e-bc63-6239c728ac49 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1303 microversion: 2.1 time: 0.119839 Oct 26 05:04:19.492721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.493167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 486/992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:19 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:19.493551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.494127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.575327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:19.584206 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79c72404-ce3d-41d4-ac68-56d4904fcf56 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1276 microversion: 2.1 time: 0.107936 Oct 26 05:04:19.584787 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 507/993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:19 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:19.640255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:19.641260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:19.648925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.649700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.650144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.651029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.651495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.651925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.772578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:19.774139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:19.780449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.782109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.782925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.783843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:19.784469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:19.785103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:19.894936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:19.906145 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3aecb3d9-2ef4-4a59-8548-3d9923e6421f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1526 microversion: 2.1 time: 0.270970 Oct 26 05:04:19.907263 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 487/994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:19 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:20.281073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:20.291207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d66ff7c-7d7f-470d-a950-21a1780c28aa tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1513 microversion: 2.1 time: 0.538244 Oct 26 05:04:20.292618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 508/995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:19 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:20.418536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:20.420497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:20.435431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.436312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.437033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.438826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.440490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.441535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.517600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:20.519196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:20.546127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.564027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.564469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.565262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.565759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.566195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.641151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:20.643343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.644313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.645646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.646106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lazy-loading 'fault' on Instance uuid 007c6b12-defc-4163-b440-e464c7601c48 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:20.696115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:20.710539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89c9cc65-9cca-490d-af1a-64c61721e8d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1472 microversion: 2.1 time: 0.307911 Oct 26 05:04:20.729349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 488/996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:20 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:20.730387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:20.731394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:20.738920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.739789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.740391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.741374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.741987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.742596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.768733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:20.780111 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce606e6d-5ebc-4548-80e3-0b8c06d02f7f tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1303 microversion: 2.1 time: 0.268245 Oct 26 05:04:20.783518 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 509/997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:20 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1303 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:20.803696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-622c71f7-a537-410b-ac8e-75562e96f834 req-a8bdde6d-aba6-4fc5-bd4e-d914ed02e51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bf65a6-e1be-4a40-a1cb-29cfe1bf944b", "name": "network-vif-unplugged", "status": "completed", "tag": "65dc91e0-6c38-4960-a692-8fe7863e2e2f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:20.830063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-622c71f7-a537-410b-ac8e-75562e96f834 req-a8bdde6d-aba6-4fc5-bd4e-d914ed02e51f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.830559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-622c71f7-a537-410b-ac8e-75562e96f834 req-a8bdde6d-aba6-4fc5-bd4e-d914ed02e51f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.831002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-622c71f7-a537-410b-ac8e-75562e96f834 req-a8bdde6d-aba6-4fc5-bd4e-d914ed02e51f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.839564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:20.850450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80aea921-ab1d-4eee-b971-1be1dabc271d tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1282 microversion: 2.1 time: 0.126712 Oct 26 05:04:20.850941 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 489/998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:20 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:20.861619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-622c71f7-a537-410b-ac8e-75562e96f834 req-a8bdde6d-aba6-4fc5-bd4e-d914ed02e51f service nova] Creating event network-vif-unplugged:65dc91e0-6c38-4960-a692-8fe7863e2e2f for instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b on n-h2-862416-4 Oct 26 05:04:20.867609 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-622c71f7-a537-410b-ac8e-75562e96f834 req-a8bdde6d-aba6-4fc5-bd4e-d914ed02e51f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067710 Oct 26 05:04:20.868717 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 510/999] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:04:20.933885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:20.936232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:20.945840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.946265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.947034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:20.947753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:20.948214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:20.948830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.107711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:21.116795 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d2418b68-536b-4b51-af92-d788ed57bb58 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1526 microversion: 2.1 time: 0.189732 Oct 26 05:04:21.116916 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 490/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:20 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:21.316839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:21.318694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:21.332813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.333341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.333810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.334540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.335008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.335437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.660355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:21.670925 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-655a17c6-baf9-4544-8076-87cc9664560d tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1513 microversion: 2.1 time: 0.360142 Oct 26 05:04:21.678190 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 511/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:21 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:21.747304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:21.747924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:21.757651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:21.764538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.765304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.766252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.769788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.770326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.770776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.806442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:21.807059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:21.822605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.823121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.823587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.824363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.824856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.828083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.902260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:21.906016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:21.907497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:21.907995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lazy-loading 'fault' on Instance uuid 007c6b12-defc-4163-b440-e464c7601c48 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:22.011619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322c1719106e43b186d41751779b6072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd384488592ca416395088f0ade0ffa3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:22.019667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-092e982d-95b0-4d3f-82ea-cb5d4d88a6f7 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 200 len: 1303 microversion: 2.1 time: 0.216974 Oct 26 05:04:22.020256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 512/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:21 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 1303 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:22.041785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:22.042664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:22.073297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:22.075524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:22.078859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:22.082874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:22.083626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:22.084326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:22.596596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:22.599424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:22.613806 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23ddd394-bc00-48d6-a0a5-64d9877762aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1472 microversion: 2.1 time: 0.871784 Oct 26 05:04:22.623212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 491/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:21 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1472 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:22.639854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:22.640995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:22.651782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:22.652642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:22.653602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:22.655701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:22.659426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:22.661114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:22.764976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:22.778367 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08f6643c-f8b7-4baf-a74f-4bba671c0407 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.751819 Oct 26 05:04:22.779228 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 513/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:22 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:22.791296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:22.794020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:22.807449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:22.808236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:22.813412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:22.815086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:22.815862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:22.829741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.086893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:23.100403 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f0e2972-df9f-4587-affb-e32995196abf tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1526 microversion: 2.1 time: 0.474236 Oct 26 05:04:23.102516 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 492/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:22 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1526 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:23.119534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:23.121237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] [instance: 007c6b12-defc-4163-b440-e464c7601c48] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:23.136152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:23.139038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:23.141650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.143040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:23.144734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:23.146593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.182269 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] HTTP exception thrown: Instance 007c6b12-defc-4163-b440-e464c7601c48 could not be found. Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Request method failure captured: Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 HTTP/1.1 Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-y9Y7LidULzdpc3KLR7CQrI4SAqUECRO5oieihfNyiqihoU7jhXw4ulHfnkuWpCcy_qG9FbOzLchoRQEuZUc-lD2L_SfU5Q-GesnfmMIkZTBRrOLvOKNF7jDNMGRyobVIC2sxb2oQMLV6L7pFPWzewqwNUn42IWloDL_Pvl6gBQrY Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: d384488592ca416395088f0ade0ffa3c Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TenantUsagesTestJSON-879305441 Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:23.189098 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d384488592ca416395088f0ade0ffa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d384488592ca416395088f0ade0ffa3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d384488592ca416395088f0ade0ffa3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d384488592ca416395088f0ade0ffa3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TenantUsagesTestJSON-879305441 Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: d384488592ca416395088f0ade0ffa3c Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TenantUsagesTestJSON-879305441 Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TenantUsagesTestJSON-879305441-project Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 322c1719106e43b186d41751779b6072 Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TenantUsagesTestJSON-879305441-project Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 007c6b12-defc-4163-b440-e464c7601c48 could not be found. Oct 26 05:04:23.191386 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '007c6b12-defc-4163-b440-e464c7601c48'} Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 007c6b12-defc-4163-b440-e464c7601c48 could not be found. Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:23.192363 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 007c6b12-defc-4163-b440-e464c7601c48 could not be found. Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 007c6b12-defc-4163-b440-e464c7601c48 could not be found. Oct 26 05:04:23.194866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:23.197569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] Returning 404 to user: Instance 007c6b12-defc-4163-b440-e464c7601c48 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:23.199679 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b1be830-dced-4ded-bd06-2bfd75077574 tempest-TenantUsagesTestJSON-879305441 tempest-TenantUsagesTestJSON-879305441-project] 10.222.0.16 "GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48" status: 404 len: 111 microversion: 2.1 time: 0.094979 Oct 26 05:04:23.201490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 493/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:23 2022] GET /compute/v2.1/servers/007c6b12-defc-4163-b440-e464c7601c48 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:23.221246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:23.230301 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e289ba2-fc89-4409-9418-c59aadcd9af7 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1513 microversion: 2.1 time: 0.447726 Oct 26 05:04:23.231605 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 514/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:22 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:23.657374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:23.661663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:23.683947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:23.684547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:23.685013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.690053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:23.723294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:23.724172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.759730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:23.760512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:23.780759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:23.782046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:23.782672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.785922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:23.786979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:23.789468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:23.851440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:23.865602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:04:24.065132 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-240b1858-f2ad-4ee4-82a9-6684ff83bbcb tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 204 len: 0 microversion: 2.1 time: 0.309862 Oct 26 05:04:24.066937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 515/1008] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:23 2022] DELETE /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:24.075231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:24.083880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:24.102016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.103947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.104490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.106452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.115496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.116502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.321000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:24.340556 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67727724-955a-4906-ae33-c79958cf35aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1469 microversion: 2.1 time: 0.705711 Oct 26 05:04:24.370215 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 494/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:23 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1469 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:24.376543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3180401d-1b6e-40f2-9b00-117ba7b81a31 req-5ce5ef8a-b8c4-41b6-a422-9a186de37dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25", "tag": "19fc3792-1dd9-455c-b9df-c064851bf4d8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:24.387329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3180401d-1b6e-40f2-9b00-117ba7b81a31 req-5ce5ef8a-b8c4-41b6-a422-9a186de37dca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.388043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3180401d-1b6e-40f2-9b00-117ba7b81a31 req-5ce5ef8a-b8c4-41b6-a422-9a186de37dca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.388653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3180401d-1b6e-40f2-9b00-117ba7b81a31 req-5ce5ef8a-b8c4-41b6-a422-9a186de37dca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.409744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3180401d-1b6e-40f2-9b00-117ba7b81a31 req-5ce5ef8a-b8c4-41b6-a422-9a186de37dca service nova] Creating event network-changed:19fc3792-1dd9-455c-b9df-c064851bf4d8 for instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 on n-h1-862416-4 Oct 26 05:04:24.415232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3180401d-1b6e-40f2-9b00-117ba7b81a31 req-5ce5ef8a-b8c4-41b6-a422-9a186de37dca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043301 Oct 26 05:04:24.416576 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 495/1010] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:24.423947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:24.425070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:24.456570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.463376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.464098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.465171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.465845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.466505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.547606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:24.562518 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51ecd162-8f5e-47d2-b20e-2dedb124d196 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.491215 Oct 26 05:04:24.565564 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 516/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:24 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:24.576692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:24.580361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:24.592575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.595015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.595673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.598519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.599034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.599479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.898608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:24.907448 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f28c559-4264-44e0-8df7-21eeaf20b344 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1712 microversion: 2.1 time: 0.489575 Oct 26 05:04:24.913834 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 496/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:24 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1712 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:24.926915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:24.927740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:24.940474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.940990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.941493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.942221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.942849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.943444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.982327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:24.982823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:24.983271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:24.983731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lazy-loading 'fault' on Instance uuid 7392b49d-3e77-42f8-8de8-a5be23766ad8 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:25.018678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:25.039888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aba99de3-2867-400f-93d3-5a6f2ec98162 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 200 len: 1526 microversion: 2.1 time: 0.471364 Oct 26 05:04:25.041577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 517/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:24 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 1526 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:25.044034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:25.053251 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48fe3139-7e8d-410c-a2b0-ea9b0328f55f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 200 len: 1307 microversion: 2.1 time: 0.138348 Oct 26 05:04:25.053396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:25.053972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:25.060004 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 497/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:24 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:25.071417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.071851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.072299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.073030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.073537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.073972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.235033 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dcabbff2-871c-4624-b189-47c37ea82675 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8/action" status: 204 len: 0 microversion: 2.1 time: 0.188978 Oct 26 05:04:25.247260 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 518/1015] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:04:25 2022] POST /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:25.256001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:25.256615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:25.268969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.269541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.269986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.270707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.278228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.278975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.592653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:25.594327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:25.615732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.620381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.623395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.632172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.634222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.635034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.822281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:25.832308 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a07047f1-d3a9-4e2d-9791-f4fce859f58f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1469 microversion: 2.1 time: 0.580038 Oct 26 05:04:25.832900 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 498/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:25 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1469 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:25.942172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:25.942797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:25.955134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.955637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.956078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:25.956790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:25.961046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:25.961731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.225012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:26.233785 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aac5082d-1c72-4665-944f-beee3c07a5da tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.647061 Oct 26 05:04:26.234526 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 519/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:25 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:26.241386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8631070-27e5-49d8-9465-e295b5f8ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "fe726bee-c752-416b-a2c0-0b2b35895ff4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:26.274518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.275140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.275422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.294518 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] Creating event network-vif-plugged:fe726bee-c752-416b-a2c0-0b2b35895ff4 for instance a8631070-27e5-49d8-9465-e295b5f8ccb8 on n-h2-862416-4 Oct 26 05:04:26.301589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:04:26.312921 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-28c7320d-d371-4961-8490-9a8f43270131 req-e9cb1413-1b34-478a-a3db-938bbed0c831 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076020 Oct 26 05:04:26.319691 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 520/1018] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:26.330329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:26.331479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:26.332386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:26.342701 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d92c9569-6985-470a-891d-8958df19da18 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1712 microversion: 2.1 time: 0.406088 Oct 26 05:04:26.350390 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 499/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:25 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1712 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:26.364916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.365294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:26.366005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.366473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.366600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 7392b49d-3e77-42f8-8de8-a5be23766ad8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:26.369851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.372145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.373268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.373706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.373983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.374526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.375453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.376015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.381915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.403853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] HTTP exception thrown: Instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 could not be found. Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Request method failure captured: Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 HTTP/1.1 Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL84Qrdjb1AuOBQXZ3YPcAy4rZibKOWIUiNVacmZrnb-cS1Ly91Abt77ugL04PxwESGvkwJFaq_Yd3YblrHbh-xttdcE-_wYx2StJCzuPPJ_f2Xf7ZopK5kAg2wco8hcegX9S-RWX_4yyUD0ZfseZ-OmPYZ2_wBTHj8IEZSIZUS7kpI Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bc3201d6ec664f51a56170294f242a6c Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesAdminNegativeTest-1142525342 Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:26.406014 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesAdminNegativeTest-1142525342 Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bc3201d6ec664f51a56170294f242a6c Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1142525342 Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesAdminNegativeTest-1142525342-project Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dd5ce89745564263bab98d4227858c97 Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesAdminNegativeTest-1142525342-project Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 could not be found. Oct 26 05:04:26.408250 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7392b49d-3e77-42f8-8de8-a5be23766ad8'} Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 could not be found. Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:26.409188 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 could not be found. Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 could not be found. Oct 26 05:04:26.410811 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.412697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Returning 404 to user: Instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:26.412697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7d2991dc-0ea9-4ca1-9d03-b506eef20cb9 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8" status: 404 len: 111 microversion: 2.1 time: 0.056706 Oct 26 05:04:26.412697 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 500/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:26 2022] GET /compute/v2.1/servers/7392b49d-3e77-42f8-8de8-a5be23766ad8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:26.420397 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b HTTP/1.1 Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:26.422593 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:04:26.424463 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b'} Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:26.425479 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:04:26.426960 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:26.434546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:26.435810 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ace7480a-e832-4904-bbb5-dedf109c2cf0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 404 len: 111 microversion: 2.1 time: 0.114147 Oct 26 05:04:26.444375 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 521/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:26 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:26.447977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7392b49d-3e77-42f8-8de8-a5be23766ad8", "name": "network-vif-deleted", "tag": "73da0280-5872-4070-9b28-46bdf2e2d6c6"}, {"server_uuid": "75bf65a6-e1be-4a40-a1cb-29cfe1bf944b", "name": "network-vif-deleted", "tag": "65dc91e0-6c38-4960-a692-8fe7863e2e2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:26.450713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4ff23eb0-2e70-469e-b867-a16cbf9c8236 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'create', calling method: .version_select at 0x7f470a87bf70>, body: {"keypair": {"name": "tempest-keypair-1618198833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDHVAtWF3woAkLeCMQZ3ReoodVtLsxjB+McpNwYjh1Iq94TFpVvozg+4zSRPXpoDxYXLEDpn+J1ybKH92pBkMq6ZQEzGqqxjaZsCXDpo8Ke3ww1evY9y8zDSLecVy2rvw=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:26.472591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.473722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.474337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.493948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-4ff23eb0-2e70-469e-b867-a16cbf9c8236 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for project 05ec452e1add45cdb311971b90e34200. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:04:26.500816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-4ff23eb0-2e70-469e-b867-a16cbf9c8236 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for user c496b6a683e147f8b41e82b2921454d6 and project 05ec452e1add45cdb311971b90e34200. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:04:26.525566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] Creating event network-vif-deleted:73da0280-5872-4070-9b28-46bdf2e2d6c6 for instance 7392b49d-3e77-42f8-8de8-a5be23766ad8 on n-h2-862416-4 Oct 26 05:04:26.527623 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] Creating event network-vif-deleted:65dc91e0-6c38-4960-a692-8fe7863e2e2f for instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b on n-h2-862416-4 Oct 26 05:04:26.535943 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4ff23eb0-2e70-469e-b867-a16cbf9c8236 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089767 Oct 26 05:04:26.539868 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 522/1022] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:04:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:26.546624 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9421967b-181b-4f24-a5f2-c9a4b5b8410e req-2ee8e798-afc7-4cd0-b6e0-a40c8a51f961 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107086 Oct 26 05:04:26.555754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 501/1023] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:26.869353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:26.870118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:26.891792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.900444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.901425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:26.904124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:26.904954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:26.907202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:27.160049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1250320049", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "92d513bb-c446-48d6-b8f5-d149382fd9ca"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:27.269913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] validate_networks() for [('92d513bb-c446-48d6-b8f5-d149382fd9ca', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:04:27.589428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:27.603552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf0bceaa-17c5-4ce2-a5ba-0f38cc7d3b49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1469 microversion: 2.1 time: 0.744724 Oct 26 05:04:27.604384 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 502/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:26 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1469 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:27.617305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:27.620665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:27.636472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:27.636978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:27.637449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:27.642379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:27.643229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:27.643893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:27.922545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:28.103434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:28.136603 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b219276-cbc0-4a3f-afd4-66c0b4f444ce tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 2346 microversion: 2.25 time: 0.530189 Oct 26 05:04:28.139682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 503/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:04:27 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 2346 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:04:28.147982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:28.148893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:28.155582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.156848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.157618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.158551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.173413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.174338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.410879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:04:28.411668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:04:28.412159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:04:28.412876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:04:28.413795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:04:28.452477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.464358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.465680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.469389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.471723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.475053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.539693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:04:28.555676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for user 6390eed87d6a41df96e727227de791bb and project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:04:28.593395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:04:28.602380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:04:28.616233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:28.630417 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81fc0ef6-dae7-40d5-9938-f2315f88c6ba tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.489465 Oct 26 05:04:28.631550 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 504/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:28 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:28.638679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:28.639518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:28.662959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.667041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.668932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.671576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.672703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.673803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.763871 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46d94123-7c71-4565-8b75-4ba995e0c93d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.942631 Oct 26 05:04:28.770629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 523/1027] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:04:28.804747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:28.824883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.827869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.828671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.833786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:28.834570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:28.837631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:28.919898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43735d2f58ca41b699f15ffc645aba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d91a2576da84ef6984dae45db8b8543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:28.934358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9083b102-dae1-441e-954a-d0a231416291 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 200 len: 1349 microversion: 2.1 time: 0.301248 Oct 26 05:04:28.936303 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 505/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:28 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 1349 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:28.956629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:28.957274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:28.960251 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3de6ba74-6179-4171-b430-82a21aba6864 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.188140 Oct 26 05:04:28.974884 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 524/1029] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 26 05:04:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:04:28.986579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-fbc22c23-2333-4254-a192-0a6c857c80e8 req-c51e40e2-a58f-4b87-8d4c-cd7108f61b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad81e86-6a28-45c7-a375-7bfb5be32303", "name": "network-vif-deleted", "tag": "f55b1e9a-447f-4ad1-a8b6-680bd05742d7"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:29.014734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fbc22c23-2333-4254-a192-0a6c857c80e8 req-c51e40e2-a58f-4b87-8d4c-cd7108f61b1e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.018791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.019356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.019829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:29.020612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.021064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.025660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fbc22c23-2333-4254-a192-0a6c857c80e8 req-c51e40e2-a58f-4b87-8d4c-cd7108f61b1e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.026220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fbc22c23-2333-4254-a192-0a6c857c80e8 req-c51e40e2-a58f-4b87-8d4c-cd7108f61b1e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:29.031539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:29.067099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-fbc22c23-2333-4254-a192-0a6c857c80e8 req-c51e40e2-a58f-4b87-8d4c-cd7108f61b1e service nova] Creating event network-vif-deleted:f55b1e9a-447f-4ad1-a8b6-680bd05742d7 for instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 on n-h1-862416-4 Oct 26 05:04:29.081201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-fbc22c23-2333-4254-a192-0a6c857c80e8 req-c51e40e2-a58f-4b87-8d4c-cd7108f61b1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104402 Oct 26 05:04:29.087846 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 525/1030] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:29.114933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4576d4a7-d05e-405a-a2b7-7c9910c267a1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:29.115977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4576d4a7-d05e-405a-a2b7-7c9910c267a1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:29.554962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4576d4a7-d05e-405a-a2b7-7c9910c267a1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:29.563242 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4576d4a7-d05e-405a-a2b7-7c9910c267a1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1208 microversion: 2.1 time: 0.472786 Oct 26 05:04:29.601117 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 526/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:29 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1208 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:29.656558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:29.657184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:29.671078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.679392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.679881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:29.680636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.689956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.693927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:29.740729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:29.748790 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34003652-48d7-4ff1-a0f6-b4f55a6f386e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1461 microversion: 2.1 time: 0.811413 Oct 26 05:04:29.752907 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 506/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:28 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1461 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:29.778104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:29.779953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:29.794114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.802183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.803905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:29.807972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:29.810650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:29.814181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.355927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:30.372996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0425c5ac-f413-41cf-8c86-27b475d4d739 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.720539 Oct 26 05:04:30.394985 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 527/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:29 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:30.428903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:30.431105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:30.459746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.462207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.462753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.463578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.466364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.470252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.522428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:30.531964 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a304dc7-98a4-4dd8-8681-11e043e4e044 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1461 microversion: 2.1 time: 0.758268 Oct 26 05:04:30.536905 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 507/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:29 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1461 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:30.539634 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 HTTP/1.1 Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:30.549663 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:30.551523 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9ad81e86-6a28-45c7-a375-7bfb5be32303'} Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:30.552503 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:30.554068 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.555885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:30.555885 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1690c29a-c385-48fb-b1a9-8c06fc5d00a7 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 404 len: 111 microversion: 2.1 time: 0.151711 Oct 26 05:04:30.561727 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 528/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:30 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:30.571419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:30.571966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:30.575429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b675dfa1-1918-44c6-98e2-d23d914ecc34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'create', calling method: .version_select at 0x7f470aa76c10>, body: {"keypair": {"name": "tempest-keypair-1876014347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS/mBKOKJXoDa7w4nfAwRSsYCOn80mwYNP5MbDomoJN18ZclBQiPxtvaBV6sRVkB12cGA8cJM2c2fvU8zMrIwUlpqw6AgaOn+q9IekCjJNncOtZE+MLM3G8cODRvly24w=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:30.589951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.590462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.590910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.591629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.602597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.603085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.649670 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:30.651115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b675dfa1-1918-44c6-98e2-d23d914ecc34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d HTTP/1.1 Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:30.657373 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:30.659173 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7433cab3-8fe8-4104-8a57-52413f45846d'} Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:30.660114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:30.661702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:30.664620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:30.667764 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cd4bce9-c361-4ade-947b-3d980ca37212 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 404 len: 111 microversion: 2.1 time: 0.108263 Oct 26 05:04:30.668341 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 508/1036] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:30 2022] DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:30.685048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:30.685709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:30.689065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b675dfa1-1918-44c6-98e2-d23d914ecc34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for user 5e48790bfe71452288c91f49586a624e and project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:04:30.731371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.731947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.732407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.733260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.733754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.734743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.794538 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b675dfa1-1918-44c6-98e2-d23d914ecc34 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226863 Oct 26 05:04:30.796258 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 529/1037] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:04:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:30.812780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:30.817725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:30.863988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.866144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.867172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:30.868708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:30.874770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:30.897432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:31.013841 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d HTTP/1.1 Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:31.040185 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:31.041803 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7433cab3-8fe8-4104-8a57-52413f45846d'} Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:31.042660 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:31.043935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.047265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:31.055887 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3608a51b-c358-4c02-a291-9c9f80140414 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 404 len: 111 microversion: 2.1 time: 0.246237 Oct 26 05:04:31.081951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 530/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:30 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:31.085432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:31.144938 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3f34862-6a48-4b84-a18c-5fd9d2f88ca0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1204 microversion: 2.1 time: 0.438530 Oct 26 05:04:31.166425 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 509/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:30 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1204 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:31.186770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-797c5da2-6dae-479b-8d2f-c12546e2dfae tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '.version_select at 0x7f470a722dc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:31.257601 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-797c5da2-6dae-479b-8d2f-c12546e2dfae tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483760941" status: 202 len: 0 microversion: 2.1 time: 0.089753 Oct 26 05:04:31.261354 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 510/1040] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483760941 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:31.402906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:31.403968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:31.421433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:31.426008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:31.427339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:31.431110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:31.433152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:31.435465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:31.489987 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c27e413-9afb-456b-a195-7f528c84721c tempest-TenantUsagesNegativeTestJSON-2029474480 tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-25T05%3A04%3A30.762944&end=2022-10-27T05%3A04%3A30.762944" status: 404 len: 112 microversion: - time: 0.406588 Oct 26 05:04:31.498204 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 531/1041] 10.222.0.16 () {58 vars in 1316 bytes} [Wed Oct 26 05:04:31 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-25T05%3A04%3A30.762944&end=2022-10-27T05%3A04%3A30.762944 => generated 112 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 05:04:31.510070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d8cb7b5-9ab7-4126-86ff-85ad199ca70b tempest-TenantUsagesNegativeTestJSON-2029474480 tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin] Calling method '.version_select at 0x7f470c72c700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:31.514783 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0d8cb7b5-9ab7-4126-86ff-85ad199ca70b tempest-TenantUsagesNegativeTestJSON-2029474480 tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d8cb7b5-9ab7-4126-86ff-85ad199ca70b tempest-TenantUsagesNegativeTestJSON-2029474480 tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin] Request method failure captured: Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-simple-tenant-usage/b42beddcd4e9495ca435ba4327c9059f?start=2022-10-27T05%3A04%3A30.762944&end=2022-10-25T05%3A04%3A30.762944 HTTP/1.1 Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_e_tZIxK5A_hkp-Is8ji158UxjNrtUmCK49YoL4gc_J86VW4i6SouF-UVG0PnYWhs9D-i-bZnEaNKS3CuJ__Evq-4EGF6TMkpowDIUdp3RidHW8OA1YFrbnGe5_lGBanZThCMEPZViotNiNGmZXA1yL40Fm-MpiG_XqbJHfDORVDY Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3668ba167bf747e78086dae85fbc3eeb Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2029474480 Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:04:31.520140 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3668ba167bf747e78086dae85fbc3eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3668ba167bf747e78086dae85fbc3eeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3668ba167bf747e78086dae85fbc3eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3668ba167bf747e78086dae85fbc3eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2029474480 Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3668ba167bf747e78086dae85fbc3eeb Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2029474480 Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e56313c352f94666903189e9403472f3 Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid start time. The start time cannot occur after the end time. Oct 26 05:04:31.521745 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'b42beddcd4e9495ca435ba4327c9059f'} Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 05:04:31.522585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 26 05:04:31.523921 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.532254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d8cb7b5-9ab7-4126-86ff-85ad199ca70b tempest-TenantUsagesNegativeTestJSON-2029474480 tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:31.534598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d8cb7b5-9ab7-4126-86ff-85ad199ca70b tempest-TenantUsagesNegativeTestJSON-2029474480 tempest-TenantUsagesNegativeTestJSON-2029474480-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/b42beddcd4e9495ca435ba4327c9059f?start=2022-10-27T05%3A04%3A30.762944&end=2022-10-25T05%3A04%3A30.762944" status: 400 len: 111 microversion: 2.1 time: 0.034749 Oct 26 05:04:31.544593 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 532/1042] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 26 05:04:31 2022] GET /compute/v2.1/os-simple-tenant-usage/b42beddcd4e9495ca435ba4327c9059f?start=2022-10-27T05%3A04%3A30.762944&end=2022-10-25T05%3A04%3A30.762944 => generated 111 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:04:31.809378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7e1e4d64-3452-4a9d-af0d-c2fa7c6b48c1 tempest-TenantUsagesNegativeTestJSON-1145569914 tempest-TenantUsagesNegativeTestJSON-1145569914-project] Calling method '.version_select at 0x7f470aa8eb80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:31.837060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7e1e4d64-3452-4a9d-af0d-c2fa7c6b48c1 tempest-TenantUsagesNegativeTestJSON-1145569914 tempest-TenantUsagesNegativeTestJSON-1145569914-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'dae69049ed304430910f5b658d78a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42beddcd4e9495ca435ba4327c9059f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7e1e4d64-3452-4a9d-af0d-c2fa7c6b48c1 tempest-TenantUsagesNegativeTestJSON-1145569914 tempest-TenantUsagesNegativeTestJSON-1145569914-project] Request method failure captured: Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T05%3A04%3A30.762944&end=2022-10-27T05%3A04%3A30.762944&detailed=1 HTTP/1.1 Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_c5Nm54QMJ7XDXY6z2b_L9IDy0aLtp1dGfw-_fh2ymadcKjkYzpGc_ip2ZycKyeLEm0z-hz3waM98RT4Cl2dudiTLQpB_-TNlUzJXBCMh5pipO2qRhQDvBex0vOtqSFNp6DcC0AiKDkhePYJjk_TJyp_oUKued1lmUc30ChuZue0g Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b42beddcd4e9495ca435ba4327c9059f Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1145569914 Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:31.852546 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42beddcd4e9495ca435ba4327c9059f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42beddcd4e9495ca435ba4327c9059f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42beddcd4e9495ca435ba4327c9059f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42beddcd4e9495ca435ba4327c9059f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1145569914 Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b42beddcd4e9495ca435ba4327c9059f Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1145569914 Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TenantUsagesNegativeTestJSON-1145569914-project Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dae69049ed304430910f5b658d78a30d Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1145569914-project Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:04:31.854179 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:04:31.855081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:04:31.856284 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:04:31.857559 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 26 05:04:31.857559 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:31.857559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7e1e4d64-3452-4a9d-af0d-c2fa7c6b48c1 tempest-TenantUsagesNegativeTestJSON-1145569914 tempest-TenantUsagesNegativeTestJSON-1145569914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:31.857559 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7e1e4d64-3452-4a9d-af0d-c2fa7c6b48c1 tempest-TenantUsagesNegativeTestJSON-1145569914 tempest-TenantUsagesNegativeTestJSON-1145569914-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T05%3A04%3A30.762944&end=2022-10-27T05%3A04%3A30.762944&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.308481 Oct 26 05:04:31.862099 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 533/1043] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 26 05:04:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-25T05%3A04%3A30.762944&end=2022-10-27T05%3A04%3A30.762944&detailed=1 => generated 123 bytes in 316 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:32.175632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:32.179602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:32.231630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:32.233748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:32.242447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:32.246441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:32.248715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:32.249172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:32.916332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:32.933525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1897f719-b249-4132-b4a3-fe49c9766615 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1266 microversion: 2.1 time: 0.767287 Oct 26 05:04:32.934599 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 534/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:32 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1266 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:32.940249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b69d797a-3781-4607-9c64-a06fdad1a320", "device": "/dev/xvdb"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:32.945895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:32.954394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:32.962209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:32.962683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:32.965872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:32.966817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:32.967484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:32.972192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:32.975962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-819d208a-893a-4220-b59c-433af8b1c72c tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 1.577034 Oct 26 05:04:32.980555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 511/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:31 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:32.994126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ef30b3de-03da-48f3-bcdc-b0a5120ac1df req-d3fa0158-5b77-42ff-88af-1058e33084c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25", "name": "network-vif-plugged", "status": "completed", "tag": "19fc3792-1dd9-455c-b9df-c064851bf4d8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:33.023098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef30b3de-03da-48f3-bcdc-b0a5120ac1df req-d3fa0158-5b77-42ff-88af-1058e33084c8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:33.023756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef30b3de-03da-48f3-bcdc-b0a5120ac1df req-d3fa0158-5b77-42ff-88af-1058e33084c8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:33.026424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef30b3de-03da-48f3-bcdc-b0a5120ac1df req-d3fa0158-5b77-42ff-88af-1058e33084c8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:33.075428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:33.083883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ef30b3de-03da-48f3-bcdc-b0a5120ac1df req-d3fa0158-5b77-42ff-88af-1058e33084c8 service nova] Creating event network-vif-plugged:19fc3792-1dd9-455c-b9df-c064851bf4d8 for instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 on n-h1-862416-4 Oct 26 05:04:33.098285 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ef30b3de-03da-48f3-bcdc-b0a5120ac1df req-d3fa0158-5b77-42ff-88af-1058e33084c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115233 Oct 26 05:04:33.101119 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 512/1046] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:33.466692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e07127f-f586-4414-a14e-3aeebbf3e4d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "POST /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.530587 Oct 26 05:04:33.469731 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 535/1047] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 26 05:04:32 2022] POST /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:04:33.961378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:33.962251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:33.978270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:33.978912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:33.979455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:33.980257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:33.980948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:33.981618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.012056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.013363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.027353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.028251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.028913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.034608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.035425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.036088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.106915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:34.115027 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f134f84-1076-4b05-a407-654027a467d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1266 microversion: 2.1 time: 0.158437 Oct 26 05:04:34.136957 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 513/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:33 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:34.143707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a88faa72-028e-4209-87ec-a3c8d2bc2b73 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.156925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:34.165654 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a88faa72-028e-4209-87ec-a3c8d2bc2b73 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/708446982" status: 202 len: 0 microversion: 2.1 time: 0.027171 Oct 26 05:04:34.166828 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 514/1049] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:04:34 2022] DELETE /compute/v2.1/flavors/708446982 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:34.176492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ea2b26f-1087-41ad-8ce3-6d22993d0fe7 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.213001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ea2b26f-1087-41ad-8ce3-6d22993d0fe7 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.041301 Oct 26 05:04:34.214369 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 515/1050] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:04:34 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:34.241649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6544213-3366-4ea6-a9be-530abda73858 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.264187 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6544213-3366-4ea6-a9be-530abda73858 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1728521196" status: 202 len: 0 microversion: 2.1 time: 0.030064 Oct 26 05:04:34.266307 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 516/1051] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:04:34 2022] DELETE /compute/v2.1/flavors/1728521196 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:34.275863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8609f894-f9b6-49dd-9b2c-f7eca18d15a5 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.334148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:34.335201 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8609f894-f9b6-49dd-9b2c-f7eca18d15a5 tempest-ServersWithSpecificFlavorTestJSON-918368888 tempest-ServersWithSpecificFlavorTestJSON-918368888-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064627 Oct 26 05:04:34.335841 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 517/1052] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:04:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:34.367071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.367726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.371778 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-198b0795-abe0-440a-939b-80faa7d4c8bf tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.365366 Oct 26 05:04:34.372938 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 536/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:34 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:34.383720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.384459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.385058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.385956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.386559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.387172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.415770 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 HTTP/1.1 Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:34.429871 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.431296 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '9ad81e86-6a28-45c7-a375-7bfb5be32303'} Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:34.432055 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.433356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.434609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.434886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.436240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:34.437410 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2f87a4a-b65c-4794-ab56-9b2a6ee0879b tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 404 len: 111 microversion: 2.1 time: 0.073947 Oct 26 05:04:34.438587 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 518/1054] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:34 2022] DELETE /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:04:34.446676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.450034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 9ad81e86-6a28-45c7-a375-7bfb5be32303] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.454949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.455763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.456554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.458538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.459301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.474630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.475134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.475584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.475853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.476305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.476769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.477199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.498525 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 HTTP/1.1 Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:34.500156 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.501547 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '9ad81e86-6a28-45c7-a375-7bfb5be32303'} Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:34.502311 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. Oct 26 05:04:34.503545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.504684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 9ad81e86-6a28-45c7-a375-7bfb5be32303 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:34.504684 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8dcccd5-8c78-4138-a5f4-c4b2321fb432 tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303" status: 404 len: 111 microversion: 2.1 time: 0.058892 Oct 26 05:04:34.514903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 519/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:34 2022] GET /compute/v2.1/servers/9ad81e86-6a28-45c7-a375-7bfb5be32303 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:04:34.520845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.521591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.541677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.542479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.543096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.543975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.544600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.545197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.551084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:04:34.577015 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d HTTP/1.1 Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:34.579154 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.580533 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7433cab3-8fe8-4104-8a57-52413f45846d'} Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:34.581286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.582580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.583826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:34.583826 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70b140db-4d5c-449a-bd27-a7d539c8d62f tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 404 len: 111 microversion: 2.1 time: 0.063927 Oct 26 05:04:34.583826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 520/1056] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:34 2022] DELETE /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:34.598171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.600134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:34.601132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] [instance: 7433cab3-8fe8-4104-8a57-52413f45846d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.618286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.620571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.621507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.624455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.624649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.627199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.678600 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] HTTP exception thrown: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Request method failure captured: Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d HTTP/1.1 Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9ASPLX6Ggc5r9FIzx1jXSh0PzymoHv4WG0Wbhkw7ggCqy_a9knfn4pPu6kRwN5UcpmOw9u2xK9oDeEHoAF-hJABBrEFCdBOgeFk3cFGFhBAgrjurbIXnBoyDbD9yHLKDfdkxEPb8q6fTAi6J4vDmayzKCpDBVvxMeC4svuimwceYw Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:34.681884 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d91a2576da84ef6984dae45db8b8543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 0d91a2576da84ef6984dae45db8b8543 Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047 Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 43735d2f58ca41b699f15ffc645aba3f Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2080431047-project Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.683423 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7433cab3-8fe8-4104-8a57-52413f45846d'} Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:34.684236 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. Oct 26 05:04:34.686411 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:34.689700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] Returning 404 to user: Instance 7433cab3-8fe8-4104-8a57-52413f45846d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:34.691144 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92cafde2-5b36-4af7-b592-f1a6fa63ea1c tempest-ServersWithSpecificFlavorTestJSON-2080431047 tempest-ServersWithSpecificFlavorTestJSON-2080431047-project] 10.222.0.16 "GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d" status: 404 len: 111 microversion: 2.1 time: 0.098211 Oct 26 05:04:34.692537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 521/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:34 2022] GET /compute/v2.1/servers/7433cab3-8fe8-4104-8a57-52413f45846d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:34.711786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:34.736962 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-553152a8-398d-4e5b-8dff-2c5b58a8b207 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 204 len: 0 microversion: 2.1 time: 0.307180 Oct 26 05:04:34.740683 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 537/1058] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:34 2022] DELETE /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:34.751089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:34.752356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:34.761448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.762642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.763434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:34.764566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:34.765465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:34.766335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:35.078251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:35.086883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3c1a7e47-f12a-48e9-9325-916cbbac0309 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1682 microversion: 2.1 time: 0.342088 Oct 26 05:04:35.092937 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 522/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:34 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1682 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:35.147388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:35.149294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:35.158801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:35.160340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:35.161098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:35.162033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:35.162921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:35.163522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:35.271220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:35.279334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54c32046-6bf9-4e00-b2c8-6c5cbb204751 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1266 microversion: 2.1 time: 0.138371 Oct 26 05:04:35.280538 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 538/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:35 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:35.395352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:35.395967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:35.404589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:35.411232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:35.411824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:35.412832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:35.413918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:35.414467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:35.682155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:35.694023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c203d96-896d-4b1b-9683-71459a2b9f5b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1324 microversion: 2.1 time: 0.302120 Oct 26 05:04:35.694640 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 523/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:35 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:36.117584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:36.118395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:36.137904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:36.138684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:36.139368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:36.140432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:36.141295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:36.141967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:36.274744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1294697329", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:36.351921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] validate_networks() for [('6bd1105c-8c6d-456c-9c51-070859af68ac', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:04:36.570967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:36.613123 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4d60ad3-bf55-4fc3-b7a4-a616534c175f tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1682 microversion: 2.1 time: 0.482092 Oct 26 05:04:36.619023 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 539/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:36 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1682 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:36.631980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:36.637725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:36.657663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:36.658542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:36.659147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:36.660029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:36.660683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:36.661273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:36.995360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:37.013181 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f82015ec-fae3-42b4-9409-ea0087f7fbd4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.390671 Oct 26 05:04:37.016346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 540/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:36 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:37.034905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:37.036569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:37.061012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.068517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.071180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.072375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.077290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.086722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.660523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:04:37.662449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:04:37.663441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:04:37.664189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:04:37.664782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:04:37.665251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:37.683657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78fd2305-5616-4f31-86f0-b3e1e36b564a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1520 microversion: 2.1 time: 0.663514 Oct 26 05:04:37.684273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 541/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:37 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:37.688865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.689658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.690431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.693243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.694113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.695814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.715507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-289cf219-06df-4134-8177-ff0cd47e6f9c tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '.version_select at 0x7f470a846c10>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:37.721975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-289cf219-06df-4134-8177-ff0cd47e6f9c tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.724714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-289cf219-06df-4134-8177-ff0cd47e6f9c tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.725456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-289cf219-06df-4134-8177-ff0cd47e6f9c tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.739914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for project 05ec452e1add45cdb311971b90e34200. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:04:37.746955 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-289cf219-06df-4134-8177-ff0cd47e6f9c tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.048065 Oct 26 05:04:37.754847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for user c496b6a683e147f8b41e82b2921454d6 and project 05ec452e1add45cdb311971b90e34200. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:04:37.765076 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 542/1065] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:04:37 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:37.777701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:37.778754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:37.791767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.796700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.798686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.800630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:37.801366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:04:37.801964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:37.802419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:37.805969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:04:37.940704 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-995799ab-4100-4218-8488-634c7d9caf66 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.672349 Oct 26 05:04:37.947842 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 524/1066] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:04:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:04:37.964786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:37.967115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:38.016008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:38.022088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:38.022698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:38.023563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:38.024275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:38.024938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:38.101973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] HTTP exception thrown: Action 999 not found Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Request method failure captured: Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25/os-instance-actions/999 HTTP/1.1 Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_QPUFE2lYDK0Czb_x_I63VoedBhI-GsFtk0zXeE5TTPhLfytERuZpehZiFgvDCcLPeTsy4wRfPNRfrQgm4oP_0uzEfwSiWf_Jvk3XnihGlNKlxtVJjY4SRlsfCoZg3LYLOrsZBXanNHRZgxx5AgE40ia0GbATNUI-VrUXIge5E6rk Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3161351100b14f9680cf30081345ae8f Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:38.103824 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3161351100b14f9680cf30081345ae8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3161351100b14f9680cf30081345ae8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3161351100b14f9680cf30081345ae8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3161351100b14f9680cf30081345ae8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3161351100b14f9680cf30081345ae8f Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceActionsNegativeTestJSON-841658822-project Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3fb943b45b774d9187356290ee4012e2 Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-841658822-project Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: exception: Action 999 not found Oct 26 05:04:38.105499 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': '71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25', 'id': '999'} Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 26 05:04:38.106440 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.110690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Returning 404 to user: Action 999 not found {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:38.113466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b281a3a3-9eaa-4658-89ce-fa0c4c0a1b91 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.164177 Oct 26 05:04:38.116143 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 525/1067] 10.222.0.16 () {58 vars in 1308 bytes} [Wed Oct 26 05:04:37 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25/os-instance-actions/999 => generated 66 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:04:38.126941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fdea498-4b27-4269-bbf3-3ea118707d8f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:38.134553 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fdea498-4b27-4269-bbf3-3ea118707d8f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017089 Oct 26 05:04:38.145001 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 526/1068] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:04:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:38.151360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98b9144f-0343-4126-adbd-4928a314c27c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:38.152303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98b9144f-0343-4126-adbd-4928a314c27c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:38.581818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:38.600692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-746fd3e2-b7cb-4cbf-91b3-3f2b652cdb3b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1614 microversion: 2.1 time: 0.833703 Oct 26 05:04:38.601281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 543/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:37 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1614 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:38.633118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:38.633898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:38.642482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:38.642983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:38.643607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:38.645305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:38.645800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:38.646238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:38.701523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-98b9144f-0343-4126-adbd-4928a314c27c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:38.711990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98b9144f-0343-4126-adbd-4928a314c27c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1225 microversion: 2.1 time: 0.564383 Oct 26 05:04:38.726660 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 527/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:38 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1225 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:38.747300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f09dc6f-dc86-45f6-976f-86653c4bb64a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '.version_select at 0x7f470a6f2ca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:38.747870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f09dc6f-dc86-45f6-976f-86653c4bb64a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 44c1038f-2945-4c05-90a5-982bcd13444f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:38.768371 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7f09dc6f-dc86-45f6-976f-86653c4bb64a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] HTTP exception thrown: Instance 44c1038f-2945-4c05-90a5-982bcd13444f could not be found. Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f09dc6f-dc86-45f6-976f-86653c4bb64a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Request method failure captured: Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/44c1038f-2945-4c05-90a5-982bcd13444f/os-instance-actions HTTP/1.1 Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_QPUFE2lYDK0Czb_x_I63VoedBhI-GsFtk0zXeE5TTPhLfytERuZpehZiFgvDCcLPeTsy4wRfPNRfrQgm4oP_0uzEfwSiWf_Jvk3XnihGlNKlxtVJjY4SRlsfCoZg3LYLOrsZBXanNHRZgxx5AgE40ia0GbATNUI-VrUXIge5E6rk Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3161351100b14f9680cf30081345ae8f Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:38.770046 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3161351100b14f9680cf30081345ae8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3161351100b14f9680cf30081345ae8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3161351100b14f9680cf30081345ae8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3161351100b14f9680cf30081345ae8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3161351100b14f9680cf30081345ae8f Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceActionsNegativeTestJSON-841658822-project Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3fb943b45b774d9187356290ee4012e2 Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-841658822-project Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 44c1038f-2945-4c05-90a5-982bcd13444f could not be found. Oct 26 05:04:38.771461 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': '44c1038f-2945-4c05-90a5-982bcd13444f'} Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c1038f-2945-4c05-90a5-982bcd13444f could not be found. Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:04:38.772238 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c1038f-2945-4c05-90a5-982bcd13444f could not be found. Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c1038f-2945-4c05-90a5-982bcd13444f could not be found. Oct 26 05:04:38.773570 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:38.774859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f09dc6f-dc86-45f6-976f-86653c4bb64a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Returning 404 to user: Instance 44c1038f-2945-4c05-90a5-982bcd13444f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:38.774859 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f09dc6f-dc86-45f6-976f-86653c4bb64a tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/44c1038f-2945-4c05-90a5-982bcd13444f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043625 Oct 26 05:04:38.785046 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 528/1071] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 26 05:04:38 2022] GET /compute/v2.1/servers/44c1038f-2945-4c05-90a5-982bcd13444f/os-instance-actions => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:38.790889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-45b1a1b1-1768-48d2-8f57-d11102e291d3 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-140286494", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:38.832638 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-45b1a1b1-1768-48d2-8f57-d11102e291d3 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.046010 Oct 26 05:04:38.838129 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 529/1072] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Oct 26 05:04:38 2022] POST /compute/v2.1/flavors => generated 498 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:38.854723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:38.855671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:38.871698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:38.873706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:38.875191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:38.877856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:38.878439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:38.879410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:38.897053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:38.974063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:04:39.155483 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6625ea54-3f0b-45c7-a0a6-829a14db1778 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 204 len: 0 microversion: 2.1 time: 0.314981 Oct 26 05:04:39.157760 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 530/1073] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:04:38 2022] DELETE /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:39.163065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa79daa8-0100-4278-b2d8-7419e51e20f9 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:39.180222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa79daa8-0100-4278-b2d8-7419e51e20f9 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021121 Oct 26 05:04:39.198881 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 531/1074] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 26 05:04:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:04:39.204095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:39.204841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:39.243437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:39.243940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:39.244389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:39.245109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:39.245595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:39.246028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:39.518961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:39.536068 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e1725f2-8c9d-4698-8039-e80867802b51 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.911316 Oct 26 05:04:39.537982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 544/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:38 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:39.556355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-156935527", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "470386d6-5084-4f03-aa0c-20f50bda87f5"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:39.669281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:04:39.732098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:39.742627 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6767a37-d506-4157-b4f0-6b0404582a5f tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1526 microversion: 2.1 time: 0.542383 Oct 26 05:04:39.744535 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 532/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:39 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1526 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:39.755405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:39.759502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:39.792221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:39.793875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:39.794995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:39.807337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:39.808108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:39.808658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.080868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:40.090325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c42230ae-a8a0-4bd3-b1bf-3a758eb7a92c tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1614 microversion: 2.1 time: 0.344499 Oct 26 05:04:40.090913 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 533/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:39 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1614 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:40.115147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:40.115768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:40.151349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.151857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.152295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.153270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.153934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.155445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.358602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:04:40.360632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:04:40.361890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:04:40.362559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:04:40.363138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:04:40.375685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=25 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:40.395864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.399547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.401093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.402471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.407883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.411963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.477280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:40.484437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:04:40.489084 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81fb8b31-1725-434f-a2fa-8dd703282f3f tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1295 microversion: 2.1 time: 0.397042 Oct 26 05:04:40.490300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 534/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:40 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1295 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:40.508168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-65d59d53-5ba2-431b-8e58-b9c04984c898 req-1bb553f1-0331-4381-bc46-a2334736553b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d592cac-0cd1-4090-9d22-a64f8689a08c", "name": "network-vif-deleted", "tag": "f42ca225-bc17-488a-a326-71240a1747c0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:40.511200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for user 5e48790bfe71452288c91f49586a624e and project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:04:40.526598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:04:40.527240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65d59d53-5ba2-431b-8e58-b9c04984c898 req-1bb553f1-0331-4381-bc46-a2334736553b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.527814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65d59d53-5ba2-431b-8e58-b9c04984c898 req-1bb553f1-0331-4381-bc46-a2334736553b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.528395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65d59d53-5ba2-431b-8e58-b9c04984c898 req-1bb553f1-0331-4381-bc46-a2334736553b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.530783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:04:40.549969 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-65d59d53-5ba2-431b-8e58-b9c04984c898 req-1bb553f1-0331-4381-bc46-a2334736553b service nova] Creating event network-vif-deleted:f42ca225-bc17-488a-a326-71240a1747c0 for instance 0d592cac-0cd1-4090-9d22-a64f8689a08c on n-h1-862416-4 Oct 26 05:04:40.563536 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-65d59d53-5ba2-431b-8e58-b9c04984c898 req-1bb553f1-0331-4381-bc46-a2334736553b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071857 Oct 26 05:04:40.564841 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 535/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:40.574289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:40.575197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:40.583625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.584558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.585157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.586078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:40.586696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:40.587309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:40.639060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7fb9257-e89b-496b-9e8a-2db2935f3d0c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099240 Oct 26 05:04:40.642003 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 545/1080] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:04:40.654712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39afdff0-0700-458d-a2c8-5d15e89c6cde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:40.657455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-39afdff0-0700-458d-a2c8-5d15e89c6cde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:41.059039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39afdff0-0700-458d-a2c8-5d15e89c6cde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:41.059039 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39afdff0-0700-458d-a2c8-5d15e89c6cde tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1278 microversion: 2.1 time: 0.406427 Oct 26 05:04:41.065404 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 546/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:40 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1278 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:41.076908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:41.078622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:41.095604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:41.096571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:41.097262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:41.098273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:41.098965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:41.099629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:41.430572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:41.446135 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3325eff-3193-482e-b033-3c5af0b46638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.879736 Oct 26 05:04:41.447733 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 536/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:40 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:41.461980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:41.462954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:41.477092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:41.479740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:41.480445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:41.483122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:41.483790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:41.485824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:41.595124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:41.597485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:41.597948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:41.600688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lazy-loading 'fault' on Instance uuid 0d592cac-0cd1-4090-9d22-a64f8689a08c {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:41.968290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5ce89745564263bab98d4227858c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3201d6ec664f51a56170294f242a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:41.989472 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-188b54cf-88b0-4709-a9cb-eed84090b86b tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 200 len: 1332 microversion: 2.1 time: 0.540615 Oct 26 05:04:42.013218 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 537/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:41 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 1332 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:42.034746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:42.035524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:42.053994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.055171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.056387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.059606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.060284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.060985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.251635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:42.277268 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c05052ce-9e89-4ac4-a5b1-f45f81e93b36 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1526 microversion: 2.1 time: 1.211461 Oct 26 05:04:42.282150 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 547/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:41 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1526 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:42.294324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:42.296443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:42.335569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.351142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.355706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.356498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.356995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.357464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.381264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:42.394233 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2149d71e-beb8-4c0e-aa46-877923370997 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1283 microversion: 2.1 time: 0.379657 Oct 26 05:04:42.405352 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 538/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:42 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:42.473372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:42.474034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:42.487155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.488078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.490375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.495840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.498174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.502368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.689640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:42.706454 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4ebaa964-a9f3-4f1d-b2d1-48348834e63b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1330 microversion: 2.1 time: 0.424355 Oct 26 05:04:42.707073 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 548/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:42 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1330 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:42.717618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8f5ad651-05f4-4af6-9bd8-2c224b596c44 req-91e20ca2-12ff-47e9-bd02-d3419b11f5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c7821e-445f-43cc-84e8-7e697b1dd6c3", "tag": "de5767ec-427f-4e5e-b355-722b276d6fbb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:42.748140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8f5ad651-05f4-4af6-9bd8-2c224b596c44 req-91e20ca2-12ff-47e9-bd02-d3419b11f5be service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:42.748639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8f5ad651-05f4-4af6-9bd8-2c224b596c44 req-91e20ca2-12ff-47e9-bd02-d3419b11f5be service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:42.749287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8f5ad651-05f4-4af6-9bd8-2c224b596c44 req-91e20ca2-12ff-47e9-bd02-d3419b11f5be service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:42.779076 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8f5ad651-05f4-4af6-9bd8-2c224b596c44 req-91e20ca2-12ff-47e9-bd02-d3419b11f5be service nova] Creating event network-changed:de5767ec-427f-4e5e-b355-722b276d6fbb for instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 on n-h2-862416-4 Oct 26 05:04:42.791633 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8f5ad651-05f4-4af6-9bd8-2c224b596c44 req-91e20ca2-12ff-47e9-bd02-d3419b11f5be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078029 Oct 26 05:04:42.793757 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 549/1087] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:43.015563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:43.016589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] [instance: 0d592cac-0cd1-4090-9d22-a64f8689a08c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:43.020662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:43.028551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.029074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.029538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.031591 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-feaabbeb-4837-4413-be32-7c3568a55cc3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.561590 Oct 26 05:04:43.035643 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 539/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:42 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:43.042502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.043928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.066867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.086710 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] HTTP exception thrown: Instance 0d592cac-0cd1-4090-9d22-a64f8689a08c could not be found. Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Request method failure captured: Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c HTTP/1.1 Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL84Qrdjb1AuOBQXZ3YPcAy4rZibKOWIUiNVacmZrnb-cS1Ly91Abt77ugL04PxwESGvkwJFaq_Yd3YblrHbh-xttdcE-_wYx2StJCzuPPJ_f2Xf7ZopK5kAg2wco8hcegX9S-RWX_4yyUD0ZfseZ-OmPYZ2_wBTHj8IEZSIZUS7kpI Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: bc3201d6ec664f51a56170294f242a6c Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesAdminNegativeTest-1142525342 Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:04:43.088841 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc3201d6ec664f51a56170294f242a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesAdminNegativeTest-1142525342 Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: bc3201d6ec664f51a56170294f242a6c Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1142525342 Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesAdminNegativeTest-1142525342-project Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dd5ce89745564263bab98d4227858c97 Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesAdminNegativeTest-1142525342-project Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 0d592cac-0cd1-4090-9d22-a64f8689a08c could not be found. Oct 26 05:04:43.090307 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '0d592cac-0cd1-4090-9d22-a64f8689a08c'} Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d592cac-0cd1-4090-9d22-a64f8689a08c could not be found. Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:43.091128 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d592cac-0cd1-4090-9d22-a64f8689a08c could not be found. Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d592cac-0cd1-4090-9d22-a64f8689a08c could not be found. Oct 26 05:04:43.092508 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:04:43.098483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Returning 404 to user: Instance 0d592cac-0cd1-4090-9d22-a64f8689a08c could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:43.100016 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77ba74ca-8d40-44f0-9768-f7d38fb1c3c8 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c" status: 404 len: 111 microversion: 2.1 time: 0.089636 Oct 26 05:04:43.105147 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 550/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:43 2022] GET /compute/v2.1/servers/0d592cac-0cd1-4090-9d22-a64f8689a08c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:04:43.110612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37f704f5-7789-46d3-98ce-2ed64e063a98 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] Calling method '.version_select at 0x7f470a8bb0d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:43.166337 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37f704f5-7789-46d3-98ce-2ed64e063a98 tempest-VolumesAdminNegativeTest-1142525342 tempest-VolumesAdminNegativeTest-1142525342-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796051392" status: 202 len: 0 microversion: 2.1 time: 0.059948 Oct 26 05:04:43.167258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 540/1090] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796051392 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:43.304783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:43.306066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:43.320280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.322440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.323383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.326221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.326952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.332063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.424488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:43.425136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:43.436045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.443159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.446190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.449188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.449880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.450479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.474104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:43.791493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb943b45b774d9187356290ee4012e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3161351100b14f9680cf30081345ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:43.805653 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2936bff-f32c-4b73-ab75-b9b34af0264b tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 200 len: 1484 microversion: 2.1 time: 0.504758 Oct 26 05:04:43.825802 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 551/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:43 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 1484 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:43.834234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:43.835066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:43.841890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.842643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.844666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.845715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:43.846344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:43.847278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:43.991082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:44.004432 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-db678d1b-1bad-42ba-896b-8c7308275412 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1336 microversion: 2.1 time: 0.174660 Oct 26 05:04:44.005824 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 552/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:43 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1336 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:44.084527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:44.101079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:44.113390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:44.117578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:44.118555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:44.119389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:44.121073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:44.121895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:44.122605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:44.126814 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d23d8a91-c505-478c-bd24-802c150c1995 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.706172 Oct 26 05:04:44.137996 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 541/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:43 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:44.538272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:44.555911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b141a8e5-4b37-4d07-99e9-5489f78938f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.500201 Oct 26 05:04:44.570223 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 553/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:44 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:44.835563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:44.836854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] [instance: 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:44.851123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:44.851899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:44.852575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:44.853578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:44.854352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:44.855148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:44.882984 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] HTTP exception thrown: Instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 could not be found. Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Request method failure captured: Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 HTTP/1.1 Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_QPUFE2lYDK0Czb_x_I63VoedBhI-GsFtk0zXeE5TTPhLfytERuZpehZiFgvDCcLPeTsy4wRfPNRfrQgm4oP_0uzEfwSiWf_Jvk3XnihGlNKlxtVJjY4SRlsfCoZg3LYLOrsZBXanNHRZgxx5AgE40ia0GbATNUI-VrUXIge5E6rk Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3161351100b14f9680cf30081345ae8f Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:04:44.885675 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3161351100b14f9680cf30081345ae8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3161351100b14f9680cf30081345ae8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3161351100b14f9680cf30081345ae8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3161351100b14f9680cf30081345ae8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3161351100b14f9680cf30081345ae8f Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-841658822 Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceActionsNegativeTestJSON-841658822-project Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3fb943b45b774d9187356290ee4012e2 Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-841658822-project Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 could not be found. Oct 26 05:04:44.887253 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25'} Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 could not be found. Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:04:44.888072 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 could not be found. Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 could not be found. Oct 26 05:04:44.889389 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:04:44.899345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] Returning 404 to user: Instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:04:44.900488 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32051cd6-0f3f-440d-91bb-0be0bbbd3792 tempest-InstanceActionsNegativeTestJSON-841658822 tempest-InstanceActionsNegativeTestJSON-841658822-project] 10.222.0.16 "GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25" status: 404 len: 111 microversion: 2.1 time: 0.075789 Oct 26 05:04:44.910800 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 542/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:44 2022] GET /compute/v2.1/servers/71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:04:45.006608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-36bf7f9b-e822-4de7-9176-c71e72ca0daa req-514bedca-be5c-4c7d-b9f4-ddd67222f1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25", "name": "network-vif-deleted", "tag": "19fc3792-1dd9-455c-b9df-c064851bf4d8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:45.033618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:45.034825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:45.064488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-36bf7f9b-e822-4de7-9176-c71e72ca0daa req-514bedca-be5c-4c7d-b9f4-ddd67222f1f1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.064842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.065413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.065999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.067137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.067578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-36bf7f9b-e822-4de7-9176-c71e72ca0daa req-514bedca-be5c-4c7d-b9f4-ddd67222f1f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.068132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-36bf7f9b-e822-4de7-9176-c71e72ca0daa req-514bedca-be5c-4c7d-b9f4-ddd67222f1f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.068538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.069150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.098164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-36bf7f9b-e822-4de7-9176-c71e72ca0daa req-514bedca-be5c-4c7d-b9f4-ddd67222f1f1 service nova] Creating event network-vif-deleted:19fc3792-1dd9-455c-b9df-c064851bf4d8 for instance 71c7b46a-f6d4-4f40-8b4f-e4c9bef65c25 on n-h1-862416-4 Oct 26 05:04:45.112362 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-36bf7f9b-e822-4de7-9176-c71e72ca0daa req-514bedca-be5c-4c7d-b9f4-ddd67222f1f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117050 Oct 26 05:04:45.113756 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 554/1096] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:45.163218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:45.166801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:45.175383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.176214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.176916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.181657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.182721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.183868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.450062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:45.465564 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-843072ca-71a4-41d3-ba7c-7cd17f47e587 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1336 microversion: 2.1 time: 0.439257 Oct 26 05:04:45.490195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 543/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:45 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1336 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:45.585714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:45.586731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:45.602535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.603039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.613232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.614549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:45.615404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:45.616059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:45.691325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:45.702067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9051e6d-123e-4728-bbad-69d972571408 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.543614 Oct 26 05:04:45.705628 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 555/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:45 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:46.196023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:46.206253 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f714be24-0845-4052-a0ec-969fb1a7d7a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.625516 Oct 26 05:04:46.208624 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 544/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:45 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:46.497362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:46.498221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:46.505073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:46.511605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:46.512327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:46.513141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:46.513697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:46.514126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:46.735168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:46.737232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:46.748091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:46.760824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:46.765732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:46.766593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:46.767616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:46.768380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:46.769017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:47.303447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:47.313013 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd90debc-e15e-4da8-bba7-2b73351edbb9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.819525 Oct 26 05:04:47.313638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 556/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:46 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:47.318561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8bc0f09b-01ad-4460-8ba6-fe804febee8a req-d3b98e0a-1487-479b-b8de-120ef07edac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c7821e-445f-43cc-84e8-7e697b1dd6c3", "name": "network-vif-plugged", "status": "completed", "tag": "de5767ec-427f-4e5e-b355-722b276d6fbb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:47.329058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8bc0f09b-01ad-4460-8ba6-fe804febee8a req-d3b98e0a-1487-479b-b8de-120ef07edac0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:47.329826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8bc0f09b-01ad-4460-8ba6-fe804febee8a req-d3b98e0a-1487-479b-b8de-120ef07edac0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:47.330411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8bc0f09b-01ad-4460-8ba6-fe804febee8a req-d3b98e0a-1487-479b-b8de-120ef07edac0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:47.343081 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8bc0f09b-01ad-4460-8ba6-fe804febee8a req-d3b98e0a-1487-479b-b8de-120ef07edac0 service nova] Creating event network-vif-plugged:de5767ec-427f-4e5e-b355-722b276d6fbb for instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 on n-h2-862416-4 Oct 26 05:04:47.349264 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8bc0f09b-01ad-4460-8ba6-fe804febee8a req-d3b98e0a-1487-479b-b8de-120ef07edac0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Oct 26 05:04:47.350520 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 557/1101] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:47.360947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:47.361766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:47.369849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:47.370586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:47.371190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:47.372101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:47.373865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:47.375147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:47.381642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:47.408398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:47.424556 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f040f933-3aaf-41e8-a1d0-97f591deefc6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.699661 Oct 26 05:04:47.425745 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 545/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:46 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:47.670957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6a596511-b151-43fa-8792-b7cc46580d65 req-4cf130ec-eee3-4970-ab9c-c1edd22c3858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9dca6b-e1aa-420f-838b-c9af8a42bee6", "tag": "4e604617-e2f4-4f7b-acea-0f42fc5b992a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:47.687442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6a596511-b151-43fa-8792-b7cc46580d65 req-4cf130ec-eee3-4970-ab9c-c1edd22c3858 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:47.688307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6a596511-b151-43fa-8792-b7cc46580d65 req-4cf130ec-eee3-4970-ab9c-c1edd22c3858 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:47.689434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6a596511-b151-43fa-8792-b7cc46580d65 req-4cf130ec-eee3-4970-ab9c-c1edd22c3858 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:47.704950 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6a596511-b151-43fa-8792-b7cc46580d65 req-4cf130ec-eee3-4970-ab9c-c1edd22c3858 service nova] Creating event network-changed:4e604617-e2f4-4f7b-acea-0f42fc5b992a for instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 on n-h2-862416-4 Oct 26 05:04:47.710918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6a596511-b151-43fa-8792-b7cc46580d65 req-4cf130ec-eee3-4970-ab9c-c1edd22c3858 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044341 Oct 26 05:04:47.712196 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 546/1103] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:04:48.120655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:48.129585 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f46431e-702a-4293-9696-52b8cdd498bf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 0.774665 Oct 26 05:04:48.130624 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 558/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:47 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:48.337151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:48.342336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:48.344311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:48.386179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:48.386694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:48.389958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:48.392261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:48.393302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:48.394374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:48.452536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:48.454235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:48.467635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:48.469803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:48.472118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:48.473809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:48.478676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:48.479355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:48.706914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:48.911497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:48.933362 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-472605e9-3f59-42ed-bd79-b14786d99ef8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.596366 Oct 26 05:04:48.945475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:48.950519 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 547/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:48 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:48.959093 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0292f9c8-7e9a-49a2-bf98-c2c5723675f8 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.512098 Oct 26 05:04:48.961561 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 559/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:48 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:49.152079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:49.152687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:49.168217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.168713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.169151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:49.169890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.170341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.180778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:49.391949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:49.392802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:49.406361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.407228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.407871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:49.409849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.410496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.411195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:49.884216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:49.908524 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92277dda-7761-4c42-b90a-0a46066766fe tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 2424 microversion: 2.25 time: 0.520660 Oct 26 05:04:49.910078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 560/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:04:49 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 2424 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:04:49.918157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c6acb45e-0cb1-4b9e-94cd-3cea27b3a096 req-f25d5eba-27d3-4162-a18a-7574e0b8f647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:49.930377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6acb45e-0cb1-4b9e-94cd-3cea27b3a096 req-f25d5eba-27d3-4162-a18a-7574e0b8f647 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.931402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6acb45e-0cb1-4b9e-94cd-3cea27b3a096 req-f25d5eba-27d3-4162-a18a-7574e0b8f647 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.932629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6acb45e-0cb1-4b9e-94cd-3cea27b3a096 req-f25d5eba-27d3-4162-a18a-7574e0b8f647 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:49.953697 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c6acb45e-0cb1-4b9e-94cd-3cea27b3a096 req-f25d5eba-27d3-4162-a18a-7574e0b8f647 service nova] Creating event network-changed:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:04:49.961844 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c6acb45e-0cb1-4b9e-94cd-3cea27b3a096 req-f25d5eba-27d3-4162-a18a-7574e0b8f647 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048995 Oct 26 05:04:49.963450 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 561/1108] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:49.971293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": "auto"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:49.978499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:49.991486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.992415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.993093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:49.995175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:49.996606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:49.997331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:50.050272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'flavor' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:04:50.070068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Going to try to live migrate instance to n-h2-862416-4 {{(pid=120586) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:04:50.459399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:50.531838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:50.552869 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b9f9123-f24b-4567-801f-2923343ee86a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1308 microversion: 2.1 time: 1.397329 Oct 26 05:04:50.553639 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 548/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:49 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1308 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:50.571176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:50.572270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:50.582568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:50.585949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:50.586890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:50.588020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:50.588781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:50.589789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:51.053649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=7 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:51.433448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:51.462817 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19d2ff0a-0c21-43da-a783-26bfe82f71b3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.905133 Oct 26 05:04:51.463852 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 549/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:50 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:51.469508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:51.470336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:51.482456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:51.482952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:51.487627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:51.488651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:51.495145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:51.495942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:52.183581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:52.199022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9fb10b88-df1b-45e5-a45f-d8d77506cf2b tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.734076 Oct 26 05:04:52.213343 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 550/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:51 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:52.221204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:52.222979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:52.236161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:52.236679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:52.237149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:52.237945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:52.238459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:52.238900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:52.756938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:52.768142 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d55f6225-babc-4999-80c2-0976e3752555 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1489 microversion: 2.1 time: 0.564562 Oct 26 05:04:52.773792 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 551/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:52 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1489 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:52.784170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:52.785076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:52.803988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:52.804497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:52.804943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:52.805705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:52.808441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:52.808891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:53.340425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:53.346221 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fcabbc35-8d73-4983-b9ed-f1854db1c416 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.570918 Oct 26 05:04:53.346809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 552/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:52 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:53.360355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:53.363630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:53.386577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:53.387124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:53.388916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:53.390459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:53.391478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:53.391922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:53.560008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f77fe97-e9af-4c59-96d3-bdeb3a4e7194 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.205088 Oct 26 05:04:53.564678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 553/1114] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:04:53 2022] POST /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:04:53.578938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:53.581695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:53.598444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:53.598885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:53.602339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:53.603090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:53.603572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:53.605996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:54.628677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:54.641449 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b742549d-a006-4266-a579-0e10abe7b486 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 1.076740 Oct 26 05:04:54.642040 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 554/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:53 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:54.664403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:54.667221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:54.682439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:54.683225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:54.684462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:54.687725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:54.688510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:54.689177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:55.237391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:55.245972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8d7f71e-5478-4413-b047-ad6ffd9859b1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 200 len: 1474 microversion: 2.1 time: 0.596529 Oct 26 05:04:55.249901 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 555/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:54 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 1474 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:55.263630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:55.280232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:55.295451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:55.296902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:55.297690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:55.299498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:55.300770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:55.301957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:55.321866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3bc7ee5b-9d2a-4f44-82ee-97423d0056c0 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/action" status: 202 len: 0 microversion: 2.25 time: 5.355654 Oct 26 05:04:55.323515 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 562/1117] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:04:49 2022] POST /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/action => generated 0 bytes in 5359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:04:55.331848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1908369230"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:55.336480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:55.372063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:55.374873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:55.378623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:55.385078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:55.386186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:55.392039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:55.818752 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1058dc10-1839-4b89-ae5f-8508ec81fe22 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.491924 Oct 26 05:04:55.825536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 563/1118] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:04:55 2022] POST /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:04:55.834351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:55.835411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:55.843483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:55.844372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:55.844571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:55.845948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:55.847415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:55.848095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:56.222443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:56.223714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:56.240980 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-621bc4d1-a096-4df0-979a-fc10a8d371dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.986926 Oct 26 05:04:56.244381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:56.256094 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 556/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:55 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:56.256993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:56.258403 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef8ab459-6d82-4302-a38e-11c3b87cf811 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.431661 Oct 26 05:04:56.268227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:56.269230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:56.276842 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 564/1120] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:04:55 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:04:56.280144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:56.280886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:56.281621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:56.283127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:56.283836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:56.284698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:56.295604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60ee1601-62bf-4272-8427-c8402606bfab tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a827790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:56.368962 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60ee1601-62bf-4272-8427-c8402606bfab tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.087461 Oct 26 05:04:56.370131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 565/1121] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:04:56 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:56.714097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:56.730077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c092b96-4b10-4f79-85de-f024cfd4d900 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.472441 Oct 26 05:04:56.730660 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 557/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:56 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:57.080647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f15a8542-77b4-46a4-8c0a-80889f659791 req-f3932a71-969b-454e-bc2e-14cba11907ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9dca6b-e1aa-420f-838b-c9af8a42bee6", "name": "network-vif-plugged", "status": "completed", "tag": "4e604617-e2f4-4f7b-acea-0f42fc5b992a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:57.101430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f15a8542-77b4-46a4-8c0a-80889f659791 req-f3932a71-969b-454e-bc2e-14cba11907ca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.102152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f15a8542-77b4-46a4-8c0a-80889f659791 req-f3932a71-969b-454e-bc2e-14cba11907ca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.114018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f15a8542-77b4-46a4-8c0a-80889f659791 req-f3932a71-969b-454e-bc2e-14cba11907ca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.125513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f15a8542-77b4-46a4-8c0a-80889f659791 req-f3932a71-969b-454e-bc2e-14cba11907ca service nova] Creating event network-vif-plugged:4e604617-e2f4-4f7b-acea-0f42fc5b992a for instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 on n-h2-862416-4 Oct 26 05:04:57.136117 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f15a8542-77b4-46a4-8c0a-80889f659791 req-f3932a71-969b-454e-bc2e-14cba11907ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060029 Oct 26 05:04:57.139295 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 566/1123] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:04:57.270288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:57.270902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:57.280891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.284990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.288110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.289013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:57.289396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.289985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:57.292756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.294314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.303041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.303711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.304274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.305106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.305845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.306515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.326926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:04:57.741644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:57.756159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:57.758049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:57.762241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:57.763908 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1de52f93-8152-4361-8656-e43d454afb57 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.479604 Oct 26 05:04:57.768172 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 567/1124] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:04:57 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:04:57.784167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e82dc28-6f55-4276-a984-79775c05cb05 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a7fff70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:57.798894 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b03a4173-6498-4845-b4b0-fed0bcbf78a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.533989 Oct 26 05:04:57.799809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 558/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:57 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:04:57.808757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:57.812743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:57.821782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.822667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.823413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.824322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:57.824936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:57.825551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:57.864772 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e82dc28-6f55-4276-a984-79775c05cb05 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.094876 Oct 26 05:04:57.865661 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 568/1126] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:04:57 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:58.118880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:58.131193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-877430c6-139c-4671-a793-7d39ed5d90ae tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1325 microversion: 2.1 time: 0.329729 Oct 26 05:04:58.134309 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 559/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:57 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:58.795041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:58.796510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:58.805930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:58.807179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:58.807941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:58.815963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:58.821400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:58.823144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:58.823561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:58.824271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:58.840433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:58.842384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:58.844661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:58.846164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:58.848020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:58.850386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:59.487006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:59.502045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:59.504793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:59.507206 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e7e93a0-7d5d-47f0-95be-5368d2700a17 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.718059 Oct 26 05:04:59.508213 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 569/1128] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:04:58 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:04:59.515583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60013740-8b99-4dca-8d61-08eccf731341 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a7ff4c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:59.574280 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60013740-8b99-4dca-8d61-08eccf731341 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.063816 Oct 26 05:04:59.576170 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 570/1129] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:04:59 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:59.582586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:04:59.583206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:04:59.591789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:59.592349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:59.593446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:59.594258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:59.596637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:59.597246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:59.705437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:04:59.743372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-910bd37c-64bb-4616-bb1d-c8cdb275486f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.924934 Oct 26 05:04:59.745494 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 560/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:58 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:04:59.767990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b1e16024-9f3e-439c-8160-d700f19036e3 req-4d12cfad-c520-423f-bb6c-c06abfdd59ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "name": "network-vif-plugged", "status": "completed", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:04:59.778585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b1e16024-9f3e-439c-8160-d700f19036e3 req-4d12cfad-c520-423f-bb6c-c06abfdd59ce service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:04:59.779323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b1e16024-9f3e-439c-8160-d700f19036e3 req-4d12cfad-c520-423f-bb6c-c06abfdd59ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:04:59.779926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b1e16024-9f3e-439c-8160-d700f19036e3 req-4d12cfad-c520-423f-bb6c-c06abfdd59ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:04:59.802533 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b1e16024-9f3e-439c-8160-d700f19036e3 req-4d12cfad-c520-423f-bb6c-c06abfdd59ce service nova] Creating event network-vif-plugged:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:04:59.813083 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b1e16024-9f3e-439c-8160-d700f19036e3 req-4d12cfad-c520-423f-bb6c-c06abfdd59ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062710 Oct 26 05:04:59.815560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 561/1131] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:00.099917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:00.112234 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23fa0779-5712-4f13-a81e-5416118297fe tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1522 microversion: 2.1 time: 0.534002 Oct 26 05:05:00.112830 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 571/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:04:59 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:00.147674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:00.148593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:00.161935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:00.162847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:00.166128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:00.167121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:00.167817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:00.168475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:00.468882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:00.484342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43d4f6c0-2707-462a-82df-46c792865bf7 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1522 microversion: 2.1 time: 0.340760 Oct 26 05:05:00.490832 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 562/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:00 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:00.524393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1319377284"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:00.540752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:00.541885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:00.542020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:00.553246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:00.559086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:00.560014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:00.560618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:00.561668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:00.562499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:00.563175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:00.563695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:00.564201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:00.564953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:00.565467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:00.565915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:00.811928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:00.836034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:00.841606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:00.847552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44fb9765-4dd7-4cb0-80ee-8a4de6003d18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.313485 Oct 26 05:05:00.854040 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 563/1134] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:00 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:05:00.881236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dc886b5-c4a2-41c0-b559-0fcb46144c4e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470eb15820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:00.989387 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0dc886b5-c4a2-41c0-b559-0fcb46144c4e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.131755 Oct 26 05:05:00.993527 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 564/1135] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:00 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:00.994370 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7adb1f5e-2470-4ac7-a3bb-24004f5477b4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6/action" status: 202 len: 0 microversion: 2.1 time: 0.475020 Oct 26 05:05:01.005673 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 572/1136] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:05:00 2022] POST /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:05:01.012141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dcaa8b59-7e5f-4e5b-85f4-330f581c7cdb tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '.version_select at 0x7f470a827040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:01.038250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:01.041992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:01.070826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:01.085804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:01.086327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:01.092150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:01.093182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:01.098201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:01.390056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dcaa8b59-7e5f-4e5b-85f4-330f581c7cdb tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd" status: 204 len: 0 microversion: 2.1 time: 0.381999 Oct 26 05:05:01.391955 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 573/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:01 2022] DELETE /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:05:01.400893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06f1f0fb-2e0a-493a-95f7-3e9c698edf27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '.version_select at 0x7f470a827ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:01.453645 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-06f1f0fb-2e0a-493a-95f7-3e9c698edf27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Image not found. Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06f1f0fb-2e0a-493a-95f7-3e9c698edf27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd HTTP/1.1 Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:05:01.456005 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '6259dcf7-6b94-4a7e-9927-d422c9a9fcbd'} Oct 26 05:05:01.457598 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:05:01.463727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6259dcf7-6b94-4a7e-9927-d422c9a9fcbd Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:05:01.465067 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6259dcf7-6b94-4a7e-9927-d422c9a9fcbd could not be found. Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:05:01.467241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:01.475136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06f1f0fb-2e0a-493a-95f7-3e9c698edf27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:05:01.479330 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-06f1f0fb-2e0a-493a-95f7-3e9c698edf27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd" status: 404 len: 62 microversion: 2.1 time: 0.060333 Oct 26 05:05:01.479330 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 574/1138] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:01 2022] GET /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:05:01.479330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:01.479330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:01.497457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:01.498243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:01.502378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:01.503132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:01.503620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:01.504064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:01.615041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:01.635250 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da3f8f23-a6f1-426d-85a8-f9015a5edb26 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1378 microversion: 2.1 time: 0.639505 Oct 26 05:05:01.635858 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 565/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:00 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1378 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:01.881300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:01.881964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:01.890409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:01.907044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:01.907614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:01.908391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:01.908873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:01.916728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:03.559561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:03.609254 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cadbede8-b208-48f4-8a22-356088f51849 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1534 microversion: 2.1 time: 2.142733 Oct 26 05:05:03.610220 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 575/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:01 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1534 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:03.642506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b67b7bbf-0067-45d2-861e-568c391b4677 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a80e8b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:03.695780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:03.715242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:03.717015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:03.721430 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f51ece9c-02c1-44d5-82c8-eb342bf75682 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.843137 Oct 26 05:05:03.722027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 566/1141] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:01 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:05:03.736125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a07305bb-2a7f-4d8d-ba1b-53ce972d0afe req-7d6bc6b0-8657-4269-b97a-ef519a382630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c7821e-445f-43cc-84e8-7e697b1dd6c3", "name": "network-vif-plugged", "status": "completed", "tag": "de5767ec-427f-4e5e-b355-722b276d6fbb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:03.737161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b67b7bbf-0067-45d2-861e-568c391b4677 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.125314 Oct 26 05:05:03.737983 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 576/1142] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:03 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:03.758812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:03.759772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:03.762480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a07305bb-2a7f-4d8d-ba1b-53ce972d0afe req-7d6bc6b0-8657-4269-b97a-ef519a382630 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:03.763004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a07305bb-2a7f-4d8d-ba1b-53ce972d0afe req-7d6bc6b0-8657-4269-b97a-ef519a382630 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:03.771729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a07305bb-2a7f-4d8d-ba1b-53ce972d0afe req-7d6bc6b0-8657-4269-b97a-ef519a382630 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:03.785576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:03.789209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:03.789869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:03.790804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:03.797168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:03.800088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:03.805229 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a07305bb-2a7f-4d8d-ba1b-53ce972d0afe req-7d6bc6b0-8657-4269-b97a-ef519a382630 service nova] Creating event network-vif-plugged:de5767ec-427f-4e5e-b355-722b276d6fbb for instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 on n-h2-862416-4 Oct 26 05:05:03.830092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a07305bb-2a7f-4d8d-ba1b-53ce972d0afe req-7d6bc6b0-8657-4269-b97a-ef519a382630 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106321 Oct 26 05:05:03.834064 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 567/1143] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:03.891461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:04.458929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Calling method '.version_select at 0x7f470eba8820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:04.469010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.472177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.472952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.522511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.524621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.525977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.658899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:04.662844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.663819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.664429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.690947 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-290e3d04-daef-4f23-9a9b-19116c96f342 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1528 microversion: 2.1 time: 0.942363 Oct 26 05:05:04.691572 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 577/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:03 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1528 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:04.705080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:04.706604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:04.718761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.723242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.724234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.725552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.726019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.726503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.727250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.728267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.728267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.865794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.868314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.868791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.877560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e124811-ae8d-4b7b-a28f-049c6bfdbc47 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2231 microversion: 2.53 time: 0.771332 Oct 26 05:05:04.880427 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 568/1145] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 26 05:05:04 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2231 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:04.886665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:04.887687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:04.898660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.899460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.900107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:04.901408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:04.902776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:04.903593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.293050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:05.315294 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98ae8006-0705-4867-a1f8-8eea81ad5e02 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1540 microversion: 2.1 time: 0.620353 Oct 26 05:05:05.318634 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 578/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:04 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1540 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:05.339168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-246ea2b9-fc3a-45bc-b722-ea391876fe74 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a80e5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:05.380997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:05.394305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c82d1c4-aee0-4a9a-ad81-3f99e029a8f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1528 microversion: 2.1 time: 0.511940 Oct 26 05:05:05.397760 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 569/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:04 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1528 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:05.408146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:05.409211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:05.427741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.429925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.430558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.433187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.434022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.435641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.493938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-246ea2b9-fc3a-45bc-b722-ea391876fe74 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.165964 Oct 26 05:05:05.497233 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 579/1148] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:05 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:05.511167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Calling method '.version_select at 0x7f470a904ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:05.519628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.522730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.523642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.555077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:05.564520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.565790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.566723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.626306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.627451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.628814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.662741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.665157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.667966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.742986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.744253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.746663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.759297 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-729253e3-9b2e-4459-86ca-2b296d98905d tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 923 microversion: 2.53 time: 0.259552 Oct 26 05:05:05.772523 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 580/1149] 10.222.0.16 () {60 vars in 1222 bytes} [Wed Oct 26 05:05:05 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 923 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:05:05.775194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98e63953-1aac-459d-92d8-adff97d75c90 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:05.822780 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98e63953-1aac-459d-92d8-adff97d75c90 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/470386d6-5084-4f03-aa0c-20f50bda87f5" status: 202 len: 0 microversion: 2.1 time: 0.055822 Oct 26 05:05:05.827984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 581/1150] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:05:05 2022] DELETE /compute/v2.1/flavors/470386d6-5084-4f03-aa0c-20f50bda87f5 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:05:05.837880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Calling method '.version_select at 0x7f470a85c670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:05.847388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.853555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.854247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.897913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:05.901289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:05.901911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:05.920816 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32302a6f-e6c6-4d6a-b00a-d91648a6da84 tempest-HypervisorAdminV253TestBase-1518491949 tempest-HypervisorAdminV253TestBase-1518491949-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/867ad880-53ab-41a3-85b5-3bfd9442fb03" status: 200 len: 792 microversion: 2.53 time: 0.091377 Oct 26 05:05:05.937376 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 582/1151] 10.222.0.16 () {60 vars in 1298 bytes} [Wed Oct 26 05:05:05 2022] GET /compute/v2.1/os-hypervisors/867ad880-53ab-41a3-85b5-3bfd9442fb03 => generated 792 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:05:05.937376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f111766e-34d1-4668-a0c3-eef65496acac tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:05.948431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:05.962606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:05.965634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:05.971361 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ef03a9c-2f97-46a5-beb3-03970f6aedef tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.568793 Oct 26 05:05:05.975831 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 570/1152] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:05 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:05.989772 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f111766e-34d1-4668-a0c3-eef65496acac tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058461 Oct 26 05:05:05.996203 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 583/1153] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:05:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:06.015683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:06.018575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:06.047061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:06.047635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:06.048884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:06.049640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:06.051241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:06.055674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:06.340080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:06.340695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:06.354321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:06.360133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:06.360991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:06.362337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:06.362970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:06.364287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:06.423805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:06.432581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Old instance type tempest-test_resize_flavor_-140286494, new instance type m1.heat {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:05:06.461102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:05:06.465913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:05:06.468665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:05:06.471177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:05:06.475636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:05:06.822843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24651243-c6fa-4aab-a777-69b8b2be56c5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65/action" status: 202 len: 0 microversion: 2.1 time: 0.812137 Oct 26 05:05:06.827567 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 571/1154] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:05:06 2022] POST /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65/action => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:05:06.840154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc387e52-be50-4de0-ae88-78f3ac6a166e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470eb63700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:06.909168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:06.921368 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aacded44-0d32-424c-a314-e7bb8d1e98f6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1540 microversion: 2.1 time: 0.582257 Oct 26 05:05:06.922807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 584/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:06 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1540 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:06.935360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:06.948534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:06.956529 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc387e52-be50-4de0-ae88-78f3ac6a166e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.127301 Oct 26 05:05:06.963702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:06.964842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:06.965262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 572/1156] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:06 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:06.967094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:06.969961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:06.971286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:06.972560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:07.001459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:07.002240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:07.018785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:07.022322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:07.022816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:07.062570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:07.064064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:07.066875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:07.688677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:07.700334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:07.718357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:07.725439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44e8965c-8eee-40ed-ade4-a7c7593676b8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.729070 Oct 26 05:05:07.733776 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 573/1157] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:06 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:07.930988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:07.947315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:07.948380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:07.963116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85749a8d-04f1-479a-a097-f8fdf4dccffe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1537 microversion: 2.1 time: 1.038966 Oct 26 05:05:07.982304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:07.982883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:07.983865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:07.984571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 585/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:06 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1537 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:07.992870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09dfed70-080e-4cd1-ae31-ce0452e6e932 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a846dc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:07.998043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:07.998700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:08.001804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:08.122765 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09dfed70-080e-4cd1-ae31-ce0452e6e932 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.137017 Oct 26 05:05:08.124035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 586/1159] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:07 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:08.754731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:08.755495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:08.783449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:08.784026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:08.784599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:08.785457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:08.786029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:08.786571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:09.947997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:09.958318 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d5d47a49-efb1-4ced-8b76-180386d48a1e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1540 microversion: 2.1 time: 2.013950 Oct 26 05:05:09.962666 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 574/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:07 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1540 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:09.975697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:09.986873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:10.008343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:10.009040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:10.012433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:10.013465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:10.014486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:10.016168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:10.505945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:10.528742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:10.531330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:10.538632 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-975550c9-d8ca-4096-bd70-f2c16114173a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.787513 Oct 26 05:05:10.553811 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 587/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:08 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:10.569237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-266a813a-e42c-49e4-97e5-6405c80bb937 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a80e430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:10.646634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:10.653196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:10.674898 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-266a813a-e42c-49e4-97e5-6405c80bb937 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.118413 Oct 26 05:05:10.676830 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cbf0a10-f878-4d0d-8e46-fdee377e47eb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1537 microversion: 2.1 time: 0.712924 Oct 26 05:05:10.685016 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 588/1162] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:10 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:10.685200 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 575/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:09 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1537 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:10.685334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ce200255-d4bd-4530-b345-1451b4a00200 req-88102fb7-3159-499a-91fc-88d7a3bd370b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9dca6b-e1aa-420f-838b-c9af8a42bee6", "name": "network-vif-plugged", "status": "completed", "tag": "4e604617-e2f4-4f7b-acea-0f42fc5b992a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:10.698458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce200255-d4bd-4530-b345-1451b4a00200 req-88102fb7-3159-499a-91fc-88d7a3bd370b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:10.699682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce200255-d4bd-4530-b345-1451b4a00200 req-88102fb7-3159-499a-91fc-88d7a3bd370b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:10.703405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce200255-d4bd-4530-b345-1451b4a00200 req-88102fb7-3159-499a-91fc-88d7a3bd370b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:10.719961 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce200255-d4bd-4530-b345-1451b4a00200 req-88102fb7-3159-499a-91fc-88d7a3bd370b service nova] Creating event network-vif-plugged:4e604617-e2f4-4f7b-acea-0f42fc5b992a for instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 on n-h2-862416-4 Oct 26 05:05:10.729719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ce200255-d4bd-4530-b345-1451b4a00200 req-88102fb7-3159-499a-91fc-88d7a3bd370b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049858 Oct 26 05:05:10.731914 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 589/1164] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:10.984797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:10.985456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:11.000471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:11.001151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:11.001797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:11.002972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:11.003600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:11.004192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:11.570606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:11.571447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:11.617284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:11.618449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:11.619902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:11.620915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:11.624059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:11.625623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:11.719311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:11.734792 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7262e88-0651-4f2b-b757-4f5abada0bf6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1522 microversion: 2.1 time: 0.754655 Oct 26 05:05:11.758167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 576/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:10 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:11.770291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e51112b2-2f4d-49ee-8fb2-b8d379236b0e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ea733a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:11.866262 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e51112b2-2f4d-49ee-8fb2-b8d379236b0e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.106389 Oct 26 05:05:11.867250 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 577/1166] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:11 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:11.878015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:11.882914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:11.904957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:11.908453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:11.909236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:11.910687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:11.911763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:11.914791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:12.400741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:12.410845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:12.417510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:12.422546 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1078de7-efc9-40c1-8b5f-22a7907a8acd tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.857651 Oct 26 05:05:12.423333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 590/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:11 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:12.444096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:12.444610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:12.463202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:12.463704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:12.464144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:12.464860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:12.465503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:12.465784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:12.538924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:05:12.600954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:12.609824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-910f271d-e093-452e-a163-31ef07c29137 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 0.740734 Oct 26 05:05:12.616784 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 578/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:11 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:12.747533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c982232e-1ba2-4a08-a512-364108811a72 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 204 len: 0 microversion: 2.1 time: 0.319093 Oct 26 05:05:12.750561 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 591/1169] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:05:12 2022] DELETE /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:05:12.763384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:12.764336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:12.776177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:12.778841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:12.780556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:12.783767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:12.784536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:12.785656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:12.890333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-559123d7-2a03-4771-a350-1ef2d875b08d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ab30ca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:12.981391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-559123d7-2a03-4771-a350-1ef2d875b08d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.098269 Oct 26 05:05:12.982322 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 592/1170] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:12 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:13.023980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3abde99c-d633-4f6d-a8e7-1d2e30e3e897 req-c4ce1070-86df-498b-afe7-ca7905d5a272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9dca6b-e1aa-420f-838b-c9af8a42bee6", "name": "network-vif-unplugged", "status": "completed", "tag": "4e604617-e2f4-4f7b-acea-0f42fc5b992a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:13.059847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3abde99c-d633-4f6d-a8e7-1d2e30e3e897 req-c4ce1070-86df-498b-afe7-ca7905d5a272 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:13.063890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3abde99c-d633-4f6d-a8e7-1d2e30e3e897 req-c4ce1070-86df-498b-afe7-ca7905d5a272 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:13.065622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3abde99c-d633-4f6d-a8e7-1d2e30e3e897 req-c4ce1070-86df-498b-afe7-ca7905d5a272 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:13.097681 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3abde99c-d633-4f6d-a8e7-1d2e30e3e897 req-c4ce1070-86df-498b-afe7-ca7905d5a272 service nova] Creating event network-vif-unplugged:4e604617-e2f4-4f7b-acea-0f42fc5b992a for instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 on n-h2-862416-4 Oct 26 05:05:13.118413 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3abde99c-d633-4f6d-a8e7-1d2e30e3e897 req-c4ce1070-86df-498b-afe7-ca7905d5a272 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098442 Oct 26 05:05:13.121462 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 593/1171] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:05:13.456869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:13.457996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:13.485786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:13.486622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:13.487349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:13.490337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:13.492640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:13.494861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:14.101758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:14.113765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d054267b-6e2f-4dcb-8dd6-f19371c3304e tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1528 microversion: 2.1 time: 1.357452 Oct 26 05:05:14.118187 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 579/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:12 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1528 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:14.129048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:14.132383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:14.144983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:14.146456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:14.147786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:14.151356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:14.152531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:14.153932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:14.423133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:14.453617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:14.455573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:14.460525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18f59a88-9ccc-455b-a0d0-fe686c4b8bdc tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.009160 Oct 26 05:05:14.485257 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 594/1173] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:13 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:14.502446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d82b5a2-ca94-44df-9ce4-95b5d8b433f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a8233a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:14.589058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d82b5a2-ca94-44df-9ce4-95b5d8b433f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.102261 Oct 26 05:05:14.614317 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 595/1174] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:14 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:14.656731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:14.667886 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7beffdcd-7236-4565-839c-48de972a88b5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 0.548172 Oct 26 05:05:14.689963 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 580/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:14 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:15.144157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:15.145400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:15.178641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:15.179644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:15.180396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:15.181929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:15.183043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:15.183844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:15.492143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:15.493408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:15.504523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:15.507570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:15.510905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:15.511982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:15.514787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:15.516559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:15.912339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:15.931373 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a2b8a0b5-2a3b-425b-9e41-ed3cd2216a27 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1528 microversion: 2.1 time: 0.790592 Oct 26 05:05:15.956008 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 596/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:15 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1528 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:15.980851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c78f132-fd1b-46cb-bcd8-a98ce9bfdc70 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a941940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:16.074413 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c78f132-fd1b-46cb-bcd8-a98ce9bfdc70 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.115544 Oct 26 05:05:16.083343 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 597/1177] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:15 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:16.085738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:16.086363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:16.119741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:16.125956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:16.126486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:16.129740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:16.130242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:16.130692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:16.159150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:16.169578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:16.171210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:16.172416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2be686d6-b798-47f5-bbe2-9af1b222bc59 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.685858 Oct 26 05:05:16.212536 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 581/1178] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:15 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:16.688676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ad3026d1-367c-46f6-86b7-c7343650c4c4 req-5c622c33-55fb-4163-89e6-dae8d826c999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9dca6b-e1aa-420f-838b-c9af8a42bee6", "name": "network-vif-deleted", "tag": "4e604617-e2f4-4f7b-acea-0f42fc5b992a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:16.693865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:16.712433 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1638b517-46b1-48c8-8093-2fce70a45d49 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 0.629193 Oct 26 05:05:16.725595 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 598/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:16 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:16.727472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ad3026d1-367c-46f6-86b7-c7343650c4c4 req-5c622c33-55fb-4163-89e6-dae8d826c999 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:16.728037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ad3026d1-367c-46f6-86b7-c7343650c4c4 req-5c622c33-55fb-4163-89e6-dae8d826c999 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:16.731418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ad3026d1-367c-46f6-86b7-c7343650c4c4 req-5c622c33-55fb-4163-89e6-dae8d826c999 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:16.805778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ad3026d1-367c-46f6-86b7-c7343650c4c4 req-5c622c33-55fb-4163-89e6-dae8d826c999 service nova] Creating event network-vif-deleted:4e604617-e2f4-4f7b-acea-0f42fc5b992a for instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 on n-h2-862416-4 Oct 26 05:05:16.833570 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ad3026d1-367c-46f6-86b7-c7343650c4c4 req-5c622c33-55fb-4163-89e6-dae8d826c999 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151688 Oct 26 05:05:16.845271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 582/1180] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:16.965518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:16.966828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:16.980243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:16.984933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:16.988356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:16.989431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:17.000219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:17.001102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:17.091813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09f43075-c079-4680-a57d-4ad949298018 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470eba48b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:18.134425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:18.143533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a7085630-0629-4f5e-871f-1151f44ecd03 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 200 len: 1310 microversion: 2.1 time: 1.184875 Oct 26 05:05:18.147963 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 599/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:16 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 1310 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:18.171470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:18.174521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:18.187693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:18.188781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:18.189881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:18.198764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:18.199621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:18.200285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:18.257229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:18.726306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:18.752564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:18.780591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:18.783556 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed40df4f-bb70-4ca8-aaca-9e433765ebd3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.633209 Oct 26 05:05:18.788510 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 600/1182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:18 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:18.812346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:18.816357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:18.855406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:18.856327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:18.860768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:18.888545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:18.892552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:18.893575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:20.114621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:20.123344 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4860fa66-3202-4395-9b9f-1dce544781ee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 1.329018 Oct 26 05:05:20.123941 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 601/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:18 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:20.142913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:20.146948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:20.176069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:20.177031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:20.178602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:20.185094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:20.188930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:20.192286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:20.253728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 HTTP/1.1 Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:05:20.266805 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:05:20.268749 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9b9dca6b-e1aa-420f-838b-c9af8a42bee6'} Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:05:20.269807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:05:20.271518 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:05:20.274997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:05:20.277232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eca83044-784f-4e34-b3bd-a817cbb78548 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 404 len: 111 microversion: 2.1 time: 0.149180 Oct 26 05:05:20.279324 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 602/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:20 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:05:20.291144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:20.307077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:20.335339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:20.335863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:20.336393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:20.337040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:20.337560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:20.341289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:21.272212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:21.290569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:21.297006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:21.300171 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ad9fc86-6283-4faf-9a09-48d634584ad7 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.018009 Oct 26 05:05:21.314591 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 603/1185] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:20 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:21.356109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5e136554-3e1f-4c02-acbb-1295ef627e02 req-51023926-272f-43c1-bd46-eaabe6efa8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d8713-2b19-48a3-987e-27843e15111f", "name": "network-vif-unplugged", "status": "completed", "tag": "895a25f8-b756-40d5-83d8-7c6eeaa273b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:21.403271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5e136554-3e1f-4c02-acbb-1295ef627e02 req-51023926-272f-43c1-bd46-eaabe6efa8ae service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:21.403755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5e136554-3e1f-4c02-acbb-1295ef627e02 req-51023926-272f-43c1-bd46-eaabe6efa8ae service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:21.404192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5e136554-3e1f-4c02-acbb-1295ef627e02 req-51023926-272f-43c1-bd46-eaabe6efa8ae service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:21.453467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5e136554-3e1f-4c02-acbb-1295ef627e02 req-51023926-272f-43c1-bd46-eaabe6efa8ae service nova] Creating event network-vif-unplugged:895a25f8-b756-40d5-83d8-7c6eeaa273b0 for instance e07d8713-2b19-48a3-987e-27843e15111f on n-h1-862416-4 Oct 26 05:05:21.484125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5e136554-3e1f-4c02-acbb-1295ef627e02 req-51023926-272f-43c1-bd46-eaabe6efa8ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157114 Oct 26 05:05:21.488765 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 604/1186] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:21.500480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09f43075-c079-4680-a57d-4ad949298018 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 4.412931 Oct 26 05:05:21.507391 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 583/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:17 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 4420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:21.509094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1040708902", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:21.513169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:21.515469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:21.527000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=79 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:21.539650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:21.540493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:21.541151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:21.542199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:21.542885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:21.543524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:21.642520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] validate_networks() for [('6bd1105c-8c6d-456c-9c51-070859af68ac', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:05:22.749658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:22.758311 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c314daa8-e650-465c-b581-5f6564b4b7a8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 1.249408 Oct 26 05:05:22.758903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 584/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:21 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:22.795474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:22.801736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:22.840124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:22.848549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:22.849014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:22.856569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:22.867060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:22.868720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:24.175638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:24.192534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:24.198248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:24.200681 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b673eaa-6078-4fd0-b32c-07db96813208 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.440709 Oct 26 05:05:24.223426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 585/1189] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:22 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:24.236689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d038df7f-899b-4f81-bd67-b6b17e66f732 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470eb690d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:24.323593 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d038df7f-899b-4f81-bd67-b6b17e66f732 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.098387 Oct 26 05:05:24.324846 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 586/1190] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:24 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:24.338519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7d020e90-f424-4991-b7aa-0b615d141279 req-ec82b9b4-4c2f-443d-a2bb-29cfe0c1e12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07d8713-2b19-48a3-987e-27843e15111f", "tag": "895a25f8-b756-40d5-83d8-7c6eeaa273b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:24.363941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7d020e90-f424-4991-b7aa-0b615d141279 req-ec82b9b4-4c2f-443d-a2bb-29cfe0c1e12a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:24.376355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7d020e90-f424-4991-b7aa-0b615d141279 req-ec82b9b4-4c2f-443d-a2bb-29cfe0c1e12a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:24.377851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7d020e90-f424-4991-b7aa-0b615d141279 req-ec82b9b4-4c2f-443d-a2bb-29cfe0c1e12a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:24.450741 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7d020e90-f424-4991-b7aa-0b615d141279 req-ec82b9b4-4c2f-443d-a2bb-29cfe0c1e12a service nova] Creating event network-changed:895a25f8-b756-40d5-83d8-7c6eeaa273b0 for instance e07d8713-2b19-48a3-987e-27843e15111f on n-h1-862416-4 Oct 26 05:05:24.470614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7d020e90-f424-4991-b7aa-0b615d141279 req-ec82b9b4-4c2f-443d-a2bb-29cfe0c1e12a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139643 Oct 26 05:05:24.471986 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 587/1191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:24.487239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:24.490414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:24.507493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:24.508720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:24.509738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:24.510950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:24.514112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:24.516164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:24.548967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:05:24.549685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:05:24.550343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:05:24.550956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:05:24.551539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:05:24.574483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:24.576660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:24.577124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:24.577932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:24.578404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:24.578842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:24.644333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for project 05ec452e1add45cdb311971b90e34200. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:05:24.656536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Getting quotas for user c496b6a683e147f8b41e82b2921454d6 and project 05ec452e1add45cdb311971b90e34200. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:05:24.701870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:05:24.704800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:05:24.867342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd57a6a9-6392-4201-bdfb-a5b2eb0e88a5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.373236 Oct 26 05:05:24.875089 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 605/1192] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:05:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:05:24.890216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f81f66ed-afb6-4284-b558-46b6f6cec264 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:24.891120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f81f66ed-afb6-4284-b558-46b6f6cec264 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:25.157354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f81f66ed-afb6-4284-b558-46b6f6cec264 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:25.167842 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f81f66ed-afb6-4284-b558-46b6f6cec264 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1225 microversion: 2.1 time: 0.281691 Oct 26 05:05:25.177750 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 606/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:24 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1225 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:25.241067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:25.241779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:25.286130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:25.305059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:25.305943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:25.307086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:25.307757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:25.308407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:25.866412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:25.892312 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3af6a024-db1c-4584-ad3a-3f5d7c070ec2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 1.416929 Oct 26 05:05:25.894345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 588/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:24 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:25.908378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a7f0059-4f58-4dbd-8229-fb0b7b7fc7f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ea0cc10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:26.011114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a7f0059-4f58-4dbd-8229-fb0b7b7fc7f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.115475 Oct 26 05:05:26.012021 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 589/1195] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:25 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:26.214396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9eb3e53a-b97a-4aa8-8046-a1943c954267 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:26.218071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9eb3e53a-b97a-4aa8-8046-a1943c954267 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:26.398492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:26.402910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9eb3e53a-b97a-4aa8-8046-a1943c954267 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:26.425456 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9eb3e53a-b97a-4aa8-8046-a1943c954267 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1225 microversion: 2.1 time: 0.211063 Oct 26 05:05:26.427713 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 590/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:26 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1225 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:26.454173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:26.461057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:26.463531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0402de97-5ee1-46e9-a65d-625cf65204e1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.227340 Oct 26 05:05:26.464756 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 607/1197] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:25 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:26.924962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:26.925779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:26.941776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:26.943530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:26.944078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:26.946409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:26.948378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:26.951692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:27.033663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b31a423-b6be-4764-83c9-016191e16886 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a9a2af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:27.135664 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b31a423-b6be-4764-83c9-016191e16886 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.107165 Oct 26 05:05:27.170836 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 608/1198] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:27 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:27.454528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:27.470130 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ba14cba-863b-4bac-b0cf-7fa94f7a77c0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 0.549073 Oct 26 05:05:27.471324 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 591/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:26 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:27.481529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:27.483607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:27.495843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:27.498149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:27.498860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:27.499806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:27.503111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:27.503870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:27.658067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:27.672126 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed2a5b9d-7604-4677-93a6-8bd2d75939e4 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1277 microversion: 2.1 time: 0.199534 Oct 26 05:05:27.681638 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 592/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:27 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:27.695085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:27.697063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-304549678", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d084340c-589b-4a43-855f-22cdd2964102"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:27.698457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:27.723582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:27.724400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:27.725218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:27.730982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:27.731477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:27.731928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:27.880753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] validate_networks() for [('d084340c-589b-4a43-855f-22cdd2964102', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:05:28.812433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:28.822598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:28.835202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:28.844943 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0cd04834-c3f9-46f4-9d43-fe04f3b711e5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.165426 Oct 26 05:05:28.850015 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 593/1201] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:27 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:28.863598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a6e7385-1cba-416a-98ba-416aeaeefa09 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ea0c940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:29.092776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a6e7385-1cba-416a-98ba-416aeaeefa09 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1414 microversion: 2.1 time: 0.240612 Oct 26 05:05:29.118995 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 594/1202] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:28 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1414 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:29.158723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:29.164520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:29.226995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:29.229749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:29.236463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:29.246908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:29.251474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:29.253417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:30.477771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:05:30.483269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:05:30.484062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:05:30.484649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:05:30.485237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:05:30.514852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:30.525983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:30.526849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:30.527876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:30.528344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:30.528776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:30.578923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:30.588519 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0163eb13-dd74-42f0-afb8-c3f7912d826a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 1.463442 Oct 26 05:05:30.589111 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 595/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:29 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:30.616280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Getting quotas for project 33c3c90010884e638985cbbc2c91757b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:05:30.624354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Getting quotas for user 7e5bfb998a6e4f87ad47eaddae04a60d and project 33c3c90010884e638985cbbc2c91757b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:05:30.626145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:30.634186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:30.645969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Going to run 3 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:05:30.649223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:05:30.650567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:30.654251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:30.662212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:30.670266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:30.671259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:30.671902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:30.718070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=c9d33722-dbfe-4da7-b65c-510fe13e50f3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:05:30.836595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=60d71a4a-1263-4408-a694-d9ceded8ae86,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:05:30.861797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:30.862773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:30.879267 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a6deab1-1e9f-4293-9233-992c29e43fce tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1283 microversion: 2.1 time: 0.265209 Oct 26 05:05:30.897203 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 596/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:30 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1283 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:30.912289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:30.913126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:30.936077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:30.936483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:30.937676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:30.945172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:30.945605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:30.946235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:31.063561 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a9d394e-88be-46fb-9536-5afe018d77c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.681242 Oct 26 05:05:31.066242 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 609/1205] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:05:31.075415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-536cfd09-b6ae-493d-a2a4-b358dea0256b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a823310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:31.337060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:31.350916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:31.352610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:31.354057 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cab30509-28f7-4543-8cc0-80e8365de404 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.455764 Oct 26 05:05:31.355178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 597/1206] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:30 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:31.361061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:31.366564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:31.367551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:05:31.410313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:31.411631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:31.412522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:31.413501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:31.414237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:31.415075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:31.574124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-374f7bbc-c100-40c6-bcb6-e062ab7a2971 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.217514 Oct 26 05:05:31.575922 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 598/1207] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:05:31 2022] GET /compute/v2.1/servers => generated 1015 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:31.618605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7de76756-1f00-4d72-9a97-85554f27a2a3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:31.622001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7de76756-1f00-4d72-9a97-85554f27a2a3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:31.822484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7de76756-1f00-4d72-9a97-85554f27a2a3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:31.833942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7de76756-1f00-4d72-9a97-85554f27a2a3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1222 microversion: 2.1 time: 0.239623 Oct 26 05:05:31.841303 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 599/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:31 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1222 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:31.888917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:31.897657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:31.928740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:31.929613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:31.930350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:31.931395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:31.932023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:31.932616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:32.289767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:32.317266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-074dbaeb-3693-4993-8cde-28db6ff34aec tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 0.461410 Oct 26 05:05:32.320765 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 600/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:31 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:32.348607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:32.352678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:32.384544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:32.385258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:32.388714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:32.389822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:32.390313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:32.390759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:32.468099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:32.600105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:32.637754 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ebd0e582-8229-49ca-b2cf-57b25ac29f34 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1283 microversion: 2.1 time: 0.310946 Oct 26 05:05:32.644569 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 601/1210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:32 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1283 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:32.666390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:32.672926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:32.696499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:32.697839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:32.701982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:32.705663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:32.707144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:32.708153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:33.058850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:33.089215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:33.110400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:33.126021 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6da90fd5-8ace-486b-a6f1-c36aab32c014 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.479891 Oct 26 05:05:33.128729 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 602/1211] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:32 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:33.134244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6e7a15a-4d61-4b78-84dc-a738152c12c1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:33.147879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6e7a15a-4d61-4b78-84dc-a738152c12c1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:33.379343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6e7a15a-4d61-4b78-84dc-a738152c12c1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:33.389346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6e7a15a-4d61-4b78-84dc-a738152c12c1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1222 microversion: 2.1 time: 0.257491 Oct 26 05:05:33.395322 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 603/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:33 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:33.401066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:33.401704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:33.428412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:33.429953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:33.430651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:33.435577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:33.436420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:33.437079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:35.416965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:35.430649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70e92d84-942d-4601-807b-7392ae25bf90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1542 microversion: 2.1 time: 2.034120 Oct 26 05:05:35.433551 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 604/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:33 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1542 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:35.480348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:35.483611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:35.497697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:35.498648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:35.499361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:35.501134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:35.501918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:35.504062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:36.967678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:36.993006 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fc9e175-9bd3-49de-b2da-a916c71ad5fc tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 1.556917 Oct 26 05:05:37.003092 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:35 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:37.015638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:37.032556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:37.082249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:37.082988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:37.083454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:37.093795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:37.094409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:37.094869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:38.938220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:38.958751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:38.963992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:38.972879 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c1b3ee0-d4b0-4e92-9cfe-4a71029e7ad3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.964051 Oct 26 05:05:38.975694 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 606/1215] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:37 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:38.992581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:38.993212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:39.018708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:39.019209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:39.022002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:39.024156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:39.028622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:39.032182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:39.520517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:39.534919 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b6d1eed-e799-4c29-9b32-e698a144719e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1280 microversion: 2.1 time: 0.552557 Oct 26 05:05:39.545357 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 607/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:38 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1280 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:39.554929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "name": "network-vif-unplugged", "status": "completed", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:39.583648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:39.584166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:39.584606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:39.600772 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] Creating event network-vif-unplugged:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:05:39.609210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:05:39.616466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4625e065-a35a-4868-a182-6a04b4ed94f0 req-ecd51da8-8eb9-4ceb-8b35-8e829b086046 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077114 Oct 26 05:05:39.617153 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 608/1217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:39.624403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:39.625499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:39.633351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:39.634263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:39.634871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:39.635797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:39.636598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:39.637494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:40.273953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-536cfd09-b6ae-493d-a2a4-b358dea0256b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1423 microversion: 2.1 time: 9.206352 Oct 26 05:05:40.274552 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 610/1218] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:31 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1423 bytes in 9208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:40.285050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:40.285718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:40.319165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:40.319667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:40.320326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:40.321057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:40.323181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:40.325264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:40.555460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:40.570672 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc7ef61e-2148-4256-b4b2-1d062abe4eee tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1541 microversion: 2.1 time: 0.951878 Oct 26 05:05:40.571674 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 609/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:39 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1541 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:40.580108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:40.582921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:40.588095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:40.603335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:40.604341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:40.604966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:40.605908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:40.606539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:40.607806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:40.640058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=14 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:41.504548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:41.691733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:41.704346 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-806f3038-5027-446c-a077-6ee2d7feeab5 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 1.427555 Oct 26 05:05:41.708128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 611/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:40 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:41.717808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9f7480a-0813-4052-a10f-9e34d626c23d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a7dc160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:41.835288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9f7480a-0813-4052-a10f-9e34d626c23d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 200 len: 1423 microversion: 2.1 time: 0.125611 Oct 26 05:05:41.846322 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 612/1221] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:05:41 2022] GET /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:41.863579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:41.865292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:41.888461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:41.896205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:41.897039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:41.907419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:41.908255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:41.908928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:42.025596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:42.040663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:42.050497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:42.051961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48098e98-dc2c-407d-9757-252217af8b95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 1.478923 Oct 26 05:05:42.053070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 610/1222] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:40 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:42.062239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:42.066860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:42.083363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:42.091240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:42.092789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:42.093823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:42.094505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:42.096112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:43.384379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:43.522827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:43.537964 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd664127-7be0-4139-8785-1d5b7c7881aa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1280 microversion: 2.1 time: 1.687072 Oct 26 05:05:43.557612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 613/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:41 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1280 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:43.568674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54ceed2b-e87c-4155-880d-d01fb97e6938 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a827790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:44.506617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:44.517693 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd0d1567-720f-4262-8a64-c69b17bb6523 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1541 microversion: 2.1 time: 2.459883 Oct 26 05:05:44.520369 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 611/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:42 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1541 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:44.543680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:44.546008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:44.554172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:44.561264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:44.562234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:44.563720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:44.565536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:44.566245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:44.742272 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54ceed2b-e87c-4155-880d-d01fb97e6938 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 204 len: 0 microversion: 2.1 time: 1.178169 Oct 26 05:05:44.751867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 614/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:43 2022] DELETE /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 0 bytes in 1190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:05:44.761848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:44.764616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:44.782873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:44.786540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:44.787642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:44.789705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:44.792000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:44.792715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:45.326229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:45.335581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-866231a5-edb1-411c-a1cc-6d86d3d5ac42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.800103 Oct 26 05:05:45.336166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 612/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:44 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:45.343415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:45.350301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:45.368124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:45.368921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:45.369578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:45.370464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:45.371149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:45.371580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:45.513737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:45.523261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:45.524780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:45.536569 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1add6962-c07d-43ac-9194-ff1047f03e98 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.783179 Oct 26 05:05:45.549681 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 615/1227] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:44 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:45.549681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:45.549856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:45.574722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:45.576232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:45.578953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:45.582144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:45.582844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:45.584112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:45.664302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:05:45.869194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c847c169-6f3c-4021-a57c-5c19127760fe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 204 len: 0 microversion: 2.1 time: 0.324505 Oct 26 05:05:45.870211 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 616/1228] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:05:45 2022] DELETE /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:05:45.879936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-35d1529a-e653-4c44-9b48-c7c3cddd1999 req-8c1ce91d-01ca-4cb1-b407-8f83ee06ca10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be1e9b92-1459-4e68-8724-8f167d464102", "tag": "c6bbc87f-d448-4b13-9d31-16005e77c8ee"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:45.905494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-35d1529a-e653-4c44-9b48-c7c3cddd1999 req-8c1ce91d-01ca-4cb1-b407-8f83ee06ca10 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:45.906976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-35d1529a-e653-4c44-9b48-c7c3cddd1999 req-8c1ce91d-01ca-4cb1-b407-8f83ee06ca10 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:45.907579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-35d1529a-e653-4c44-9b48-c7c3cddd1999 req-8c1ce91d-01ca-4cb1-b407-8f83ee06ca10 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:45.937843 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-35d1529a-e653-4c44-9b48-c7c3cddd1999 req-8c1ce91d-01ca-4cb1-b407-8f83ee06ca10 service nova] Creating event network-changed:c6bbc87f-d448-4b13-9d31-16005e77c8ee for instance be1e9b92-1459-4e68-8724-8f167d464102 on n-h2-862416-4 Oct 26 05:05:45.951451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-35d1529a-e653-4c44-9b48-c7c3cddd1999 req-8c1ce91d-01ca-4cb1-b407-8f83ee06ca10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079706 Oct 26 05:05:45.952326 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 617/1229] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:45.967478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-26b1f4a7-b5d0-4d81-a8f9-4bac6bf320d9 req-2ccaac9b-d629-4f7e-b967-4629f5fe6271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c7821e-445f-43cc-84e8-7e697b1dd6c3", "name": "network-vif-unplugged", "status": "completed", "tag": "de5767ec-427f-4e5e-b355-722b276d6fbb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:46.001971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-26b1f4a7-b5d0-4d81-a8f9-4bac6bf320d9 req-2ccaac9b-d629-4f7e-b967-4629f5fe6271 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:46.002378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-26b1f4a7-b5d0-4d81-a8f9-4bac6bf320d9 req-2ccaac9b-d629-4f7e-b967-4629f5fe6271 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:46.002819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-26b1f4a7-b5d0-4d81-a8f9-4bac6bf320d9 req-2ccaac9b-d629-4f7e-b967-4629f5fe6271 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:46.048537 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-26b1f4a7-b5d0-4d81-a8f9-4bac6bf320d9 req-2ccaac9b-d629-4f7e-b967-4629f5fe6271 service nova] Creating event network-vif-unplugged:de5767ec-427f-4e5e-b355-722b276d6fbb for instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 on n-h2-862416-4 Oct 26 05:05:46.067171 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-26b1f4a7-b5d0-4d81-a8f9-4bac6bf320d9 req-2ccaac9b-d629-4f7e-b967-4629f5fe6271 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113271 Oct 26 05:05:46.071787 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 618/1230] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:46.080715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:46.086011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:46.086782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:46.099586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f32403a2-8398-4004-b43b-1d76e34a900a tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.753236 Oct 26 05:05:46.105215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:46.105753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:46.106198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:46.107134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:46.107598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:46.108035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:46.120342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 613/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:45 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:46.135617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-143910369", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "92d513bb-c446-48d6-b8f5-d149382fd9ca"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:46.308436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] validate_networks() for [('92d513bb-c446-48d6-b8f5-d149382fd9ca', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:05:46.554772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:46.573655 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4487393b-2f32-465f-99db-c111dcdab5cb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1470 microversion: 2.1 time: 0.496236 Oct 26 05:05:46.576096 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 619/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:46 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1470 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:46.588662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:46.590094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:46.611537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:46.615993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:46.620842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:46.623393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:46.627079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:46.627543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:47.441251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:05:47.445059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:05:47.445787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:05:47.446403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:05:47.446987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:05:47.467887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:47.472979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:47.476225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:47.483780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:47.485126 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e1db3e14-1985-4e06-8c49-2408871efe5a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.907475 Oct 26 05:05:47.486282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:47.486557 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 620/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:46 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:47.487322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:47.488508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:47.500151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:47.500827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:47.515472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:47.517971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:47.519618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:47.520675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:47.527229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:47.527841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:47.562917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:05:47.587109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for user 6390eed87d6a41df96e727227de791bb and project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:05:47.640997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:05:47.650260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:05:47.859981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-12c65aec-79aa-4e1c-a3a7-3e256d4de8d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738356 Oct 26 05:05:47.868584 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 614/1234] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:05:47.892822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:47.896543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:47.924515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:47.925014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:47.932532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:47.938521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:47.939111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:47.941745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:48.127993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:48.128550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:48.129216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:48.130062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:48.130526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:48.130960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:48.199400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:05:48.212039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for user 5e48790bfe71452288c91f49586a624e and project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:05:48.490379 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-14d8af62-ce91-4c4c-8b88-59f3ff640119 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65/action" status: 202 len: 0 microversion: 2.1 time: 0.620392 Oct 26 05:05:48.497906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 615/1235] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:05:47 2022] POST /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:05:48.534017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:48.534795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:48.550335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:48.550844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:48.551290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:48.558428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:48.559323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:48.560375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:49.660705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:49.673507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:49.692666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:49.700980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:49.709761 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e203ef3-58fd-4dd2-9e68-40f1cf6031fb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 2.221442 Oct 26 05:05:49.735371 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 621/1236] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:47 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:50.155993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-202327760", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "3985538d-bfbe-4200-9b84-bfdebdcb224a"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:50.276492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] validate_networks() for [('3985538d-bfbe-4200-9b84-bfdebdcb224a', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:05:50.286449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:50.297018 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7402241-c955-48e7-a68c-4c115644c3cc tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 1.784810 Oct 26 05:05:50.297696 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 616/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:48 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:50.308772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:50.309406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:50.332841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:50.333358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:50.333808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:50.334523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:50.334977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:50.349955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:50.423877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:50.542965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:50.560342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d0f02aff-f792-45b7-8d78-4de8b561f4cf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1259 microversion: 2.1 time: 0.254652 Oct 26 05:05:50.561463 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 617/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:50 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:50.580632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "name": "network-vif-plugged", "status": "completed", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:50.605362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:50.614215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:50.614660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:50.656595 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] Creating event network-vif-plugged:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:05:50.672213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:05:50.699201 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2667f2ea-7170-4e72-8725-572a64971988 req-aadba5d6-c231-4b8d-a6bf-c7d0c75e53ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136451 Oct 26 05:05:50.700154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 618/1239] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:50.706185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:50.707129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:50.719387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:50.721263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:50.721958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:50.722563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:50.723467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:50.726769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:50.728532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:51.460663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:51.470469 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b529570-b562-46de-a588-03e83b35ab81 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1469 microversion: 2.1 time: 0.768396 Oct 26 05:05:51.471060 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 619/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:50 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1469 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:51.491031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:51.494264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:51.511203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:51.511968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:51.513424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:51.514592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:51.518060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:51.520724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:51.956122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:05:51.956532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:05:51.956865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:05:51.957529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:05:51.958133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:05:51.969959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:51.971786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:51.979126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:51.981594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:51.982479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:51.984467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:51.991141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:51.999905 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bdfef2c8-ab2e-480e-80ad-bf13991038db tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.520299 Oct 26 05:05:52.005487 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 620/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:51 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:52.052047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Getting quotas for project 67fbce7c49554dde9754fc79cbffa8be. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:05:52.065336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Getting quotas for user ebf85e7319884c87ba745771b8abaa92 and project 67fbce7c49554dde9754fc79cbffa8be. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:05:52.097131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:05:52.099679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:05:52.152668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9330c18f-8b7f-4b6f-84cc-9a83086adfd9 req-7e0162f9-0012-4823-baf8-c4142a8991cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c7821e-445f-43cc-84e8-7e697b1dd6c3", "name": "network-vif-deleted", "tag": "de5767ec-427f-4e5e-b355-722b276d6fbb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:52.176555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9330c18f-8b7f-4b6f-84cc-9a83086adfd9 req-7e0162f9-0012-4823-baf8-c4142a8991cc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.177754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9330c18f-8b7f-4b6f-84cc-9a83086adfd9 req-7e0162f9-0012-4823-baf8-c4142a8991cc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.178710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9330c18f-8b7f-4b6f-84cc-9a83086adfd9 req-7e0162f9-0012-4823-baf8-c4142a8991cc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.209338 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-463d2c88-37e8-4d0d-ab9c-780716038926 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.472467 Oct 26 05:05:52.216853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 622/1242] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:05:52.226993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0e43d85e-cb4f-4a33-ac99-11b5c12ac311 req-c25d8ab2-fd3f-4673-af35-21547fd50124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d33722-dbfe-4da7-b65c-510fe13e50f3", "tag": "9e2dd033-169e-403c-a393-6f8c43832ce4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:52.229628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9330c18f-8b7f-4b6f-84cc-9a83086adfd9 req-7e0162f9-0012-4823-baf8-c4142a8991cc service nova] Creating event network-vif-deleted:de5767ec-427f-4e5e-b355-722b276d6fbb for instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 on n-h2-862416-4 Oct 26 05:05:52.242138 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9330c18f-8b7f-4b6f-84cc-9a83086adfd9 req-7e0162f9-0012-4823-baf8-c4142a8991cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235186 Oct 26 05:05:52.245177 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 621/1243] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:52.267764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0e43d85e-cb4f-4a33-ac99-11b5c12ac311 req-c25d8ab2-fd3f-4673-af35-21547fd50124 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.268273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0e43d85e-cb4f-4a33-ac99-11b5c12ac311 req-c25d8ab2-fd3f-4673-af35-21547fd50124 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.268711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0e43d85e-cb4f-4a33-ac99-11b5c12ac311 req-c25d8ab2-fd3f-4673-af35-21547fd50124 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.280579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:52.281881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:52.293168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.304761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.305530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.306442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.308874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.310191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0e43d85e-cb4f-4a33-ac99-11b5c12ac311 req-c25d8ab2-fd3f-4673-af35-21547fd50124 service nova] Creating event network-changed:9e2dd033-169e-403c-a393-6f8c43832ce4 for instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 on n-h1-862416-4 Oct 26 05:05:52.310839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.324305 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0e43d85e-cb4f-4a33-ac99-11b5c12ac311 req-c25d8ab2-fd3f-4673-af35-21547fd50124 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105774 Oct 26 05:05:52.326078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 623/1244] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:52.335519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:52.339411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:52.348813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.352344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.352817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.353628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.354797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.355232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.764660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:52.777716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e91ce9f-ad6e-4536-8fcf-b8f38048a6ef tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.446844 Oct 26 05:05:52.780175 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 624/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:52 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:52.793876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:52.797710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:52.814797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.820092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.825306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.826538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:52.828777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:52.831735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:52.882913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:52.917093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:52.924527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:52.936064 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1848a746-61b9-4091-9540-ebb0a23f4943 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.686489 Oct 26 05:05:52.945144 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 622/1246] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:52 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:52.974750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-998cc4b1-25d7-4123-91f8-fefb74751656 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:52.975467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-998cc4b1-25d7-4123-91f8-fefb74751656 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:53.152326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-998cc4b1-25d7-4123-91f8-fefb74751656 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:53.178777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-998cc4b1-25d7-4123-91f8-fefb74751656 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1223 microversion: 2.1 time: 0.230118 Oct 26 05:05:53.179402 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 623/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:52 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1223 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:53.216121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:53.216747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:53.251745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:53.252278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:53.257943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:53.261986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:53.269093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:53.270382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:53.419847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:53.430215 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3154d2e-f3c7-4b23-8627-552f2e414bfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1267 microversion: 2.1 time: 0.648709 Oct 26 05:05:53.444877 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 625/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:52 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1267 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:53.461419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:53.465442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:53.488320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:53.489835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:53.490532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:53.492634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:53.493350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:53.494113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:53.783522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:53.794273 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab244a88-5460-4a36-9e30-e1cc82521abe tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1469 microversion: 2.1 time: 0.583991 Oct 26 05:05:53.802507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 624/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:53 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1469 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:53.814607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:53.815651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:53.828036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:53.831393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:53.832067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:53.834051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:53.836251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:53.841621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.053511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.067283 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86b472ba-6f8a-4842-ab2c-be2a0d525a40 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.616386 Oct 26 05:05:54.068080 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 626/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:53 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:54.076355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:54.078071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:54.093329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.094216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.094917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.095889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.099360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.103266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.329065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.337578 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11b8ea17-9841-4dc9-876c-3d0c4f39b288 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.533663 Oct 26 05:05:54.344930 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 625/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:53 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:54.353031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:54.353685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:54.384077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.384586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.385053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.385898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.386380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.397476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.575469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.593593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.599980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.601264 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3af2bed-b176-4399-a90f-5ed557a335b0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.531885 Oct 26 05:05:54.601864 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 627/1252] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:54 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:54.605808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.627967 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-139d7266-7fe3-46a9-9455-1303385f7687 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1227 microversion: 2.1 time: 0.281742 Oct 26 05:05:54.628548 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 626/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:54 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1227 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:54.639851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:54.640662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d71a4a-1263-4408-a694-d9ceded8ae86", "tag": "3ec4081f-0d42-4526-ac70-45a8f2f2e315"}, {"name": "network-changed", "server_uuid": "b261345c-dd9b-4215-9c81-6842f985dd36", "tag": "ff67121d-7207-4ebc-b96e-258cdfde039b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:54.641718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:54.662556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.663070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.663511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.666389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.671415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.673176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.673920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.696498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.701657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.743577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] Creating event network-changed:3ec4081f-0d42-4526-ac70-45a8f2f2e315 for instance 60d71a4a-1263-4408-a694-d9ceded8ae86 on n-h2-862416-4 Oct 26 05:05:54.744327 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] Creating event network-changed:ff67121d-7207-4ebc-b96e-258cdfde039b for instance b261345c-dd9b-4215-9c81-6842f985dd36 on n-h1-862416-4 Oct 26 05:05:54.757228 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-32f84713-38a1-4c18-b522-605e7eab9b89 req-69ecf360-0fa5-49eb-8c3a-e8fc7d685ec1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.127356 Oct 26 05:05:54.759064 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 627/1254] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:54.825691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:54.831047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:54.839760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.840561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.841232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.842545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:54.843164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:54.847839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:54.884738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:54.895790 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b484ed9-8e0e-45a7-88b1-6502b7b63306 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1265 microversion: 2.1 time: 0.278805 Oct 26 05:05:54.896775 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 628/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:54 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:55.092539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:55.095004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:55.098052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:55.110575 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef74aa97-7b73-47ff-bf03-a628e68ef05d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1469 microversion: 2.1 time: 0.290948 Oct 26 05:05:55.111699 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 628/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:54 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:55.116344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.117094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.117737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.118643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.119269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.119923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.368805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:55.369774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:55.378696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.379695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.380357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:55.380505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.381669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.383461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.383911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.391589 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed4c7daa-7cb0-4a2d-bbbd-357d296c8b05 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.303333 Oct 26 05:05:55.392302 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 629/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:55 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:55.626088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:55.633070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:55.634141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:55.635001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a59388a9-db45-4a7a-818d-dd5c6d6ee8d2 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.270788 Oct 26 05:05:55.636455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 629/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:55 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:55.654307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:55.655027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:55.662415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.663219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.663852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.664748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.665409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.665810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.666189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.670700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.676458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.679946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.683042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.687833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.853957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:55.873072 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f80ddac2-b3b2-498b-839b-5bfb139bec93 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1219 microversion: 2.1 time: 0.220556 Oct 26 05:05:55.885350 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 630/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:55 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:55.928520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:55.930086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:55.955510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.956056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.956513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:55.957267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:55.957763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:55.958196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:56.188367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:56.204183 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f5ae70d-e8c7-4bb8-8377-78d373fb5516 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1265 microversion: 2.1 time: 0.284456 Oct 26 05:05:56.214257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:56.223491 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 631/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:55 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:56.230470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:56.232431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:56.234189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:56.240715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:56.241476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:56.242085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:56.242921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:56.243794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:56.245277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:56.245885 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bdefb05-7179-4d3f-af90-7afb3d720392 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1815 microversion: 2.25 time: 0.617445 Oct 26 05:05:56.246538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:56.248704 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 630/1261] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:55 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1815 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:56.421853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:56.422838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:56.459271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:56.462072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:56.462533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:56.463305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:56.463748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:56.468507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:56.509893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:56.524063 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3932a35c-cc61-475f-9cf4-618be90765a3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1535 microversion: 2.1 time: 0.298409 Oct 26 05:05:56.525937 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 632/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:56 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1535 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:56.660405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:56.661475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:56.671575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:56.674739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:56.675397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:56.677282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:56.679761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:56.680905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.078431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.097562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7b65460-8a8c-499d-bcd0-2d29735fcf49 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.680005 Oct 26 05:05:57.115413 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 631/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:56 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:57.132124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:57.135868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:57.151853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.155200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.157216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.158987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.159766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.160797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.194142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.213715 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1eb473cc-ee15-455d-8f5a-1ceaf64989d5 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.554227 Oct 26 05:05:57.220927 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 633/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:56 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:57.235668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:57.236547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:57.249873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.250577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.252114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.253075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.255243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.256968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.523236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.534875 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50d2009e-259f-462a-b07e-b305525370a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1265 microversion: 2.1 time: 0.303838 Oct 26 05:05:57.535662 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 634/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:57 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:05:57.550644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:57.552518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:57.568581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.572195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.572675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.573520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.575658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.576104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.600464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.614437 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3264534e-7f2b-484e-b965-5ebd8580871f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1283 microversion: 2.1 time: 0.494176 Oct 26 05:05:57.615041 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 632/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:57 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1283 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:57.622744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:57.623365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:57.645276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.645807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.646256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.646977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:57.647431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:57.647869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:57.958227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.981529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.984469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:57.990693 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a3351ed-352e-4eb6-bd01-28760ebc1190 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1805 microversion: 2.25 time: 0.447064 Oct 26 05:05:57.991562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 635/1267] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:57 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1805 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:58.018540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "name": "network-vif-unplugged", "status": "completed", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:05:58.046843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.047421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.047867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.059820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:58.079960 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c28e845f-197c-40e6-8cc0-0c377083ad90 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1535 microversion: 2.1 time: 0.463546 Oct 26 05:05:58.101726 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 633/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:57 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1535 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:58.117885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b410719-e446-40b4-b572-faef7e0f7631 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '.version_select at 0x7f470a827280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:58.136597 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] Creating event network-vif-unplugged:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:05:58.137544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b410719-e446-40b4-b572-faef7e0f7631 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.138625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b410719-e446-40b4-b572-faef7e0f7631 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.139386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b410719-e446-40b4-b572-faef7e0f7631 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.169292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:58.172917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:05:58.180922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:05:58.208079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b410719-e446-40b4-b572-faef7e0f7631 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.104839 Oct 26 05:05:58.215980 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 634/1269] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 26 05:05:58 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:58.238646 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6927cbe4-3af1-4f53-98bb-88d2cd80ce45 req-b8b3f654-876b-4356-86fb-763585fd175b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.239973 Oct 26 05:05:58.239259 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 636/1270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:05:58.257211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:58.258113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:58.259150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:58.267073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:58.269342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.272189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.275415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.284467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.285072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.285671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.288403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.293332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.294573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.296232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.299068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.299651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.764359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:05:58.799375 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d63cf4f-210d-4465-a88f-2bac3a937f42 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 2424 microversion: 2.25 time: 0.546022 Oct 26 05:05:58.802264 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 637/1271] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:58 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 2424 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:05:58.809989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:58.812029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:58.819279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.820151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.820814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.822531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.824396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.826733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.844793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:58.859840 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7c3ac71-ddc5-4e99-bb04-62e72b43151d tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.627400 Oct 26 05:05:58.862522 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 635/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:58 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:58.872666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:58.874265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:58.909186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.912444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.913430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:58.914925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:58.917367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:58.918032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:59.177548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:59.202447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6542224c-0781-451d-b90e-afa606173c0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.395645 Oct 26 05:05:59.220669 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 638/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:58 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:59.229520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:59.230142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:59.253596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:59.255297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:59.255769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:59.258558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:59.260321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:59.260783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:59.381560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:59.393560 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5998809f-9185-4dda-a885-43e2aa6c836f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.528193 Oct 26 05:05:59.397158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:05:59.406608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c65bbdd4-339a-42e5-98a6-f240d9f7ffee tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1281 microversion: 2.1 time: 0.183604 Oct 26 05:05:59.409944 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 636/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:58 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:59.459126 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 639/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:59 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1281 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:05:59.459363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:59.461763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:59.470601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:05:59.471252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:05:59.486835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:59.487905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:59.488607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:59.489461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:59.489982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:59.490496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:59.490761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:59.491411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:59.492071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:05:59.492716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:05:59.493212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:05:59.493684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.119771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:00.133657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:06:00.136474 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3c989c89-dd38-4b31-be29-bb40aa7ab085 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1535 microversion: 2.1 time: 0.675106 Oct 26 05:06:00.143031 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 640/1276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:05:59 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1535 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:00.149260 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df65f6bd-e8d5-434f-b640-7181a46f027b tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 2424 microversion: 2.25 time: 0.737798 Oct 26 05:06:00.156860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 637/1277] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:05:59 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 2424 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:00.161940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:00.162758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:00.181473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.181982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.182431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.183404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.183616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.184566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.289868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a0654c6-5ce3-45cb-bfdd-3c4a98aa8e9d tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Action: 'create', calling method: .version_select at 0x7f470eb63ca0>, body: {"keypair": {"name": "tempest-keypair-512605010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFs8xgnPliA+SmJmblIltfr6ubeZejhN9lbddg0kR39LPHNzzNFF6TVpA84Cy9HO8YPbwI2S50fAK1vlkBqyIfDY47YymnBbZ3ZQ3NET6otRdBNGaQHq8Fcy8f/AFXKnw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:00.331383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9a0654c6-5ce3-45cb-bfdd-3c4a98aa8e9d tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Getting quotas for project 05daa3b4e1914e6f82f7491d810c2b0d. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:00.346940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9a0654c6-5ce3-45cb-bfdd-3c4a98aa8e9d tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Getting quotas for user 690f0e61ed8642abb3c0e6ba980416ae and project 05daa3b4e1914e6f82f7491d810c2b0d. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:00.398243 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a0654c6-5ce3-45cb-bfdd-3c4a98aa8e9d tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253598 Oct 26 05:06:00.400533 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 641/1278] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:06:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:00.412373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:00.426487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:00.449205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.456027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.456836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.458233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.459072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.459713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.502447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:00.532866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e161f4f-0703-4212-8538-eec9c13fbeec tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.374842 Oct 26 05:06:00.537984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 638/1279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:00 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:00.633674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-496beb12-05fa-4f9a-be3d-7c41fb42e0b8 req-8e424b15-af60-4734-b078-5bb0e4059e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d33722-dbfe-4da7-b65c-510fe13e50f3", "name": "network-vif-plugged", "status": "completed", "tag": "9e2dd033-169e-403c-a393-6f8c43832ce4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:00.646745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-496beb12-05fa-4f9a-be3d-7c41fb42e0b8 req-8e424b15-af60-4734-b078-5bb0e4059e7e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.647406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-496beb12-05fa-4f9a-be3d-7c41fb42e0b8 req-8e424b15-af60-4734-b078-5bb0e4059e7e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.648550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-496beb12-05fa-4f9a-be3d-7c41fb42e0b8 req-8e424b15-af60-4734-b078-5bb0e4059e7e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.666249 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-496beb12-05fa-4f9a-be3d-7c41fb42e0b8 req-8e424b15-af60-4734-b078-5bb0e4059e7e service nova] Creating event network-vif-plugged:9e2dd033-169e-403c-a393-6f8c43832ce4 for instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 on n-h1-862416-4 Oct 26 05:06:00.674670 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-496beb12-05fa-4f9a-be3d-7c41fb42e0b8 req-8e424b15-af60-4734-b078-5bb0e4059e7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134447 Oct 26 05:06:00.676030 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 639/1280] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:00.682993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:00.683930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:00.692307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.693765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.695331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.696331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.696977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.697648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.748881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:00.758129 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b7f71fd-5143-46f3-84cf-c98bcbb0dc8d tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.355778 Oct 26 05:06:00.761568 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 642/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:00 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:00.771762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:00.773094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:00.790238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.790766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.796736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.798606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:00.798606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:00.799009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:00.855318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:00.869214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lazy-loading 'services' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:06:01.022365 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4d0df68-380c-46b1-b702-92a161ac294a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments/b69d797a-3781-4607-9c64-a06fdad1a320" status: 202 len: 0 microversion: 2.25 time: 0.344058 Oct 26 05:06:01.022620 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 640/1282] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 26 05:06:00 2022] DELETE /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments/b69d797a-3781-4607-9c64-a06fdad1a320 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:06:01.030327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:01.031108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:01.038933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.039422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.040089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.041028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.041581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.042046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.084106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:01.101924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b0e7d0b1-f77f-4258-954d-19c57efd6e62 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.328618 Oct 26 05:06:01.102595 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 643/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:00 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:01.113068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:01.120832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:01.131409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.132191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.132861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.133913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.136489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.137849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.169074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:01.186825 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82a26cd4-8cda-4304-9b8c-c502a6010f87 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1281 microversion: 2.1 time: 0.162932 Oct 26 05:06:01.187416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 641/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:01 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:01.200083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:01.201120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:01.205176 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f60c3f1a-94a1-46a6-8a53-5baa799a2f74 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099936 Oct 26 05:06:01.205817 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 644/1285] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:01 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:06:01.211040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:01.212550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.213094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.213548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.214521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.214992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.215967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.422475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:01.432669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e81a8aa4-2ca1-42df-9a95-e7d885fc1ca5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1535 microversion: 2.1 time: 0.243350 Oct 26 05:06:01.433834 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 642/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:01 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1535 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:01.564696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:01.565404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:01.571901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.572428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.572858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.573730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.574384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.575809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.794348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:01.795838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:01.812468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.813732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.815277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.816477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:01.818764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:01.819504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:01.825856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:01.839259 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9946796-b1de-4aea-8c99-d41ff63f380c tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.278503 Oct 26 05:06:01.843057 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 645/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:01 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:02.026388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:02.089828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:02.128111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:02.129600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:02.142943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.144388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.145497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.146478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.150420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.151514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.309800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:02.321824 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d5a76713-f58f-4346-99a8-5155efc0fa0b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.537293 Oct 26 05:06:02.326581 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 643/1288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:01 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:02.336763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:02.337803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:02.350148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.350948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.351572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.352503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.353151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.353782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.638364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:02.648513 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-26fef1fa-15c1-4a31-9b85-76da8d7f5ffa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.524261 Oct 26 05:06:02.650241 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 646/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:02 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:02.656776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:02.660313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:02.674026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.674940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.675664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.677072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.677801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.680631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.711994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:02.727472 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd4045f7-6700-4073-b0f6-513b9af370ef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 0.398967 Oct 26 05:06:02.728571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 644/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:02 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:02.742960 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53d4ba5b-40a1-4e4b-a975-f51c8ace5a32 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091012 Oct 26 05:06:02.743166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:02.743737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:02.744985 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 647/1291] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:02 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:06:02.750726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.751185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.751611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.752331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.752796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.753231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.754953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1e9b92-1459-4e68-8724-8f167d464102", "name": "network-vif-plugged", "status": "completed", "tag": "c6bbc87f-d448-4b13-9d31-16005e77c8ee"}, {"server_uuid": "60d71a4a-1263-4408-a694-d9ceded8ae86", "name": "network-vif-plugged", "status": "completed", "tag": "3ec4081f-0d42-4526-ac70-45a8f2f2e315"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:02.767252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.767872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.768311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.792094 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] Creating event network-vif-plugged:c6bbc87f-d448-4b13-9d31-16005e77c8ee for instance be1e9b92-1459-4e68-8724-8f167d464102 on n-h2-862416-4 Oct 26 05:06:02.792798 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] Creating event network-vif-plugged:3ec4081f-0d42-4526-ac70-45a8f2f2e315 for instance 60d71a4a-1263-4408-a694-d9ceded8ae86 on n-h2-862416-4 Oct 26 05:06:02.800450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-718aca7d-fb7f-40f5-a7ea-f8f0fc9c8041 req-f7d512dd-18f3-4ecc-9c07-154750d06993 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051552 Oct 26 05:06:02.805976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 648/1292] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:02.865376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:02.874573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:02.897120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.898811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.902176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:02.903529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:02.905818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:02.906421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.064748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:03.074417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0297d34c-936b-472f-89d3-83b7d36f27d0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1528 microversion: 2.1 time: 0.344588 Oct 26 05:06:03.079427 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 645/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:02 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1528 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:03.107002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:03.107722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:03.117717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:03.118330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:03.118814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.119618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:03.125366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:03.125949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.392398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:03.406097 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bad0b8fc-d95e-4b24-adb2-f47dd4938f42 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.545394 Oct 26 05:06:03.422086 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 649/1294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:02 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:03.428584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:03.429325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:03.437860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:03.438412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:03.438952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.439726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:03.440231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:03.440673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.683191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:03.703759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31644ef3-92ae-4c8a-ae85-b148848c40d2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1528 microversion: 2.1 time: 0.601132 Oct 26 05:06:03.705826 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 646/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:03 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1528 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:03.712250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:03.713127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:03.726121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:03.727077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:03.727798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.729529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:03.730206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:03.731372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:03.732286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:03.741585 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85f518ad-01d7-409e-bc19-916d51c8910e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.318025 Oct 26 05:06:03.753974 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 650/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:03 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:03.759128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1435242331", "imageRef": "7f7732a5-ea0d-4bca-8473-e505ae9ff624", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "399df563-22be-4e39-b13b-eff7f8aa97ef"}], "security_groups": [{"name": "tempest-securitygroup--2056826786"}], "key_name": "tempest-keypair-512605010", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:03.947248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] validate_networks() for [('399df563-22be-4e39-b13b-eff7f8aa97ef', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:03.990583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:04.003696 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-910b7a23-f091-4788-9924-3370ae4d6513 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.296188 Oct 26 05:06:04.018155 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 647/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:03 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:04.029141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d57375a7-8901-49c7-b1ef-53d7ea7e3a7d tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:04.039264 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-d57375a7-8901-49c7-b1ef-53d7ea7e3a7d tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] HTTP exception thrown: Flavor 470386d6-5084-4f03-aa0c-20f50bda87f5 could not be found. Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d57375a7-8901-49c7-b1ef-53d7ea7e3a7d tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Request method failure captured: Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/flavors/470386d6-5084-4f03-aa0c-20f50bda87f5 HTTP/1.1 Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9JhgZJ_f_Dt_EWSsczkpN2JwcyFPZF-6W4Oeb2apCqeKoPaXQ0Cr9vWcfG0we6GMH5d8ssPSNu11VK52UvizhA54WAkRbiCLlGG-lLKVt3DcGPVHztF0IcO3U0MF46zi8XjK0CJ2t91Kn2_sj8kjJesXAxsYhBQaV5YbPXFXSWUvY Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e3b6f2581d23493896cc3f2142bc9765 Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-MigrationsAdminTest-1157675081 Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:06:04.049098 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e3b6f2581d23493896cc3f2142bc9765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b6f2581d23493896cc3f2142bc9765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b6f2581d23493896cc3f2142bc9765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e3b6f2581d23493896cc3f2142bc9765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-MigrationsAdminTest-1157675081 Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e3b6f2581d23493896cc3f2142bc9765 Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-MigrationsAdminTest-1157675081 Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-MigrationsAdminTest-1157675081-project-admin Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b012e8793cfd4ebf9121fdcab58605b8 Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-MigrationsAdminTest-1157675081-project-admin Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: exception: Flavor 470386d6-5084-4f03-aa0c-20f50bda87f5 could not be found. Oct 26 05:06:04.050870 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '470386d6-5084-4f03-aa0c-20f50bda87f5'} Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 470386d6-5084-4f03-aa0c-20f50bda87f5 could not be found. Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:04.051752 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 470386d6-5084-4f03-aa0c-20f50bda87f5 could not be found. Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 470386d6-5084-4f03-aa0c-20f50bda87f5 could not be found. Oct 26 05:06:04.053166 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:04.058412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d57375a7-8901-49c7-b1ef-53d7ea7e3a7d tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Returning 404 to user: Flavor 470386d6-5084-4f03-aa0c-20f50bda87f5 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:04.061015 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d57375a7-8901-49c7-b1ef-53d7ea7e3a7d tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/470386d6-5084-4f03-aa0c-20f50bda87f5" status: 404 len: 109 microversion: 2.1 time: 0.037935 Oct 26 05:06:04.062293 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 648/1298] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:04 2022] DELETE /compute/v2.1/flavors/470386d6-5084-4f03-aa0c-20f50bda87f5 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:04.073496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:04.075560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:04.094180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.095100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:04.096441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:04.098838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.099553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:04.102643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:04.397487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:04.406732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-874e5088-1e63-4df8-bdf4-b5a63bcc4c04 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 0.342944 Oct 26 05:06:04.410494 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 649/1299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:04 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:04.417835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:04.431701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:04.439307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.439829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:04.440852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:04.441613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.442092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:04.442518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:04.524123 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e8e6b55-1411-4b60-8569-bbba5a3799e8 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109993 Oct 26 05:06:04.525401 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 650/1300] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:04 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:06:04.531229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-762d329f-c7f9-4da1-aae4-f9b3541b2791 req-aa304f78-856f-4f82-bd11-60d390695e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3631f7b3-349e-43e1-8d4f-128ddb274ee8", "tag": "8e51ca90-1775-48fe-979a-365eabcef0bb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:04.544689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-762d329f-c7f9-4da1-aae4-f9b3541b2791 req-aa304f78-856f-4f82-bd11-60d390695e7c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.545858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-762d329f-c7f9-4da1-aae4-f9b3541b2791 req-aa304f78-856f-4f82-bd11-60d390695e7c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:04.546736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-762d329f-c7f9-4da1-aae4-f9b3541b2791 req-aa304f78-856f-4f82-bd11-60d390695e7c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:04.566161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-762d329f-c7f9-4da1-aae4-f9b3541b2791 req-aa304f78-856f-4f82-bd11-60d390695e7c service nova] Creating event network-changed:8e51ca90-1775-48fe-979a-365eabcef0bb for instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 on n-h2-862416-4 Oct 26 05:06:04.582554 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-762d329f-c7f9-4da1-aae4-f9b3541b2791 req-aa304f78-856f-4f82-bd11-60d390695e7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055295 Oct 26 05:06:04.583406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 651/1301] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:04.594273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1108433781", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:04.700733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:04.971281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:04.972294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:04.973107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:04.973798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:04.974461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:04.995628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.997042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:04.998095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:04.999132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:04.999825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.000480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.019447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Getting quotas for project 05daa3b4e1914e6f82f7491d810c2b0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:05.034087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Getting quotas for user 690f0e61ed8642abb3c0e6ba980416ae and project 05daa3b4e1914e6f82f7491d810c2b0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:05.060927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:05.070674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7f7732a5-ea0d-4bca-8473-e505ae9ff624',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:05.126563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:05.127131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:05.127464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:05.127957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:05.128379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:05.140145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.140481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.140922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.141706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.142111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-110b0546-9a19-4495-bba6-7acccd08e54a tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.384561 Oct 26 05:06:05.142247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.142589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.144422 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 651/1302] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:05.158140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:05.159149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:05.167543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.168854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.169701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.170705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.172139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.172755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.244677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:05.261752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Getting quotas for user 5e48790bfe71452288c91f49586a624e and project daf57b356c404d8f9d3986b355cb5ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:05.289004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:05.292006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:05.404456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ec90564-67d8-4ad6-843f-189cfd4bcc91 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819711 Oct 26 05:06:05.412225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 652/1303] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:05.417195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:05.417899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:05.439248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.439760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.440231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.440941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.454079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.455061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.472204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:05.507214 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e1ba1ff-45b9-4cb8-b681-8f79c00102d6 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1325 microversion: 2.1 time: 0.345573 Oct 26 05:06:05.507890 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 652/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:05 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:05.540947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d31aadbf-d7ea-4540-a5ee-41cfd3e6b022 req-e8da5b8c-33e4-4abe-99cb-fd6e01f5fd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261345c-dd9b-4215-9c81-6842f985dd36", "name": "network-vif-plugged", "status": "completed", "tag": "ff67121d-7207-4ebc-b96e-258cdfde039b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:05.593440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d31aadbf-d7ea-4540-a5ee-41cfd3e6b022 req-e8da5b8c-33e4-4abe-99cb-fd6e01f5fd1b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.593990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d31aadbf-d7ea-4540-a5ee-41cfd3e6b022 req-e8da5b8c-33e4-4abe-99cb-fd6e01f5fd1b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.595324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d31aadbf-d7ea-4540-a5ee-41cfd3e6b022 req-e8da5b8c-33e4-4abe-99cb-fd6e01f5fd1b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.649588 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d31aadbf-d7ea-4540-a5ee-41cfd3e6b022 req-e8da5b8c-33e4-4abe-99cb-fd6e01f5fd1b service nova] Creating event network-vif-plugged:ff67121d-7207-4ebc-b96e-258cdfde039b for instance b261345c-dd9b-4215-9c81-6842f985dd36 on n-h1-862416-4 Oct 26 05:06:05.686219 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d31aadbf-d7ea-4540-a5ee-41cfd3e6b022 req-e8da5b8c-33e4-4abe-99cb-fd6e01f5fd1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172390 Oct 26 05:06:05.698057 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 653/1305] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:05.735516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:05.739126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:05.791212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.797241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.797840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.802153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:05.810390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:05.811057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:05.900658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:05.915192 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0013be41-d938-45d5-9ea7-cd1e360af2e3 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.500947 Oct 26 05:06:05.923108 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 653/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:05 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:05.929604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5ad3484-93a8-47e9-8af4-18656a768da7 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:05.933160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5ad3484-93a8-47e9-8af4-18656a768da7 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.037620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f5ad3484-93a8-47e9-8af4-18656a768da7 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:06.049023 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5ad3484-93a8-47e9-8af4-18656a768da7 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1245 microversion: 2.1 time: 0.121956 Oct 26 05:06:06.049978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 654/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:05 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:06.062682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de451d1f-c734-44ab-8233-532165c52265 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:06.063593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de451d1f-c734-44ab-8233-532165c52265 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.176233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de451d1f-c734-44ab-8233-532165c52265 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:06.193018 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de451d1f-c734-44ab-8233-532165c52265 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1213 microversion: 2.1 time: 0.140886 Oct 26 05:06:06.193482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:06.196450 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 655/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:06 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:06.203623 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22c55626-693e-44b4-8014-d15a6ba668c5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.504123 Oct 26 05:06:06.204592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 654/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:05 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:06.213034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:06.217041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.221861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:06.222551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.225066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:06.229158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.230406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.232485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.232632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.233053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.233553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.234169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.234872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.234995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.235447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.235900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.236018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.326169 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c4b6e16-2162-41e4-acb8-193c5c8753eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117842 Oct 26 05:06:06.327595 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 655/1310] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:06 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:06:06.530896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:06.531680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.550856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.561899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.564268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.565857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.577947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.578600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.581747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:06.631258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:06.644940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef33a599-24a1-46f0-bb33-f210225b687f tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 0.446123 Oct 26 05:06:06.645685 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 656/1311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:06 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:06.650474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-735b23c6-06a4-4a73-b0b0-08c45dc6c5d4 req-0e420797-d620-4cc1-9da1-b86d1f24dfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:06.681260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-735b23c6-06a4-4a73-b0b0-08c45dc6c5d4 req-0e420797-d620-4cc1-9da1-b86d1f24dfb2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.686091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-735b23c6-06a4-4a73-b0b0-08c45dc6c5d4 req-0e420797-d620-4cc1-9da1-b86d1f24dfb2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.686868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-735b23c6-06a4-4a73-b0b0-08c45dc6c5d4 req-0e420797-d620-4cc1-9da1-b86d1f24dfb2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.713090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-735b23c6-06a4-4a73-b0b0-08c45dc6c5d4 req-0e420797-d620-4cc1-9da1-b86d1f24dfb2 service nova] Creating event network-changed:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:06:06.720702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-735b23c6-06a4-4a73-b0b0-08c45dc6c5d4 req-0e420797-d620-4cc1-9da1-b86d1f24dfb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073525 Oct 26 05:06:06.721504 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 657/1312] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:06.864779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:06.877823 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92c71aa8-89b8-4a4f-9b19-209a6d1e0014 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1521 microversion: 2.1 time: 0.350871 Oct 26 05:06:06.879212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 656/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:06 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:06.910184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:06.910793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.930003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.930512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.930965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.931686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.932364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.932959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.950992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:06.951884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:06.960184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.960914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.961571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.962602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:06.963224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:06.963832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:06.991760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:06:07.145475 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f551720-72c6-4ecf-8d82-255dc41a46f9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 204 len: 0 microversion: 2.1 time: 0.239753 Oct 26 05:06:07.149256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 658/1314] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:06 2022] DELETE /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:06:07.155737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:07.160952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:07.174524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.175045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.175499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.176235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.176708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.177261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.250866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:07.261372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fa90754-04f7-4f9c-8203-05324e724643 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1322 microversion: 2.1 time: 0.316071 Oct 26 05:06:07.262879 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 657/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:06 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:07.273733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:07.274527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:07.283560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.284356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.284972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.285902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.287200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.287855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.312430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:07.321391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0dfb5e4f-51db-4bde-851a-9fb4934fd38c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1241 microversion: 2.1 time: 0.170243 Oct 26 05:06:07.342019 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 659/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:07 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1241 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:07.347766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:07.348647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:07.359162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.359672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.360127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.360864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.361373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.361791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.365265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:07.527864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:07.539373 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4df423c-d250-42e2-a559-35670210bb16 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1265 microversion: 2.1 time: 0.196000 Oct 26 05:06:07.550948 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 660/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:07 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:07.564809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:07.568757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:07.586892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.587398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.587954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.588631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.589093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.589648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.595163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:07.613345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8dc4a60d-3391-428a-b4f5-9cd28d238c36 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1527 microversion: 2.1 time: 0.348986 Oct 26 05:06:07.616192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 658/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:07 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:07.635053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:07.644283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:07.662421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.662919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.666098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.668597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.673366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.675579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.733940 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48f75fcf-9e46-4f37-9a66-63bd10e6b13f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116642 Oct 26 05:06:07.735311 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 659/1319] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:07 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:06:07.741168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:07.742027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:07.749507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.750263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.751140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.752032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.752655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.753509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.938723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:07.950751 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77b7e38b-2d70-4a81-99bf-5810f83e9561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.407585 Oct 26 05:06:07.952032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 661/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:07 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:07.957449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1fddae35-fdb9-430c-b1c7-2b247965227a req-e6c8260a-4357-4b85-a391-9e1869c6cf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "name": "network-vif-plugged", "status": "completed", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:07.971264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1fddae35-fdb9-430c-b1c7-2b247965227a req-e6c8260a-4357-4b85-a391-9e1869c6cf2c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:07.972176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1fddae35-fdb9-430c-b1c7-2b247965227a req-e6c8260a-4357-4b85-a391-9e1869c6cf2c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:07.972828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1fddae35-fdb9-430c-b1c7-2b247965227a req-e6c8260a-4357-4b85-a391-9e1869c6cf2c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:07.982595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:07.990851 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57c27469-1c5d-4dfe-8533-8e8a1d4fec47 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 0.254274 Oct 26 05:06:07.991434 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 660/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:07 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:07.996113 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1fddae35-fdb9-430c-b1c7-2b247965227a req-e6c8260a-4357-4b85-a391-9e1869c6cf2c service nova] Creating event network-vif-plugged:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:06:08.003046 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1fddae35-fdb9-430c-b1c7-2b247965227a req-e6c8260a-4357-4b85-a391-9e1869c6cf2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049652 Oct 26 05:06:08.004586 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 662/1322] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:08.290051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:08.291391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:08.299773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.300602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.301277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.302501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.303165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.303782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.359233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:08.361044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:08.376637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.377564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.378324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.379263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.379948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.380541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.496180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:08.508901 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dcef82d5-c4f5-42bf-b30c-48c5faa83545 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1241 microversion: 2.1 time: 0.166368 Oct 26 05:06:08.528611 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 663/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:08 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:08.530612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:08.542178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-77e44958-bcbb-4797-9e05-279ecb4808ab tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 200 len: 1516 microversion: 2.1 time: 0.256246 Oct 26 05:06:08.551456 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 661/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:08 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:08.567169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:08.567945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:08.568620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:08.569481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:08.575632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.576216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.576865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.577718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.578273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.578886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.584837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.585819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.587310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.591229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.591955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.592709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.676582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:08.690454 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a947aff-c1d4-4ac2-8f45-cd506928b954 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1265 microversion: 2.1 time: 0.127047 Oct 26 05:06:08.691046 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 662/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:08 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:08.701417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:08.702481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:08.710087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.711058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.711623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.712649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.713274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.713971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.883792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:08.892282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e010b7c-afe8-4479-b276-4dcd21e943a7 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1516 microversion: 2.1 time: 0.329072 Oct 26 05:06:08.893901 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 664/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:08 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:08.899302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:08.901828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:08.909437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.910735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.913865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.915822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:08.916299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:08.916889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:08.975782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:08.985032 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e898fc4a-2d08-492c-8e1a-0e3305616f83 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1527 microversion: 2.1 time: 0.292919 Oct 26 05:06:09.006247 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 663/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:08 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1527 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:09.023033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.026476 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f27fade1-2ed9-4206-882f-afd7ab930373 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131304 Oct 26 05:06:09.027377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.030783 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 665/1328] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:08 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:06:09.037375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.038223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.041216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.042736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.044217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.045066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.046449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.047429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.048125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.049488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.050065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.050604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.061857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.062708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.297156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:09.300641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:09.307102 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b60bfa2c-2f93-4424-a420-831f31df74e1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.274980 Oct 26 05:06:09.307688 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 666/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:09 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:09.311330 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93af0797-6355-40bb-9472-5b846aa57caa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 200 len: 1515 microversion: 2.1 time: 0.303856 Oct 26 05:06:09.314194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.315058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.321647 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 664/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:09 2022] GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:09.323414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.323981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.324538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.325333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.326023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.327613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.396437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1116440958", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "1d3f1995-4a9c-473d-83e2-e714a42436e5"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:09.478531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] validate_networks() for [('1d3f1995-4a9c-473d-83e2-e714a42436e5', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:09.508502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:09.517748 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-819c8a26-669d-4498-92b3-6218d2f931db tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 0.208665 Oct 26 05:06:09.519623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 667/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:09 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:09.525509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.526020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.541094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.541661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.542707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.542847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.543522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.544072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.580782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:06:09.712642 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6daa6746-e3ac-4c07-ba97-207ea64f16e0 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 204 len: 0 microversion: 2.1 time: 0.190282 Oct 26 05:06:09.716316 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 668/1332] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:09 2022] DELETE /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:06:09.720560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.721372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.727943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.728432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.728905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.729652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.730107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.730538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.820167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:09.828581 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77066c6a-345c-4a2c-acaf-c7f400030222 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1241 microversion: 2.1 time: 0.113412 Oct 26 05:06:09.829490 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 669/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:09 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:09.834351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.835268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.841943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.842728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.843402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.844338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.844816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.845259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.940677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:09.948725 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49aa65a2-72ef-408c-8a2c-767524c82e82 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1265 microversion: 2.1 time: 0.117916 Oct 26 05:06:09.949303 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 670/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:09 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:09.954338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:09.954952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:09.961034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.961616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.962225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.963351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:09.963986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:09.964598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:09.990144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:09.990576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:09.991063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:09.991479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:09.991893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:10.002259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.002999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.003441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.004338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.004801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.006990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.026371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:10.032832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for user dbd1775d9dd04820aec1aa2efde776e1 and project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:10.046919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:10.049618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:10.100638 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8cb4cd90-2313-438a-b5f4-b5e87b9661db tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777280 Oct 26 05:06:10.101356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 665/1335] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:10.106565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:10.107491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:10.114681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.115394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.116031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.116897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.117532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.118116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.124683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:10.134018 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-96031a57-8265-4662-9bd3-46688a6c5afe tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 200 len: 1521 microversion: 2.1 time: 0.183337 Oct 26 05:06:10.134609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 671/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:09 2022] GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:10.140814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:10.143206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:10.149813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.150653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.151242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.153095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.153665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.154729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.206975 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-50e3bad3-e810-4deb-9b0d-f51060e3b21d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.070362 Oct 26 05:06:10.207949 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 672/1337] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:06:10 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:10.214019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a0e754a-730b-4db9-9ebd-a67669faca94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:10.214639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a0e754a-730b-4db9-9ebd-a67669faca94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:10.325675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7a0e754a-730b-4db9-9ebd-a67669faca94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:10.336372 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a0e754a-730b-4db9-9ebd-a67669faca94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1211 microversion: 2.1 time: 0.127000 Oct 26 05:06:10.336973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 673/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:10 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:10.352955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:10.353624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:10.376206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.376741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.377180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.377950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.381670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.382163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.442301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:10.453243 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e381951a-29e3-4808-83d2-04186ccd0474 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1527 microversion: 2.1 time: 0.350756 Oct 26 05:06:10.467379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 666/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:10 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1527 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:10.547260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:10.548027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:10.559098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.563512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.566370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.567289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.567740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.568282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.769913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:10.784471 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a1a6d79-f791-4164-aaac-32c2cb610d83 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.446135 Oct 26 05:06:10.786982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 674/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:10 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:10.852266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:10.852911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:10.868741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.869391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.869846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:10.876488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:10.876995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:10.880550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:11.524295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:11.537029 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1eb5c6ae-8c91-4466-ae1c-a5e9ea91d9a8 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1241 microversion: 2.1 time: 0.689680 Oct 26 05:06:11.553351 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 675/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:10 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1241 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:11.559331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:11.559331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:11.566040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:11.583744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:11.585821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:11.586290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:11.593118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:11.601177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:11.603186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:11.604173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:11.616252 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c89514a-d4e2-4233-970d-de159414035a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 1.064908 Oct 26 05:06:11.633344 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 667/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:10 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:11.649408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:11.649913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:11.677430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:11.679013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:11.682932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:11.683916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:11.706926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:11.706926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:11.854131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:11.857633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:11.877337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-632d5e59-4319-4c54-9d62-74c690ac6430 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1271 microversion: 2.1 time: 0.330040 Oct 26 05:06:11.878182 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 676/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:11 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1271 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:11.926242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:11.931467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:11.955018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:11.956240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:11.958518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:11.959569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:11.961435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:11.962121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:12.115217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:12.144759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a105db5-f161-486b-b98e-25f766d895ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1263 microversion: 2.1 time: 0.228737 Oct 26 05:06:12.153440 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 677/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:11 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1263 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:12.158408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:12.159238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:12.166263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:12.167418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:12.168234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:12.169495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:12.170652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:12.171306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:12.513019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:12.526369 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f388250e-a809-42a5-b357-868d705f3b2b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 200 len: 1521 microversion: 2.1 time: 0.902875 Oct 26 05:06:12.531643 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 668/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:11 2022] GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 1521 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:12.556455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:12.557107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:12.588030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:12.590674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:12.591221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:12.592102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:12.592611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:12.593047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.028947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:13.040382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c406043f-1fef-4885-88c9-7073ee19fa08 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1527 microversion: 2.1 time: 0.885693 Oct 26 05:06:13.057338 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 678/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:12 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1527 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:13.058106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:13.059526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:13.079557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.080710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.085270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.086789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.087511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.088167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.315089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:13.333940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1f1f553-5acd-4ec0-8f1a-c96aeeea0635 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1303 microversion: 2.1 time: 0.283785 Oct 26 05:06:13.334921 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 679/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:13 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1303 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:13.355204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:13.355204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:13.366215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.370532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.371047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.372025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.380654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:13.382787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.383512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.392308 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19da08dc-4ef1-4f18-892b-31f0746af4bc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.856547 Oct 26 05:06:13.393206 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 669/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:12 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:13.415632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:13.418572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:13.465854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.466520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.466883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.467618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.468085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.468538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.795609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:13.811798 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4fca52ce-a92f-4ddc-9713-dd505060946d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1271 microversion: 2.1 time: 0.413165 Oct 26 05:06:13.815056 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 670/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:13 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1271 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:13.828126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:13.835078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:13.868373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.869267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.871886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:13.875191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:13.882463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:13.884136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.219425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:14.248956 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-702a95b2-c1ba-4a8f-af32-4bcc8e04420a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1269 microversion: 2.1 time: 0.431095 Oct 26 05:06:14.265732 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 671/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:13 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1269 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:14.288924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:14.291229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:14.327232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:14.334839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:14.341701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.342940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:14.344530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:14.347859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.464685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:14.466638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:14.468181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.479278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lazy-loading 'fault' on Instance uuid c9d33722-dbfe-4da7-b65c-510fe13e50f3 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:06:14.763160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:14.776603 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-28ac6aaf-44d1-4c3c-98e5-628643ccdda2 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 1.439828 Oct 26 05:06:14.778201 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 680/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:13 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:14.791582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:14.809771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6cff46f1-3932-49dc-887a-0e83f38b2f17 req-56f53cd3-a9b6-4458-af8d-722189c9cef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d33722-dbfe-4da7-b65c-510fe13e50f3", "name": "network-vif-deleted", "tag": "9e2dd033-169e-403c-a393-6f8c43832ce4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:14.818210 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7252030-53be-42bb-891d-2347b5621ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 200 len: 1312 microversion: 2.1 time: 0.544693 Oct 26 05:06:14.818816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 672/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:14 2022] GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:14.833238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:14.833238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:14.855009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6cff46f1-3932-49dc-887a-0e83f38b2f17 req-56f53cd3-a9b6-4458-af8d-722189c9cef8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:14.856046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6cff46f1-3932-49dc-887a-0e83f38b2f17 req-56f53cd3-a9b6-4458-af8d-722189c9cef8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:14.856484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6cff46f1-3932-49dc-887a-0e83f38b2f17 req-56f53cd3-a9b6-4458-af8d-722189c9cef8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.873827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:14.874470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:14.874912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.875693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:14.876154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:14.893394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:14.907927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:14.926493 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6cff46f1-3932-49dc-887a-0e83f38b2f17 req-56f53cd3-a9b6-4458-af8d-722189c9cef8 service nova] Creating event network-vif-deleted:9e2dd033-169e-403c-a393-6f8c43832ce4 for instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 on n-h1-862416-4 Oct 26 05:06:14.957942 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6cff46f1-3932-49dc-887a-0e83f38b2f17 req-56f53cd3-a9b6-4458-af8d-722189c9cef8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178286 Oct 26 05:06:14.969282 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 681/1353] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:15.002025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:15.002771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:15.035397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:15.035901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:15.036351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:15.037341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:15.057119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:15.057934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:15.195905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:15.580328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:15.593213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-81485f25-dee8-4923-8d02-a140743ce666 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.622446 Oct 26 05:06:15.597921 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 682/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:14 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:15.603184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:15.615144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:15.625039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:15.625985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:15.628277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:15.629387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:15.632211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:15.632906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:15.708021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:15.723711 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5304b77a-f893-47e1-b2d9-d818df24e163 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1527 microversion: 2.1 time: 0.903620 Oct 26 05:06:15.733947 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 673/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:14 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1527 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:15.753293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:15.755662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:15.772007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:15.772868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:15.773560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:15.779179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:15.780185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:15.784504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:15.995724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:16.010571 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed785d5c-3932-4343-b056-8d2ee5c9711f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1271 microversion: 2.1 time: 0.274802 Oct 26 05:06:16.011464 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 674/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:15 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:16.022108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d434936c-a1df-44f8-a7b1-e4d9d9cbf4a3 req-4127faee-a975-4f2d-bc62-98bd7821779d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "name": "network-vif-plugged", "status": "completed", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:16.049604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d434936c-a1df-44f8-a7b1-e4d9d9cbf4a3 req-4127faee-a975-4f2d-bc62-98bd7821779d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.050504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d434936c-a1df-44f8-a7b1-e4d9d9cbf4a3 req-4127faee-a975-4f2d-bc62-98bd7821779d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.051080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d434936c-a1df-44f8-a7b1-e4d9d9cbf4a3 req-4127faee-a975-4f2d-bc62-98bd7821779d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.080715 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d434936c-a1df-44f8-a7b1-e4d9d9cbf4a3 req-4127faee-a975-4f2d-bc62-98bd7821779d service nova] Creating event network-vif-plugged:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:06:16.087137 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d434936c-a1df-44f8-a7b1-e4d9d9cbf4a3 req-4127faee-a975-4f2d-bc62-98bd7821779d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069091 Oct 26 05:06:16.090614 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 675/1357] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:16.104973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:16.114472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:16.131378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.140269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.141282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.143062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.143865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.144671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.217728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:16.232797 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f127615c-9a58-447d-aeb2-3415d18b64d6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.633395 Oct 26 05:06:16.233670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 683/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:15 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:16.238465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:16.247046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:16.267421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.268360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.269091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.270204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.270787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.271298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.599004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:16.608904 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc8d0f2e-2c85-42e9-8e57-4439f4c90d31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.516820 Oct 26 05:06:16.611809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 676/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:16 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:16.616716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:16.617346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:16.635268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.635931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.636382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.640015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.647203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.647824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.714263 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] HTTP exception thrown: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 HTTP/1.1 Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:16.719002 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:16.720963 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c9d33722-dbfe-4da7-b65c-510fe13e50f3'} Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:16.722076 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:16.723759 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:16.727001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 404 to user: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:16.728768 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37624e6f-2261-415a-ac81-2ae626961b67 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 404 len: 111 microversion: 2.1 time: 0.115933 Oct 26 05:06:16.736279 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 677/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:16 2022] GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:16.742391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:16.756162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:16.782621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.784264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.785591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:16.788407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:16.789874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:16.792051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.218172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:17.239296 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c6f6c0f7-cab4-46b3-8c1e-0f96b786f8b1 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 1.004244 Oct 26 05:06:17.243284 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 684/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:16 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:17.259021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:17.278148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:17.282205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:17.296642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.298223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.299944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.301987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.304340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.305829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.380566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:17.396932 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d5e5eab-aa64-42e6-9f2c-78ff5f74e6fd tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.658372 Oct 26 05:06:17.421142 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:16 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:17.438083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:17.448914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:17.463957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.471675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.477111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.481579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.482080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.482535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.528327 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9f51f4e-a4b6-4040-b508-438a3588a2f9 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.282131 Oct 26 05:06:17.529268 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 685/1363] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 26 05:06:17 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:06:17.557360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:17.558988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:17.580866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.583211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.584797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.587566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.589173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.590372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.687623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:17.708385 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cf1bc07-088d-4580-acbe-645401fa3b1a tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1485 microversion: 2.1 time: 0.282995 Oct 26 05:06:17.711605 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 679/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:17 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1485 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:17.734894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:17.738365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:17.762912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.763412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.766947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:17.768101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:17.771029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:17.772955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:18.734962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:18.749369 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85e238a3-c452-48ae-aebe-ace4dff4ed31 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 1.200116 Oct 26 05:06:18.757470 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 686/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:17 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:18.787603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-752dc4c1-9133-40e0-835f-9a448970a251 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:18.788978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:18.799186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-de2a8276-fbbe-46aa-b815-dfdaa2b77bc1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 1.086199 Oct 26 05:06:18.800531 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 680/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:17 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:18.805284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:18.806110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:18.812396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-752dc4c1-9133-40e0-835f-9a448970a251 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:18.812988 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 26 05:06:18.814754 n-d-862416-4 devstack@n-api.service[120586]: action_args: {} Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:18.815720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:18.818321 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:18.819957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:18.819957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:18.819957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 26 05:06:18.819957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:18.819957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-752dc4c1-9133-40e0-835f-9a448970a251 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:18.820794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:18.821543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:18.821961 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-752dc4c1-9133-40e0-835f-9a448970a251 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.062125 Oct 26 05:06:18.823029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:18.823749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:18.824919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:18.828369 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 687/1367] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 26 05:06:18 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:18.833887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-da0d89a8-abdd-4d9b-b14b-4f02341754b0 req-d2936aec-c806-4228-a6c6-c5aa49152aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1e9b92-1459-4e68-8724-8f167d464102", "name": "network-vif-deleted", "tag": "c6bbc87f-d448-4b13-9d31-16005e77c8ee"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:18.864716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-da0d89a8-abdd-4d9b-b14b-4f02341754b0 req-d2936aec-c806-4228-a6c6-c5aa49152aed service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:18.874074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-da0d89a8-abdd-4d9b-b14b-4f02341754b0 req-d2936aec-c806-4228-a6c6-c5aa49152aed service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:18.874796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-da0d89a8-abdd-4d9b-b14b-4f02341754b0 req-d2936aec-c806-4228-a6c6-c5aa49152aed service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:18.902045 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-da0d89a8-abdd-4d9b-b14b-4f02341754b0 req-d2936aec-c806-4228-a6c6-c5aa49152aed service nova] Creating event network-vif-deleted:c6bbc87f-d448-4b13-9d31-16005e77c8ee for instance be1e9b92-1459-4e68-8724-8f167d464102 on n-h2-862416-4 Oct 26 05:06:18.923529 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-da0d89a8-abdd-4d9b-b14b-4f02341754b0 req-d2936aec-c806-4228-a6c6-c5aa49152aed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093249 Oct 26 05:06:18.924791 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 688/1368] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:18.930888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f01973ce-79bf-4035-aff6-2b895c45a748 req-13e23f03-284b-443f-90e6-060e45cb0b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3631f7b3-349e-43e1-8d4f-128ddb274ee8", "name": "network-vif-plugged", "status": "completed", "tag": "8e51ca90-1775-48fe-979a-365eabcef0bb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:18.962340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f01973ce-79bf-4035-aff6-2b895c45a748 req-13e23f03-284b-443f-90e6-060e45cb0b6a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:18.965335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f01973ce-79bf-4035-aff6-2b895c45a748 req-13e23f03-284b-443f-90e6-060e45cb0b6a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:18.967698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f01973ce-79bf-4035-aff6-2b895c45a748 req-13e23f03-284b-443f-90e6-060e45cb0b6a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:18.994204 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f01973ce-79bf-4035-aff6-2b895c45a748 req-13e23f03-284b-443f-90e6-060e45cb0b6a service nova] Creating event network-vif-plugged:8e51ca90-1775-48fe-979a-365eabcef0bb for instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 on n-h2-862416-4 Oct 26 05:06:19.036368 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f01973ce-79bf-4035-aff6-2b895c45a748 req-13e23f03-284b-443f-90e6-060e45cb0b6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109632 Oct 26 05:06:19.039612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 689/1369] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:19.048485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:19.049655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:19.056933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.057834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.059746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.060735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.061709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.062580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.339152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:19.352546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7bef51e-9ccd-458b-ab80-ab778fdc23f7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.550751 Oct 26 05:06:19.358158 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 681/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:18 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:19.369456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:19.370191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:19.384067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.384856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.385753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.389539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.390391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.391071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.676539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:19.684935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-53a507c5-b0b1-4ec6-8e32-099e8d652207 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1323 microversion: 2.1 time: 0.643355 Oct 26 05:06:19.685550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 690/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:19 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1323 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:19.713021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:19.713673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:19.746419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.747132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.747482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.748224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.752908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.753456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.798597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.799358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.800140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.800819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lazy-loading 'fault' on Instance uuid be1e9b92-1459-4e68-8724-8f167d464102 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:06:19.808436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:19.818351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-feab5162-6df9-49eb-bcff-5645673d070c tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.458932 Oct 26 05:06:19.819261 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 682/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:19 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:19.824848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:19.839166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:19.840845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:19.847978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.848702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.850201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.851184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.861356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.862383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:19.898335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:06:19.905221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c496b6a683e147f8b41e82b2921454d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ec452e1add45cdb311971b90e34200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:19.922195 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-055edf95-06e8-4b9e-8478-aefd9e0f8aed tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 200 len: 1315 microversion: 2.1 time: 0.212889 Oct 26 05:06:19.922885 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 691/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:19 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:19.931822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a33dc280-e8b8-4e52-ba01-87fd89906180 req-faa2711a-02e9-4f28-8765-efaa2e9e589e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73891979-1cb8-4772-be88-1e6eebb0c6ca", "tag": "95d26a1c-494a-40cf-b790-57f45dfab372"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:19.969544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a33dc280-e8b8-4e52-ba01-87fd89906180 req-faa2711a-02e9-4f28-8765-efaa2e9e589e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:19.970335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a33dc280-e8b8-4e52-ba01-87fd89906180 req-faa2711a-02e9-4f28-8765-efaa2e9e589e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:19.970998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a33dc280-e8b8-4e52-ba01-87fd89906180 req-faa2711a-02e9-4f28-8765-efaa2e9e589e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.005430 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a33dc280-e8b8-4e52-ba01-87fd89906180 req-faa2711a-02e9-4f28-8765-efaa2e9e589e service nova] Creating event network-changed:95d26a1c-494a-40cf-b790-57f45dfab372 for instance 73891979-1cb8-4772-be88-1e6eebb0c6ca on n-h2-862416-4 Oct 26 05:06:20.015902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a33dc280-e8b8-4e52-ba01-87fd89906180 req-faa2711a-02e9-4f28-8765-efaa2e9e589e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090904 Oct 26 05:06:20.028077 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 692/1374] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:20.043916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.044992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:20.053684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=24 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:20.057205 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea04c291-a47b-4aa3-b18f-17c7dc3a89fa tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.236692 Oct 26 05:06:20.058415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 683/1375] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:06:19 2022] GET /compute/v2.1/servers => generated 681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:20.066339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.067198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:20.068633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.069156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.069907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.070930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.071556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.072211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.075160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.076084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.076730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.086776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.087654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.088262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.330139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:20.395420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:20.406272 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9db34592-c49a-45c0-af6a-17ca08c5fc9c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.346068 Oct 26 05:06:20.427605 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 684/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:20.427605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.436733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:20.446703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.servers [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Removing options 'limit' from query {{(pid=120585) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 05:06:20.448587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:20.469918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.470482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.471064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.472022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.475925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.477358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.489945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:20.502002 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a98fc031-18c7-42a8-9663-e7dcf3fb5f97 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.469279 Oct 26 05:06:20.502602 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 693/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:20.518401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.521576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:20.545459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:06:20.565512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.566041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.566498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.567249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.567716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.568151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.593558 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-459df8f5-c548-4f40-b9e1-614412c7e188 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.179690 Oct 26 05:06:20.595911 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 685/1378] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:20.611733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-045d6405-70d6-4fea-b423-588283cc3061 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-045d6405-70d6-4fea-b423-588283cc3061 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:20.617323 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 26 05:06:20.618912 n-d-862416-4 devstack@n-api.service[120585]: action_args: {} Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi '-1' Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:20.619877 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.622356 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:20.623704 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:20.623704 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:20.623704 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:20.623704 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:20.623704 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 26 05:06:20.623704 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.628525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-045d6405-70d6-4fea-b423-588283cc3061 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:20.629659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-045d6405-70d6-4fea-b423-588283cc3061 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022303 Oct 26 05:06:20.630804 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 686/1379] 10.222.0.16 () {58 vars in 1142 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:20.643069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-954af36f-d58e-44ec-8755-53def9a7618e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-954af36f-d58e-44ec-8755-53def9a7618e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:20.647553 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 26 05:06:20.649118 n-d-862416-4 devstack@n-api.service[120585]: action_args: {} Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'testing' Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:20.649998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.651556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:20.653148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:20.653148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:20.653148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:20.653148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:20.653148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 26 05:06:20.653148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:20.659714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-954af36f-d58e-44ec-8755-53def9a7618e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:20.661147 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-954af36f-d58e-44ec-8755-53def9a7618e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023286 Oct 26 05:06:20.662639 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 687/1380] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:20.673061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fdf7ef3-c742-4714-96d3-0626dd82b225 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.681638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fdf7ef3-c742-4714-96d3-0626dd82b225 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:20.683213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1fdf7ef3-c742-4714-96d3-0626dd82b225 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:20.691749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.servers [None req-1fdf7ef3-c742-4714-96d3-0626dd82b225 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Flavor 'non_existing_flavor' could not be found {{(pid=120585) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 26 05:06:20.693254 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fdf7ef3-c742-4714-96d3-0626dd82b225 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024839 Oct 26 05:06:20.694503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 688/1381] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:06:20.710477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.719910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:20.730682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.731261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.731990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.732718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:20.737283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:20.737772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:20.934307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:20.948198 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa171b0f-93ad-4682-aa15-ba1287611b94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.444510 Oct 26 05:06:20.974687 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 694/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:20.984450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:20.999194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:21.002576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:21.018099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.018919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.026331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.028456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.029261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.029948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.295446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-faa9b2a6-6d39-465c-b56f-f954d8b12c4e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.319023 Oct 26 05:06:21.305303 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 695/1383] 10.222.0.16 () {58 vars in 1174 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:06:21.312025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:21.320595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:21.346348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.349830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.350354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.353258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.353804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.354539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.620271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:21.636085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b658acb7-11c4-43d1-a1e3-2e3d8564a816 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1518 microversion: 2.1 time: 0.929100 Oct 26 05:06:21.655575 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 689/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:20 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1518 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:21.667381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:21.671690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: be1e9b92-1459-4e68-8724-8f167d464102] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:21.683997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.686404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.686897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.687643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.688113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.688558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.725640 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance be1e9b92-1459-4e68-8724-8f167d464102 could not be found. Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 HTTP/1.1 Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:21.727246 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance be1e9b92-1459-4e68-8724-8f167d464102 could not be found. Oct 26 05:06:21.728848 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'be1e9b92-1459-4e68-8724-8f167d464102'} Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be1e9b92-1459-4e68-8724-8f167d464102 could not be found. Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:21.729743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be1e9b92-1459-4e68-8724-8f167d464102 could not be found. Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be1e9b92-1459-4e68-8724-8f167d464102 could not be found. Oct 26 05:06:21.731879 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:21.733129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance be1e9b92-1459-4e68-8724-8f167d464102 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:21.733129 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9614ee11-3cad-45b2-a13d-abdf774c7cb0 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102" status: 404 len: 111 microversion: 2.1 time: 0.072011 Oct 26 05:06:21.733618 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 690/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:21 2022] GET /compute/v2.1/servers/be1e9b92-1459-4e68-8724-8f167d464102 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:21.749088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fe6b45bf-74a9-4184-b82d-5283b0898cba req-938486ba-0cfd-4e3b-b6ef-e103cf0f7d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c383a0fb-6b77-41e4-8323-9dc041ca04f3", "tag": "3dd54acc-61f5-4fc4-8558-83cda3a2ad32"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:21.771012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fe6b45bf-74a9-4184-b82d-5283b0898cba req-938486ba-0cfd-4e3b-b6ef-e103cf0f7d81 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.771500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fe6b45bf-74a9-4184-b82d-5283b0898cba req-938486ba-0cfd-4e3b-b6ef-e103cf0f7d81 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.771933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fe6b45bf-74a9-4184-b82d-5283b0898cba req-938486ba-0cfd-4e3b-b6ef-e103cf0f7d81 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.802397 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fe6b45bf-74a9-4184-b82d-5283b0898cba req-938486ba-0cfd-4e3b-b6ef-e103cf0f7d81 service nova] Creating event network-changed:3dd54acc-61f5-4fc4-8558-83cda3a2ad32 for instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 on n-h1-862416-4 Oct 26 05:06:21.821414 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fe6b45bf-74a9-4184-b82d-5283b0898cba req-938486ba-0cfd-4e3b-b6ef-e103cf0f7d81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079229 Oct 26 05:06:21.821414 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 691/1386] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:21.857775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:21.876955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:21.879564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:21.880982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:21.891240 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f049211-86d9-47a4-9d3d-eec7bc17a3d9 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.583092 Oct 26 05:06:21.893627 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:21 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:21.898013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.899359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:21.900225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:21.900892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.903520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.904579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.905837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.908692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.911111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.911998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.915969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:21.920661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:21.926668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:21.927265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:22.177641 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82bf3ad7-b8fa-45c1-b3b6-4487db2fef21 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.352486 Oct 26 05:06:22.180485 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 692/1388] 10.222.0.16 () {58 vars in 1184 bytes} [Wed Oct 26 05:06:21 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:06:22.192508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:22.197052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:22.224572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:22.227180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:22.227637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:22.237381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:22.237893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:22.238128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:22.238605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:22.252090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-151ae968-b047-40f4-ae08-2a7fb162e705 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.357112 Oct 26 05:06:22.271118 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 697/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:21 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:22.278236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e5c8899-48ae-4025-be71-994729dfbddd tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'create', calling method: .version_select at 0x7f470abbcee0>, body: {"pool": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:22.554256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:22.566493 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-12bd48fd-4f1b-4f32-9859-0a482b2606aa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.384647 Oct 26 05:06:22.568199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:22 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:22.577458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39279292-f8de-4ea4-87c6-f643b4c5ead9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '.version_select at 0x7f470a1b2280>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:24.405794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e5c8899-48ae-4025-be71-994729dfbddd tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.133355 Oct 26 05:06:24.406968 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 698/1391] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:06:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:24.412781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:24.413869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:24.422599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.423143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.423604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.429751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.430341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.430965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.435582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:24.592096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:24.600591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-70829f3f-a847-46ee-b285-411a2ca8174a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.192112 Oct 26 05:06:24.601166 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 699/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:24 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:24.612578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:24.617401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-39279292-f8de-4ea4-87c6-f643b4c5ead9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Image not found. Oct 26 05:06:24.617897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:24.618196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39279292-f8de-4ea4-87c6-f643b4c5ead9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd HTTP/1.1 Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:24.619964 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '6259dcf7-6b94-4a7e-9927-d422c9a9fcbd'} Oct 26 05:06:24.621562 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6259dcf7-6b94-4a7e-9927-d422c9a9fcbd to delete Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:24.625486 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6259dcf7-6b94-4a7e-9927-d422c9a9fcbd could not be found. Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:24.627086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39279292-f8de-4ea4-87c6-f643b4c5ead9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:24.628808 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39279292-f8de-4ea4-87c6-f643b4c5ead9 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd" status: 404 len: 62 microversion: 2.1 time: 2.052877 Oct 26 05:06:24.630184 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 694/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:22 2022] DELETE /compute/v2.1/images/6259dcf7-6b94-4a7e-9927-d422c9a9fcbd => generated 62 bytes in 2054 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:06:24.630327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.630327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.630327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.630327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.630715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.630715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.630912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:24.630912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:24.639468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.639975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.640552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.641267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.641824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.642442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.736123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:06:24.784776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:24.793257 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-52d94490-88cc-4b76-8069-38521fdb896e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.169180 Oct 26 05:06:24.801419 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 695/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:24 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:24.801419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:24.801419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:24.805917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.805917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.806213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.806818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.807271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.807757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.810205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:24.817271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:24.817904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:24.818455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:24.830940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:25.006502 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f05e2529-c658-4eae-973b-aa30737a73c4 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.404228 Oct 26 05:06:25.008561 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 700/1395] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:06:24 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:25.010534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:25.017256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.017923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.019856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69d2950d-10ee-417b-a24a-372e50c4e6bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.224676 Oct 26 05:06:25.027297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.028128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.028128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.028753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.029168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.029622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.039269 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 696/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:24 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:25.044047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0d000a32-1a7c-4dd3-a87f-d644cdf088ba req-82eda6dd-8f06-48cc-8a31-0f2724f1aa4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:25.063363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0d000a32-1a7c-4dd3-a87f-d644cdf088ba req-82eda6dd-8f06-48cc-8a31-0f2724f1aa4d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.063859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0d000a32-1a7c-4dd3-a87f-d644cdf088ba req-82eda6dd-8f06-48cc-8a31-0f2724f1aa4d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.064312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0d000a32-1a7c-4dd3-a87f-d644cdf088ba req-82eda6dd-8f06-48cc-8a31-0f2724f1aa4d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.076622 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0d000a32-1a7c-4dd3-a87f-d644cdf088ba req-82eda6dd-8f06-48cc-8a31-0f2724f1aa4d service nova] Creating event network-changed:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h2-862416-4 Oct 26 05:06:25.081573 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0d000a32-1a7c-4dd3-a87f-d644cdf088ba req-82eda6dd-8f06-48cc-8a31-0f2724f1aa4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040999 Oct 26 05:06:25.082475 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 697/1397] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:25.087605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-440539027", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "3985538d-bfbe-4200-9b84-bfdebdcb224a"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:25.155140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] validate_networks() for [('3985538d-bfbe-4200-9b84-bfdebdcb224a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:25.255856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:25.264560 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6898fc9b-8d0f-4952-b548-f8da3c85576e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.254365 Oct 26 05:06:25.264794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 701/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:25 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:25.282535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.283175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.290745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.291334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.292007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.293700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.294295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.294732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.314387 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 HTTP/1.1 Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:25.315751 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.317522 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9b9dca6b-e1aa-420f-838b-c9af8a42bee6'} Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:25.318512 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.320121 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.321817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:25.321817 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f49efd2b-5ad0-45b7-a39d-d8c9ed328b75 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 404 len: 111 microversion: 2.1 time: 0.051630 Oct 26 05:06:25.321817 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 702/1399] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:25 2022] DELETE /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:25.326739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-130328f2-9dc0-44d7-906d-96a75b536e49 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.331901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-130328f2-9dc0-44d7-906d-96a75b536e49 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:25.334006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-130328f2-9dc0-44d7-906d-96a75b536e49 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011498 Oct 26 05:06:25.334742 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 703/1400] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Oct 26 05:06:25 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:06:25.349540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.350724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 9b9dca6b-e1aa-420f-838b-c9af8a42bee6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.358396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.358891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.359334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.360400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.360863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.361286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.380164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 HTTP/1.1 Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:25.381773 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.383382 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9b9dca6b-e1aa-420f-838b-c9af8a42bee6'} Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:25.384217 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. Oct 26 05:06:25.385562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.387987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance 9b9dca6b-e1aa-420f-838b-c9af8a42bee6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:25.387987 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6f7f7bc-72f6-4381-af6f-0dbfea8aa6b1 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6" status: 404 len: 111 microversion: 2.1 time: 0.038748 Oct 26 05:06:25.387987 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 704/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:25 2022] GET /compute/v2.1/servers/9b9dca6b-e1aa-420f-838b-c9af8a42bee6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:25.392391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.397049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:25.397903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Searching by: {'deleted': False, 'project_id': '33c3c90010884e638985cbbc2c91757b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:06:25.403943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.404431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.404869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.405719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.406151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.406748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.436143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:06:25.468592 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aef98c95-ef84-4732-bfa5-f32c0c9a9387 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.079827 Oct 26 05:06:25.469180 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 705/1402] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:06:25 2022] GET /compute/v2.1/servers => generated 681 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:25.473763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab0f5b20-59c3-4086-a693-81be4c761c37 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '.version_select at 0x7f470aac8ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.495255 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab0f5b20-59c3-4086-a693-81be4c761c37 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618198833" status: 202 len: 0 microversion: 2.1 time: 0.024918 Oct 26 05:06:25.496003 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 706/1403] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618198833 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:06:25.501399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.501907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.507976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.508474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.508914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.509652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.510112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.510545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.532285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] HTTP exception thrown: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 HTTP/1.1 Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:25.534142 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:25.535848 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c9d33722-dbfe-4da7-b65c-510fe13e50f3'} Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:25.537113 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:25.538753 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:25.541012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 404 to user: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:25.542082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5fd35d0e-70e9-4508-92c7-1beee1975128 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 404 len: 111 microversion: 2.1 time: 0.045141 Oct 26 05:06:25.544335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 707/1404] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:25 2022] DELETE /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:25.554674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.555588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.562833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.563568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.564181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.565070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.565999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.566599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.601020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:06:25.632285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:25.632989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:25.633516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:25.633933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:25.634504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:25.646555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.647594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.648224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.649864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.650543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.651146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.675676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:25.685787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Getting quotas for project 67fbce7c49554dde9754fc79cbffa8be. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:25.695344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Getting quotas for user ebf85e7319884c87ba745771b8abaa92 and project 67fbce7c49554dde9754fc79cbffa8be. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:25.711292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:25.716019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:25.739254 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d55c7891-086a-4a0c-9c21-3b95bcb5ed26 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 204 len: 0 microversion: 2.1 time: 0.188135 Oct 26 05:06:25.740032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 708/1405] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:25 2022] DELETE /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:06:25.751330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.753493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.761713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.762861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.763602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.764892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.766042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.766953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.807879 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c7ce48f-69a4-4b6a-96bf-772f2fb2df45 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719220 Oct 26 05:06:25.811833 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 698/1406] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:25.821938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:25.822489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:25.830314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.830832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.831344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.832054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:25.833116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:25.833585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:25.881117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:06:25.995477 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b987f7a0-6c73-4547-9c80-79536b7dc1a6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 204 len: 0 microversion: 2.1 time: 0.181543 Oct 26 05:06:25.997083 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 699/1407] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:25 2022] DELETE /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:06:26.009012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.010067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.019158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.019899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.020503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.021364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.021905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.022451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.152821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:26.163111 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-29ac636d-c917-4af5-b32f-338e620d309f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.421595 Oct 26 05:06:26.164083 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 709/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:25 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:26.170596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6ff6298-f71e-4b98-a652-6cdc9603570d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.171215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6ff6298-f71e-4b98-a652-6cdc9603570d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.254416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6ff6298-f71e-4b98-a652-6cdc9603570d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:26.262141 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6ff6298-f71e-4b98-a652-6cdc9603570d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1223 microversion: 2.1 time: 0.096617 Oct 26 05:06:26.263013 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 710/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:26.268150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.269113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: c9d33722-dbfe-4da7-b65c-510fe13e50f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.275205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.275916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.276577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.277740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.278214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.278654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.296503 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] HTTP exception thrown: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 HTTP/1.1 Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:26.300508 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:26.302445 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c9d33722-dbfe-4da7-b65c-510fe13e50f3'} Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:26.303360 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. Oct 26 05:06:26.304688 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.307150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 404 to user: Instance c9d33722-dbfe-4da7-b65c-510fe13e50f3 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:26.307150 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23775aa8-236e-4aa1-a663-dc0a8a80e386 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3" status: 404 len: 111 microversion: 2.1 time: 0.038295 Oct 26 05:06:26.307150 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 711/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] GET /compute/v2.1/servers/c9d33722-dbfe-4da7-b65c-510fe13e50f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:26.310880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.311560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.318008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.318513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.318962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.319678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.320142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.320575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.346135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:26.359313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e23d9831-999c-4cf9-8e81-e99ace7b9dce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.360899 Oct 26 05:06:26.360632 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 700/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:25 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:26.365898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.366800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.374019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.374853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.375769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.376734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.377301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.377862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.623024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:26.631020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7cea4324-ff5d-4849-bda2-62c463895178 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.326652 Oct 26 05:06:26.631584 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 712/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:26.646933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:26.652577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.654046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.658824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67b0515d-9f6e-48ef-879a-cb009904e503 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.296762 Oct 26 05:06:26.659835 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 701/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:26.666898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.668811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.669265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.669999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.670468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.670893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.810168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4627c6e-5e95-4df2-8ae2-bd26a3343d79 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '.version_select at 0x7f470eba29d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.833464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e4627c6e-5e95-4df2-8ae2-bd26a3343d79 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Image not found. Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4627c6e-5e95-4df2-8ae2-bd26a3343d79 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/images/74b4674f-f729-4c88-80af-a2f6429abf68 HTTP/1.1 Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:26.835380 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '74b4674f-f729-4c88-80af-a2f6429abf68'} Oct 26 05:06:26.836855 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 74b4674f-f729-4c88-80af-a2f6429abf68 to delete Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.837764 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 74b4674f-f729-4c88-80af-a2f6429abf68 could not be found. Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:26.839064 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4627c6e-5e95-4df2-8ae2-bd26a3343d79 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:26.841838 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4627c6e-5e95-4df2-8ae2-bd26a3343d79 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/images/74b4674f-f729-4c88-80af-a2f6429abf68" status: 404 len: 62 microversion: 2.1 time: 0.031190 Oct 26 05:06:26.842964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 702/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] DELETE /compute/v2.1/images/74b4674f-f729-4c88-80af-a2f6429abf68 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:06:26.846132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.846639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.851074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:26.855989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.856481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.856922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.857671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.858122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.858559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.859457 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-805efce9-8af6-47b3-8734-7aad77002382 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1522 microversion: 2.1 time: 0.215604 Oct 26 05:06:26.860037 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 713/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:26.872252 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b HTTP/1.1 Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:26.873833 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.875569 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b'} Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:26.876543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.878250 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.879800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:26.879800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc314c70-ef24-48fa-a2df-bf137553c641 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 404 len: 111 microversion: 2.1 time: 0.032894 Oct 26 05:06:26.879800 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 703/1416] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:26 2022] DELETE /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:26.883947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:26.884567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] [instance: 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:26.891368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.891863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.892303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.893004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:26.893509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:26.893942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:26.910612 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] HTTP exception thrown: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Request method failure captured: Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b HTTP/1.1 Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL-uxsGszxpMhImya3Kmud1lkU7dDhGqne2jCX_E0PA2zPB2PBjLORPdgYmLPazcEYeZfCavbNbl8UlUvNAq3IENbpe_o6ET7G5FZN7DOgcDUtnVmTkUoxiTzcbY-2fI639uL-DjsjtOaQ8lp1tY3nZ2Ny5pR69X0BuilgUaAZQJ7WM Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:26.912436 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05ec452e1add45cdb311971b90e34200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05ec452e1add45cdb311971b90e34200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05ec452e1add45cdb311971b90e34200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 05ec452e1add45cdb311971b90e34200 Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-413325440 Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c496b6a683e147f8b41e82b2921454d6 Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-413325440-project Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.914179 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75bf65a6-e1be-4a40-a1cb-29cfe1bf944b'} Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:26.915137 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. Oct 26 05:06:26.916710 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:26.919044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] Returning 404 to user: Instance 75bf65a6-e1be-4a40-a1cb-29cfe1bf944b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:26.919044 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc1e13ec-56a7-46b8-aac7-f4f1d3a21dc2 tempest-ImagesOneServerNegativeTestJSON-413325440 tempest-ImagesOneServerNegativeTestJSON-413325440-project] 10.222.0.16 "GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b" status: 404 len: 111 microversion: 2.1 time: 0.033732 Oct 26 05:06:26.919044 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 714/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:26 2022] GET /compute/v2.1/servers/75bf65a6-e1be-4a40-a1cb-29cfe1bf944b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:27.190519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:27.190519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:27.201593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.203651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.204308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.206782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.207809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.208408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.298786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:27.299762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:27.316029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.316656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.317393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.318530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.321487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.322448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.436125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:27.451496 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5fceabee-26c9-4598-b9cb-7c66983e1c0b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1219 microversion: 2.1 time: 0.171155 Oct 26 05:06:27.452617 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 715/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:27 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:27.471285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-222ea9a3-5c2c-43c2-bbac-e0aedd0a992a req-563fc16e-9ec5-48d4-a815-2ecd2d5f1723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c383a0fb-6b77-41e4-8323-9dc041ca04f3", "name": "network-vif-plugged", "status": "completed", "tag": "3dd54acc-61f5-4fc4-8558-83cda3a2ad32"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:27.482377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-222ea9a3-5c2c-43c2-bbac-e0aedd0a992a req-563fc16e-9ec5-48d4-a815-2ecd2d5f1723 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.483133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-222ea9a3-5c2c-43c2-bbac-e0aedd0a992a req-563fc16e-9ec5-48d4-a815-2ecd2d5f1723 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.483736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-222ea9a3-5c2c-43c2-bbac-e0aedd0a992a req-563fc16e-9ec5-48d4-a815-2ecd2d5f1723 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.500034 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-222ea9a3-5c2c-43c2-bbac-e0aedd0a992a req-563fc16e-9ec5-48d4-a815-2ecd2d5f1723 service nova] Creating event network-vif-plugged:3dd54acc-61f5-4fc4-8558-83cda3a2ad32 for instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 on n-h1-862416-4 Oct 26 05:06:27.506641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-222ea9a3-5c2c-43c2-bbac-e0aedd0a992a req-563fc16e-9ec5-48d4-a815-2ecd2d5f1723 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052006 Oct 26 05:06:27.508118 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 716/1419] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:27.519169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:27.519914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:27.526574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.527121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.527564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.528556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.529009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.529476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.570604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:27.581489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b8774340-e5a7-4c65-8526-3bf5ef89a60d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.394734 Oct 26 05:06:27.582711 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 704/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:27 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:27.656995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:27.659186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:27.669434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.670671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.671629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.672670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.673355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.674233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.853034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:27.864779 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-794abdf6-eb80-4f1e-8f78-2ecaabbee304 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.351444 Oct 26 05:06:27.877998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 717/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:27 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:27.887672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:27.888552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:27.897627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.898061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.898986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:27.900017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:27.900853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:27.901478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.044806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:28.054233 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20c4ec83-c3f1-442f-8fae-4ad815d3bfb9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.403460 Oct 26 05:06:28.070259 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 705/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:27 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:28.076169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:28.076797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:28.085210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.086231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.087782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.088691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.092832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.093856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.273028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:28.283271 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6021cae8-836e-4a99-bacb-22a433ad1d3e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.403810 Oct 26 05:06:28.302962 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 718/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:27 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:28.313138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-816f3fc4-f965-4b1f-9feb-49a80024950b req-4d50cce7-3047-4536-ba82-d17d697fdc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261345c-dd9b-4215-9c81-6842f985dd36", "name": "network-vif-deleted", "tag": "ff67121d-7207-4ebc-b96e-258cdfde039b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:28.334184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-816f3fc4-f965-4b1f-9feb-49a80024950b req-4d50cce7-3047-4536-ba82-d17d697fdc82 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.335643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-816f3fc4-f965-4b1f-9feb-49a80024950b req-4d50cce7-3047-4536-ba82-d17d697fdc82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.341279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-816f3fc4-f965-4b1f-9feb-49a80024950b req-4d50cce7-3047-4536-ba82-d17d697fdc82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.392409 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-816f3fc4-f965-4b1f-9feb-49a80024950b req-4d50cce7-3047-4536-ba82-d17d697fdc82 service nova] Creating event network-vif-deleted:ff67121d-7207-4ebc-b96e-258cdfde039b for instance b261345c-dd9b-4215-9c81-6842f985dd36 on n-h1-862416-4 Oct 26 05:06:28.403357 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-816f3fc4-f965-4b1f-9feb-49a80024950b req-4d50cce7-3047-4536-ba82-d17d697fdc82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097883 Oct 26 05:06:28.403976 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 719/1424] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:28.424732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:28.446673 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-918e0a2c-2a7a-4f0d-9f90-f81a4213aa9b tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1522 microversion: 2.1 time: 0.375207 Oct 26 05:06:28.456748 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 706/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:28 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:28.476930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:28.477605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:28.486160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.487089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.487733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.488632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.489271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.489721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.587814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:28.591770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:28.605989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:28.606861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:28.610489 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba6485e7-47a6-4c8b-9c30-875051c58bc4 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1275 microversion: 2.1 time: 0.128546 Oct 26 05:06:28.611618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 720/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:28 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:28.620318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.621697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.622428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.623359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.624009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.624779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.893134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:28.894013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:28.910052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.915473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.916225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.917175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:28.917933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:28.918903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:28.958292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:28.971512 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17861f73-d62c-4c9e-99dd-07ab231f75cb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1311 microversion: 2.1 time: 0.369270 Oct 26 05:06:28.986076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 707/1427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:28 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1311 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:29.086744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:29.089160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:29.099843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.103402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.104123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.106050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.106928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.107984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.359693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:29.370250 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31f5cc8a-7bd7-453c-8bd9-a866cef843bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.482005 Oct 26 05:06:29.373504 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 721/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:28 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:29.383947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:29.386403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:29.403820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:29.406698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.407550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.408283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.409270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.409982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.410642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.482954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:29.497335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d9a034f-dce3-4086-a518-ed3909056433 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1307 microversion: 2.1 time: 0.418869 Oct 26 05:06:29.498567 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 708/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:29 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:29.505361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:29.507010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:29.515740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.516920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.517893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.519446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.520331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.521212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.798021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:29.815238 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f9f09f2-1d59-4d38-bb4a-b8314e1cbcd8 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.440130 Oct 26 05:06:29.815846 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 722/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:29 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:29.837999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:29.838917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:29.856528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.856933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.857412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:29.858149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:29.858614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:29.874161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:30.248903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:30.258656 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff0fdb9f-82e1-4edd-a6e8-0dce2ba26012 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1522 microversion: 2.1 time: 0.758701 Oct 26 05:06:30.266954 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 709/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:29 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1522 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:30.272198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:30.280233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:30.288064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:30.295847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:30.296564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:30.297496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:30.298284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:30.298829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:30.445981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:30.454816 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-920d2df5-f472-4cf3-ae8d-716ad2bcebb9 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1281 microversion: 2.1 time: 0.623029 Oct 26 05:06:30.477695 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 723/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:29 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1281 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:30.510764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:30.513151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:30.578190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:30.578743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:30.579201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:30.579955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:30.592339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:30.592917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:30.689119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:30.702320 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae5067a5-e478-46b6-9310-019c3585ff53 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1494 microversion: 2.1 time: 0.433655 Oct 26 05:06:30.703910 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 710/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:30 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1494 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:30.712030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:30.713486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:30.725202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:30.726561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:30.728110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:30.729702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:30.731146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:30.732016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.104354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:31.116191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f27733e3-91de-4f72-8f90-bec8ec845b24 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.636905 Oct 26 05:06:31.122996 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 724/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:30 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:31.249794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:31.253270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:31.271382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.272412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.273151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.274420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.275496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.282396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.304567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:31.320294 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-925949b0-dd63-4ab7-9dc1-a25f43d15a43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1488 microversion: 2.1 time: 0.614149 Oct 26 05:06:31.322022 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 711/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:30 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1488 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:31.333029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:31.343765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:31.373906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.374677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.375361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.376353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.377054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.377734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.697223 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff025e31-e838-4bd6-90f4-3f0de46ff255 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1645 microversion: 2.1 time: 0.572672 Oct 26 05:06:31.699981 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 725/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:31 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1645 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:31.717609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:31.718799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:31.740083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.742601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.743983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.747741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.751708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.753367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.829083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:31.837218 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c9ee36dd-fba0-4f8d-9cee-84fa3faae8cf tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.509613 Oct 26 05:06:31.839702 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 712/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:31 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:31.844964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a660d01c-a495-46e8-ae0a-7306b35756c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:31.852953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a660d01c-a495-46e8-ae0a-7306b35756c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:31.853703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a660d01c-a495-46e8-ae0a-7306b35756c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:31.854329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a660d01c-a495-46e8-ae0a-7306b35756c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:31.956459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a660d01c-a495-46e8-ae0a-7306b35756c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Going to try to stop instance {{(pid=120585) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:06:31.988225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:32.043825 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a660d01c-a495-46e8-ae0a-7306b35756c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8/action" status: 202 len: 0 microversion: 2.1 time: 0.201583 Oct 26 05:06:32.048036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 713/1438] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:31 2022] POST /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:06:32.053755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:32.055194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:32.063447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.064594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.065268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.066219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.066847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.067447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.094749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:32.106817 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77cb5d48-6b03-44e2-a550-2a696d029d44 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1522 microversion: 2.1 time: 0.402271 Oct 26 05:06:32.107463 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 726/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:31 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:32.128402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:32.129276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:32.136822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.137627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.138318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.139206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.139828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.140452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.426179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:32.453292 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b695088-7cea-4593-8153-8d7008bbfc6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1323 microversion: 2.1 time: 0.403937 Oct 26 05:06:32.454204 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 714/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:32 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:32.459013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:32.459661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:32.475870 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d2b8760-7388-475c-80f5-e0e8eaffca3a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1645 microversion: 2.1 time: 0.353289 Oct 26 05:06:32.476776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.476776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.477092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.479080 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 727/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:32 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1645 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:32.481948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.482819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.482819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.487493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:32.488692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:32.499968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.501058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.502465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.503685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.504610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.505384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.922192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:32.926923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:32.931397 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d78b0c69-baae-4658-9f5b-5e08f2bc3f7e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.450557 Oct 26 05:06:32.932533 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 728/1442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:32 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:32.938987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a55dfd2b-1ecc-4cf7-b004-ad2ad0b68248 req-37fc9e71-66d2-4ff4-9890-da878f12ed1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394d62d7-2614-4420-8f55-ad5178d6c877", "tag": "5d74ffd2-2464-486a-a80e-27f76c357c36"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:32.948580 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a70fe86a-faca-4de2-b27e-9f61eac86d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.493270 Oct 26 05:06:32.950394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a55dfd2b-1ecc-4cf7-b004-ad2ad0b68248 req-37fc9e71-66d2-4ff4-9890-da878f12ed1f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.950953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a55dfd2b-1ecc-4cf7-b004-ad2ad0b68248 req-37fc9e71-66d2-4ff4-9890-da878f12ed1f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.952156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a55dfd2b-1ecc-4cf7-b004-ad2ad0b68248 req-37fc9e71-66d2-4ff4-9890-da878f12ed1f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.954044 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 715/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:32 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:32.967675 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a55dfd2b-1ecc-4cf7-b004-ad2ad0b68248 req-37fc9e71-66d2-4ff4-9890-da878f12ed1f service nova] Creating event network-changed:5d74ffd2-2464-486a-a80e-27f76c357c36 for instance 394d62d7-2614-4420-8f55-ad5178d6c877 on n-h1-862416-4 Oct 26 05:06:32.968295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:32.972389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.972922 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a55dfd2b-1ecc-4cf7-b004-ad2ad0b68248 req-37fc9e71-66d2-4ff4-9890-da878f12ed1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037881 Oct 26 05:06:32.973905 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 729/1444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:32.974374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.975045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.980527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:32.981346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:32.982017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.982716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.983457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.989000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.989603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.990163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:32.990793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:32.991291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:32.992026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:33.003965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=13 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:33.039834 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a90b3ba-d1ef-43c5-bf0f-6646e1f964c1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084387 Oct 26 05:06:33.041509 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 716/1445] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:06:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:33.054221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": true, "disk_over_commit": false}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:33.059800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:33.077621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:33.078077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:33.078530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:33.079224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:33.079941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:33.080376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:33.118738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lazy-loading 'flavor' on Instance uuid c383a0fb-6b77-41e4-8323-9dc041ca04f3 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:06:33.135400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Going to try to live migrate instance to n-h2-862416-4 {{(pid=120585) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:06:33.229731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:33.242579 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6067dea9-196a-4261-a52e-b631bd84ace0 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.266679 Oct 26 05:06:33.243452 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 730/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:32 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:33.249215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:33.250195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:33.259966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:33.260878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:33.262259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:33.263469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:33.264797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:33.265619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:33.687813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:33.699533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc604c91-da84-4483-b356-f4549ba07d8e tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1522 microversion: 2.1 time: 0.453493 Oct 26 05:06:33.700788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 731/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:33 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:33.707408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:33.708143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:33.714351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:33.715127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:33.715798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:33.716953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:33.717854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:33.718578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:34.162082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:34.177816 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-585c53ca-f82a-4afc-bc6d-0d147d46c114 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1323 microversion: 2.1 time: 0.474863 Oct 26 05:06:34.195173 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 732/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:33 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:34.195173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:34.195173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:34.218544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:34.218967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:34.224090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:34.224611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:34.225249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:34.234102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:34.687411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:34.704769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d75b8e1f-923a-48a1-b974-37086d75f390 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.522667 Oct 26 05:06:34.705779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 733/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:34 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:34.712964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:34.713613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:34.742317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:34.743350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:34.744719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:34.746938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:34.747560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:34.748200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.068255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:35.085048 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07893469-aae3-43b4-936d-1d0d124a15b8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.376154 Oct 26 05:06:35.085751 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 734/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:34 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:35.093890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:35.094950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:35.103170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.103945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.104556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.106044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.106679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.107274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.177292 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c9c62a61-12e0-4be5-b14c-ee45de3653b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3/action" status: 202 len: 0 microversion: 2.1 time: 2.126674 Oct 26 05:06:35.178438 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 717/1451] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:33 2022] POST /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3/action => generated 0 bytes in 2129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:06:35.185426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:35.186341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:35.197624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.198286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.202257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.203563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.204222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.204829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.383182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:35.392991 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7675ee22-bbe7-45ba-b1b2-71b7dc504d86 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1480 microversion: 2.1 time: 0.212712 Oct 26 05:06:35.399533 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 718/1452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:35 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1480 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:35.409046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b7ba5b0a-172a-4bd6-b286-190f5c8e7c62 req-a72dc107-26e2-4ff7-b838-c1d28b2074d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d71a4a-1263-4408-a694-d9ceded8ae86", "name": "network-vif-deleted", "tag": "3ec4081f-0d42-4526-ac70-45a8f2f2e315"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:35.418077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:35.429476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b7ba5b0a-172a-4bd6-b286-190f5c8e7c62 req-a72dc107-26e2-4ff7-b838-c1d28b2074d3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.429854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b7ba5b0a-172a-4bd6-b286-190f5c8e7c62 req-a72dc107-26e2-4ff7-b838-c1d28b2074d3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.430286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b7ba5b0a-172a-4bd6-b286-190f5c8e7c62 req-a72dc107-26e2-4ff7-b838-c1d28b2074d3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.437505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:35.452116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19ec0b7c-ddaa-48f0-b446-cfcc20434353 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.359751 Oct 26 05:06:35.460470 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b7ba5b0a-172a-4bd6-b286-190f5c8e7c62 req-a72dc107-26e2-4ff7-b838-c1d28b2074d3 service nova] Creating event network-vif-deleted:3ec4081f-0d42-4526-ac70-45a8f2f2e315 for instance 60d71a4a-1263-4408-a694-d9ceded8ae86 on n-h2-862416-4 Oct 26 05:06:35.463515 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 735/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:35 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:35.474386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:35.474552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b7ba5b0a-172a-4bd6-b286-190f5c8e7c62 req-a72dc107-26e2-4ff7-b838-c1d28b2074d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073480 Oct 26 05:06:35.475446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:35.475913 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 719/1454] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:35.481739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:35.482448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:35.489784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.490473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.491090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.492590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.493215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.493829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.501860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.504113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.505612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.508342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.509122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.511615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.706894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:35.747530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:35.756098 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7bf592b5-90d8-46fb-b469-250108d8ac7d tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1323 microversion: 2.1 time: 0.278972 Oct 26 05:06:35.757234 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 720/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:35 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:35.762021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:35.762987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:35.769121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.769870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.770826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.771722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:35.771964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:35.772572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:35.773284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:35.781186 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ae72946b-3a05-4cfc-ad86-9d587e7ee7cc tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.314930 Oct 26 05:06:35.798024 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 736/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:35 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:35.961051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:35.970707 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88294bcc-ba4c-453e-9aa8-b050027c078f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.212261 Oct 26 05:06:35.989921 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 721/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:35 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:36.108857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:36.109595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:36.119568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.128291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.128988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.129770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.130246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.130680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.258813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:36.300178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:36.309003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9c6859e-c9eb-4ddf-a519-9e5bb6b67250 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.204026 Oct 26 05:06:36.309770 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 737/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:36 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:36.423116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:36.423724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:36.450524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.450974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.451423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.452443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.452798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.453231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.487289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:36.487905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:36.498909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.499416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.499860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.500566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.501024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.501474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.504440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:36.519565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:36.529257 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23bfd1d0-207a-474e-8d75-76020ae4b108 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1480 microversion: 2.1 time: 0.109850 Oct 26 05:06:36.542899 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 722/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:36 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1480 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:36.746610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:36.760232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f79f809b-a505-4110-a802-42e456647610 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.274594 Oct 26 05:06:36.763399 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 738/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:36 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:36.783162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:36.788702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:36.804364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.804852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.805539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.806409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.811872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:36.812478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:36.815929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.817483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.830591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.831093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.831537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:36.832237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:36.834477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:36.834919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.080281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:37.090071 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c806c676-c5a2-49d1-8e87-f09d350619dc tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1323 microversion: 2.1 time: 0.313812 Oct 26 05:06:37.107163 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 723/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:36 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:37.115468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:37.116083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:37.132530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.133031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.133528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.134239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.134685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.144180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.145888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:37.155794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc1347a0-7727-4fe2-bfe3-8000b37b66be tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.347484 Oct 26 05:06:37.156801 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 739/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:36 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:37.332251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:37.332856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:37.339820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.340413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.340851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.343140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.343603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.344026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.373929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:37.386968 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8075c877-ba90-4bb1-9da2-0313dd8a0d29 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.278587 Oct 26 05:06:37.387819 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 724/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:37 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:37.427003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-53d240ba-fa49-4e06-a0f1-b921d237c042 req-25650931-ac1d-47c0-8800-ce69946e0654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394d62d7-2614-4420-8f55-ad5178d6c877", "name": "network-vif-plugged", "status": "completed", "tag": "5d74ffd2-2464-486a-a80e-27f76c357c36"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:37.470354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-53d240ba-fa49-4e06-a0f1-b921d237c042 req-25650931-ac1d-47c0-8800-ce69946e0654 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.486167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-53d240ba-fa49-4e06-a0f1-b921d237c042 req-25650931-ac1d-47c0-8800-ce69946e0654 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.486683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-53d240ba-fa49-4e06-a0f1-b921d237c042 req-25650931-ac1d-47c0-8800-ce69946e0654 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.511466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-53d240ba-fa49-4e06-a0f1-b921d237c042 req-25650931-ac1d-47c0-8800-ce69946e0654 service nova] Creating event network-vif-plugged:5d74ffd2-2464-486a-a80e-27f76c357c36 for instance 394d62d7-2614-4420-8f55-ad5178d6c877 on n-h1-862416-4 Oct 26 05:06:37.519983 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-53d240ba-fa49-4e06-a0f1-b921d237c042 req-25650931-ac1d-47c0-8800-ce69946e0654 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098949 Oct 26 05:06:37.520644 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 725/1464] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:37.557711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:37.559423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:37.574193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.575562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.578731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.581599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.583269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.584483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.648416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:37.660973 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4ef62ed-cda4-4dc7-b915-bc25dd89ff43 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.332761 Oct 26 05:06:37.663980 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 740/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:37 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:37.682689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.683373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.683815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.684286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lazy-loading 'fault' on Instance uuid 60d71a4a-1263-4408-a694-d9ceded8ae86 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:06:37.735858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5bfb998a6e4f87ad47eaddae04a60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c3c90010884e638985cbbc2c91757b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:37.747033 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98b8250c-b5be-4660-a06b-f68a8dd170e1 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 200 len: 1312 microversion: 2.1 time: 0.195420 Oct 26 05:06:37.763463 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 726/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:37 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:37.787099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:37.787717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:37.795669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.796358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.796944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.797861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:37.798487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:37.799100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:37.965829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:37.975430 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-703d3ad9-c82a-4ed8-9afb-f0d4d968a35b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.192527 Oct 26 05:06:37.977519 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 741/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:37 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:38.114486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.114910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:38.123352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.123804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.124258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.125079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.125855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.126583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.189771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.192086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:38.227351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.229245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.230299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.231796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.232619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.234347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.441894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:38.455498 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43288f90-d14a-4d6c-9426-0d3abc66e09a tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1323 microversion: 2.1 time: 0.345654 Oct 26 05:06:38.472163 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 727/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1323 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:38.483898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.485386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:38.493211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.497677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.504376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.505148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.505686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.508199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.568195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:38.579048 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e60a14b-32c9-4e09-be3a-c7ad8d6c06c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.396867 Oct 26 05:06:38.589612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 742/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:38.689995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.690674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:38.697379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.706019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.706658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.707426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.708098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.708541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.757877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:38.771723 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4eac3324-2fa7-4bb2-a498-3a1737c2c063 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.304904 Oct 26 05:06:38.773839 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 728/1470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:38.780719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.791989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: 60d71a4a-1263-4408-a694-d9ceded8ae86] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:38.809797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.810294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.813855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.814785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.817931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.819144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.850740 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] HTTP exception thrown: Instance 60d71a4a-1263-4408-a694-d9ceded8ae86 could not be found. Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 HTTP/1.1 Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:38.852678 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 60d71a4a-1263-4408-a694-d9ceded8ae86 could not be found. Oct 26 05:06:38.854529 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '60d71a4a-1263-4408-a694-d9ceded8ae86'} Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d71a4a-1263-4408-a694-d9ceded8ae86 could not be found. Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:38.856824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d71a4a-1263-4408-a694-d9ceded8ae86 could not be found. Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d71a4a-1263-4408-a694-d9ceded8ae86 could not be found. Oct 26 05:06:38.858530 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.867227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 404 to user: Instance 60d71a4a-1263-4408-a694-d9ceded8ae86 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:38.868567 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc54d59e-6ceb-4262-8a14-fe04f64d2ad6 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86" status: 404 len: 111 microversion: 2.1 time: 0.093316 Oct 26 05:06:38.874095 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 729/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/60d71a4a-1263-4408-a694-d9ceded8ae86 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:38.883683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.884285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] [instance: b261345c-dd9b-4215-9c81-6842f985dd36] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:38.908897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.909458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.909856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.910571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:38.911021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:38.911690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:38.928781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:38.937715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23a6b39d-a870-4bfc-b3fa-fca74898b332 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.252053 Oct 26 05:06:38.938098 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] HTTP exception thrown: Instance b261345c-dd9b-4215-9c81-6842f985dd36 could not be found. Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Request method failure captured: Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 HTTP/1.1 Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMAWhPHlf6BiC9xqKF7d2o_O8CNe8rcrJ-GwgoZblT1IOkgsUcSGutIsWywf-a0wQNdkgEtfIcc1y5xOW3UQkH4Hsn88KD1A_YuxNVNJEF2a96pa1Y2gapJnEzgPrHvqatwAmzrK3G8YJdSZOfSrueCHoVGcgjDZx_Gku2sqhomXaSs Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:38.939898 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33c3c90010884e638985cbbc2c91757b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33c3c90010884e638985cbbc2c91757b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 33c3c90010884e638985cbbc2c91757b Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-820979081 Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7e5bfb998a6e4f87ad47eaddae04a60d Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListServersNegativeTestJSON-820979081-project Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance b261345c-dd9b-4215-9c81-6842f985dd36 could not be found. Oct 26 05:06:38.941458 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'b261345c-dd9b-4215-9c81-6842f985dd36'} Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b261345c-dd9b-4215-9c81-6842f985dd36 could not be found. Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:38.942276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b261345c-dd9b-4215-9c81-6842f985dd36 could not be found. Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b261345c-dd9b-4215-9c81-6842f985dd36 could not be found. Oct 26 05:06:38.943575 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:38.944774 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 743/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:38.945636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] Returning 404 to user: Instance b261345c-dd9b-4215-9c81-6842f985dd36 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:38.946639 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15284725-4ea2-4d14-892a-189dd8c5ef08 tempest-ListServersNegativeTestJSON-820979081 tempest-ListServersNegativeTestJSON-820979081-project] 10.222.0.16 "GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36" status: 404 len: 111 microversion: 2.1 time: 0.071554 Oct 26 05:06:38.947227 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 730/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/b261345c-dd9b-4215-9c81-6842f985dd36 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:06:38.999229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:38.999850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:39.006756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.007256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.007713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.008426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.008889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.009359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.070378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b7d724a9-a5be-4417-b9a1-f13b14e8d3cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eba49d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:39.123030 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b7d724a9-a5be-4417-b9a1-f13b14e8d3cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/d819c8cf-71ec-4eeb-817d-af60974d0d2f" status: 200 len: 662 microversion: 2.1 time: 0.056371 Oct 26 05:06:39.123947 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 731/1474] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:06:39 2022] GET /compute/v2.1/images/d819c8cf-71ec-4eeb-817d-af60974d0d2f => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:06:39.140451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8f2fc7e-91ba-44a6-ad8e-851251c84f42 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a7495e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:39.192087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8f2fc7e-91ba-44a6-ad8e-851251c84f42 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/d819c8cf-71ec-4eeb-817d-af60974d0d2f" status: 200 len: 662 microversion: 2.1 time: 0.056693 Oct 26 05:06:39.203056 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 732/1475] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:06:39 2022] GET /compute/v2.1/images/d819c8cf-71ec-4eeb-817d-af60974d0d2f => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:39.252455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:39.273965 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad30f585-844d-413a-86e5-9558dd5f378f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.265295 Oct 26 05:06:39.274535 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 744/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:38 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:39.490093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:39.490684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:39.497912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.498481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.498997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.499784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.500308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.500810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.505628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:39.545748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-535bfb3d-f7a6-4ef3-9b15-969002a24d28 req-51fc56d4-28e7-4be6-894d-0d5b84885157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73891979-1cb8-4772-be88-1e6eebb0c6ca", "name": "network-vif-plugged", "status": "completed", "tag": "95d26a1c-494a-40cf-b790-57f45dfab372"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:39.563317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-535bfb3d-f7a6-4ef3-9b15-969002a24d28 req-51fc56d4-28e7-4be6-894d-0d5b84885157 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.564219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-535bfb3d-f7a6-4ef3-9b15-969002a24d28 req-51fc56d4-28e7-4be6-894d-0d5b84885157 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.565026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-535bfb3d-f7a6-4ef3-9b15-969002a24d28 req-51fc56d4-28e7-4be6-894d-0d5b84885157 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.605061 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-535bfb3d-f7a6-4ef3-9b15-969002a24d28 req-51fc56d4-28e7-4be6-894d-0d5b84885157 service nova] Creating event network-vif-plugged:95d26a1c-494a-40cf-b790-57f45dfab372 for instance 73891979-1cb8-4772-be88-1e6eebb0c6ca on n-h2-862416-4 Oct 26 05:06:39.613020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-535bfb3d-f7a6-4ef3-9b15-969002a24d28 req-51fc56d4-28e7-4be6-894d-0d5b84885157 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074973 Oct 26 05:06:39.615002 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 745/1477] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:39.623452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:39.624567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:39.633729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.634945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.637101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.638795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.639451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.640060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.756089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:39.766043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cae5195-df63-43b8-b0ea-24a43de2282b tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1323 microversion: 2.1 time: 0.286500 Oct 26 05:06:39.767298 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 733/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:39 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:39.772647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-154d52a4-40c4-4523-9919-daea0d312882 req-3155e74e-9e71-4e0c-bcdd-3b5f984af25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c383a0fb-6b77-41e4-8323-9dc041ca04f3", "name": "network-vif-unplugged", "status": "completed", "tag": "3dd54acc-61f5-4fc4-8558-83cda3a2ad32"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:39.783283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-154d52a4-40c4-4523-9919-daea0d312882 req-3155e74e-9e71-4e0c-bcdd-3b5f984af25d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.784087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-154d52a4-40c4-4523-9919-daea0d312882 req-3155e74e-9e71-4e0c-bcdd-3b5f984af25d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.785537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-154d52a4-40c4-4523-9919-daea0d312882 req-3155e74e-9e71-4e0c-bcdd-3b5f984af25d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.800569 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-154d52a4-40c4-4523-9919-daea0d312882 req-3155e74e-9e71-4e0c-bcdd-3b5f984af25d service nova] Creating event network-vif-unplugged:3dd54acc-61f5-4fc4-8558-83cda3a2ad32 for instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 on n-h1-862416-4 Oct 26 05:06:39.806820 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-154d52a4-40c4-4523-9919-daea0d312882 req-3155e74e-9e71-4e0c-bcdd-3b5f984af25d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037929 Oct 26 05:06:39.807425 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 734/1479] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:39.814799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:39.816311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:39.824165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.825489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.826196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.827541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.828172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.829014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.834953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:39.844030 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4bd36644-bf0e-435a-b1f2-f173500ede30 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.226565 Oct 26 05:06:39.845622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 746/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:39 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:39.966622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:39.966883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:39.967885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:39.974757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.974932 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44eeb889-904f-43db-9af0-ae34da9266ab tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.165395 Oct 26 05:06:39.975260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.975691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.976567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:39.977043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:39.977483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:39.994357 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 735/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:39 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:40.124054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:40.133009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9637d3af-8bf2-44c0-8006-01d9e15316c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.174699 Oct 26 05:06:40.149861 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 747/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:39 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:40.301856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:40.302592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:40.308611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:40.309098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:40.309598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:40.310343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:40.310792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:40.311245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:40.483167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:40.505581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c6f57e8-869c-4d00-a235-93404fc3d556 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.206639 Oct 26 05:06:40.533761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 736/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:40 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:40.563814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1132860602", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bc063782-2e7c-4930-8052-d7ca13d54283"}], "block_device_mapping_v2": [{"uuid": "4a21cae5-cfb2-4324-9e2a-5ba2580f9157", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:40.663641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] validate_networks() for [('bc063782-2e7c-4930-8052-d7ca13d54283', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:40.686723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d27d093d-0067-43eb-b1b7-72b65a5e3c8d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a722040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:40.734841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d27d093d-0067-43eb-b1b7-72b65a5e3c8d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/ef2cf785-b722-413f-a8c5-29cfa0a3f950" status: 200 len: 662 microversion: 2.1 time: 0.052712 Oct 26 05:06:40.736215 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 737/1484] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:06:40 2022] GET /compute/v2.1/images/ef2cf785-b722-413f-a8c5-29cfa0a3f950 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:06:40.750158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-702cfed6-ff75-446a-a45c-7e110800d6d2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a6f2c10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:40.812311 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-702cfed6-ff75-446a-a45c-7e110800d6d2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/ef2cf785-b722-413f-a8c5-29cfa0a3f950" status: 200 len: 662 microversion: 2.1 time: 0.066041 Oct 26 05:06:40.813365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 738/1485] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:06:40 2022] GET /compute/v2.1/images/ef2cf785-b722-413f-a8c5-29cfa0a3f950 => generated 662 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:06:40.818129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:40.818959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:40.826836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:40.827535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:40.828160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:40.829147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:40.829632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:40.830259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:41.437258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:41.446328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7fe70496-3a8e-497f-aded-f86532040fb5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 200 len: 1519 microversion: 2.1 time: 0.631734 Oct 26 05:06:41.449644 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 739/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:40 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 1519 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:41.454526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:41.458520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:41.472436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:41.474705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:41.476802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:41.480165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:41.480933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:41.481623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:41.547171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:41.548233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:41.549019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:41.549788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:41.550401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:41.578640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:41.579507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:41.580125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:41.581216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:41.581897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:41.582580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:41.626602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:41.637191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Getting quotas for user b36c8ac2dee24d33b680608a740463bb and project a891e93c2035474fb99ebafc3de91101. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:41.760617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:41.762914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a21cae5-cfb2-4324-9e2a-5ba2580f9157',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:41.815649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:41.825209 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d221ac26-3531-4f4a-81ab-c21289f7ff2f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.374334 Oct 26 05:06:41.826677 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 740/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:41 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:41.832168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:41.833023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:41.839696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:41.840401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:41.841007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:41.841927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:41.843107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:41.843795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:42.080713 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3fe9f8d4-d432-4a29-a7df-116d8b4ca810 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.520966 Oct 26 05:06:42.091040 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 748/1488] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:06:42.099243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:42.100560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:42.102016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:42.110407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:42.110913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:42.111359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:42.112589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:42.113059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:42.113537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:42.120941 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8b5b2a37-ebd3-42f2-a754-f4c1e00a4ec0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1371 microversion: 2.1 time: 0.292490 Oct 26 05:06:42.125453 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 741/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:41 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:42.146868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'action', calling method: .version_select at 0x7f470c4c8af0>, body: {"addFloatingIp": {"address": "172.25.6.182"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:42.153814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:42.168139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:42.170258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:42.171219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:42.171433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:42.172337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:42.172979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:42.184201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:42.369968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:06:42.371329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquired lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:06:42.387510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:42.400577 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c153f0a9-cac9-4b66-9466-de5fbd9c82ce tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.308329 Oct 26 05:06:42.401944 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 749/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:42 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:42.407199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:42.414161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:42.431310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:42.432261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:42.433641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:42.434621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:42.435250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:42.436176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.016046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:43.020856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:43.030479 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d3d0e53-ccd6-4893-9242-4c5dbd3d0507 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.625491 Oct 26 05:06:43.032498 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 750/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:42 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:43.043403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-39c936cc-3097-4482-8692-93e351a23834 req-8ae42306-7ce5-4c0a-ad9a-26e4031ea1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "name": "network-vif-plugged", "status": "completed", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:43.066798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-39c936cc-3097-4482-8692-93e351a23834 req-8ae42306-7ce5-4c0a-ad9a-26e4031ea1d2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.069631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-39c936cc-3097-4482-8692-93e351a23834 req-8ae42306-7ce5-4c0a-ad9a-26e4031ea1d2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.070201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-39c936cc-3097-4482-8692-93e351a23834 req-8ae42306-7ce5-4c0a-ad9a-26e4031ea1d2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.090174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-39c936cc-3097-4482-8692-93e351a23834 req-8ae42306-7ce5-4c0a-ad9a-26e4031ea1d2 service nova] Creating event network-vif-plugged:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h2-862416-4 Oct 26 05:06:43.098738 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-39c936cc-3097-4482-8692-93e351a23834 req-8ae42306-7ce5-4c0a-ad9a-26e4031ea1d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064551 Oct 26 05:06:43.100190 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 751/1492] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:43.122035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ceb005a9-1bb9-4490-a70c-1da082d132a9 req-ce922670-b9c9-4c8c-bae3-4186e25eecb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c383a0fb-6b77-41e4-8323-9dc041ca04f3", "tag": "3dd54acc-61f5-4fc4-8558-83cda3a2ad32"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:43.136383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ceb005a9-1bb9-4490-a70c-1da082d132a9 req-ce922670-b9c9-4c8c-bae3-4186e25eecb4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.138037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ceb005a9-1bb9-4490-a70c-1da082d132a9 req-ce922670-b9c9-4c8c-bae3-4186e25eecb4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.139157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ceb005a9-1bb9-4490-a70c-1da082d132a9 req-ce922670-b9c9-4c8c-bae3-4186e25eecb4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.155789 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ceb005a9-1bb9-4490-a70c-1da082d132a9 req-ce922670-b9c9-4c8c-bae3-4186e25eecb4 service nova] Creating event network-changed:3dd54acc-61f5-4fc4-8558-83cda3a2ad32 for instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 on n-h1-862416-4 Oct 26 05:06:43.161854 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ceb005a9-1bb9-4490-a70c-1da082d132a9 req-ce922670-b9c9-4c8c-bae3-4186e25eecb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059594 Oct 26 05:06:43.163087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 752/1493] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:43.170672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:43.172292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:43.200197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.200990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.201473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.202199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.202780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.204056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.287900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:43.304520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:43.307033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:43.309450 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aea440f1-93e8-4677-9106-453b3b94bf68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1177 microversion: 2.25 time: 0.144904 Oct 26 05:06:43.310547 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 753/1494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:43 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1177 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:43.315957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f9891cf-7417-4139-bfd8-0b1abc3b6089 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470ac2da60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:43.385521 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f9891cf-7417-4139-bfd8-0b1abc3b6089 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/33f9bfce-15bf-434a-bf81-1bed36799267" status: 200 len: 661 microversion: 2.1 time: 0.073563 Oct 26 05:06:43.386458 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 754/1495] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:06:43 2022] GET /compute/v2.1/images/33f9bfce-15bf-434a-bf81-1bed36799267 => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:43.392537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:43.393494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:43.403643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.405694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.406458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.407994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.409675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.410266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.679629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:43.687620 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-12f18714-1cf3-417f-a7b0-36e5d07af697 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.299877 Oct 26 05:06:43.701867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 755/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:43 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:43.709350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:43.715399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:43.725266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.726992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.727504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:43.728223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:43.728854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:43.730118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:44.031619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:44.059227 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62f6e16b-059d-442f-b18d-2749a4569fb5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1557 microversion: 2.1 time: 0.346639 Oct 26 05:06:44.060179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 756/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:43 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1557 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:44.068827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-830e17e7-9522-425f-a10c-4153b62909e7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470acf8310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:44.180501 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-830e17e7-9522-425f-a10c-4153b62909e7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/33f9bfce-15bf-434a-bf81-1bed36799267" status: 200 len: 661 microversion: 2.1 time: 0.119193 Oct 26 05:06:44.186275 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 757/1498] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:06:44 2022] GET /compute/v2.1/images/33f9bfce-15bf-434a-bf81-1bed36799267 => generated 661 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:44.195303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:44.195911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:44.213612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:44.214360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:44.214584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:44.215307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:44.215763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:44.216196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:44.275520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Building network info cache for instance {{(pid=120585) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:06:44.542476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:44.550811 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b9488c01-c843-4d4c-aa2b-060aec1fe848 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.363304 Oct 26 05:06:44.550997 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 758/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:44 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:44.564231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:44.567270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:44.582227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:44.582830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:44.583363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:44.584185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:44.584737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:44.585257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:44.612276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:44.884051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:44.892538 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16af8ad3-5e1f-4c6f-a468-a1252b663964 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1313 microversion: 2.1 time: 0.336819 Oct 26 05:06:44.893136 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 759/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:44 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:44.904051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:44.907889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:44.923137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:44.925728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:44.927893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:44.930903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:44.931813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:44.933739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:45.074489 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92010cfc-4056-4334-9863-6e6cce4877a2 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174938 Oct 26 05:06:45.075093 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 760/1501] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:06:44 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:45.087437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6458f7e7-c3ce-4774-810d-728efdc986e9 req-d598d1dc-c966-4b86-b57d-c5ae12db93c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:45.112452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6458f7e7-c3ce-4774-810d-728efdc986e9 req-d598d1dc-c966-4b86-b57d-c5ae12db93c3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:45.113022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6458f7e7-c3ce-4774-810d-728efdc986e9 req-d598d1dc-c966-4b86-b57d-c5ae12db93c3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:45.113591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6458f7e7-c3ce-4774-810d-728efdc986e9 req-d598d1dc-c966-4b86-b57d-c5ae12db93c3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:45.140472 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6458f7e7-c3ce-4774-810d-728efdc986e9 req-d598d1dc-c966-4b86-b57d-c5ae12db93c3 service nova] Creating event network-changed:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:06:45.149528 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6458f7e7-c3ce-4774-810d-728efdc986e9 req-d598d1dc-c966-4b86-b57d-c5ae12db93c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065679 Oct 26 05:06:45.150209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 761/1502] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:45.156266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1982413530", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:45.254412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:45.846450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:45.847110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:45.847618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:45.848037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:45.848754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:45.876128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:45.876624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:45.877065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:45.879615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:45.880092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:45.880528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:45.926133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Getting quotas for project ab86a0b60ef64ada93def6110b51a7a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:45.939800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Getting quotas for user cac28401d16c47d4a2c3392352a4bb55 and project ab86a0b60ef64ada93def6110b51a7a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:45.969855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:45.971597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:45.982547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:46.079685 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2035fc1-64ce-43c3-b0de-a22081d10bfa tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928168 Oct 26 05:06:46.080652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 762/1503] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:46.085233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:46.094157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:46.113205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:46.113736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:46.114454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:46.115336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:46.115957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:46.116553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:46.166324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Updating instance_info_cache with network_info: [{"id": "3c788602-9553-472f-b12e-94f4ef62f02f", "address": "fa:16:3e:14:c3:70", "network": {"id": "3985538d-bfbe-4200-9b84-bfdebdcb224a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-953121902-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67fbce7c49554dde9754fc79cbffa8be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c788602-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120585) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:06:46.195440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Releasing lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:06:46.196241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54c82129-7697-48bd-bab0-ecf491931cef tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action" status: 202 len: 0 microversion: 2.1 time: 4.057039 Oct 26 05:06:46.197844 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 742/1504] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:42 2022] POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action => generated 0 bytes in 4059 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:06:46.224782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:46.228253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:46.258152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:46.259563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:46.267027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:46.270074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:46.270725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:46.271325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:46.821944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:46.836926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:46.838586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:46.843359 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35e98e73-3177-416e-8445-1b986043853c tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1251 microversion: 2.25 time: 0.761643 Oct 26 05:06:46.843966 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 763/1505] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:46 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1251 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:46.863842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:46.871616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:46.887110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:46.888833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:46.890452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:46.891365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:46.895893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:46.896609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:47.218596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:47.229224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0655e7e3-c6ce-42ed-a058-f4f4869832a9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 1.028764 Oct 26 05:06:47.232658 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 743/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:46 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:47.250565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:47.251958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:47.258407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:47.259224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:47.261459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:47.264035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:47.264724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:47.267606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:47.528790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:47.536908 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6d793fe-1efd-4ac4-ae9c-e674b7d901d9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.691648 Oct 26 05:06:47.537521 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 764/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:46 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:47.554003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'action', calling method: .version_select at 0x7f470ce7ae50>, body: {"addFloatingIp": {"address": "172.25.6.182"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:47.557048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:47.564297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:47.565074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:47.565734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:47.566602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:47.567219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:47.567808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:47.725925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:47.749967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "refresh_cache-394d62d7-2614-4420-8f55-ad5178d6c877" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:06:47.750371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquired lock "refresh_cache-394d62d7-2614-4420-8f55-ad5178d6c877" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:06:47.758688 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff946f2f-faca-45a1-a09e-ac0c7dcd86dd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1463 microversion: 2.1 time: 0.506848 Oct 26 05:06:47.760952 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 744/1508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:47 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:47.778700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-283274547", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:47.874767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:48.655486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:48.656091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:48.656970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:48.657613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:48.658036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:48.674531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:48.675028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:48.675475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:48.682790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:48.683306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:48.683867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:48.752927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Getting quotas for project ab86a0b60ef64ada93def6110b51a7a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:48.762865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Getting quotas for user cac28401d16c47d4a2c3392352a4bb55 and project ab86a0b60ef64ada93def6110b51a7a1. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:48.789506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:48.794257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:48.915300 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c5d463d-e273-49dd-9592-ba67c6824703 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152130 Oct 26 05:06:48.918446 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 745/1509] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:48.942366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:48.945167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:48.979168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:48.980611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:48.982248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:48.986133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:48.989594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:48.990290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:49.403245 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e60991b5-a202-490c-952d-b14bb29bd592 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1614 microversion: 2.1 time: 0.483459 Oct 26 05:06:49.407143 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 746/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:48 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1614 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:49.422801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:49.424038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:49.436934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:49.437725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:49.440500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:49.441876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:49.443760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:49.444396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:49.776587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:49.788973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:49.791106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:49.793389 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73bdc75d-fd5e-4994-b556-22e553f372c1 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1293 microversion: 2.25 time: 0.384794 Oct 26 05:06:49.794140 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 747/1511] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:49 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1293 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:49.810901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8ce407c8-2347-43e1-a98f-2fe4969403b6 req-2c8e9c4b-7ba8-474d-be40-062c99444eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afdec39-d5c9-4e87-b528-7227a49580e5", "tag": "18a6c1cd-7330-433a-8098-880895a40bb1"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:49.828437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8ce407c8-2347-43e1-a98f-2fe4969403b6 req-2c8e9c4b-7ba8-474d-be40-062c99444eed service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:49.830156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8ce407c8-2347-43e1-a98f-2fe4969403b6 req-2c8e9c4b-7ba8-474d-be40-062c99444eed service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:49.831155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8ce407c8-2347-43e1-a98f-2fe4969403b6 req-2c8e9c4b-7ba8-474d-be40-062c99444eed service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:49.851833 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8ce407c8-2347-43e1-a98f-2fe4969403b6 req-2c8e9c4b-7ba8-474d-be40-062c99444eed service nova] Creating event network-changed:18a6c1cd-7330-433a-8098-880895a40bb1 for instance 0afdec39-d5c9-4e87-b528-7227a49580e5 on n-h1-862416-4 Oct 26 05:06:49.859058 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8ce407c8-2347-43e1-a98f-2fe4969403b6 req-2c8e9c4b-7ba8-474d-be40-062c99444eed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062608 Oct 26 05:06:49.860105 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 748/1512] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:49.866999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:49.867977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:49.878552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:49.880735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:49.881440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:49.884712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:49.889380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:49.890038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:50.811992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:50.824521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-257c9afa-5572-4087-b453-7254983aeb2c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1504 microversion: 2.1 time: 0.963022 Oct 26 05:06:50.842945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 749/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:49 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1504 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:50.865849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:50.866756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:50.881373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:50.882202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:50.882825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:50.883753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:50.886971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:50.887629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:51.410230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:51.421840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-26b01c03-e7c7-4854-9cf3-53a263c2d1c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.576487 Oct 26 05:06:51.435137 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 750/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:50 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:51.439985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-518679e4-ff8a-43b2-aa56-e8b34334fb5c req-e027ded3-20e1-4992-a455-409dbf46f62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73891979-1cb8-4772-be88-1e6eebb0c6ca", "tag": "95d26a1c-494a-40cf-b790-57f45dfab372"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:51.464774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-518679e4-ff8a-43b2-aa56-e8b34334fb5c req-e027ded3-20e1-4992-a455-409dbf46f62e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:51.465899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-518679e4-ff8a-43b2-aa56-e8b34334fb5c req-e027ded3-20e1-4992-a455-409dbf46f62e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:51.466337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-518679e4-ff8a-43b2-aa56-e8b34334fb5c req-e027ded3-20e1-4992-a455-409dbf46f62e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:51.490206 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-518679e4-ff8a-43b2-aa56-e8b34334fb5c req-e027ded3-20e1-4992-a455-409dbf46f62e service nova] Creating event network-changed:95d26a1c-494a-40cf-b790-57f45dfab372 for instance 73891979-1cb8-4772-be88-1e6eebb0c6ca on n-h2-862416-4 Oct 26 05:06:51.497224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-518679e4-ff8a-43b2-aa56-e8b34334fb5c req-e027ded3-20e1-4992-a455-409dbf46f62e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060755 Oct 26 05:06:51.498438 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 751/1515] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:51.516416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:51.517709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:51.531344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:51.537200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:51.537934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:51.539104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:51.540723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:51.542623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:51.655400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:51.680190 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-185f8483-23e5-4ecf-bb99-57ebf8cd5d6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1275 microversion: 2.1 time: 0.180298 Oct 26 05:06:51.684797 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 752/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:51 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:51.774467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.network.neutron [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] re-assign floating IP 172.25.6.182 from instance 851bd930-4d29-4a45-a402-3d7f5a311927 Oct 26 05:06:51.851836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Building network info cache for instance {{(pid=120586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:06:51.908382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e5e4d8a-d19b-4289-b937-7430932daaf6 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1319246307", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:51.915056 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1e5e4d8a-d19b-4289-b937-7430932daaf6 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] HTTP exception thrown: min_count must be <= max_count Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e5e4d8a-d19b-4289-b937-7430932daaf6 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Request method failure captured: Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 184 Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMBoRzoiJhazyKPzw843q8tIuhugif7isThc4MvLnu9zuOa31gv_SEAXI9v4kKNOunuD2Jn9H33pJ3QkvCIM2wX4Mwu_qJiDQ7FSdduGQI9MEbat1aFblxyGYZ6qcRYg3VbvUounlgSeBRis4RRiVhbcNpurHcNim0qhMgd3glHB-Ys Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:51.921157 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3dec4725e21478e809b801791967cb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3dec4725e21478e809b801791967cb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 8af524b9f7244fa2accc1af283dc65bd Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:06:51.923097 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1319246307", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: exception: min_count must be <= max_count Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1319246307', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:06:51.923923 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 26 05:06:51.925293 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:51.928825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e5e4d8a-d19b-4289-b937-7430932daaf6 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Returning 400 to user: min_count must be <= max_count {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:51.933508 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e5e4d8a-d19b-4289-b937-7430932daaf6 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.244680 Oct 26 05:06:51.934883 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 753/1517] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:51 2022] POST /compute/v2.1/servers => generated 74 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:06:51.948637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:51.951794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:51.964533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:51.967507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:51.970320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:51.971305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:51.973828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:51.976854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:52.051638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:52.060243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b012e8793cfd4ebf9121fdcab58605b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b6f2581d23493896cc3f2142bc9765', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:52.060836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] flavor_id is None. Assuming migration. {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 05:06:52.061279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:06:52.462286 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb8d7d35-f3b5-4f1d-9d1a-5c89f46b893f tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219/action" status: 202 len: 0 microversion: 2.1 time: 0.525459 Oct 26 05:06:52.463769 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 754/1518] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:51 2022] POST /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:06:52.470433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:52.471417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:52.478135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:52.478135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:52.478514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:52.479768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:52.480267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:52.480853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:52.739152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Updating instance_info_cache with network_info: [{"id": "3c788602-9553-472f-b12e-94f4ef62f02f", "address": "fa:16:3e:14:c3:70", "network": {"id": "3985538d-bfbe-4200-9b84-bfdebdcb224a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-953121902-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67fbce7c49554dde9754fc79cbffa8be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c788602-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:06:52.767734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Building network info cache for instance {{(pid=120586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:06:52.872454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:52.883128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:52.884630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:52.886218 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a9d8781-df88-49b8-b490-dfc846e3aeaa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.420944 Oct 26 05:06:52.890961 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 755/1519] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:52 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:52.898080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:52.899162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:52.914486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:52.915244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:52.915398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:52.916133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:52.916605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:52.917162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:53.244125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:53.260882 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2622832b-13a6-4f2e-b53c-ea9e3225468d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1494 microversion: 2.1 time: 0.368013 Oct 26 05:06:53.279417 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 756/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:52 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1494 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:53.285545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-328512f6-7b28-49f6-a1c2-164eb713098e tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-785459878", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "max_count": 0}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-328512f6-7b28-49f6-a1c2-164eb713098e tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Request method failure captured: Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 167 Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMBoRzoiJhazyKPzw843q8tIuhugif7isThc4MvLnu9zuOa31gv_SEAXI9v4kKNOunuD2Jn9H33pJ3QkvCIM2wX4Mwu_qJiDQ7FSdduGQI9MEbat1aFblxyGYZ6qcRYg3VbvUounlgSeBRis4RRiVhbcNpurHcNim0qhMgd3glHB-Ys Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:53.295138 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3dec4725e21478e809b801791967cb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3dec4725e21478e809b801791967cb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 8af524b9f7244fa2accc1af283dc65bd Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:06:53.296773 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-785459878", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "max_count": 0}} Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-785459878', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'max_count': 0}}} Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 0 Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.297710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.301830 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-328512f6-7b28-49f6-a1c2-164eb713098e tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:53.305765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-328512f6-7b28-49f6-a1c2-164eb713098e tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016489 Oct 26 05:06:53.308344 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 757/1521] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:53.339994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:53.340646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:53.371455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:53.371990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:53.372461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:53.376698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:53.379976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:53.380464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:53.690787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:53.723471 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-498a4b96-3110-44ee-8956-6f9fd10ba842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.404880 Oct 26 05:06:53.740613 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 758/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:53 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:53.753478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:53.755100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:53.764513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:53.765265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:53.766000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:53.766956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:53.767637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:53.768300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.110290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:54.122846 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08981e33-b9bf-4288-beac-47abe6b974fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1472 microversion: 2.1 time: 0.380690 Oct 26 05:06:54.123917 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 759/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:53 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:54.142644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:54.143340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:54.153197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.153718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.154378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.155936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.157691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.159281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.218402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Updating instance_info_cache with network_info: [{"id": "5d74ffd2-2464-486a-a80e-27f76c357c36", "address": "fa:16:3e:02:eb:24", "network": {"id": "3985538d-bfbe-4200-9b84-bfdebdcb224a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-953121902-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67fbce7c49554dde9754fc79cbffa8be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d74ffd2-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:06:54.237079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Releasing lock "refresh_cache-394d62d7-2614-4420-8f55-ad5178d6c877" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:06:54.239899 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48144505-1010-4a7f-b29a-55c9f0e8804e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877/action" status: 202 len: 0 microversion: 2.1 time: 6.699135 Oct 26 05:06:54.244225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 765/1524] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:47 2022] POST /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877/action => generated 0 bytes in 6702 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:06:54.250411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2a1515f-82ea-453f-bea0-ed03f4772bf3 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '.version_select at 0x7f470ad21040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:54.257663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1515f-82ea-453f-bea0-ed03f4772bf3 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.258527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1515f-82ea-453f-bea0-ed03f4772bf3 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.259202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1515f-82ea-453f-bea0-ed03f4772bf3 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.291579 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2a1515f-82ea-453f-bea0-ed03f4772bf3 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3070 microversion: 2.1 time: 0.045078 Oct 26 05:06:54.304335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 766/1525] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:06:54 2022] GET /compute/v2.1/os-migrations => generated 3070 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:54.310211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1f690bf-36fa-48a0-868f-8e523da83b5a tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-308447889", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "max_count": 2.5}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1f690bf-36fa-48a0-868f-8e523da83b5a tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Request method failure captured: Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 169 Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMBoRzoiJhazyKPzw843q8tIuhugif7isThc4MvLnu9zuOa31gv_SEAXI9v4kKNOunuD2Jn9H33pJ3QkvCIM2wX4Mwu_qJiDQ7FSdduGQI9MEbat1aFblxyGYZ6qcRYg3VbvUounlgSeBRis4RRiVhbcNpurHcNim0qhMgd3glHB-Ys Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:54.315899 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3dec4725e21478e809b801791967cb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3dec4725e21478e809b801791967cb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 8af524b9f7244fa2accc1af283dc65bd Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:06:54.317547 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-308447889", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "max_count": 2.5}} Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-308447889', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'max_count': 2.5}}} Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 2.5 Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.318335 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.321813 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:54.325838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:54.325838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:54.325838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:54.325838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:54.325838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 05:06:54.325838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:54.327356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1f690bf-36fa-48a0-868f-8e523da83b5a tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:54.327356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1f690bf-36fa-48a0-868f-8e523da83b5a tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021597 Oct 26 05:06:54.337936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 767/1526] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:54.343907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}, {"name": "network-changed", "server_uuid": "394d62d7-2614-4420-8f55-ad5178d6c877", "tag": "5d74ffd2-2464-486a-a80e-27f76c357c36"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:54.360797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.361331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.361794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.382190 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] Creating event network-changed:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:06:54.382710 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] Creating event network-changed:5d74ffd2-2464-486a-a80e-27f76c357c36 for instance 394d62d7-2614-4420-8f55-ad5178d6c877 on n-h1-862416-4 Oct 26 05:06:54.383835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:54.410136 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-06d159c2-9387-4d49-b03c-f3abe9ef934a req-d1d516f6-5366-451b-a632-0b8d7ff35394 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.080806 Oct 26 05:06:54.410338 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b84a2010-ca4e-44fb-8ae1-6b2c8437a7cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1317 microversion: 2.1 time: 0.283915 Oct 26 05:06:54.414961 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 768/1527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:54.416826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 760/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:54 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:54.423961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:54.424684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:54.429147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'action', calling method: .version_select at 0x7f470c4c8c10>, body: {"removeFloatingIp": {"address": "172.25.6.182"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:54.452502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.452995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.453464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.454600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.454600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.455021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.718960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:54.738182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.738911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.739534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.744579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:54.748642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.749361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.750113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.755086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:54.756883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:54.758531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f47889e9-1208-4931-a1eb-81f23c6dfa7d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.342157 Oct 26 05:06:54.759732 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 769/1529] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:54 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:54.765745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:54.766739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:54.780641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.781524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.782145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:54.783679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:54.784291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:54.785346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.042601 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c394e20-a5b3-4704-8408-76c25c547b7f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1645 microversion: 2.1 time: 0.280743 Oct 26 05:06:55.043733 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 770/1530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:54 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1645 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:55.049035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0990290-321a-47ad-a9cd-092200193dec tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2130079442", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 0}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0990290-321a-47ad-a9cd-092200193dec tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Request method failure captured: Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 168 Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMBoRzoiJhazyKPzw843q8tIuhugif7isThc4MvLnu9zuOa31gv_SEAXI9v4kKNOunuD2Jn9H33pJ3QkvCIM2wX4Mwu_qJiDQ7FSdduGQI9MEbat1aFblxyGYZ6qcRYg3VbvUounlgSeBRis4RRiVhbcNpurHcNim0qhMgd3glHB-Ys Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:06:55.055317 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3dec4725e21478e809b801791967cb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3dec4725e21478e809b801791967cb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 8af524b9f7244fa2accc1af283dc65bd Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:06:55.056924 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2130079442", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 0}} Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2130079442', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'min_count': 0}}} Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 0 Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.058466 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.060235 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.061737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:55.061737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:55.061737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:55.061737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:55.061737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 26 05:06:55.061737 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.062943 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] HTTP exception thrown: Floating IP 172.25.6.182 is not associated with instance 851bd930-4d29-4a45-a402-3d7f5a311927. Oct 26 05:06:55.063924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0990290-321a-47ad-a9cd-092200193dec tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Request method failure captured: Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action HTTP/1.1 Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 49 Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMArNHnj9wMzDsDtLwv2ieN92vFJV3l1AIj697V9nsfxiX-mJkqVVuMI5hRbCc6pG3G2yZXQr434ZwzTImchkUAipmYBKINucgIv6EmH1ohAt_683iZrAJe5qVq_N29DTyF7UYXOINWoR8DEr3Opd-eNMXmeYuh-KlZIWj9OBzm9r2k Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:55.064203 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ebf85e7319884c87ba745771b8abaa92 Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: {"removeFloatingIp": {"address": "172.25.6.182"}} Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:06:55.066727 n-d-862416-4 devstack@n-api.service[120585]: exception: Floating IP 172.25.6.182 is not associated with instance 851bd930-4d29-4a45-a402-3d7f5a311927. Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '851bd930-4d29-4a45-a402-3d7f5a311927', 'body': {'removeFloatingIp': {'address': '172.25.6.182'}}} Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.182 is not associated with instance 851bd930-4d29-4a45-a402-3d7f5a311927. Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.067807 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.182 is not associated with instance 851bd930-4d29-4a45-a402-3d7f5a311927. Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Returning 409 to user: Floating IP 172.25.6.182 is not associated with instance 851bd930-4d29-4a45-a402-3d7f5a311927. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af276677-83a6-4721-88c5-93751d3af59e tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action" status: 409 len: 146 microversion: 2.1 time: 0.647867 Oct 26 05:06:55.070653 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 761/1531] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:54 2022] POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action => generated 146 bytes in 649 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:06:55.073784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0990290-321a-47ad-a9cd-092200193dec tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028778 Oct 26 05:06:55.074988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:55.075511 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 771/1532] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:55.075817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:55.080446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c1f2f440-ffca-4161-8c45-123dfb235651 req-508bb567-9577-4e53-8bd0-1c2ea997c5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:55.082949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.083451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.083969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.084931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.085763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.086212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.097945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c1f2f440-ffca-4161-8c45-123dfb235651 req-508bb567-9577-4e53-8bd0-1c2ea997c5e4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.100016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c1f2f440-ffca-4161-8c45-123dfb235651 req-508bb567-9577-4e53-8bd0-1c2ea997c5e4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.100642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c1f2f440-ffca-4161-8c45-123dfb235651 req-508bb567-9577-4e53-8bd0-1c2ea997c5e4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.124814 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c1f2f440-ffca-4161-8c45-123dfb235651 req-508bb567-9577-4e53-8bd0-1c2ea997c5e4 service nova] Creating event network-changed:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:06:55.129731 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c1f2f440-ffca-4161-8c45-123dfb235651 req-508bb567-9577-4e53-8bd0-1c2ea997c5e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052600 Oct 26 05:06:55.131095 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 772/1533] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:55.137677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'action', calling method: .version_select at 0x7f470c71c310>, body: {"removeFloatingIp": {"address": "172.25.6.182"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:55.337293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:55.346822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.351535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:55.356268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.356725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.357559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.358026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.358456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.361823 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-90299055-2568-4cd7-ac98-f6a2b190b564 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.291291 Oct 26 05:06:55.362949 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 762/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:55 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:55.367662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:55.368517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:55.376725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.377503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.378212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.379136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:55.379950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:55.380779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:55.610496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:55.620434 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b64de90-cb81-4f99-961c-6798112641e2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1472 microversion: 2.1 time: 0.255711 Oct 26 05:06:55.621024 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 763/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:55 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:55.626515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83590912-24d0-43ef-a167-5ae16de9a039 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2063748528", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 2.5}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83590912-24d0-43ef-a167-5ae16de9a039 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Request method failure captured: Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 170 Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMBoRzoiJhazyKPzw843q8tIuhugif7isThc4MvLnu9zuOa31gv_SEAXI9v4kKNOunuD2Jn9H33pJ3QkvCIM2wX4Mwu_qJiDQ7FSdduGQI9MEbat1aFblxyGYZ6qcRYg3VbvUounlgSeBRis4RRiVhbcNpurHcNim0qhMgd3glHB-Ys Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:06:55.633287 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3dec4725e21478e809b801791967cb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3dec4725e21478e809b801791967cb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3dec4725e21478e809b801791967cb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: d3dec4725e21478e809b801791967cb5 Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1204790432 Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 8af524b9f7244fa2accc1af283dc65bd Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1204790432-project Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:06:55.635149 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2063748528", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 2.5}} Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2063748528', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'min_count': 2.5}}} Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 2.5 Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.635982 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.637597 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:06:55.639209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:06:55.639209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:06:55.639209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:06:55.639209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:06:55.639209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 26 05:06:55.639209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:06:55.640935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83590912-24d0-43ef-a167-5ae16de9a039 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:06:55.641093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "refresh_cache-394d62d7-2614-4420-8f55-ad5178d6c877" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:06:55.641413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquired lock "refresh_cache-394d62d7-2614-4420-8f55-ad5178d6c877" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:06:55.641886 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83590912-24d0-43ef-a167-5ae16de9a039 tempest-MultipleCreateNegativeTestJSON-1204790432 tempest-MultipleCreateNegativeTestJSON-1204790432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019561 Oct 26 05:06:55.642455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 764/1536] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:06:55.647650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1375744617", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "1d3f1995-4a9c-473d-83e2-e714a42436e5"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:55.726429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] validate_networks() for [('1d3f1995-4a9c-473d-83e2-e714a42436e5', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:06:55.900383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:55.958390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:56.777340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:06:56.778721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:06:56.779275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:06:56.779755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:06:56.780293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:06:56.794247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:56.795128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:56.795946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:56.797003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:56.798625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:56.799337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:56.824520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:06:56.830144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for user dbd1775d9dd04820aec1aa2efde776e1 and project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:06:56.844557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:06:56.847099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:06:56.924496 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4263a708-3ddf-45e2-b89f-ac74cce6f4d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.280529 Oct 26 05:06:56.925529 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 765/1537] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:06:56.938893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:56.940965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:56.949821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:56.950506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:56.951127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:56.952021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:56.952641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Building network info cache for instance {{(pid=120586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:06:56.953302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:56.953925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:57.238416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:57.259105 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ded3425b-8242-41f4-bf8d-3e9ae80dda20 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1317 microversion: 2.1 time: 0.325349 Oct 26 05:06:57.259896 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 766/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:56 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:57.281258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:57.281918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:57.288324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:57.288827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:57.289458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:57.290048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:57.290507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:57.290939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:57.680834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:57.696844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:57.698597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:57.699775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46a47deb-fbba-443f-80b9-d546b88d02a2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.424031 Oct 26 05:06:57.714109 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 767/1539] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:57 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:06:57.725889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:57.727197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:57.735345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:57.736075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:57.736681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:57.737613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:57.738421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:57.739431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.002625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:58.012659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61ebbc37-002d-4101-9614-dc3b070833a7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.297055 Oct 26 05:06:58.014077 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 768/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:57 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:58.019093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:58.020061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:58.034400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.034910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.035387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.036104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.038264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.039739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.052001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Updating instance_info_cache with network_info: [{"id": "5d74ffd2-2464-486a-a80e-27f76c357c36", "address": "fa:16:3e:02:eb:24", "network": {"id": "3985538d-bfbe-4200-9b84-bfdebdcb224a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-953121902-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67fbce7c49554dde9754fc79cbffa8be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d74ffd2-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:06:58.062605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Releasing lock "refresh_cache-394d62d7-2614-4420-8f55-ad5178d6c877" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:06:58.064113 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d7d08391-03a2-43f8-b68a-dae0fb07e828 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877/action" status: 202 len: 0 microversion: 2.1 time: 2.930977 Oct 26 05:06:58.065220 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 773/1541] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:55 2022] POST /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877/action => generated 0 bytes in 2933 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:06:58.071396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:58.072119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:58.080805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.081340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.081803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.082515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.082978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.083411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.161231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:58.172458 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f330522-8e4b-49de-8dbc-fa7c1e52255a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1215 microversion: 2.1 time: 0.105514 Oct 26 05:06:58.173461 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 774/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:58 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:58.178245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9cdb1177-78c9-48b7-b11d-453f1b11f7c1 req-6cac8833-b33e-40af-9712-64cb5b6429f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394d62d7-2614-4420-8f55-ad5178d6c877", "tag": "5d74ffd2-2464-486a-a80e-27f76c357c36"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:58.189183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9cdb1177-78c9-48b7-b11d-453f1b11f7c1 req-6cac8833-b33e-40af-9712-64cb5b6429f6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.190037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9cdb1177-78c9-48b7-b11d-453f1b11f7c1 req-6cac8833-b33e-40af-9712-64cb5b6429f6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.190704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9cdb1177-78c9-48b7-b11d-453f1b11f7c1 req-6cac8833-b33e-40af-9712-64cb5b6429f6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.204511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9cdb1177-78c9-48b7-b11d-453f1b11f7c1 req-6cac8833-b33e-40af-9712-64cb5b6429f6 service nova] Creating event network-changed:5d74ffd2-2464-486a-a80e-27f76c357c36 for instance 394d62d7-2614-4420-8f55-ad5178d6c877 on n-h1-862416-4 Oct 26 05:06:58.214998 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9cdb1177-78c9-48b7-b11d-453f1b11f7c1 req-6cac8833-b33e-40af-9712-64cb5b6429f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040008 Oct 26 05:06:58.216367 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 775/1543] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:58.222605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b7fe4eb8-5ff4-46c2-896e-c703c62dd532 req-e41666c8-df7a-4e62-b817-854de8d45905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1775471-ce05-493c-8ec3-03ef2f475e70", "tag": "09ae13fc-660e-48a5-9396-5902986e5f6c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:58.232791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b7fe4eb8-5ff4-46c2-896e-c703c62dd532 req-e41666c8-df7a-4e62-b817-854de8d45905 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.233306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b7fe4eb8-5ff4-46c2-896e-c703c62dd532 req-e41666c8-df7a-4e62-b817-854de8d45905 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.233758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b7fe4eb8-5ff4-46c2-896e-c703c62dd532 req-e41666c8-df7a-4e62-b817-854de8d45905 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.241866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:58.253115 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b7fe4eb8-5ff4-46c2-896e-c703c62dd532 req-e41666c8-df7a-4e62-b817-854de8d45905 service nova] Creating event network-changed:09ae13fc-660e-48a5-9396-5902986e5f6c for instance c1775471-ce05-493c-8ec3-03ef2f475e70 on n-h1-862416-4 Oct 26 05:06:58.253973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d8e0c5c6-661a-46f0-8095-43bdf5c31afc tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1472 microversion: 2.1 time: 0.238585 Oct 26 05:06:58.265717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 769/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:58 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:58.266641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b7fe4eb8-5ff4-46c2-896e-c703c62dd532 req-e41666c8-df7a-4e62-b817-854de8d45905 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041158 Oct 26 05:06:58.266641 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 776/1545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:06:58.266843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:58.266843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:58.273545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.273545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.273545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.273545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.274548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.274548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.288508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:58.289394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:58.298169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.298994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.299535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.301260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.301844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.302593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.309420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:06:58.383355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:58.421378 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1536998f-53f7-4ba4-b694-94bb50751075 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "DELETE /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 204 len: 0 microversion: 2.1 time: 0.165138 Oct 26 05:06:58.425350 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 770/1546] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:06:58 2022] DELETE /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:06:58.437861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.182"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:06:58.444073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:58.453434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.453932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.454374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.455092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.455538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.455969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.485386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:06:58.485933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquired lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:06:58.490326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:58.498383 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8464e1e0-0380-4699-a710-f3d13232efbc tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1317 microversion: 2.1 time: 0.216022 Oct 26 05:06:58.499826 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 777/1547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:58 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:06:58.730199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:58.731123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:58.737666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.738156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.738592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:58.739298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:58.739776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:58.740197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:59.083378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:59.092664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:59.094273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:59.095475 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e11b468-ee87-4f75-b7e9-4d58a94eaffa tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.369850 Oct 26 05:06:59.096055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 778/1548] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:06:58 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:06:59.105769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:59.106376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:59.112606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:59.113073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:59.113608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:59.114301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:59.114750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:59.115323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:59.466523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:59.476375 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6071614-a9d6-42ce-8991-564feb8c6a34 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1498 microversion: 2.1 time: 0.374331 Oct 26 05:06:59.477690 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 779/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:59 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:59.483001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:59.483614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:59.490733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:59.491439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:59.492074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:59.492773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:59.493227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:59.493679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:59.500031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:06:59.630934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:06:59.639618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24f52524-528b-40b1-848a-383c567e3178 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1215 microversion: 2.1 time: 0.160625 Oct 26 05:06:59.640477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 780/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:59 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:06:59.645809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:06:59.646731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:06:59.653921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:59.654579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:59.655150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:06:59.656107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:06:59.656700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:06:59.657423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:00.187735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:00.195921 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3808041-fb40-4880-a960-d6e20c5312a1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1472 microversion: 2.1 time: 0.554210 Oct 26 05:07:00.196799 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 781/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:06:59 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:00.213383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:00.214792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:00.222558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:00.223393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:00.224141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:00.225289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:00.226078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:00.226733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:00.514919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:00.524534 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c46341ac-b09b-45c8-8666-1e976daefeb7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1317 microversion: 2.1 time: 0.326448 Oct 26 05:07:00.525285 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 782/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:00 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:00.530554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:00.531367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:00.538553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:00.539442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:00.541136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:00.542599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:00.543692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:00.544125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:00.682574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Building network info cache for instance {{(pid=120585) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:07:01.074394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:01.083326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:01.090094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:01.091369 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d50901dd-f768-4974-9716-3d8c4389a3ce tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.564810 Oct 26 05:07:01.091952 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 783/1553] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:00 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:01.100378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:01.101000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:01.125110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.125724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.126175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.127706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.131573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.132040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.398171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:01.408674 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78803fe3-aca2-44a1-93c3-f4fbf0ff9ab6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 200 len: 1475 microversion: 2.1 time: 0.315645 Oct 26 05:07:01.412487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 784/1554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:01 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:01.423409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:01.426175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:01.438113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.441156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.441854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.444154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.445647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.447154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.641250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Updating instance_info_cache with network_info: [{"id": "3c788602-9553-472f-b12e-94f4ef62f02f", "address": "fa:16:3e:14:c3:70", "network": {"id": "3985538d-bfbe-4200-9b84-bfdebdcb224a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-953121902-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67fbce7c49554dde9754fc79cbffa8be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c788602-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120585) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:07:01.659381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Releasing lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:07:01.660752 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6fa976e8-b7e6-41f3-ab57-3284f321e7ab tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action" status: 202 len: 0 microversion: 2.1 time: 3.231317 Oct 26 05:07:01.661870 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 771/1555] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:06:58 2022] POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action => generated 0 bytes in 3234 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 26 05:07:01.670979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8ad96531-fcc2-437d-8c1f-d95d3332db1b req-f7a20fad-66a8-4a63-9174-b09ac6c2806a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:01.689716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:01.693760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8ad96531-fcc2-437d-8c1f-d95d3332db1b req-f7a20fad-66a8-4a63-9174-b09ac6c2806a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.694814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8ad96531-fcc2-437d-8c1f-d95d3332db1b req-f7a20fad-66a8-4a63-9174-b09ac6c2806a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.695455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8ad96531-fcc2-437d-8c1f-d95d3332db1b req-f7a20fad-66a8-4a63-9174-b09ac6c2806a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.705881 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7cd8042b-6090-48c0-86c8-666f5a0eb99a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1263 microversion: 2.1 time: 0.290210 Oct 26 05:07:01.720586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8ad96531-fcc2-437d-8c1f-d95d3332db1b req-f7a20fad-66a8-4a63-9174-b09ac6c2806a service nova] Creating event network-changed:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:07:01.721847 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 785/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:01 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1263 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:01.728583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:01.728741 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8ad96531-fcc2-437d-8c1f-d95d3332db1b req-f7a20fad-66a8-4a63-9174-b09ac6c2806a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064507 Oct 26 05:07:01.729279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:01.730310 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 772/1557] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:01.737980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2125251014"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:01.740712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:01.746085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.749480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.749846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.750310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.750924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.751482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.752333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.752900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.753511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:01.753650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:01.754809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:01.755455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:02.070468 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59412347-7a34-400a-851c-91f52937a713 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8/action" status: 202 len: 0 microversion: 2.1 time: 0.338184 Oct 26 05:07:02.072075 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 773/1558] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:01 2022] POST /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:07:02.090365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:02.091095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:02.102797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:02.104334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:02.104971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:02.107195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:02.113159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:02.113989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:02.193361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:02.202362 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-808f7de6-6f37-48d3-bed7-591979e7962b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.479252 Oct 26 05:07:02.206227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 786/1559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:01 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:02.217768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-051e2167-c9a9-4437-814d-37eab5c3b396 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '.version_select at 0x7f470a890dc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:02.583308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:02.607714 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49b7f0dc-3484-427e-821d-49d9bdbad070 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1317 microversion: 2.1 time: 0.533181 Oct 26 05:07:02.609716 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 774/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:02 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:02.629736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b784dd4-3dce-4a32-985d-4dfec4547797 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470eb69ca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:02.702528 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b784dd4-3dce-4a32-985d-4dfec4547797 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.090981 Oct 26 05:07:02.704508 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 775/1561] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:02 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:02.715210 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-051e2167-c9a9-4437-814d-37eab5c3b396 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/3a5fa3f7-8051-4ab8-b32c-e34dc2ccb5a1" status: 200 len: 184 microversion: 2.1 time: 0.507175 Oct 26 05:07:02.717029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:02.717634 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 787/1562] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:07:02 2022] GET /compute/v2.1/os-floating-ips/3a5fa3f7-8051-4ab8-b32c-e34dc2ccb5a1 => generated 184 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:02.718261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:02.724719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ca14ea17-4362-44af-94a1-28321e9ae6ef req-198b8bff-e8ce-4fb7-adbe-7b17e20b55bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1775471-ce05-493c-8ec3-03ef2f475e70", "name": "network-vif-plugged", "status": "completed", "tag": "09ae13fc-660e-48a5-9396-5902986e5f6c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:02.732124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:02.733026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:02.733746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:02.734719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:02.735704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:02.736749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:02.750481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ca14ea17-4362-44af-94a1-28321e9ae6ef req-198b8bff-e8ce-4fb7-adbe-7b17e20b55bb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:02.750967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ca14ea17-4362-44af-94a1-28321e9ae6ef req-198b8bff-e8ce-4fb7-adbe-7b17e20b55bb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:02.751450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ca14ea17-4362-44af-94a1-28321e9ae6ef req-198b8bff-e8ce-4fb7-adbe-7b17e20b55bb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:02.782342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ca14ea17-4362-44af-94a1-28321e9ae6ef req-198b8bff-e8ce-4fb7-adbe-7b17e20b55bb service nova] Creating event network-vif-plugged:09ae13fc-660e-48a5-9396-5902986e5f6c for instance c1775471-ce05-493c-8ec3-03ef2f475e70 on n-h1-862416-4 Oct 26 05:07:02.793907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ca14ea17-4362-44af-94a1-28321e9ae6ef req-198b8bff-e8ce-4fb7-adbe-7b17e20b55bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074965 Oct 26 05:07:02.794503 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 788/1563] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:02.811590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.182"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:03.140961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:03.173071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:03.174506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:03.177794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:03.179085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:03.179830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:03.181186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:03.220478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:03.231863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:03.240044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:03.242627 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69850f24-a78d-4ac0-90f0-4b1631d298de tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.536922 Oct 26 05:07:03.243606 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 776/1564] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:02 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:03.249969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:03.250586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:03.257123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:03.257648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:03.258808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:03.259907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:03.260692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:03.261289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:03.362714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:03.373427 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23b2e375-b88e-4daa-9b54-8fa678d580c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1269 microversion: 2.1 time: 0.128579 Oct 26 05:07:03.380702 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 777/1565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:03 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:03.593086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:07:03.593652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquired lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:07:03.716584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:03.717946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:03.721623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:03.727852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:03.729526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:03.730365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:03.731448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:03.732186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:03.732839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:04.018298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:04.037573 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-575590b0-731d-44ad-a527-c7037fd30d23 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.653829 Oct 26 05:07:04.047976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 778/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:03 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:04.060184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:04.065670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:04.082070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:04.082669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:04.083193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:04.092672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:04.094321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:04.097028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:04.539940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:04.553625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-325c647b-2622-4a55-84fc-b8912f9d495e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1317 microversion: 2.1 time: 0.503187 Oct 26 05:07:04.571431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 779/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:04 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:04.580644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7d2e5a2-a7a0-4b49-98b9-b1edba2dbb86 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a7224c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:04.636510 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7d2e5a2-a7a0-4b49-98b9-b1edba2dbb86 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.063776 Oct 26 05:07:04.637829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 780/1568] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:04 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:04.644283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-54d7f7be-ce51-4b0e-b412-86698eb35d85 req-3c8ceb8e-0ac7-4591-b576-40ac59941081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394d62d7-2614-4420-8f55-ad5178d6c877", "name": "network-vif-deleted", "tag": "5d74ffd2-2464-486a-a80e-27f76c357c36"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:04.657658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-54d7f7be-ce51-4b0e-b412-86698eb35d85 req-3c8ceb8e-0ac7-4591-b576-40ac59941081 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:04.658383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-54d7f7be-ce51-4b0e-b412-86698eb35d85 req-3c8ceb8e-0ac7-4591-b576-40ac59941081 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:04.659014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-54d7f7be-ce51-4b0e-b412-86698eb35d85 req-3c8ceb8e-0ac7-4591-b576-40ac59941081 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:04.673173 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-54d7f7be-ce51-4b0e-b412-86698eb35d85 req-3c8ceb8e-0ac7-4591-b576-40ac59941081 service nova] Creating event network-vif-deleted:5d74ffd2-2464-486a-a80e-27f76c357c36 for instance 394d62d7-2614-4420-8f55-ad5178d6c877 on n-h1-862416-4 Oct 26 05:07:04.679708 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-54d7f7be-ce51-4b0e-b412-86698eb35d85 req-3c8ceb8e-0ac7-4591-b576-40ac59941081 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039893 Oct 26 05:07:04.681225 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 781/1569] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:04.690471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:04.691442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:04.699661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:04.700348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:04.701055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:04.702028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:04.702861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:04.703960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:04.780942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Building network info cache for instance {{(pid=120586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:07:05.702526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:05.714290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:05.720109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:05.724082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-109fd995-f830-48fa-967f-987ed084dfc4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 1.039763 Oct 26 05:07:05.724875 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 782/1570] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:04 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:05.736002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:05.736895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:05.752126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:05.752859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:05.753511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:05.755142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:05.755794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:05.756380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.071712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:06.084219 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb34deb7-8adb-4d13-8037-03d0e1101950 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.355891 Oct 26 05:07:06.089624 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 783/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:05 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:06.097396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e9d49cc2-e636-4d97-834f-b44662f0b4e2 req-bf3e0415-7ae8-498a-a2c0-6753feddb5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:06.108734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e9d49cc2-e636-4d97-834f-b44662f0b4e2 req-bf3e0415-7ae8-498a-a2c0-6753feddb5fc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.109217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e9d49cc2-e636-4d97-834f-b44662f0b4e2 req-bf3e0415-7ae8-498a-a2c0-6753feddb5fc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.110393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e9d49cc2-e636-4d97-834f-b44662f0b4e2 req-bf3e0415-7ae8-498a-a2c0-6753feddb5fc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.125220 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e9d49cc2-e636-4d97-834f-b44662f0b4e2 req-bf3e0415-7ae8-498a-a2c0-6753feddb5fc service nova] Creating event network-changed:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:07:06.131700 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e9d49cc2-e636-4d97-834f-b44662f0b4e2 req-bf3e0415-7ae8-498a-a2c0-6753feddb5fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040118 Oct 26 05:07:06.132744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 784/1572] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:06.153137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "name": "network-vif-plugged", "status": "completed", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}, {"server_uuid": "0afdec39-d5c9-4e87-b528-7227a49580e5", "name": "network-vif-plugged", "status": "completed", "tag": "18a6c1cd-7330-433a-8098-880895a40bb1"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:06.171818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.172302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.172735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.203663 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] Creating event network-vif-plugged:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:07:06.205865 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] Creating event network-vif-plugged:18a6c1cd-7330-433a-8098-880895a40bb1 for instance 0afdec39-d5c9-4e87-b528-7227a49580e5 on n-h1-862416-4 Oct 26 05:07:06.221588 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-18bdf21d-c557-411e-8e6d-7281189c4465 req-2d0da042-4010-4336-9fc7-766c5ec4d10b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086432 Oct 26 05:07:06.224305 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 785/1573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:06.263310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.264037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:06.290926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.294607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.300501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.302679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.304631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.305245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.486413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Updating instance_info_cache with network_info: [{"id": "3c788602-9553-472f-b12e-94f4ef62f02f", "address": "fa:16:3e:14:c3:70", "network": {"id": "3985538d-bfbe-4200-9b84-bfdebdcb224a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-953121902-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67fbce7c49554dde9754fc79cbffa8be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c788602-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:07:06.503257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Releasing lock "refresh_cache-851bd930-4d29-4a45-a402-3d7f5a311927" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:07:06.504177 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-89f40bf1-29fa-4e59-a80a-ff55da078b6c tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action" status: 202 len: 0 microversion: 2.1 time: 3.703020 Oct 26 05:07:06.506943 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 789/1574] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:02 2022] POST /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927/action => generated 0 bytes in 3709 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:07:06.517882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.520154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:06.528485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:06.535023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.535936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.536825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.537917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.538049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb80fac6-f0a0-49c9-849f-b5dcf02a79f5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.312005 Oct 26 05:07:06.538791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.538960 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 786/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:06 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:06.542317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.544490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a729a8e8-fdea-45a9-ab1f-c51550dbe93a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a79e4c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.594884 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a729a8e8-fdea-45a9-ab1f-c51550dbe93a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.054333 Oct 26 05:07:06.595575 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 787/1576] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:06 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:06.601665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.602446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:06.613965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.614767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.615445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.616395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.617057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.617730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.637008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] HTTP exception thrown: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Request method failure captured: Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 HTTP/1.1 Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMArNHnj9wMzDsDtLwv2ieN92vFJV3l1AIj697V9nsfxiX-mJkqVVuMI5hRbCc6pG3G2yZXQr434ZwzTImchkUAipmYBKINucgIv6EmH1ohAt_683iZrAJe5qVq_N29DTyF7UYXOINWoR8DEr3Opd-eNMXmeYuh-KlZIWj9OBzm9r2k Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:07:06.639276 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ebf85e7319884c87ba745771b8abaa92 Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.641255 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '394d62d7-2614-4420-8f55-ad5178d6c877'} Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:07:06.642547 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.644598 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.647628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Returning 404 to user: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:07:06.648735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-591afabe-4d85-4563-81de-ed615bc70136 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "DELETE /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 404 len: 111 microversion: 2.1 time: 0.051990 Oct 26 05:07:06.649897 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 788/1577] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:07:06 2022] DELETE /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:07:06.659102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.660663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 394d62d7-2614-4420-8f55-ad5178d6c877] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:06.668800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.669640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.670263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.671242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.671942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.672584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.691406 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] HTTP exception thrown: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Request method failure captured: Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 HTTP/1.1 Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMArNHnj9wMzDsDtLwv2ieN92vFJV3l1AIj697V9nsfxiX-mJkqVVuMI5hRbCc6pG3G2yZXQr434ZwzTImchkUAipmYBKINucgIv6EmH1ohAt_683iZrAJe5qVq_N29DTyF7UYXOINWoR8DEr3Opd-eNMXmeYuh-KlZIWj9OBzm9r2k Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:07:06.694003 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ebf85e7319884c87ba745771b8abaa92 Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.695856 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '394d62d7-2614-4420-8f55-ad5178d6c877'} Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:07:06.696902 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. Oct 26 05:07:06.699303 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:06.702387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Returning 404 to user: Instance 394d62d7-2614-4420-8f55-ad5178d6c877 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:07:06.703491 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1a46be1-f1c3-4994-bda6-b452b4c08835 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877" status: 404 len: 111 microversion: 2.1 time: 0.049204 Oct 26 05:07:06.705033 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 789/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:06 2022] GET /compute/v2.1/servers/394d62d7-2614-4420-8f55-ad5178d6c877 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:07:06.714855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef4bd19a-ecee-4716-9761-c833776cbf96 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '.version_select at 0x7f470eb69d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.799647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:06.813416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:06.821766 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d0fb44f3-6779-4c93-8b12-43fabb65ef3a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1466 microversion: 2.1 time: 0.312420 Oct 26 05:07:06.824761 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 790/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:06 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1466 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:06.833039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:06.837591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:06.840572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:06.851108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.852045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.853551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:06.854973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:06.857605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:06.858867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:07.199375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:07.208363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:07.218649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:07.220353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-208a7416-08ce-4ac2-b05f-e07902a3f930 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.393587 Oct 26 05:07:07.221972 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 791/1580] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:06 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:07.236713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:07.237759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:07.257867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:07.258968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:07.259423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:07.261013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:07.261743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:07.262974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:07.570879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:07.585590 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b398475a-5338-41d1-94d0-c8d7b795c4a0 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1318 microversion: 2.1 time: 0.362219 Oct 26 05:07:07.602312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 792/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:07 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:07.608488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:07.609551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:07.617263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:07.618270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:07.618938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:07.620390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:07.621124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:07.621658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:07.836707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:07.848925 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1e91431-c3b5-45e7-8e92-c3b63db0af70 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.244619 Oct 26 05:07:07.866019 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 793/1582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:07 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:07.872103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:07.873019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:07.880550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:07.881350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:07.882009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:07.882949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:07.883619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:07.884253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.121545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef4bd19a-ecee-4716-9761-c833776cbf96 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3a5fa3f7-8051-4ab8-b32c-e34dc2ccb5a1" status: 202 len: 0 microversion: 2.1 time: 1.410955 Oct 26 05:07:08.122732 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 790/1583] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:07:06 2022] DELETE /compute/v2.1/os-floating-ips/3a5fa3f7-8051-4ab8-b32c-e34dc2ccb5a1 => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:07:08.127504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-74c58b15-c454-458c-9269-289c5f58bd42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a9769d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:08.179440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:08.211734 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57ee49be-96d6-4fe2-a8a1-ee4fa453462b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.344198 Oct 26 05:07:08.214636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 794/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:07 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:08.218965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-74c58b15-c454-458c-9269-289c5f58bd42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.094954 Oct 26 05:07:08.232243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:08.232751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:08.235775 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 791/1585] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:08 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:08.240118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.241598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.242257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.243174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.244031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.244881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.255440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:08.255998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:08.272674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.273171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.273645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.274358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.274819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.275246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.279732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:07:08.395074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:08.470118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59b13fe5-17a9-441e-b09e-4bafa05da1d5 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "DELETE /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 204 len: 0 microversion: 2.1 time: 0.250771 Oct 26 05:07:08.474868 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 795/1586] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:07:08 2022] DELETE /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:08.483841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1d6c6aba-18a1-4817-95e0-cb42cc73b44a req-3b1ae06d-908a-410e-a59e-4ce335089e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3631f7b3-349e-43e1-8d4f-128ddb274ee8", "name": "network-vif-plugged", "status": "completed", "tag": "8e51ca90-1775-48fe-979a-365eabcef0bb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:08.494288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1d6c6aba-18a1-4817-95e0-cb42cc73b44a req-3b1ae06d-908a-410e-a59e-4ce335089e5c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.494912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1d6c6aba-18a1-4817-95e0-cb42cc73b44a req-3b1ae06d-908a-410e-a59e-4ce335089e5c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.495594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1d6c6aba-18a1-4817-95e0-cb42cc73b44a req-3b1ae06d-908a-410e-a59e-4ce335089e5c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.508589 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1d6c6aba-18a1-4817-95e0-cb42cc73b44a req-3b1ae06d-908a-410e-a59e-4ce335089e5c service nova] Creating event network-vif-plugged:8e51ca90-1775-48fe-979a-365eabcef0bb for instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 on n-h2-862416-4 Oct 26 05:07:08.515448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1d6c6aba-18a1-4817-95e0-cb42cc73b44a req-3b1ae06d-908a-410e-a59e-4ce335089e5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038703 Oct 26 05:07:08.516632 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 796/1587] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:08.522318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:08.529559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:08.532568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:08.535047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:08.538265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:08.540845 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1aabd34b-64e7-4e3b-855d-697bf7e4d87f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1281 microversion: 2.25 time: 0.293451 Oct 26 05:07:08.543017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 792/1588] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:08 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:08.555333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.555885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.556536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.557495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.558122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.558938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.586182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fcf44fda-d35e-4071-8f33-c3621c3a8878 req-02590098-e00e-4dbd-b855-abe7e64d3e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968f8909-14e6-45b2-982a-2ca35d66232b", "tag": "c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:08.611773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fcf44fda-d35e-4071-8f33-c3621c3a8878 req-02590098-e00e-4dbd-b855-abe7e64d3e6f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.621703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fcf44fda-d35e-4071-8f33-c3621c3a8878 req-02590098-e00e-4dbd-b855-abe7e64d3e6f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.623045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fcf44fda-d35e-4071-8f33-c3621c3a8878 req-02590098-e00e-4dbd-b855-abe7e64d3e6f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.638392 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fcf44fda-d35e-4071-8f33-c3621c3a8878 req-02590098-e00e-4dbd-b855-abe7e64d3e6f service nova] Creating event network-changed:c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8 for instance 968f8909-14e6-45b2-982a-2ca35d66232b on n-h1-862416-4 Oct 26 05:07:08.656896 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fcf44fda-d35e-4071-8f33-c3621c3a8878 req-02590098-e00e-4dbd-b855-abe7e64d3e6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074199 Oct 26 05:07:08.658217 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 793/1589] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:07:08.663516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:08.664222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:08.672363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.672864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.673331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.674062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.674522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.675349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.717854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:08.728142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ddea4826-d86d-4e73-803a-dd579d25c0ed tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1524 microversion: 2.1 time: 0.209548 Oct 26 05:07:08.729207 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 797/1590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:08 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1524 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:08.852909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:08.861906 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd876a92-cbd7-4700-8cc7-208b0bdfb622 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1318 microversion: 2.1 time: 0.202537 Oct 26 05:07:08.873286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:08.874039 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 794/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:08 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:08.874634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:08.892764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.893660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.894408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:08.895358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:08.896098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:08.897744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.064047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:09.074226 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ac6a1c4-d586-41bf-b872-2667c9bc2b02 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.206048 Oct 26 05:07:09.075418 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 798/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:08 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:09.239138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-122389a0-6a14-4fff-9d60-f65ea8cc4979 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a7223a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:09.241509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:09.242466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:09.253546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.254482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.255484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.257229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.257942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.258815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.291815 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-122389a0-6a14-4fff-9d60-f65ea8cc4979 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.058331 Oct 26 05:07:09.292786 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 795/1593] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:09 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:09.436328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:09.444631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9c3570e-6585-4a33-bea8-834c63b02fe5 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.209646 Oct 26 05:07:09.446819 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 799/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:09 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:09.568563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:09.570869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:09.582084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.582928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.583607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.584575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.585196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.585810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.593717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:09.753573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:09.754344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:09.762772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.763505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.764040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.764905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.765517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.766048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.767369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:09.776861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:09.778377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:09.779546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e6b5d29-cb66-47df-8af2-9ae2f7db2269 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1478 microversion: 2.25 time: 0.215004 Oct 26 05:07:09.780110 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 796/1595] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:09 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1478 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:09.817670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:09.818589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:09.826342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.826842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.827312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.828239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:09.828939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:09.829438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:09.954888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:09.967231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0e69a54-8ec9-4e21-9059-3701edbc2efb tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1524 microversion: 2.1 time: 0.215951 Oct 26 05:07:09.967940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 800/1596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:09 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1524 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:07:09.997614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:10.001199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:10.010290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.011979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.012954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.014328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.015695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.016459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.047997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 0afdec39-d5c9-4e87-b528-7227a49580e5 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:10.063987 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7ac4d2bc-4be7-4e53-a368-97599b66de7a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1971 microversion: 2.25 time: 0.252511 Oct 26 05:07:10.078088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 797/1597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:09 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1971 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:10.091387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:10.092102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:10.098764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.099166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.099867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.100591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.101049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.101522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.249103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:10.259744 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79591957-1ab3-41ad-956f-2882c779feb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1468 microversion: 2.1 time: 0.270924 Oct 26 05:07:10.261822 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 801/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:09 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1468 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:10.283134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:10.283746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:10.290578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.291900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.292511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.293121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 0afdec39-d5c9-4e87-b528-7227a49580e5 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:10.293942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.294565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.295178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.314937 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5a67cf3-b1dc-4648-9d59-1e1a188c8043 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1971 microversion: 2.25 time: 0.228026 Oct 26 05:07:10.329547 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 798/1599] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:10 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1971 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:07:10.338612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1883553479"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:10.344454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:10.350998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.351784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.351986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.352618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.353303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.354393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.523263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:10.533187 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-96316633-1dba-4e86-a608-258fba7f5eee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.253661 Oct 26 05:07:10.546204 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 802/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:10 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:10.551256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5add681e-fe96-4ac4-895a-4479792b85c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a78a790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:10.705985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5add681e-fe96-4ac4-895a-4479792b85c4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.167899 Oct 26 05:07:10.715004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 803/1601] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:10 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:10.734532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:10.744740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.746513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.746804 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d9e95680-63ec-41b8-aaad-f548ea8dfd12 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "POST /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26/action" status: 202 len: 0 microversion: 2.1 time: 0.421597 Oct 26 05:07:10.747117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.748266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 799/1602] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:10 2022] POST /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:07:10.758680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:10.759281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.761078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.762330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.763787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:10.775594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.776238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.777262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.778163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:10.778946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:10.779485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:10.910331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0de93d17-0b74-47e7-ad36-e5310fcbc403 tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.202212 Oct 26 05:07:10.914069 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 804/1603] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 26 05:07:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:07:10.978205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:10.988870 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b67c1dcd-11f2-41c0-9248-f1990887e82c tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.238999 Oct 26 05:07:10.990104 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 800/1604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:10 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:10.995452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4e9e169-12a1-4b7f-915c-a8766c056f07 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8b9d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:11.049419 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4e9e169-12a1-4b7f-915c-a8766c056f07 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.058170 Oct 26 05:07:11.050310 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 801/1605] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:10 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:11.055466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": "auto"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:11.058888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:11.068974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:11.069377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:11.070061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:11.070989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:11.071637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:11.072837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:11.101689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'flavor' on Instance uuid 0afdec39-d5c9-4e87-b528-7227a49580e5 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:11.116705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Going to try to live migrate instance to n-h2-862416-4 {{(pid=120585) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:07:11.132457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-814492250", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "cbb50316-1f13-4e95-be20-9684f6dc4bcd"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:11.227697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] validate_networks() for [('cbb50316-1f13-4e95-be20-9684f6dc4bcd', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:07:11.971362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:07:11.971963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:07:11.972595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:07:11.972790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:07:11.973691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:07:11.984970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:11.985744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:11.986451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:11.987874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:11.988560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:11.989002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.017139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Getting quotas for project a841c0d671e0484682485e4dc43960cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:07:12.024930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Getting quotas for user 5b9587c8a44e4a0d96b0e9efc7bfbe33 and project a841c0d671e0484682485e4dc43960cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:07:12.048016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:07:12.050832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:07:12.107904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:12.141990 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7c8f389-0a22-4480-a6ab-68c5d3bc3a01 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224842 Oct 26 05:07:12.148480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 805/1606] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:07:12.149606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:12.150810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:12.176747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.177255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.177727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.178442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.178897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.179552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.243182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.243873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.245064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.245912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lazy-loading 'fault' on Instance uuid 851bd930-4d29-4a45-a402-3d7f5a311927 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:12.301549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf85e7319884c87ba745771b8abaa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67fbce7c49554dde9754fc79cbffa8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:12.313177 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-40e0566b-5550-4cac-adcd-2dcea7b83cde tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 200 len: 1313 microversion: 2.1 time: 0.168658 Oct 26 05:07:12.324540 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 806/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:12 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:12.335458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-52fe381d-5ad8-48b4-8747-e0581c3b65d2 req-e4e62d5e-f264-466c-9902-ff5c80316756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851bd930-4d29-4a45-a402-3d7f5a311927", "name": "network-vif-deleted", "tag": "3c788602-9553-472f-b12e-94f4ef62f02f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:12.347430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-52fe381d-5ad8-48b4-8747-e0581c3b65d2 req-e4e62d5e-f264-466c-9902-ff5c80316756 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.347914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-52fe381d-5ad8-48b4-8747-e0581c3b65d2 req-e4e62d5e-f264-466c-9902-ff5c80316756 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.349138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-52fe381d-5ad8-48b4-8747-e0581c3b65d2 req-e4e62d5e-f264-466c-9902-ff5c80316756 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.364007 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-52fe381d-5ad8-48b4-8747-e0581c3b65d2 req-e4e62d5e-f264-466c-9902-ff5c80316756 service nova] Creating event network-vif-deleted:3c788602-9553-472f-b12e-94f4ef62f02f for instance 851bd930-4d29-4a45-a402-3d7f5a311927 on n-h1-862416-4 Oct 26 05:07:12.373376 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-52fe381d-5ad8-48b4-8747-e0581c3b65d2 req-e4e62d5e-f264-466c-9902-ff5c80316756 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047059 Oct 26 05:07:12.373745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 807/1608] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:12.382254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:12.382991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:12.390558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.391234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.391677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.392438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.392821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.394336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.652680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:12.665297 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d72cff50-2af3-4407-996d-31935a1ccfca tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.290161 Oct 26 05:07:12.677418 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 808/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:12 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:12.677418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69c1b174-ba6a-44b4-b6bd-043ba235c2f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a80ed30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:12.797168 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69c1b174-ba6a-44b4-b6bd-043ba235c2f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.128736 Oct 26 05:07:12.802549 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 809/1610] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:12 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:12.820295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:12.824346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:12.837096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.844400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.845235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:12.857933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:12.858466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:12.858917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.307680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:13.322273 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34145605-e659-40a7-a039-1232deaba560 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.515667 Oct 26 05:07:13.340151 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 810/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:12 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:13.351449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5621ebc2-8a7c-4723-a73e-61017ac9c7f9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a201310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:13.437511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5621ebc2-8a7c-4723-a73e-61017ac9c7f9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.095081 Oct 26 05:07:13.437511 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 811/1612] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:13 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:13.442466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:13.443111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:13.450527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.451033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.451478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.452196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.452661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.453098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.629266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:13.646042 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5738528c-869c-422d-b0dc-51a39258f042 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1211 microversion: 2.1 time: 0.207412 Oct 26 05:07:13.648020 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 812/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:13 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1211 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:13.657296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:13.657948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] [instance: 851bd930-4d29-4a45-a402-3d7f5a311927] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:13.707565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.708065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.708505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.709214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.709731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.710179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.716992 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df902070-4834-4901-b4b3-f76cacae063a tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5/action" status: 202 len: 0 microversion: 2.25 time: 2.665055 Oct 26 05:07:13.717976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 802/1614] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:07:11 2022] POST /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5/action => generated 0 bytes in 2667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:13.727739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:13.729005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:13.737938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] HTTP exception thrown: Instance 851bd930-4d29-4a45-a402-3d7f5a311927 could not be found. Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Request method failure captured: Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 HTTP/1.1 Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMArNHnj9wMzDsDtLwv2ieN92vFJV3l1AIj697V9nsfxiX-mJkqVVuMI5hRbCc6pG3G2yZXQr434ZwzTImchkUAipmYBKINucgIv6EmH1ohAt_683iZrAJe5qVq_N29DTyF7UYXOINWoR8DEr3Opd-eNMXmeYuh-KlZIWj9OBzm9r2k Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:07:13.739619 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67fbce7c49554dde9754fc79cbffa8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 67fbce7c49554dde9754fc79cbffa8be Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1793177995 Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: ebf85e7319884c87ba745771b8abaa92 Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1793177995-project Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 851bd930-4d29-4a45-a402-3d7f5a311927 could not be found. Oct 26 05:07:13.741776 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '851bd930-4d29-4a45-a402-3d7f5a311927'} Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851bd930-4d29-4a45-a402-3d7f5a311927 could not be found. Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:07:13.742857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851bd930-4d29-4a45-a402-3d7f5a311927 could not be found. Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851bd930-4d29-4a45-a402-3d7f5a311927 could not be found. Oct 26 05:07:13.745486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:07:13.747027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] Returning 404 to user: Instance 851bd930-4d29-4a45-a402-3d7f5a311927 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:07:13.747027 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-17c45bf4-5674-4c41-80a3-4fd7495e2174 tempest-FloatingIPsAssociationTestJSON-1793177995 tempest-FloatingIPsAssociationTestJSON-1793177995-project] 10.222.0.16 "GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927" status: 404 len: 111 microversion: 2.1 time: 0.092039 Oct 26 05:07:13.747279 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 813/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:13 2022] GET /compute/v2.1/servers/851bd930-4d29-4a45-a402-3d7f5a311927 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:07:13.752751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:13.753292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.753845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.754279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.755451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.756175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.756782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.767515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:13.783477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.783979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.784426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:13.785148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:13.785643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:13.791343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:14.124438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:14.144367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9cd4dfa6-01e1-4ba0-9317-d0e13b9c5cd7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.417699 Oct 26 05:07:14.145482 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 803/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:13 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:14.158274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c203b2c2-cf2a-4708-b030-da3f1c5ab776 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a8dab80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:14.170555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:14.207327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:14.210394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:14.211876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8bbe01a-0dfb-4fe1-8e1a-df593af18fb2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.463418 Oct 26 05:07:14.213862 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 814/1617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:13 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:14.267517 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c203b2c2-cf2a-4708-b030-da3f1c5ab776 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.120901 Oct 26 05:07:14.268098 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 804/1618] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:14 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:14.350411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:14.352999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:14.367246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:14.368700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:14.370819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:14.371916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:14.373217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:14.374648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:14.451903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8113c25c-231c-4372-a5e4-af047a97a085 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a9f7d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:14.535266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8113c25c-231c-4372-a5e4-af047a97a085 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.087085 Oct 26 05:07:14.536105 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 805/1619] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:14 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:14.678698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:14.679595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:14.696926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:14.698150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:14.698623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:14.699518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:14.699986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:14.700420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:14.770459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:14.779198 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6eb271c-491a-4a6c-9387-2903352cb3ac tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.436182 Oct 26 05:07:14.781053 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 815/1620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:14 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:14.890826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:14.912637 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1a530c7-dfec-4566-a07a-932ca8901636 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1275 microversion: 2.1 time: 0.241892 Oct 26 05:07:14.914193 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 806/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:14 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:07:15.177581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:15.178427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:15.193976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.194795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.196094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.196997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.197974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.198613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.246982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:15.247845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:15.261091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.261653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.262104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.264930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.265429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.267516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.642645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:15.655783 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00ed5886-5a99-47ba-8126-be30473e1f94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.480548 Oct 26 05:07:15.669389 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 816/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:15 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:15.676313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c8aa555-8bce-423f-9273-f18325a04561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ab30af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:15.764255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:15.774624 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c8aa555-8bce-423f-9273-f18325a04561 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.108714 Oct 26 05:07:15.775683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:15.775834 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 817/1623] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:15 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:15.778088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:15.779465 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59d8870e-11b0-4d75-9a30-e6caea7b5746 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.539354 Oct 26 05:07:15.780485 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 807/1624] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:15 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:15.788235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-851645f1-c1b0-488c-ac16-32df70c0e225 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8e1a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:15.810431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:15.811347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:15.823470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.824749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.826178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.827313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.828234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.828858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.881211 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-851645f1-c1b0-488c-ac16-32df70c0e225 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.103665 Oct 26 05:07:15.882363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 818/1625] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:15 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:15.940431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:15.942543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:15.958617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.959393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.961892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:15.964847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:15.967222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:15.967980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:16.133559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:16.145931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af0624f9-d318-4557-8086-7f9f81d7696f tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.341676 Oct 26 05:07:16.164409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 808/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:15 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:16.216937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:16.229194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-72dd6924-293c-4ba4-8f76-a10d3ed351d4 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1273 microversion: 2.1 time: 0.292048 Oct 26 05:07:16.230881 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 819/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:15 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:07:16.250821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d3591a1d-991a-4b02-bcce-30f4893eec68 req-3bf6c8d3-a3bf-4943-8e7f-133ed7eaa7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968f8909-14e6-45b2-982a-2ca35d66232b", "name": "network-vif-plugged", "status": "completed", "tag": "c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:16.262447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d3591a1d-991a-4b02-bcce-30f4893eec68 req-3bf6c8d3-a3bf-4943-8e7f-133ed7eaa7e2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:16.263168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d3591a1d-991a-4b02-bcce-30f4893eec68 req-3bf6c8d3-a3bf-4943-8e7f-133ed7eaa7e2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:16.263812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d3591a1d-991a-4b02-bcce-30f4893eec68 req-3bf6c8d3-a3bf-4943-8e7f-133ed7eaa7e2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:16.281856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d3591a1d-991a-4b02-bcce-30f4893eec68 req-3bf6c8d3-a3bf-4943-8e7f-133ed7eaa7e2 service nova] Creating event network-vif-plugged:c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8 for instance 968f8909-14e6-45b2-982a-2ca35d66232b on n-h1-862416-4 Oct 26 05:07:16.288394 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d3591a1d-991a-4b02-bcce-30f4893eec68 req-3bf6c8d3-a3bf-4943-8e7f-133ed7eaa7e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041094 Oct 26 05:07:16.289682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 809/1628] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:16.684961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:16.686253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:16.694319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:16.695182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:16.695847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:16.696918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:16.698083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:16.698963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:16.730598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:16.792751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-215df54c-cccf-4944-b296-926f6ac8e77c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470e9f2a60>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:16.872976 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-215df54c-cccf-4944-b296-926f6ac8e77c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.085719 Oct 26 05:07:16.886891 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 810/1629] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:16 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:16.898556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:16.899621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:16.916194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:16.917071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:16.918094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:16.919372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:16.921895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:16.922895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:17.029856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:17.038995 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-118cba1b-5579-431a-8dca-6333c8981d8b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.358141 Oct 26 05:07:17.043303 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 820/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:16 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:17.058730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84c27c43-30d9-4b79-986d-d0f0f88f7901 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a201790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:17.138367 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84c27c43-30d9-4b79-986d-d0f0f88f7901 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.093062 Oct 26 05:07:17.140062 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 821/1631] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:17 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:17.205109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:17.209754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:17.248602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:17.255122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:17.259106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:17.265700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:17.270590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:17.271698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:17.272405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:17.273072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:17.274017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:17.278760 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8eee82e7-eea3-4060-985c-5b86c5291e47 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.390324 Oct 26 05:07:17.297986 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 811/1632] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:16 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:17.297986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:17.297986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:17.300311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:17.300922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:17.301514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:17.302430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:17.303035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:17.303580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:17.772540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:17.785698 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba6425a4-00c6-4bb3-8e79-27a4462d8427 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.595479 Oct 26 05:07:17.802354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 822/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:17 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:17.852176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:17.862805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d28c08e-de1e-4f1e-9fce-df4f80ed510e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1315 microversion: 2.1 time: 0.581893 Oct 26 05:07:17.863379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 812/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:17 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:17.893392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4ee89460-1002-4230-8851-154e186a65da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a2010d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:17.957401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4ee89460-1002-4230-8851-154e186a65da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1414 microversion: 2.1 time: 0.065884 Oct 26 05:07:17.959386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 823/1635] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:17 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:18.068112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:18.069263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:18.077371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.078280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.079061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.080100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.080912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.081577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.114597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:18.154450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d18fe4a5-1292-419c-bb83-1f3cdf36d90f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a79c9d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:18.300198 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d18fe4a5-1292-419c-bb83-1f3cdf36d90f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.150270 Oct 26 05:07:18.315256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 824/1636] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:18 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:07:18.336542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:18.352322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:18.380829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.381732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.382406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.383355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.393032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.393880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.440812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:18.459106 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4fef1599-2d13-4710-9557-25d865f5d643 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1311 microversion: 2.1 time: 0.394863 Oct 26 05:07:18.466488 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 813/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:18 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1311 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:18.471796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-eed1e40f-6862-4372-a5e1-0cd8fff5491c req-91ddfa7c-14e5-4318-b920-46d783755752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "name": "network-vif-plugged", "status": "completed", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:18.495227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eed1e40f-6862-4372-a5e1-0cd8fff5491c req-91ddfa7c-14e5-4318-b920-46d783755752 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.495713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eed1e40f-6862-4372-a5e1-0cd8fff5491c req-91ddfa7c-14e5-4318-b920-46d783755752 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.497526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eed1e40f-6862-4372-a5e1-0cd8fff5491c req-91ddfa7c-14e5-4318-b920-46d783755752 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.524908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-eed1e40f-6862-4372-a5e1-0cd8fff5491c req-91ddfa7c-14e5-4318-b920-46d783755752 service nova] Creating event network-vif-plugged:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:07:18.548821 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-eed1e40f-6862-4372-a5e1-0cd8fff5491c req-91ddfa7c-14e5-4318-b920-46d783755752 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080890 Oct 26 05:07:18.557939 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 814/1638] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:18.738339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:18.751171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:18.753956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:18.756641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fec0921c-4ee4-41ce-8698-2e70afccb25a tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.440086 Oct 26 05:07:18.757227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 825/1639] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:18 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:18.809358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:18.810133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:18.821117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.821592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.831173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.832079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.832582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.833050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.885925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:18.886592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:18.903314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.914121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.914587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:18.915347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:18.916440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:18.916877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:19.345064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:19.356725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e472cc2-f272-4511-b888-b892956edced tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1477 microversion: 2.1 time: 0.551769 Oct 26 05:07:19.369338 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 815/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:18 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1477 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:19.396607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:19.406554 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e0f7857-e48b-489c-b189-51a21894acdf tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1315 microversion: 2.1 time: 0.524567 Oct 26 05:07:19.407140 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 826/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:18 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:19.425255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84e39395-89f4-418c-8693-0a0e8117bc36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470abb7b80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:19.526901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ab851015-5fe7-48b1-8a61-7870f153f4d7 req-a30a0c26-99a3-439f-8367-fdca47d87825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a08188-ace3-46f4-955f-4e631a6ed9fd", "tag": "7b9cee30-9a11-4896-97a6-3d400bfbe9e8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:19.550558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ab851015-5fe7-48b1-8a61-7870f153f4d7 req-a30a0c26-99a3-439f-8367-fdca47d87825 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:19.551442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ab851015-5fe7-48b1-8a61-7870f153f4d7 req-a30a0c26-99a3-439f-8367-fdca47d87825 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:19.551442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ab851015-5fe7-48b1-8a61-7870f153f4d7 req-a30a0c26-99a3-439f-8367-fdca47d87825 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:19.589248 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ab851015-5fe7-48b1-8a61-7870f153f4d7 req-a30a0c26-99a3-439f-8367-fdca47d87825 service nova] Creating event network-changed:7b9cee30-9a11-4896-97a6-3d400bfbe9e8 for instance 85a08188-ace3-46f4-955f-4e631a6ed9fd on n-h1-862416-4 Oct 26 05:07:19.597422 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ab851015-5fe7-48b1-8a61-7870f153f4d7 req-a30a0c26-99a3-439f-8367-fdca47d87825 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238822 Oct 26 05:07:19.598482 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 816/1642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:19.605047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95c50e70-1e80-4852-adc1-064724bafb89 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470e9f2af0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:22.001706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:22.043096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:28.903619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=30 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:29.401693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=20 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:29.545872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=60 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:29.569676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=13 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:30.761755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84e39395-89f4-418c-8693-0a0e8117bc36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1423 microversion: 2.1 time: 11.351131 Oct 26 05:07:30.765846 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 827/1643] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:19 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1423 bytes in 11356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:30.776721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:30.777499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:30.785175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:30.786401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:30.787073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:30.788004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:30.788720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:30.789487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:30.806770 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95c50e70-1e80-4852-adc1-064724bafb89 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 11.192587 Oct 26 05:07:30.808794 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 817/1644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:19 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 11209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:30.819226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:30.819976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:30.847600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:30.849196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:30.850268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:30.857356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:30.858033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:30.870890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.323493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:31.329606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:31.339628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:31.341152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:31.342426 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-378c2bed-31e8-4dc7-9d68-85378aea31f2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.529467 Oct 26 05:07:31.344578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19f46e69-7dfa-4218-9a3f-e9099445e416 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1494 microversion: 2.1 time: 0.575584 Oct 26 05:07:31.345535 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 828/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:30 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1494 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:31.361620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:31.362435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:31.373839 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 818/1646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:30 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:31.376306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.377239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.379730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.380595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.382780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.383425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.410247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:31.414464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:31.453858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.454728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.455453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.456387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.457020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.457840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.746445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:31.761367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b0525948-df57-48b0-8c34-0d3c01a6804d tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1315 microversion: 2.1 time: 0.386265 Oct 26 05:07:31.761974 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 819/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:31 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:31.773303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "name": "network-vif-unplugged", "status": "completed", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:31.793595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.796298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.798894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.829982 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] Creating event network-vif-unplugged:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h1-862416-4 Oct 26 05:07:31.841628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] Instance d50939f7-1531-4640-8d2e-f2463ddc5219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:07:31.858623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:31.864299 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cd1f7292-5a70-4f68-a389-3cd81ce1b843 req-f68dd153-414a-4739-89e8-6ebbcf751fd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097481 Oct 26 05:07:31.865518 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 820/1648] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:31.871721 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f8eaad9-1c05-46f7-9902-0f6b4de39379 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1471 microversion: 2.1 time: 0.522458 Oct 26 05:07:31.872309 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 829/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:31 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:31.872687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-243cc846-55db-4e45-9da7-5f2d07f3910b req-018a93e9-6c83-41ab-bcac-384af9a1f6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a08188-ace3-46f4-955f-4e631a6ed9fd", "name": "network-vif-plugged", "status": "completed", "tag": "7b9cee30-9a11-4896-97a6-3d400bfbe9e8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:31.877114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-758966f1-d956-4200-a3f3-3e812261acfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a201430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:31.900497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-243cc846-55db-4e45-9da7-5f2d07f3910b req-018a93e9-6c83-41ab-bcac-384af9a1f6d4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.901295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-243cc846-55db-4e45-9da7-5f2d07f3910b req-018a93e9-6c83-41ab-bcac-384af9a1f6d4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.901952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-243cc846-55db-4e45-9da7-5f2d07f3910b req-018a93e9-6c83-41ab-bcac-384af9a1f6d4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.933445 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-243cc846-55db-4e45-9da7-5f2d07f3910b req-018a93e9-6c83-41ab-bcac-384af9a1f6d4 service nova] Creating event network-vif-plugged:7b9cee30-9a11-4896-97a6-3d400bfbe9e8 for instance 85a08188-ace3-46f4-955f-4e631a6ed9fd on n-h1-862416-4 Oct 26 05:07:31.941707 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-243cc846-55db-4e45-9da7-5f2d07f3910b req-018a93e9-6c83-41ab-bcac-384af9a1f6d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074660 Oct 26 05:07:31.942491 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 821/1650] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:31.948040 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-758966f1-d956-4200-a3f3-3e812261acfa tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 200 len: 1423 microversion: 2.1 time: 0.074354 Oct 26 05:07:31.948617 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 830/1651] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:31 2022] GET /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 1423 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:31.949220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:31.950286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:31.953342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-61ca2c91-34ab-48c9-a788-d8832bfa1016 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470ae25d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:31.957399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.958776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.959625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:31.960500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:31.961251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:31.961875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:32.024545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-61ca2c91-34ab-48c9-a788-d8832bfa1016 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.074600 Oct 26 05:07:32.025448 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 831/1652] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:31 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:32.030220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:32.030756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:32.051267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:32.051777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:32.052224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:32.052947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:32.053437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:32.053869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:32.159599 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4214a120-1472-4971-b7ad-18e0ccfecff2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1645 microversion: 2.1 time: 0.215704 Oct 26 05:07:32.178254 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 822/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:31 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1645 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:32.192683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16da58c3-720f-4111-84ae-6e084f86b129 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ea13430>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:32.283056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe203244-f6f4-4394-b278-d8f7bd1558fd tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "POST /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219/action" status: 202 len: 0 microversion: 2.1 time: 0.256253 Oct 26 05:07:32.283976 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 832/1654] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:32 2022] POST /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:07:32.289676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:32.292825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:32.307683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:32.308558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:32.309193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:32.314491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:32.315160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:32.315768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:32.580392 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f560089-75e7-44a2-919b-53fb1fd9c7bd tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1645 microversion: 2.1 time: 0.293652 Oct 26 05:07:32.581542 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 833/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:32 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1645 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:32.596671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:32.597650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:32.612659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:32.613738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:32.619736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:32.620906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:32.621719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:32.622322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.005397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:33.014415 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42a35045-d521-45b8-bd4a-eeea33cc7999 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.430854 Oct 26 05:07:33.015156 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 834/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:32 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:33.020670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:33.021632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:33.031680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.032615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.033395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.034364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.035391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.036055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.344391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:33.359578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:33.364120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:33.365542 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ec8451f-d225-47dd-b1cb-f277af321380 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.348970 Oct 26 05:07:33.366536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 835/1657] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:33 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:33.372246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:33.377344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.378130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.378725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.379678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.380305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.380970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.410478 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4830abe5-6028-4ca0-87f9-5665007ee82e tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042614 Oct 26 05:07:33.420258 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 836/1658] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:07:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:33.427854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:33.429147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:33.443727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.445839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.446824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.448217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.449789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.456227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.621406 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16da58c3-720f-4111-84ae-6e084f86b129 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 204 len: 0 microversion: 2.1 time: 1.439416 Oct 26 05:07:33.626232 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 823/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:32 2022] DELETE /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 0 bytes in 1443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:33.627377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb28d310-eee7-4a06-ac8f-9935bb5e5caf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8c1ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:33.680628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:33.691303 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e386863a-5191-498f-b904-0d3ffcee6648 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1315 microversion: 2.1 time: 0.269411 Oct 26 05:07:33.692138 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 837/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:33 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:33.696839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:33.697609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:33.704233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.704981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.705654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.706542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.707226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.707871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.719971 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb28d310-eee7-4a06-ac8f-9935bb5e5caf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.088592 Oct 26 05:07:33.719971 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 824/1661] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:33 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:33.723570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:33.725749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:33.748176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.752198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.753462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.754318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.759377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.760016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.815552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:07:33.830889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-775fa686-f40a-48c7-80e4-716d26a1f5d0 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b/action" status: 202 len: 0 microversion: 2.1 time: 0.135859 Oct 26 05:07:33.832952 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 838/1662] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:33 2022] POST /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:07:33.850075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:33.851112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:33.865242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.870391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.871259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:33.872405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:33.873070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:33.873807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:34.018504 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e48af20-e391-4dc2-9bcb-d4f770a16023 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 204 len: 0 microversion: 2.1 time: 0.301876 Oct 26 05:07:34.027540 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 825/1663] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:07:33 2022] DELETE /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:34.068905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:34.128995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:34.135589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:34.137107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:34.191386 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] Creating event network-changed:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h1-862416-4 Oct 26 05:07:34.213089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] Instance d50939f7-1531-4640-8d2e-f2463ddc5219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:07:34.253065 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-21a0bb04-aa93-49f2-a17f-02a208c689e4 req-70bd5407-8d95-4336-b52e-267b33d4080d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223801 Oct 26 05:07:34.261878 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 826/1664] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:34.265803 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-460bee99-b90d-4427-ae09-072c330bc2b1 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1650 microversion: 2.1 time: 0.427378 Oct 26 05:07:34.267459 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 839/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:33 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1650 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:34.278161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:34.280934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:34.288675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "name": "network-vif-plugged", "status": "completed", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:34.299217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:34.301301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:34.304132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:34.305846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:34.307856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:34.310274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:34.326800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:34.327119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:34.335582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:34.381850 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] Creating event network-vif-plugged:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h1-862416-4 Oct 26 05:07:34.392236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] Instance d50939f7-1531-4640-8d2e-f2463ddc5219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:07:34.407459 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3142f1bb-9cc7-4e41-803d-6f25be045a3f req-423449f5-6d38-4dfb-93e3-7a300d13de95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140261 Oct 26 05:07:34.408379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 827/1666] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:34.414104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1054033109", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "92d513bb-c446-48d6-b8f5-d149382fd9ca"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:34.500331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] validate_networks() for [('92d513bb-c446-48d6-b8f5-d149382fd9ca', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:07:34.703121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:34.717081 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dfcadbef-0ec2-4027-a8b9-824afa52d505 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.447477 Oct 26 05:07:34.719283 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 840/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:34 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:34.730802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:34.734253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:34.751518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:34.752363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:34.753034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:34.754337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:34.756974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:34.757977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.090367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:35.102043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:35.109021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:35.114407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ebc0444d-26f6-4121-b6f0-da59bc1f5f77 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.393754 Oct 26 05:07:35.119802 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 841/1668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:34 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:35.132295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:35.133260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:35.150784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.152707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.153878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.156026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.156519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.161831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.445290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:35.460202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c7f67ea-186f-430d-bef1-18a093c3e6a5 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1502 microversion: 2.1 time: 0.338615 Oct 26 05:07:35.462725 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 842/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:35 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:35.475421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3dbb359-c870-4233-8851-9aac18514a0e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1c0e50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:35.573881 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3dbb359-c870-4233-8851-9aac18514a0e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.109375 Oct 26 05:07:35.583540 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 843/1670] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:35 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:35.590048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:35.593915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:35.601446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.603213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.604282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.607346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.607829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.610238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.645138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:07:35.645690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:07:35.646469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:07:35.646994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:07:35.647708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:07:35.668175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.669135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.669900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.676159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.676761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.688445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.752310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:07:35.761776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for user 6390eed87d6a41df96e727227de791bb and project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:07:35.779944 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d36b8ed-174e-4e59-b861-dbf946af55ab tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1630 microversion: 2.1 time: 0.195023 Oct 26 05:07:35.780604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:07:35.785417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:07:35.786914 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 844/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:35 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1630 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:35.793249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:35.798571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:35.809904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.810393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.810732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.811446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.811908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.812339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.846185 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2e7736d8-fb83-4339-8e40-42783aca8bd0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436295 Oct 26 05:07:35.847407 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 828/1672] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:07:35.853743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:35.854605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:35.858582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:35.862695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.863439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.864092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:35.865033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:35.865728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:35.866392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.035649 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-625e6c72-fec8-4952-a2fe-d065088f0ea7 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "DELETE /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.247586 Oct 26 05:07:36.038429 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 845/1673] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 26 05:07:35 2022] DELETE /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd/os-server-password => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:36.051615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": true, "disk_over_commit": false}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:36.056919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:36.071614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.072616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.073243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.074231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.074867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.083898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.170486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lazy-loading 'flavor' on Instance uuid 968f8909-14e6-45b2-982a-2ca35d66232b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:36.179859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:36.192361 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b88707e-db94-4711-960e-1d4ce504978a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.340300 Oct 26 05:07:36.193245 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 829/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:35 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:36.224283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c6ece7c-2d94-46be-be3c-6c8693539908 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:36.224283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c6ece7c-2d94-46be-be3c-6c8693539908 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:36.229910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Going to try to live migrate instance to n-h2-862416-4 {{(pid=120586) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:07:36.379742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c6ece7c-2d94-46be-be3c-6c8693539908 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:36.388022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c6ece7c-2d94-46be-be3c-6c8693539908 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1208 microversion: 2.1 time: 0.192348 Oct 26 05:07:36.392065 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 830/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:36 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1208 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:36.399430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:36.416576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:36.429869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.433817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.435188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.437461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.438968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.440236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.514360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f9defd6f-23cd-4a4c-9567-ce1eeb713d53 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.114869 Oct 26 05:07:36.515442 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 831/1676] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 26 05:07:36 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd/os-server-password => generated 16 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:07:36.527867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:36.528684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:36.546270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.548519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.550515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.552301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.553967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.558053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.777182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:36.789560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:36.792079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:36.793751 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa891640-d540-49a2-be11-416344ed6c4b tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.276764 Oct 26 05:07:36.794959 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 832/1677] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:36 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:36.799797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d258499b-f98a-4a40-b199-d9cafa7c6465 req-f6314e96-fdc5-4c7d-86af-211d0dabf8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3631f7b3-349e-43e1-8d4f-128ddb274ee8", "name": "network-vif-unplugged", "status": "completed", "tag": "8e51ca90-1775-48fe-979a-365eabcef0bb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:36.819878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d258499b-f98a-4a40-b199-d9cafa7c6465 req-f6314e96-fdc5-4c7d-86af-211d0dabf8b8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.824318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d258499b-f98a-4a40-b199-d9cafa7c6465 req-f6314e96-fdc5-4c7d-86af-211d0dabf8b8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.824920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d258499b-f98a-4a40-b199-d9cafa7c6465 req-f6314e96-fdc5-4c7d-86af-211d0dabf8b8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.853057 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d258499b-f98a-4a40-b199-d9cafa7c6465 req-f6314e96-fdc5-4c7d-86af-211d0dabf8b8 service nova] Creating event network-vif-unplugged:8e51ca90-1775-48fe-979a-365eabcef0bb for instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 on n-h2-862416-4 Oct 26 05:07:36.866768 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d258499b-f98a-4a40-b199-d9cafa7c6465 req-f6314e96-fdc5-4c7d-86af-211d0dabf8b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070254 Oct 26 05:07:36.867730 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 833/1678] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:36.879383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:36.883338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:36.900345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.900878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.901377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.902104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:36.902562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:36.903045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:36.983020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:07:37.249259 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4427ec22-122f-45d4-8d6c-213b0ce2f89b tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "DELETE /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 204 len: 0 microversion: 2.1 time: 0.378046 Oct 26 05:07:37.257867 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 834/1679] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:07:36 2022] DELETE /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:37.280452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d23bb23-1ef0-410f-96a8-4b15bd9f6dcb tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a937550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:37.389692 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d23bb23-1ef0-410f-96a8-4b15bd9f6dcb tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.129412 Oct 26 05:07:37.399988 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 835/1680] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:37 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:37.414195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:37.416280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:37.435164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:37.435992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:37.440214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:37.441339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:37.442423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:37.443090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:37.783101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:37.809837 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e86f8287-c451-4c5e-97c1-e0c475e73db6 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.406867 Oct 26 05:07:37.815157 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 836/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:37 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:37.827007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:37.828219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:37.835457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:37.836365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:37.838063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:37.839067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:37.840092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:37.840710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:38.089501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:38.111140 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3de9d644-5924-414d-a0bd-4611903e94cd tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1508 microversion: 2.1 time: 0.292967 Oct 26 05:07:38.112032 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 837/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:37 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:38.117138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:38.117778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:38.133648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:38.140419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:38.141288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:38.144732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:38.145682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:38.146308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:38.228344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:38.372790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:38.385479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9fcd2b8-b659-4726-9e34-64c0c40f5a29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1260 microversion: 2.1 time: 0.272190 Oct 26 05:07:38.402028 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 838/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:38 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:38.409170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:38.410092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:38.418725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:38.419505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:38.420166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:38.421065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:38.421740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:38.422909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:39.218308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:39.235565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:39.237132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:39.259320 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6345d8f0-134d-45ad-b554-2a9b0857ed09 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.855693 Oct 26 05:07:39.259951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 839/1684] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:38 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:39.287772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a7fe7d0-002c-40a4-9d85-b99aee562e75 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8dadc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:39.360022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a7fe7d0-002c-40a4-9d85-b99aee562e75 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1453 microversion: 2.1 time: 0.098909 Oct 26 05:07:39.360603 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 840/1685] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:39 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:39.391992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:39.402167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:39.413373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:39.414008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:39.414558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:39.415604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:39.416223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:39.416871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.200020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:40.210467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1617be86-ba10-4ff9-be07-1239751982fb tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.831091 Oct 26 05:07:40.211641 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 841/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:39 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:40.219483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-eb01fcec-dd86-4c3d-9b5c-779fbfdd9933 req-69f5f26b-dfda-4425-87e5-675700e280a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3631f7b3-349e-43e1-8d4f-128ddb274ee8", "name": "network-vif-deleted", "tag": "8e51ca90-1775-48fe-979a-365eabcef0bb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:40.237306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eb01fcec-dd86-4c3d-9b5c-779fbfdd9933 req-69f5f26b-dfda-4425-87e5-675700e280a2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.239579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eb01fcec-dd86-4c3d-9b5c-779fbfdd9933 req-69f5f26b-dfda-4425-87e5-675700e280a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.240519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eb01fcec-dd86-4c3d-9b5c-779fbfdd9933 req-69f5f26b-dfda-4425-87e5-675700e280a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.258430 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-eb01fcec-dd86-4c3d-9b5c-779fbfdd9933 req-69f5f26b-dfda-4425-87e5-675700e280a2 service nova] Creating event network-vif-deleted:8e51ca90-1775-48fe-979a-365eabcef0bb for instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 on n-h2-862416-4 Oct 26 05:07:40.265372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-eb01fcec-dd86-4c3d-9b5c-779fbfdd9933 req-69f5f26b-dfda-4425-87e5-675700e280a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050424 Oct 26 05:07:40.267064 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 842/1687] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:40.273450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:40.274567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:40.294844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.295992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.297090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.298126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.299358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.300085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.657404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:40.668478 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0243d20a-1b07-4f3f-8314-be7abbdc6771 tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1508 microversion: 2.1 time: 0.399792 Oct 26 05:07:40.688184 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 843/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:40 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:40.693538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:40.702298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:40.716957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.717755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.718395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.719344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.719977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.720566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.821143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:40.838514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af18c0f1-5c30-481a-912b-f2c74a234f87 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1266 microversion: 2.1 time: 0.148880 Oct 26 05:07:40.839729 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 844/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:40 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:40.850198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2808f1ce-9af8-486c-b331-8df620a3f669 req-d845585c-e198-46c5-a393-fa42e72ac7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a08188-ace3-46f4-955f-4e631a6ed9fd", "name": "network-vif-unplugged", "status": "completed", "tag": "7b9cee30-9a11-4896-97a6-3d400bfbe9e8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:40.865229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2808f1ce-9af8-486c-b331-8df620a3f669 req-d845585c-e198-46c5-a393-fa42e72ac7d7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.865748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2808f1ce-9af8-486c-b331-8df620a3f669 req-d845585c-e198-46c5-a393-fa42e72ac7d7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.866186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2808f1ce-9af8-486c-b331-8df620a3f669 req-d845585c-e198-46c5-a393-fa42e72ac7d7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.888991 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2808f1ce-9af8-486c-b331-8df620a3f669 req-d845585c-e198-46c5-a393-fa42e72ac7d7 service nova] Creating event network-vif-unplugged:7b9cee30-9a11-4896-97a6-3d400bfbe9e8 for instance 85a08188-ace3-46f4-955f-4e631a6ed9fd on n-h1-862416-4 Oct 26 05:07:40.911366 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2808f1ce-9af8-486c-b331-8df620a3f669 req-d845585c-e198-46c5-a393-fa42e72ac7d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069854 Oct 26 05:07:40.912256 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 845/1690] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:40.922413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:40.923135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:40.929597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.930363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.931737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:40.932749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:40.933936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:40.934382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:41.268453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:41.281958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:41.287243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:41.288574 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a124e9c-57dc-4f40-ad38-e2d3e8ca93b9 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.375078 Oct 26 05:07:41.292017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 846/1691] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:40 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:41.305613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc126811-eb4f-47bb-8a33-b48246741d53 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8c1dc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:41.386772 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc126811-eb4f-47bb-8a33-b48246741d53 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1462 microversion: 2.1 time: 0.092787 Oct 26 05:07:41.387374 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 847/1692] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:41 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:41.526868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-854114187", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "1b69c2ce-96da-4953-b60d-2a85ab190963"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:41.613295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] validate_networks() for [('1b69c2ce-96da-4953-b60d-2a85ab190963', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:07:42.157158 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34a111b6-bcb6-42b7-9409-b8ed39a1438a tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b/action" status: 202 len: 0 microversion: 2.1 time: 6.116595 Oct 26 05:07:42.159092 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 846/1693] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:36 2022] POST /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b/action => generated 0 bytes in 6120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:07:42.170342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:42.171375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:42.193296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:42.196528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:42.200289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:42.201303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:42.202077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:42.202754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:42.803484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:07:42.804762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:07:42.804762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:07:42.805287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:07:42.805838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:07:42.820537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:42.822795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:42.823626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:42.824622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:42.825481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:42.826143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:42.852195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Getting quotas for project affce5ab3801486298f7dc3b8bed6000. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:07:42.861518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Getting quotas for user 7021f7e236d64e70aa73f3184fb597e2 and project affce5ab3801486298f7dc3b8bed6000. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:07:42.904709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:07:42.911451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:07:42.958777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:42.975728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e10fecfa-081b-4d0f-a8b5-3cd2b2669fb3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.814991 Oct 26 05:07:42.976339 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 847/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:42 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:42.986990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8fa0769-51a5-4b3c-b722-8999c713ae58 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.592091 Oct 26 05:07:42.988760 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 848/1695] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:07:42.995043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:42.996214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:43.013810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aefd281f-615f-44d6-bd0e-2ff8a24a1f6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a77dca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:43.015625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.022098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.022587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.027049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.028323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.031298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.139918 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aefd281f-615f-44d6-bd0e-2ff8a24a1f6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 200 len: 1462 microversion: 2.1 time: 0.159302 Oct 26 05:07:43.143852 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 848/1696] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:42 2022] GET /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:43.159628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:43.170149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:43.195828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.196703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.199008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.201079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.202183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.203125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.207667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lazy-loading 'fault' on Instance uuid 85a08188-ace3-46f4-955f-4e631a6ed9fd {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:43.208352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.209121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.217353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.346274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9587c8a44e4a0d96b0e9efc7bfbe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a841c0d671e0484682485e4dc43960cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:43.363207 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf31e766-9aeb-4ab9-974d-ada3d96e5c0e tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 200 len: 1305 microversion: 2.1 time: 0.372827 Oct 26 05:07:43.363717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 849/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:42 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 1305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:43.382105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:43.383227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:43.391454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:43.396862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:43.432775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.435125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.435625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.436374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.436847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.437262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.875078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:43.902304 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56f6f08d-64ba-4970-8f4b-90c77406e7f4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.755166 Oct 26 05:07:43.903000 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 849/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:43 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:43.921675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:43.939060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:43.939722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:43.942122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f948b79e-d834-4eca-bf05-a43e08f6a494 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.567605 Oct 26 05:07:43.943449 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 850/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:43 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:43.952659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afdec39-d5c9-4e87-b528-7227a49580e5", "name": "network-vif-unplugged", "status": "completed", "tag": "18a6c1cd-7330-433a-8098-880895a40bb1"}, {"name": "network-changed", "server_uuid": "0afdec39-d5c9-4e87-b528-7227a49580e5", "tag": "18a6c1cd-7330-433a-8098-880895a40bb1"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:43.974650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.975131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.975576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.976859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.977659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.978315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.978907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:43.979400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:43.979843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:43.998162 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] Creating event network-vif-unplugged:18a6c1cd-7330-433a-8098-880895a40bb1 for instance 0afdec39-d5c9-4e87-b528-7227a49580e5 on n-h1-862416-4 Oct 26 05:07:44.003043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] Creating event network-changed:18a6c1cd-7330-433a-8098-880895a40bb1 for instance 0afdec39-d5c9-4e87-b528-7227a49580e5 on n-h1-862416-4 Oct 26 05:07:44.021969 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-89a83f33-0d3b-41be-a3ee-d4df81fb4a0d req-a2c2cf59-9dc1-4f69-aedc-24f3f5883055 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.072512 Oct 26 05:07:44.023100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 851/1700] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:44.053375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "name": "network-vif-unplugged", "status": "completed", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:44.076213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.077198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.078325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.097200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] Creating event network-vif-unplugged:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h2-862416-4 Oct 26 05:07:44.105452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] Instance d50939f7-1531-4640-8d2e-f2463ddc5219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:07:44.126944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4fd61b5d-3bed-4741-bcbb-72d04b0e027a req-5af091cd-efc7-4d29-a5f6-ab09ee5c850a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100246 Oct 26 05:07:44.128278 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 852/1701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:44.137476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:44.138534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:44.148765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.151208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.151994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.152919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.159202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.159925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.260311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:44.268770 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-52f19336-cba7-4bd9-9231-3cde81dbb47c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1235 microversion: 2.1 time: 0.139027 Oct 26 05:07:44.269409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 853/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:44 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1235 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:44.312392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:44.314012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:44.328638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.333584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.334278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.335029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.335492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.335924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.452184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:44.481495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:44.483405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:44.488561 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-466f6423-9330-40b1-9b1e-16c705c68f7f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.563949 Oct 26 05:07:44.494390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 850/1703] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:43 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:44.499397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-cd8dbbe6-cf14-403d-8a56-a5c141bc3e4c req-5d9a970b-d680-4b80-ae15-78ef4bd260aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1009243c-75eb-4ae9-9c19-1993034b9935", "tag": "65506aae-0853-4ba6-bfb3-845cc1057a42"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:44.536275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cd8dbbe6-cf14-403d-8a56-a5c141bc3e4c req-5d9a970b-d680-4b80-ae15-78ef4bd260aa service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.537087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cd8dbbe6-cf14-403d-8a56-a5c141bc3e4c req-5d9a970b-d680-4b80-ae15-78ef4bd260aa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.539271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cd8dbbe6-cf14-403d-8a56-a5c141bc3e4c req-5d9a970b-d680-4b80-ae15-78ef4bd260aa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.566275 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-cd8dbbe6-cf14-403d-8a56-a5c141bc3e4c req-5d9a970b-d680-4b80-ae15-78ef4bd260aa service nova] Creating event network-changed:65506aae-0853-4ba6-bfb3-845cc1057a42 for instance 1009243c-75eb-4ae9-9c19-1993034b9935 on n-h2-862416-4 Oct 26 05:07:44.577104 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-cd8dbbe6-cf14-403d-8a56-a5c141bc3e4c req-5d9a970b-d680-4b80-ae15-78ef4bd260aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081162 Oct 26 05:07:44.577974 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 851/1704] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:44.586606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:44.588958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:44.596835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.597890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.598494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.599374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.600095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.602373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.650087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:44.658939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4aeccb0b-bde7-4908-ba71-eeb201ba7fa7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1468 microversion: 2.1 time: 0.356084 Oct 26 05:07:44.659557 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 854/1705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:44 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:44.665415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:44.666233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] [instance: 85a08188-ace3-46f4-955f-4e631a6ed9fd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:44.672864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.673654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.674286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.676314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.676955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.677584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.697194 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] HTTP exception thrown: Instance 85a08188-ace3-46f4-955f-4e631a6ed9fd could not be found. Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Request method failure captured: Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd HTTP/1.1 Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMB-oHuoPl55hWc7HqSUgKkamNVzX3077bzbEE36X0li-bx4LbV3mu2f86HeMJsNjt0dIJJ8qUB1-BrV9rEqdSQTxb_hI4sL3p-C1iAVKtdurPLdc27chZt-q_5idJ0bbiG4MI5F6BKi9x9Sk5pEffio6I62of6youCfBbGka4DUV4w Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a841c0d671e0484682485e4dc43960cb Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerPasswordTestJSON-1623391317 Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:07:44.699170 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a841c0d671e0484682485e4dc43960cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a841c0d671e0484682485e4dc43960cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a841c0d671e0484682485e4dc43960cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a841c0d671e0484682485e4dc43960cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerPasswordTestJSON-1623391317 Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a841c0d671e0484682485e4dc43960cb Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1623391317 Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerPasswordTestJSON-1623391317-project Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5b9587c8a44e4a0d96b0e9efc7bfbe33 Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerPasswordTestJSON-1623391317-project Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 85a08188-ace3-46f4-955f-4e631a6ed9fd could not be found. Oct 26 05:07:44.700745 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '85a08188-ace3-46f4-955f-4e631a6ed9fd'} Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a08188-ace3-46f4-955f-4e631a6ed9fd could not be found. Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:07:44.702828 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a08188-ace3-46f4-955f-4e631a6ed9fd could not be found. Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a08188-ace3-46f4-955f-4e631a6ed9fd could not be found. Oct 26 05:07:44.705387 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:07:44.708927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] Returning 404 to user: Instance 85a08188-ace3-46f4-955f-4e631a6ed9fd could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:07:44.708927 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c208a195-965a-4a61-a2eb-64d51252060f tempest-ServerPasswordTestJSON-1623391317 tempest-ServerPasswordTestJSON-1623391317-project] 10.222.0.16 "GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd" status: 404 len: 111 microversion: 2.1 time: 0.039903 Oct 26 05:07:44.708927 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 855/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:44 2022] GET /compute/v2.1/servers/85a08188-ace3-46f4-955f-4e631a6ed9fd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:07:44.710985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1566206237"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:44.713683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:44.723691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.724440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.725052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.726188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.726649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.727081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.814856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:44.824422 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cdacff25-18d3-4b0a-af1f-da59d4013b0e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.244892 Oct 26 05:07:44.826359 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 852/1707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:44 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:44.932457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:44.933185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:44.943509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.944325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.944942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.945943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:44.947438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:44.947943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:44.974853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-78cdb347-b238-442b-b5ba-fc349ea5e972 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "POST /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70/action" status: 202 len: 0 microversion: 2.1 time: 0.267898 Oct 26 05:07:44.975701 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 856/1708] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:07:44 2022] POST /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:07:44.992166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:44.994788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:45.002513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.003021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.003468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.004409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.005143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.005795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.189706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:45.198247 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-11b23e54-2f5d-4f43-9622-88c3fc6340cd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.271073 Oct 26 05:07:45.198985 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 853/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:44 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:45.204711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69442df6-db50-47d5-afd9-e39a7d4eb5a9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a77d940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:45.259911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:45.261682 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69442df6-db50-47d5-afd9-e39a7d4eb5a9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.060834 Oct 26 05:07:45.266868 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 854/1710] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:45 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:45.273427 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50bc7315-1e79-4db2-b3d7-178c1f49d8fb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.288530 Oct 26 05:07:45.275039 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 857/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:44 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:45.296619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:45.297345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:45.304964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.305527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.306104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.307018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.307476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.308184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.386479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:45.395945 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-401030a0-ab65-4e65-94a0-45e42e9eeaf8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1301 microversion: 2.1 time: 0.103401 Oct 26 05:07:45.397242 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 855/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:45 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:45.519383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:45.520184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:45.529037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.529665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.530187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.531041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.531503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.531934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.697069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:45.706424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:45.708051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:45.709226 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0330cec4-563d-41df-abb1-e99b574cb8ed tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.195652 Oct 26 05:07:45.709885 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 858/1713] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:45 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:45.848197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:45.848821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:45.863112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.865296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.865663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:45.867592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:45.869343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:45.869803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.054259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.064027 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc71dd22-c019-428c-947b-28e9d2e3bf47 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.219872 Oct 26 05:07:46.065712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 856/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:45 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:46.084923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a08188-ace3-46f4-955f-4e631a6ed9fd", "name": "network-vif-deleted", "tag": "7b9cee30-9a11-4896-97a6-3d400bfbe9e8"}, {"name": "network-changed", "server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:46.097547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.098830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.099483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.105115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:46.116043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Creating event network-vif-deleted:7b9cee30-9a11-4896-97a6-3d400bfbe9e8 for instance 85a08188-ace3-46f4-955f-4e631a6ed9fd on n-h1-862416-4 Oct 26 05:07:46.116867 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Creating event network-changed:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h2-862416-4 Oct 26 05:07:46.125875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] Instance d50939f7-1531-4640-8d2e-f2463ddc5219 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:07:46.145835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-793ad416-1f97-4c47-b084-b8e3aa8d2035 req-0f4542ca-9b56-4647-b1ad-1363c8e3e203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "name": "network-vif-unplugged", "status": "completed", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:46.162288 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c6e8fad2-bb6e-450b-807e-ebf73ede9a3e req-f0c43e06-8bf0-4a44-a149-a9ac58da0d69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080806 Oct 26 05:07:46.162894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-793ad416-1f97-4c47-b084-b8e3aa8d2035 req-0f4542ca-9b56-4647-b1ad-1363c8e3e203 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.163704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-793ad416-1f97-4c47-b084-b8e3aa8d2035 req-0f4542ca-9b56-4647-b1ad-1363c8e3e203 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.163860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 859/1715] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:46.164846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-793ad416-1f97-4c47-b084-b8e3aa8d2035 req-0f4542ca-9b56-4647-b1ad-1363c8e3e203 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.178863 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-793ad416-1f97-4c47-b084-b8e3aa8d2035 req-0f4542ca-9b56-4647-b1ad-1363c8e3e203 service nova] Creating event network-vif-unplugged:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:07:46.184531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-793ad416-1f97-4c47-b084-b8e3aa8d2035 req-0f4542ca-9b56-4647-b1ad-1363c8e3e203 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043589 Oct 26 05:07:46.185346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 857/1716] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:46.227594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:46.228663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:46.235557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.236102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.236672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.237528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.238108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.238615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.278744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6241561e-546c-4a1e-9152-b8a95b0e60a4 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a2179d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:46.362472 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6241561e-546c-4a1e-9152-b8a95b0e60a4 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.088006 Oct 26 05:07:46.363937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 858/1717] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:46 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:46.370601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:46.371712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:46.380543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.381485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.382160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.383122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.384148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.384819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.428113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.449735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4f89339-de7b-4f6c-9af5-a3e8ae5938da tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.229747 Oct 26 05:07:46.464947 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 860/1718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:46 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:46.464947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:46.464947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:46.472931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.473658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.475279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.476383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.476553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.476964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.588306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.601502 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f09da2e2-c0ba-415d-85d0-d66f4d5606a1 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1289 microversion: 2.1 time: 0.149195 Oct 26 05:07:46.615373 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 861/1719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:46 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1289 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:46.635446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.644329 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1306607-0389-4800-82b2-cca9a9568bf3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.279055 Oct 26 05:07:46.645425 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 859/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:46 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:46.740536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:46.741154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:46.748461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.749422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.749951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.750762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:46.751310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:46.751988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:46.911355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.926419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.928706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:46.930439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4570a093-39cb-4a85-9955-94541b9b53bb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.194034 Oct 26 05:07:46.944146 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 862/1721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:46 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:47.093788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:47.095841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:47.105091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.105983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.106484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.107394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.107967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.108531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.279346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:47.288004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01a07abe-50b2-4d18-b760-11d14bc6ffb4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.199300 Oct 26 05:07:47.288604 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 860/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:47 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:47.379399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e91f9407-d703-4e49-94bd-c4d597fc7829 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8ff430>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:47.436536 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e91f9407-d703-4e49-94bd-c4d597fc7829 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.060971 Oct 26 05:07:47.437568 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 863/1723] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:47 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:47.472315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:47.473114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:47.480476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.481303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.482209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.483145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.483972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.484632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.628483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:47.629561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:47.639424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.640312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.641271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.642487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.643329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.644010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.757941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:47.771306 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8edae35d-8b86-4250-b767-ef70d7a95e63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.303062 Oct 26 05:07:47.792334 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 861/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:47 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:47.799635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:47.800812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:47.808905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.809748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.810361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.811409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.812962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.813643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.862741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:47.874722 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7d517bf6-b513-4962-a2ac-364cb26c6105 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.250503 Oct 26 05:07:47.875532 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 864/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:47 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:07:47.968179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:47.968959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:47.978630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.979409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.980412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.982553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:47.983228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:47.983843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:47.988445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:47.996776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1134b5a6-7bc1-4799-90cc-29c12e65ff7c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.201782 Oct 26 05:07:47.998550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 862/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:47 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:48.134905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:48.144606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:48.146760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:48.148330 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc7f0fa9-68e4-4693-9c6c-51389d6785d0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.191547 Oct 26 05:07:48.150390 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 865/1727] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:47 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:48.313972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:48.314609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:48.323206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:48.323841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:48.324378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:48.325173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:48.326183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:48.326702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:48.330716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:48.455573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-986d5570-4a96-41a5-b654-f4c7479e6dc4 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eb15e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:48.538258 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-986d5570-4a96-41a5-b654-f4c7479e6dc4 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.089139 Oct 26 05:07:48.554205 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 866/1728] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:48 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:48.667312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:48.692662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d4bd2a22-a174-48b1-a0b9-b2f7c6687daa tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.382319 Oct 26 05:07:48.694523 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 863/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:48 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:48.802035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:48.803060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:48.815524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:48.816337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:48.816799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:48.817541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:48.818159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:48.818738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:48.900602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:48.901563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:48.917076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:48.919082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:48.920466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:48.924638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:48.925655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:48.928506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:49.454770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:49.470621 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de4c32a4-ab3e-471e-a301-609148e1614f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.571177 Oct 26 05:07:49.471946 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 864/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:48 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:49.493880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:49.494642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:49.503690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:49.515932 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e1905896-a0a4-415c-bd27-3c939734c37f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.719701 Oct 26 05:07:49.536884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:49.538156 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 867/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:48 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:49.541939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:49.543564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:49.547246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:49.549763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:49.550496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:49.551794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:49.556455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:49.572284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:49.575756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:49.577870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:49.579015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:49.581168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:49.582920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:49.956929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:49.969883 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d88b7bff-4c4a-4821-9158-29cf06d883ec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.493673 Oct 26 05:07:49.985343 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 865/1732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:49 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:49.986085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0350b4ae-5265-420f-964e-34b2e84e297d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1830d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:50.047371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:50.079071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:50.080050 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0350b4ae-5265-420f-964e-34b2e84e297d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.105458 Oct 26 05:07:50.081131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 866/1733] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:49 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:50.099315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:50.105603 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a013fbc7-ee6a-4370-a671-ecf4ea1c5a20 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.565836 Oct 26 05:07:50.121337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 868/1734] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:49 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:50.121603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:50.121603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:50.121603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.121603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.122042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:50.122042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.122299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.123689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:50.215341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1225197e-6543-4167-b934-eeb2f6da1ad2 req-8d93ce61-c593-46f1-ba56-41b0f14da3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88432c1e-38bd-4136-9442-edbf5e85b261", "tag": "c48fca7c-54af-40f1-a347-5c4142210586"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:50.235594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1225197e-6543-4167-b934-eeb2f6da1ad2 req-8d93ce61-c593-46f1-ba56-41b0f14da3fc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.236774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1225197e-6543-4167-b934-eeb2f6da1ad2 req-8d93ce61-c593-46f1-ba56-41b0f14da3fc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.237551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1225197e-6543-4167-b934-eeb2f6da1ad2 req-8d93ce61-c593-46f1-ba56-41b0f14da3fc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:50.258177 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1225197e-6543-4167-b934-eeb2f6da1ad2 req-8d93ce61-c593-46f1-ba56-41b0f14da3fc service nova] Creating event network-changed:c48fca7c-54af-40f1-a347-5c4142210586 for instance 88432c1e-38bd-4136-9442-edbf5e85b261 on n-h1-862416-4 Oct 26 05:07:50.263835 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1225197e-6543-4167-b934-eeb2f6da1ad2 req-8d93ce61-c593-46f1-ba56-41b0f14da3fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054998 Oct 26 05:07:50.271461 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 869/1735] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:07:50.360580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:50.370066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7f0774a-5919-4e98-bc4e-167ab78fede3 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.272613 Oct 26 05:07:50.382095 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 867/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:50 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:50.496451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:50.497431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:50.509730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.512611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.514196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:50.516457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.518913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.522395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:50.541138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:50.542467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:50.558198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.563312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.569412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:50.570472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:50.575169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:50.575915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.296392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:51.311464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:51.314308 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0601f8de-b73d-4ba3-bbc2-2b1d361321f7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.768671 Oct 26 05:07:51.324625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19bf052b-1cda-4d50-936f-c18063ec38e4 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.833531 Oct 26 05:07:51.331023 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 868/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:50 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:51.338161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7f6bbfab-a57a-4242-bd6e-ead8ef6ad075 req-67e7425a-31af-4539-b192-37c8b3cd8dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1775471-ce05-493c-8ec3-03ef2f475e70", "name": "network-vif-plugged", "status": "completed", "tag": "09ae13fc-660e-48a5-9396-5902986e5f6c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:51.338956 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 870/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:50 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:51.347497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:51.348487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:51.351932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7f6bbfab-a57a-4242-bd6e-ead8ef6ad075 req-67e7425a-31af-4539-b192-37c8b3cd8dd1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.352694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7f6bbfab-a57a-4242-bd6e-ead8ef6ad075 req-67e7425a-31af-4539-b192-37c8b3cd8dd1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.353501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7f6bbfab-a57a-4242-bd6e-ead8ef6ad075 req-67e7425a-31af-4539-b192-37c8b3cd8dd1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.355224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.355990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.356665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.357617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.358627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.359640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.369418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7f6bbfab-a57a-4242-bd6e-ead8ef6ad075 req-67e7425a-31af-4539-b192-37c8b3cd8dd1 service nova] Creating event network-vif-plugged:09ae13fc-660e-48a5-9396-5902986e5f6c for instance c1775471-ce05-493c-8ec3-03ef2f475e70 on n-h1-862416-4 Oct 26 05:07:51.374859 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7f6bbfab-a57a-4242-bd6e-ead8ef6ad075 req-67e7425a-31af-4539-b192-37c8b3cd8dd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042317 Oct 26 05:07:51.375462 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 869/1739] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:51.384768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26b0bbd2-e677-4c37-b202-e5a5092648c1 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1e1700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:51.435969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26b0bbd2-e677-4c37-b202-e5a5092648c1 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.056255 Oct 26 05:07:51.436550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 870/1740] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:51 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:51.444318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:51.444318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:51.450516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.451018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.451661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.452498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.452952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.453527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.795667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:51.806876 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b817453-7409-40bd-a134-7626ecfb0eab tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.465286 Oct 26 05:07:51.807469 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 871/1741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:51 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:51.822286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:51.825591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:51.843678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.844404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.847465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:51.848456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:51.849085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:51.855933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:52.038473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:52.053354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:52.057193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:52.059802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-048507ab-5d02-49f6-b979-368e0790d838 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.622271 Oct 26 05:07:52.065217 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 871/1742] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:51 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:52.298203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:52.308306 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1354633-6b7a-4047-8684-3d7f11478627 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1470 microversion: 2.1 time: 0.490860 Oct 26 05:07:52.317785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 872/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:51 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:52.350349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:52.350990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:52.356783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:52.358069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:52.361791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:52.362524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:52.363154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:52.364026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:52.364646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:52.365238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:52.372848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:52.373529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:52.374251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:52.375217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:52.375901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:52.377848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:52.826581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:52.836804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:52.843937 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbee09f5-e012-4af4-8d3d-473a61b646ab tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.495821 Oct 26 05:07:52.854938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 873/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:52 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:07:52.876169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f42aed46-c756-4b33-9db1-e386771445bf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470e9f24c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:52.913895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=14 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:52.944503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:52.953935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cbc1e6fa-5d67-4501-acab-e8515143f5a2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.614986 Oct 26 05:07:52.955908 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 872/1745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:52 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:52.966058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:52.976186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:52.980181 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f42aed46-c756-4b33-9db1-e386771445bf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.118956 Oct 26 05:07:52.980812 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 874/1746] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:52 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:53.003722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.005934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.006398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.007149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.007615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.014369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.092363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:53.092986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:53.107301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.107808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.108249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.108975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.109479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.109916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.332562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:53.352744 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d227a863-b6ea-498a-9269-1f74cad23bcb tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.394458 Oct 26 05:07:53.374666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 873/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:52 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:53.381752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:53.382624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:53.389586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.390301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.390910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.391813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.392454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.393051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.754525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:53.778582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:53.781603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:53.788994 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fb53a12-15cb-4e42-8c9a-2e0bd4946d1f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1488 microversion: 2.25 time: 0.700887 Oct 26 05:07:53.792008 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 875/1748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:53 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1488 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:53.801021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-70825e65-d03a-4b34-8c7f-3c70b4389dbf req-1b8791a3-68b9-4840-a8d7-b8f8d0712473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "name": "network-vif-plugged", "status": "completed", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:53.826142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70825e65-d03a-4b34-8c7f-3c70b4389dbf req-1b8791a3-68b9-4840-a8d7-b8f8d0712473 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.827027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70825e65-d03a-4b34-8c7f-3c70b4389dbf req-1b8791a3-68b9-4840-a8d7-b8f8d0712473 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.828239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70825e65-d03a-4b34-8c7f-3c70b4389dbf req-1b8791a3-68b9-4840-a8d7-b8f8d0712473 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.866566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-70825e65-d03a-4b34-8c7f-3c70b4389dbf req-1b8791a3-68b9-4840-a8d7-b8f8d0712473 service nova] Creating event network-vif-plugged:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h2-862416-4 Oct 26 05:07:53.882714 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-70825e65-d03a-4b34-8c7f-3c70b4389dbf req-1b8791a3-68b9-4840-a8d7-b8f8d0712473 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089190 Oct 26 05:07:53.884036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 876/1749] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:53.891148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:53.894629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:53.902309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.903192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.904274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.906892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:53.907586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:53.908427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:53.982787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:53.996864 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56d4b73d-9572-4253-8f89-40ca742460e1 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1463 microversion: 2.1 time: 0.620680 Oct 26 05:07:53.997594 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 874/1750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:53 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1463 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:54.002367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:54.003236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:54.010380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:54.011140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:54.011806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:54.012714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:54.013444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:54.014209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:54.375854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:54.388330 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fe66f5d1-6174-46f6-aa8f-a324a66a3327 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.502762 Oct 26 05:07:54.389100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 877/1751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:53 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:54.405820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0db635dc-e340-4ba1-a49c-e8bb2aaf0938 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eb15c10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:54.480855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:54.492232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0db635dc-e340-4ba1-a49c-e8bb2aaf0938 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.102245 Oct 26 05:07:54.493667 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 878/1752] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:54 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:54.495683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0c7215f2-43e7-46b9-bcae-27429035d41f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.496771 Oct 26 05:07:54.497075 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 875/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:53 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:54.502229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:54.503740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:54.523024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:54.523735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:54.525438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:54.529621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:54.532754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:54.533211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:54.643992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:54.645093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:54.653056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:54.653792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:54.654436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:54.655503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:54.656231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:54.656869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:54.950027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:54.961751 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99cb4cc6-171f-4410-9ea0-36d1883fbfaa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.463130 Oct 26 05:07:54.981863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 876/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:54 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:54.990831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:54.991816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:55.002165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.002936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.008838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.010141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.011171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.011623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.039703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef600ffb-1b7a-4e45-891b-e2e9b0923d09 tempest-MigrationsAdminTest-1157675081 tempest-MigrationsAdminTest-1157675081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1614 microversion: 2.1 time: 0.542877 Oct 26 05:07:55.042156 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 879/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:54 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1614 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:55.078429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:55.079374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:55.087068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.087947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.088618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.090206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.090988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.091662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.127925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:07:55.204648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:55.317503 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-703b2cbf-9271-48af-898d-e5a4e089c9b4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 204 len: 0 microversion: 2.1 time: 0.247242 Oct 26 05:07:55.319828 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 880/1756] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:07:55 2022] DELETE /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:07:55.338709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:55.339456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:55.352827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.353362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.353804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.354526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.358004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.358499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.390329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:55.403586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:55.405911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:55.407733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46267496-4d56-4836-954d-9cdd329234eb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1478 microversion: 2.25 time: 0.424487 Oct 26 05:07:55.408859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 877/1757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:54 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1478 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:55.417913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:55.418894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:55.428038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.428935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.430440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.431671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.432585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.440260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.742137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:55.761035 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff06a43d-a88a-4fb3-84ef-7dd8add019cc tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.346310 Oct 26 05:07:55.764206 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 878/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:55 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:55.774045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5ac0d89-5a4d-43dd-86d4-01862f7d369c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '.version_select at 0x7f470a8e1a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:55.784611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5ac0d89-5a4d-43dd-86d4-01862f7d369c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.785684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5ac0d89-5a4d-43dd-86d4-01862f7d369c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.787880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5ac0d89-5a4d-43dd-86d4-01862f7d369c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.790082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:55.801147 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa06ad27-9cd0-47e9-8dfc-f520619ce2ba tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1469 microversion: 2.1 time: 0.476397 Oct 26 05:07:55.826620 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5ac0d89-5a4d-43dd-86d4-01862f7d369c tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4714 microversion: 2.25 time: 0.061057 Oct 26 05:07:55.827878 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 879/1759] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 26 05:07:55 2022] GET /compute/v2.1/os-migrations => generated 4714 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:55.828741 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 881/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:55 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1469 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:55.833140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-337156a2-72ed-4f7b-bea6-8586471ab784 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1c0040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:55.859890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:55.860773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:55.875942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.879183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.879811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.880690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:55.884040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:55.884696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:55.997774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-337156a2-72ed-4f7b-bea6-8586471ab784 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.168379 Oct 26 05:07:56.007307 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 880/1761] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:55 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:56.017156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:56.018163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:56.033460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.034285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.035083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.036274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.036945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.037616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.166364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:56.181974 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-654954f1-7c2f-4b6a-af32-7960417fbac7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.349224 Oct 26 05:07:56.195151 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 882/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:55 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:56.213397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5cf47d6f-4337-4cab-a436-dcd3b13be2ea req-afc0394f-3abf-4f11-9784-dff7570f2f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1009243c-75eb-4ae9-9c19-1993034b9935", "name": "network-vif-plugged", "status": "completed", "tag": "65506aae-0853-4ba6-bfb3-845cc1057a42"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:56.251393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5cf47d6f-4337-4cab-a436-dcd3b13be2ea req-afc0394f-3abf-4f11-9784-dff7570f2f1b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.252320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5cf47d6f-4337-4cab-a436-dcd3b13be2ea req-afc0394f-3abf-4f11-9784-dff7570f2f1b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.255219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5cf47d6f-4337-4cab-a436-dcd3b13be2ea req-afc0394f-3abf-4f11-9784-dff7570f2f1b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.288594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] Lazy-loading 'services' on Instance uuid 0afdec39-d5c9-4e87-b528-7227a49580e5 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:56.315385 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5cf47d6f-4337-4cab-a436-dcd3b13be2ea req-afc0394f-3abf-4f11-9784-dff7570f2f1b service nova] Creating event network-vif-plugged:65506aae-0853-4ba6-bfb3-845cc1057a42 for instance 1009243c-75eb-4ae9-9c19-1993034b9935 on n-h2-862416-4 Oct 26 05:07:56.318109 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b285f475-0bd0-4c16-98ff-117858db94ef tempest-LiveAutoBlockMigrationV225Test-289387134 tempest-LiveAutoBlockMigrationV225Test-289387134-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1971 microversion: 2.25 time: 0.314790 Oct 26 05:07:56.319233 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 881/1763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:56 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1971 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:56.325257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:56.326014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:56.330998 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5cf47d6f-4337-4cab-a436-dcd3b13be2ea req-afc0394f-3abf-4f11-9784-dff7570f2f1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142520 Oct 26 05:07:56.331599 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 883/1764] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:56.333201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.333850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.334439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.335255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.335831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.336404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.371520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:56.372113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:56.385707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.386211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.386662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.387382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.387846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.395460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.445731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:07:56.574182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:56.585382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66157715-b740-4631-9be5-2003418d2f4f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.264992 Oct 26 05:07:56.587361 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 882/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:56 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:56.625845 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d6b45c3-9339-4f25-a363-3de6527c9992 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 204 len: 0 microversion: 2.25 time: 0.258116 Oct 26 05:07:56.628413 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 884/1766] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:07:56 2022] DELETE /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:07:56.638541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:56.639291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:56.648598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:56.651707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.652204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.652643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.653429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.653883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.654676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.789857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:56.790891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:56.801095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.801938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.802558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.803551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.804551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.805595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.812080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:56.814565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:07:56.826711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:56.829161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:56.830761 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-255eecbb-bd30-4807-b774-39fbabc8a625 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1484 microversion: 2.25 time: 0.197753 Oct 26 05:07:56.845340 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 883/1767] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:56 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1484 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:56.854409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:56.855026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:56.861768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.863157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.863850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:56.864741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:56.869870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:56.871384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:57.032195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:57.052175 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be89363a-7dbd-4e77-b61c-cbe09a28a2b3 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.264860 Oct 26 05:07:57.053609 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 885/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:56 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:57.072614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-718299a2-4cb7-49d4-b9fb-716b548dcfc7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8759d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:57.168803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:57.177141 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-718299a2-4cb7-49d4-b9fb-716b548dcfc7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.117377 Oct 26 05:07:57.188196 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b9d9c89f-f183-46b0-85b9-d44fd73cea8b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1469 microversion: 2.1 time: 0.335277 Oct 26 05:07:57.188196 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 884/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:56 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:57.188869 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 886/1770] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:57 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:57.216792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:57.217448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:57.225773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:57.226237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:57.227482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:57.228422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:57.228893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:57.229338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:57.402526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:57.418808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6699bb80-00ea-481d-aa26-006042f8f85d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.209036 Oct 26 05:07:57.436001 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 885/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:57 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:57.614298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:57.615280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:57.622130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:57.623077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:57.623619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:57.624909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:57.625521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:57.626320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:57.799768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:57.816179 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ae5bf25-1d52-4691-829e-bcb214d809b2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.205056 Oct 26 05:07:57.818633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 887/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:57 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:57.858648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:57.859684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:57.881792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:57.884807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:57.885589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:57.886649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:57.893192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:57.894729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.081082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:58.082239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:58.093255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.094945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.095655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.097299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.097980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.098885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.180933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:58.189632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:58.191104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:58.192283 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d6adb36d-c980-4365-83e7-2799a38e8c95 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1484 microversion: 2.25 time: 0.338937 Oct 26 05:07:58.208181 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 886/1773] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:57 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1484 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:58.214062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d3f5825-af03-464a-b447-929a749af5b4 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8e18b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:58.292081 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d3f5825-af03-464a-b447-929a749af5b4 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.082665 Oct 26 05:07:58.292714 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 887/1774] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:58 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:58.309875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:58.310968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:58.323107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.325089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.325845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.326750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.327385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.327990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.576633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:58.586247 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc137758-8657-4091-820f-0e73dc96aa0b tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.511174 Oct 26 05:07:58.602078 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 888/1775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:58 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:58.609666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-41fef60b-d951-4f4c-951e-2ada03a623db req-87a07f76-9d3c-417c-94aa-ba922a359175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88432c1e-38bd-4136-9442-edbf5e85b261", "name": "network-vif-plugged", "status": "completed", "tag": "c48fca7c-54af-40f1-a347-5c4142210586"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:58.621983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41fef60b-d951-4f4c-951e-2ada03a623db req-87a07f76-9d3c-417c-94aa-ba922a359175 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.622773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41fef60b-d951-4f4c-951e-2ada03a623db req-87a07f76-9d3c-417c-94aa-ba922a359175 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.623381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41fef60b-d951-4f4c-951e-2ada03a623db req-87a07f76-9d3c-417c-94aa-ba922a359175 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.642123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-41fef60b-d951-4f4c-951e-2ada03a623db req-87a07f76-9d3c-417c-94aa-ba922a359175 service nova] Creating event network-vif-plugged:c48fca7c-54af-40f1-a347-5c4142210586 for instance 88432c1e-38bd-4136-9442-edbf5e85b261 on n-h1-862416-4 Oct 26 05:07:58.648404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:58.661788 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-634a7137-3a6f-48cc-b57e-61281b5f7890 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1469 microversion: 2.1 time: 0.363445 Oct 26 05:07:58.663596 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 888/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:58 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:58.665004 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-41fef60b-d951-4f4c-951e-2ada03a623db req-87a07f76-9d3c-417c-94aa-ba922a359175 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060862 Oct 26 05:07:58.669743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 889/1777] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:58.670034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:58.670655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:58.688848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.690249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.691153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.692726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.693443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.694082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.859191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:58.860282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:58.884735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.885776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.887791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:58.889918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:58.892034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:58.893713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.103193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.135121 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc090a64-9b91-477f-8cbd-0c0b0175ece5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1308 microversion: 2.1 time: 0.467407 Oct 26 05:07:59.138079 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 889/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:58 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:59.213360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d939d9d7-2d86-475e-8090-48c33e2cd070 req-1e7d1bb0-46b1-490e-ae0c-a0e6662b2ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afdec39-d5c9-4e87-b528-7227a49580e5", "name": "network-vif-deleted", "tag": "18a6c1cd-7330-433a-8098-880895a40bb1"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:59.247584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d939d9d7-2d86-475e-8090-48c33e2cd070 req-1e7d1bb0-46b1-490e-ae0c-a0e6662b2ab4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.248076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d939d9d7-2d86-475e-8090-48c33e2cd070 req-1e7d1bb0-46b1-490e-ae0c-a0e6662b2ab4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.252407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d939d9d7-2d86-475e-8090-48c33e2cd070 req-1e7d1bb0-46b1-490e-ae0c-a0e6662b2ab4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.288205 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d939d9d7-2d86-475e-8090-48c33e2cd070 req-1e7d1bb0-46b1-490e-ae0c-a0e6662b2ab4 service nova] Creating event network-vif-deleted:18a6c1cd-7330-433a-8098-880895a40bb1 for instance 0afdec39-d5c9-4e87-b528-7227a49580e5 on n-h2-862416-4 Oct 26 05:07:59.301666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d939d9d7-2d86-475e-8090-48c33e2cd070 req-1e7d1bb0-46b1-490e-ae0c-a0e6662b2ab4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097970 Oct 26 05:07:59.302874 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 890/1779] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:07:59.317673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:59.319032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:59.333174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.333704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.334147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.334863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.335320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.335744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.405581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.415478 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-84ddfbef-9fa4-45f1-901c-47b56bbf98ae tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.571643 Oct 26 05:07:59.416075 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 890/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:58 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:59.436130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-870a9459-50e2-4a1b-b81f-ef7ddea6bdb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470e9624c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:59.494028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.506550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.510393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.532751 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-040c9d86-02ef-441d-89ec-c858e4116cc2 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1266 microversion: 2.25 time: 0.228556 Oct 26 05:07:59.536180 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 891/1781] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:07:59 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:07:59.552783 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-870a9459-50e2-4a1b-b81f-ef7ddea6bdb3 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.130018 Oct 26 05:07:59.554049 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 891/1782] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:07:59 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:59.620176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:59.625095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:59.653223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.656003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.675711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d89c2d9b-9196-4615-8001-ac3c049d9353 req-8fa269bf-e8e4-4da3-b473-609cbd84f32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50939f7-1531-4640-8d2e-f2463ddc5219", "name": "network-vif-deleted", "tag": "507b44e2-1620-40cb-9443-c503a302f328"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:07:59.685028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.690670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.698571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.699333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.721927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d89c2d9b-9196-4615-8001-ac3c049d9353 req-8fa269bf-e8e4-4da3-b473-609cbd84f32e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.722671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d89c2d9b-9196-4615-8001-ac3c049d9353 req-8fa269bf-e8e4-4da3-b473-609cbd84f32e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.723128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d89c2d9b-9196-4615-8001-ac3c049d9353 req-8fa269bf-e8e4-4da3-b473-609cbd84f32e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.760006 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d89c2d9b-9196-4615-8001-ac3c049d9353 req-8fa269bf-e8e4-4da3-b473-609cbd84f32e service nova] Creating event network-vif-deleted:507b44e2-1620-40cb-9443-c503a302f328 for instance d50939f7-1531-4640-8d2e-f2463ddc5219 on n-h2-862416-4 Oct 26 05:07:59.765458 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d89c2d9b-9196-4615-8001-ac3c049d9353 req-8fa269bf-e8e4-4da3-b473-609cbd84f32e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093484 Oct 26 05:07:59.767616 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 892/1783] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:07:59.773327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:07:59.774299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:07:59.784447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.785121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.785770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.786890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.787505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.788469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.837569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:07:59.838755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:07:59.839954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:07:59.840760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lazy-loading 'fault' on Instance uuid d50939f7-1531-4640-8d2e-f2463ddc5219 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:07:59.903751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.922853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-893bce9f-fedf-44eb-8c72-a4189363092e tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 200 len: 1303 microversion: 2.1 time: 0.147420 Oct 26 05:07:59.923514 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 893/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:59 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:07:59.981681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:07:59.992107 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e49ce1a6-5faf-4f94-86e1-5276c919c499 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1331 microversion: 2.1 time: 0.380469 Oct 26 05:07:59.993479 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 892/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:07:59 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1331 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:00.165258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:00.176183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:00.194843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:00.197063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:00.198708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:00.201837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:00.202616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:00.204057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:00.445132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:00.447134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:00.462607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:00.463314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:00.463753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:00.465632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:00.465632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:00.470946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.188890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:01.200360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a43235af-b8d9-4e30-a4ca-363d019b1d5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1488 microversion: 2.1 time: 1.040463 Oct 26 05:08:01.206450 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 894/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:00 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1488 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:01.216017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0df3c89a-614c-4029-a146-3f7e927b0b7e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eb155e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:01.315049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0df3c89a-614c-4029-a146-3f7e927b0b7e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.107310 Oct 26 05:08:01.315946 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 895/1787] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:01 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:01.329184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:01.329834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:01.344927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.345432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.345879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.346591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.349657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.350111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.475074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:01.485667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1362c3fd-319e-4054-9665-9138562e0e38 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 1.048524 Oct 26 05:08:01.490885 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 893/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:00 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:01.504796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:01.505701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: d50939f7-1531-4640-8d2e-f2463ddc5219] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:01.518762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:01.528543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:01.533335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:01.535809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.537521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a276ed3e-e4ee-44e2-b615-edc7142848e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1266 microversion: 2.25 time: 0.220589 Oct 26 05:08:01.538223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.538849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.541253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.541928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.542166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 896/1789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:01 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:01.544047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.557345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:01.558820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:01.581616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.588246 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] HTTP exception thrown: Instance d50939f7-1531-4640-8d2e-f2463ddc5219 could not be found. Oct 26 05:08:01.589128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.589793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.590740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.592148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.594760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Request method failure captured: Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 HTTP/1.1 Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9HHlndELMWvNWwBIaH0hAmgX-fYDwCSZ7X2zEVccYXDPdAASfPjnFVHwxqW3SSEZfiIAhHUuTTUxiijs3QeZcMB4Z_4yozcShGLDT_sIYpMe2k2NZlNU5LNWagPb-XpJobBlYj5FGnpLlO4PcSPb-Lu9o8jPXSuhjl1zLb-mtXbzc Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:01.602819 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5e48790bfe71452288c91f49586a624e Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d50939f7-1531-4640-8d2e-f2463ddc5219 could not be found. Oct 26 05:08:01.604912 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd50939f7-1531-4640-8d2e-f2463ddc5219'} Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50939f7-1531-4640-8d2e-f2463ddc5219 could not be found. Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:01.606081 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50939f7-1531-4640-8d2e-f2463ddc5219 could not be found. Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50939f7-1531-4640-8d2e-f2463ddc5219 could not be found. Oct 26 05:08:01.607933 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:01.618901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Returning 404 to user: Instance d50939f7-1531-4640-8d2e-f2463ddc5219 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:01.621464 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0afd94d-84cd-47c2-93a6-385c9139ee6d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219" status: 404 len: 111 microversion: 2.1 time: 0.129393 Oct 26 05:08:01.627103 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 894/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:01 2022] GET /compute/v2.1/servers/d50939f7-1531-4640-8d2e-f2463ddc5219 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:08:01.634918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:01.643273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:01.654399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.656528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.657536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.660455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.663578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.664837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.764104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lazy-loading 'flavor' on Instance uuid 1009243c-75eb-4ae9-9c19-1993034b9935 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:01.967208 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a67b10f-1ac9-40ed-8273-c30bbb1fc0bd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935/action" status: 202 len: 0 microversion: 2.1 time: 0.338566 Oct 26 05:08:01.968179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 895/1791] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:01 2022] POST /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:08:01.974517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:01.975114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:01.991704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.992216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:01.995241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:01.995988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:01.996465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:02.002575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:02.097774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:02.151334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:02.162112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a329182-bf3b-4eee-9d2b-ccae38698c16 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1534 microversion: 2.1 time: 0.618609 Oct 26 05:08:02.164024 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 897/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:01 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1534 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:02.177082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-81e5d347-6863-4e7e-b3d6-aa29d80cc022 req-f85b9e84-c050-4857-bc1f-4dfc51f21177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968f8909-14e6-45b2-982a-2ca35d66232b", "name": "network-vif-unplugged", "status": "completed", "tag": "c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:02.206082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81e5d347-6863-4e7e-b3d6-aa29d80cc022 req-f85b9e84-c050-4857-bc1f-4dfc51f21177 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:02.207455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81e5d347-6863-4e7e-b3d6-aa29d80cc022 req-f85b9e84-c050-4857-bc1f-4dfc51f21177 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:02.208144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81e5d347-6863-4e7e-b3d6-aa29d80cc022 req-f85b9e84-c050-4857-bc1f-4dfc51f21177 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:02.233476 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-81e5d347-6863-4e7e-b3d6-aa29d80cc022 req-f85b9e84-c050-4857-bc1f-4dfc51f21177 service nova] Creating event network-vif-unplugged:c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8 for instance 968f8909-14e6-45b2-982a-2ca35d66232b on n-h1-862416-4 Oct 26 05:08:02.252271 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-81e5d347-6863-4e7e-b3d6-aa29d80cc022 req-f85b9e84-c050-4857-bc1f-4dfc51f21177 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085661 Oct 26 05:08:02.253434 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 898/1793] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:02.260679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:02.268425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:02.274746 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5630a237-f0da-41fe-b9bf-01e27c7e96a9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 204 len: 0 microversion: 2.1 time: 0.304611 Oct 26 05:08:02.279159 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 896/1794] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:01 2022] DELETE /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:02.279356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:02.279356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:02.279781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:02.282848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:02.284948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:02.285542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:02.289071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8237930-990d-45dc-aca9-869f1fb734aa tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'create', calling method: .version_select at 0x7f470acf8ca0>, body: {"pool": "1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:02.728895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:02.744261 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7c04cb36-0fce-46f3-a2d3-6f3743a0e681 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1496 microversion: 2.1 time: 0.489488 Oct 26 05:08:02.749681 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 899/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:02 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1496 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:02.756728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:02.767192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:02.773020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:02.776042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:02.777008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:02.777738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:02.778761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:02.779471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:02.780296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:02.787300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:03.348711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:03.368084 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f71abf8-9733-46b5-9748-b80b8fa555c9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1534 microversion: 2.1 time: 0.617083 Oct 26 05:08:03.368688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 900/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:02 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1534 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:03.387965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4be8cd7-b274-4c0a-8f99-54828c82c896 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1c9820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:03.459119 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4be8cd7-b274-4c0a-8f99-54828c82c896 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.079285 Oct 26 05:08:03.460520 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 901/1797] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:03 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:03.466179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:03.467415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:03.474686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:03.475473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:03.476109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:03.477268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:03.477756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:03.478359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:03.960656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:03.974781 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8b944941-89c8-4c27-b42a-14acbaa601a7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.512854 Oct 26 05:08:04.001622 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 902/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:03 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:04.009660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:04.011345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:04.022565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.023394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.024877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:04.025884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.026529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.028321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:04.284435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:04.302419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:04.303970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:04.305429 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-96c224a9-0450-4090-817c-8ed26082927f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1266 microversion: 2.25 time: 0.302381 Oct 26 05:08:04.306697 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 903/1799] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:04 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:04.311964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:04.312623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:04.319203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.319699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.320806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:04.321711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.322172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.322607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:04.738444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:04.753383 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4b8bea1-cc6e-4051-b2f9-70642db4660b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 200 len: 1479 microversion: 2.1 time: 0.445237 Oct 26 05:08:04.774830 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 904/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:04 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 1479 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:04.787109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f4d07e7b-7eca-48aa-9bb0-516d28c5ed4c req-c73e4666-1724-45bb-a3fd-bf60e49a0c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968f8909-14e6-45b2-982a-2ca35d66232b", "tag": "c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:04.844868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f4d07e7b-7eca-48aa-9bb0-516d28c5ed4c req-c73e4666-1724-45bb-a3fd-bf60e49a0c3c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.845702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f4d07e7b-7eca-48aa-9bb0-516d28c5ed4c req-c73e4666-1724-45bb-a3fd-bf60e49a0c3c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.849447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f4d07e7b-7eca-48aa-9bb0-516d28c5ed4c req-c73e4666-1724-45bb-a3fd-bf60e49a0c3c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:04.894509 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f4d07e7b-7eca-48aa-9bb0-516d28c5ed4c req-c73e4666-1724-45bb-a3fd-bf60e49a0c3c service nova] Creating event network-changed:c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8 for instance 968f8909-14e6-45b2-982a-2ca35d66232b on n-h1-862416-4 Oct 26 05:08:04.909776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f4d07e7b-7eca-48aa-9bb0-516d28c5ed4c req-c73e4666-1724-45bb-a3fd-bf60e49a0c3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131422 Oct 26 05:08:04.912166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 905/1801] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:04.920972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:04.922080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:04.941798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.942817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.943558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:04.944575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:04.945332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:04.947812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:05.024525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:05.025404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:05.026287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:05.027150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lazy-loading 'fault' on Instance uuid 0ec9404e-b594-46f1-ad01-9febafe8ef65 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:05.369141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:05.399628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-623d5c34-bb12-4d1a-8541-4af03ed0553d tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 200 len: 1368 microversion: 2.1 time: 0.483680 Oct 26 05:08:05.400173 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 906/1802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:04 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:05.425148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a1a65d2-3ff5-4108-999e-2e9418276d4c tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1791f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:05.512801 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a1a65d2-3ff5-4108-999e-2e9418276d4c tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.111499 Oct 26 05:08:05.529433 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 907/1803] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:05 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:05.534951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1835258797"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:05.556630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:05.580875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:05.586991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:05.587816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:05.588759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:05.589404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:05.590033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.138725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e23e7fc9-cae7-4391-92ce-604bc8c52818 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935/action" status: 202 len: 0 microversion: 2.1 time: 0.607631 Oct 26 05:08:06.142378 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 908/1804] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:05 2022] POST /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:08:06.147762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:06.160343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:06.182525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:06.184970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:06.187268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.193886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:06.194552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:06.195174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.521851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:06.539808 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3e823915-eec0-44cb-b56b-8f9406857b17 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.394708 Oct 26 05:08:06.544809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 909/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:06 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:06.550982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:06.552343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:06.560826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:06.561606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:06.562592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.563775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:06.564323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:06.567693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.696935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:06.706276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:06.718731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:06.720183 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-833f868b-3434-4ed1-ace1-743a45dca93d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 200 len: 1266 microversion: 2.25 time: 0.173335 Oct 26 05:08:06.720874 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 910/1806] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:06 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:06.731076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-515f8790-6cb4-4dc6-9415-f74f8366540b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a8da550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:06.808729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-515f8790-6cb4-4dc6-9415-f74f8366540b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.086382 Oct 26 05:08:06.823949 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 911/1807] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:06 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:06.823949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:06.823949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 0ec9404e-b594-46f1-ad01-9febafe8ef65] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:06.842865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:06.843598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:06.844101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.844980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:06.857833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:06.858506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:06.887257 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] HTTP exception thrown: Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 could not be found. Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Request method failure captured: Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 HTTP/1.1 Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9HHlndELMWvNWwBIaH0hAmgX-fYDwCSZ7X2zEVccYXDPdAASfPjnFVHwxqW3SSEZfiIAhHUuTTUxiijs3QeZcMB4Z_4yozcShGLDT_sIYpMe2k2NZlNU5LNWagPb-XpJobBlYj5FGnpLlO4PcSPb-Lu9o8jPXSuhjl1zLb-mtXbzc Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:06.888945 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5e48790bfe71452288c91f49586a624e Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 could not be found. Oct 26 05:08:06.890563 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0ec9404e-b594-46f1-ad01-9febafe8ef65'} Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 could not be found. Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:06.891492 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 could not be found. Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 could not be found. Oct 26 05:08:06.892927 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:06.899562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Returning 404 to user: Instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:06.899562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ce91b69-0b02-4b6f-bd5e-64e1feaabff4 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65" status: 404 len: 111 microversion: 2.1 time: 0.075165 Oct 26 05:08:06.899562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 912/1808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:06 2022] GET /compute/v2.1/servers/0ec9404e-b594-46f1-ad01-9febafe8ef65 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:08:06.903911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dfe3cc5-ddc1-443c-bc15-57dea8203872 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eba8670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:06.968279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0dfe3cc5-ddc1-443c-bc15-57dea8203872 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.069796 Oct 26 05:08:06.969877 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 913/1809] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:06 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:06.975333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b83b9be9-c038-490f-a7d4-c91397249749 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '.version_select at 0x7f470a8df5e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:07.020741 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b83b9be9-c038-490f-a7d4-c91397249749 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876014347" status: 202 len: 0 microversion: 2.1 time: 0.049460 Oct 26 05:08:07.027657 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 914/1810] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876014347 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:08:07.034534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-659093c5-58cf-4143-a1fa-facd4b2a31ca req-7b460f7d-7b3d-4f91-855a-75785a0c5e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9404e-b594-46f1-ad01-9febafe8ef65", "name": "network-vif-deleted", "tag": "58e42ee3-02b5-4bee-9d3e-74f8b459caeb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:07.047190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-659093c5-58cf-4143-a1fa-facd4b2a31ca req-7b460f7d-7b3d-4f91-855a-75785a0c5e29 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:07.048113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-659093c5-58cf-4143-a1fa-facd4b2a31ca req-7b460f7d-7b3d-4f91-855a-75785a0c5e29 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:07.048821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-659093c5-58cf-4143-a1fa-facd4b2a31ca req-7b460f7d-7b3d-4f91-855a-75785a0c5e29 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:07.063298 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-659093c5-58cf-4143-a1fa-facd4b2a31ca req-7b460f7d-7b3d-4f91-855a-75785a0c5e29 service nova] Creating event network-vif-deleted:58e42ee3-02b5-4bee-9d3e-74f8b459caeb for instance 0ec9404e-b594-46f1-ad01-9febafe8ef65 on n-h1-862416-4 Oct 26 05:08:07.071505 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-659093c5-58cf-4143-a1fa-facd4b2a31ca req-7b460f7d-7b3d-4f91-855a-75785a0c5e29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041031 Oct 26 05:08:07.073183 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 915/1811] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:07.457016 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8237930-990d-45dc-aca9-869f1fb734aa tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.177843 Oct 26 05:08:07.472438 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 897/1812] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:08:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:07.483191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.136"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:07.487403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:07.503577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:07.507338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:07.508191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:07.509288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:07.513226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:07.515164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:07.571148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:07.571654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:08:07.572039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:07.572582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquired lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:08:07.581267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:07.585025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:07.585546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:07.588636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:07.589199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:07.589828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:08.465747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:08.474301 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5d6a196-f68a-425a-98a7-a850a4d54e31 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.907032 Oct 26 05:08:08.484032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 898/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:07 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:08.491512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:08.492301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 0afdec39-d5c9-4e87-b528-7227a49580e5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:08.516620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:08.517202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:08.517784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:08.518639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:08.519207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:08.519823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:08.555594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] HTTP exception thrown: Instance 0afdec39-d5c9-4e87-b528-7227a49580e5 could not be found. Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Request method failure captured: Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 HTTP/1.1 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8osSsi_EUloEJmouMUyOoGGBvSfXKSVDh_QkRlacQl1wPp8f_G3Kc9khqdPgv7qCiDxlYTEwpW68LQkZR3rw3t12sAnLJoyFJrXV0_i93MXPVteKFOavaHGhhZE-kC10vFbayZkYhxRH75WbT1mJlcbgcuSiZb5xuyIOAgNFqzvM0 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:08.558294 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a891e93c2035474fb99ebafc3de91101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b36c8ac2dee24d33b680608a740463bb Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 0afdec39-d5c9-4e87-b528-7227a49580e5 could not be found. Oct 26 05:08:08.560278 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '0afdec39-d5c9-4e87-b528-7227a49580e5'} Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afdec39-d5c9-4e87-b528-7227a49580e5 could not be found. Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:08.561376 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afdec39-d5c9-4e87-b528-7227a49580e5 could not be found. Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afdec39-d5c9-4e87-b528-7227a49580e5 could not be found. Oct 26 05:08:08.563080 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:08.566280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Returning 404 to user: Instance 0afdec39-d5c9-4e87-b528-7227a49580e5 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:08.567356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8f8d5cd-14f7-4ea5-81cb-497dbd5b11cb tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5" status: 404 len: 111 microversion: 2.25 time: 0.082229 Oct 26 05:08:08.570566 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 899/1814] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:08 2022] GET /compute/v2.1/servers/0afdec39-d5c9-4e87-b528-7227a49580e5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:08:08.576978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ff1cdd2-463d-4b8f-b0aa-ef69b0c9b82f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1a3700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:08.665329 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ff1cdd2-463d-4b8f-b0aa-ef69b0c9b82f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.093107 Oct 26 05:08:08.666042 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 900/1815] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:08 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:08.683202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e346558d-21ac-4a54-8919-5564cd75029b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1830d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:08.760946 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e346558d-21ac-4a54-8919-5564cd75029b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1453 microversion: 2.1 time: 0.082125 Oct 26 05:08:08.765875 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 901/1816] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:08 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:09.172882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:09.175831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:09.200002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:09.201378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:09.203293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:09.204050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:09.204528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:09.204961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:09.257076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:09.275950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:09.510797 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-87d86102-cfa7-47ac-ac76-c5cb42b558a2 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 204 len: 0 microversion: 2.1 time: 0.352037 Oct 26 05:08:09.514306 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 902/1817] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:09 2022] DELETE /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:09.531812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:09.532441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:09.551140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:09.563726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:09.564372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:09.565149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:09.567562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:09.570067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:10.588307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:10.605153 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a999dde-8953-477d-b6dc-1a6173d246b9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 1.089487 Oct 26 05:08:10.606131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 903/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:09 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:10.611039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:10.615452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:10.636015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:10.636526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:10.636980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:10.637771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:10.638253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:10.641655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:11.200359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:11.208851 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59a747d2-6b04-443e-bdcc-d17aa8c9cbd9 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1467 microversion: 2.1 time: 0.601592 Oct 26 05:08:11.213990 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 904/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:10 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1467 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:11.223605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c162fcc-99cc-4236-a342-f311cd8753e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1611f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:11.307157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c162fcc-99cc-4236-a342-f311cd8753e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.091594 Oct 26 05:08:11.313654 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 905/1820] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:11 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:11.313939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Building network info cache for instance {{(pid=120585) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:08:11.318525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f2b1a24-0e3b-4484-929a-16493c2f0eb8 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a15b700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:11.403099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f2b1a24-0e3b-4484-929a-16493c2f0eb8 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1462 microversion: 2.1 time: 0.088238 Oct 26 05:08:11.404432 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 906/1821] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:11 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:11.417102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6d36d78d-0d9f-4e6f-8f2e-8a12eac849f0 req-b5e973bd-32ce-47e0-b1cf-3a8e7e37264f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88432c1e-38bd-4136-9442-edbf5e85b261", "tag": "c48fca7c-54af-40f1-a347-5c4142210586"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:11.451094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6d36d78d-0d9f-4e6f-8f2e-8a12eac849f0 req-b5e973bd-32ce-47e0-b1cf-3a8e7e37264f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:11.455162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6d36d78d-0d9f-4e6f-8f2e-8a12eac849f0 req-b5e973bd-32ce-47e0-b1cf-3a8e7e37264f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:11.456189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6d36d78d-0d9f-4e6f-8f2e-8a12eac849f0 req-b5e973bd-32ce-47e0-b1cf-3a8e7e37264f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:11.481033 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6d36d78d-0d9f-4e6f-8f2e-8a12eac849f0 req-b5e973bd-32ce-47e0-b1cf-3a8e7e37264f service nova] Creating event network-changed:c48fca7c-54af-40f1-a347-5c4142210586 for instance 88432c1e-38bd-4136-9442-edbf5e85b261 on n-h1-862416-4 Oct 26 05:08:11.499319 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6d36d78d-0d9f-4e6f-8f2e-8a12eac849f0 req-b5e973bd-32ce-47e0-b1cf-3a8e7e37264f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093047 Oct 26 05:08:11.499995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 907/1822] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:11.535594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5afdb42f-e1a7-44c8-ad59-3d2e1838affe tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a182820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:11.630181 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5afdb42f-e1a7-44c8-ad59-3d2e1838affe tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 200 len: 1462 microversion: 2.1 time: 0.128862 Oct 26 05:08:11.640510 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 908/1823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:11 2022] GET /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 1462 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:11.652409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:11.654324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:11.668241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:11.674489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:11.675327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:11.676505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:11.677142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:11.680694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:11.932001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:11.941838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c83029e6-d27b-428f-bfe3-1a103b60860f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1504 microversion: 2.1 time: 0.299774 Oct 26 05:08:11.942424 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 909/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:11 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:11.955761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:11.968655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:11.994843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:11.995624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:11.996257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:11.997190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:11.997861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:11.999620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:12.627188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:12.643125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-782a3c1d-c0d7-43c2-9d0b-cd288eaeaad2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1466 microversion: 2.1 time: 0.694967 Oct 26 05:08:12.648373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 910/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:11 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1466 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:12.653289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:12.658279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:12.670722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:12.671223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:12.678845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:12.679713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:12.680299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:12.680751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:12.792902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Updating instance_info_cache with network_info: [{"id": "c48fca7c-54af-40f1-a347-5c4142210586", "address": "fa:16:3e:b9:12:4d", "network": {"id": "1b69c2ce-96da-4953-b60d-2a85ab190963", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-749998299-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "affce5ab3801486298f7dc3b8bed6000", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc48fca7c-54", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120585) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:08:12.816309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Releasing lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:08:12.819776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44ac1166-dfa6-4ac7-a185-326800070022 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action" status: 202 len: 0 microversion: 2.1 time: 5.340327 Oct 26 05:08:12.823546 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 916/1826] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:07 2022] POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action => generated 0 bytes in 5347 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:08:12.843346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc2566ff-dfb6-41b5-9938-d24912381638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a179040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:12.935301 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc2566ff-dfb6-41b5-9938-d24912381638 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.106429 Oct 26 05:08:12.936836 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 917/1827] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:12 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:12.950794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-bdd30153-4dcc-4a43-b29c-1fa24fa59b70 req-c9aaff9a-9ae4-40f1-97d8-88ca30dacc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1009243c-75eb-4ae9-9c19-1993034b9935", "name": "network-vif-plugged", "status": "completed", "tag": "65506aae-0853-4ba6-bfb3-845cc1057a42"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:12.981442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bdd30153-4dcc-4a43-b29c-1fa24fa59b70 req-c9aaff9a-9ae4-40f1-97d8-88ca30dacc76 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:12.986134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bdd30153-4dcc-4a43-b29c-1fa24fa59b70 req-c9aaff9a-9ae4-40f1-97d8-88ca30dacc76 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:12.988629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bdd30153-4dcc-4a43-b29c-1fa24fa59b70 req-c9aaff9a-9ae4-40f1-97d8-88ca30dacc76 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:13.006206 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-bdd30153-4dcc-4a43-b29c-1fa24fa59b70 req-c9aaff9a-9ae4-40f1-97d8-88ca30dacc76 service nova] Creating event network-vif-plugged:65506aae-0853-4ba6-bfb3-845cc1057a42 for instance 1009243c-75eb-4ae9-9c19-1993034b9935 on n-h2-862416-4 Oct 26 05:08:13.026156 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-bdd30153-4dcc-4a43-b29c-1fa24fa59b70 req-c9aaff9a-9ae4-40f1-97d8-88ca30dacc76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087043 Oct 26 05:08:13.027212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 918/1828] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:13.038357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-916925133"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:13.048062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:13.069115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:13.073063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:13.074103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:13.076735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:13.078465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:13.080893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:13.638124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4664c52-1451-40c6-af52-f916d6bee38a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "POST /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26/action" status: 202 len: 0 microversion: 2.1 time: 0.603504 Oct 26 05:08:13.644269 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 919/1829] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:13 2022] POST /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:08:13.691371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1193fcc-8027-42c2-a55f-0a605a7203cb tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'create', calling method: .version_select at 0x7f470a8df9d0>, body: {"pool": "1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2"} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:13.777809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:13.791506 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf4e9b9c-0952-4415-a17a-638ba5e6d045 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1467 microversion: 2.1 time: 1.139245 Oct 26 05:08:13.792158 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 911/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:12 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1467 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:13.826589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:13.832402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:13.845303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:13.846239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:13.847009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:13.848075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:13.848937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:13.850170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:14.655200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:14.668473 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7e585dcd-9d6c-47bd-99b8-0ed39764ded3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1479 microversion: 2.1 time: 0.857239 Oct 26 05:08:14.673943 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 912/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:13 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1479 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:14.682771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-847bb1d2-9ed7-49e8-bbea-84c3871ecc6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a15b4c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:14.821683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-847bb1d2-9ed7-49e8-bbea-84c3871ecc6b tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.145834 Oct 26 05:08:14.823951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 913/1832] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:14 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:14.838743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec8e0e58-1089-4c79-a699-0b973a9f549f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a15b160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:14.970489 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec8e0e58-1089-4c79-a699-0b973a9f549f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.143682 Oct 26 05:08:14.977699 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 914/1833] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:14 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:14.997259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b47f1ea6-a4ed-4a82-9bd4-2286e345482c req-4216b581-69c4-4e22-92a4-c56011aa984f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8631070-27e5-49d8-9465-e295b5f8ccb8", "name": "network-vif-deleted", "tag": "fe726bee-c752-416b-a2c0-0b2b35895ff4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:15.032713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b47f1ea6-a4ed-4a82-9bd4-2286e345482c req-4216b581-69c4-4e22-92a4-c56011aa984f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.036408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b47f1ea6-a4ed-4a82-9bd4-2286e345482c req-4216b581-69c4-4e22-92a4-c56011aa984f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.042786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b47f1ea6-a4ed-4a82-9bd4-2286e345482c req-4216b581-69c4-4e22-92a4-c56011aa984f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.092125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b47f1ea6-a4ed-4a82-9bd4-2286e345482c req-4216b581-69c4-4e22-92a4-c56011aa984f service nova] Creating event network-vif-deleted:fe726bee-c752-416b-a2c0-0b2b35895ff4 for instance a8631070-27e5-49d8-9465-e295b5f8ccb8 on n-h2-862416-4 Oct 26 05:08:15.121141 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b47f1ea6-a4ed-4a82-9bd4-2286e345482c req-4216b581-69c4-4e22-92a4-c56011aa984f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139222 Oct 26 05:08:15.123718 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 915/1834] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:15.147424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18017ab6-a6d2-4c88-b9e8-c80ad19cb0fb tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '.version_select at 0x7f470a101940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:15.172119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18017ab6-a6d2-4c88-b9e8-c80ad19cb0fb tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.177131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18017ab6-a6d2-4c88-b9e8-c80ad19cb0fb tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.177695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18017ab6-a6d2-4c88-b9e8-c80ad19cb0fb tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.228869 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18017ab6-a6d2-4c88-b9e8-c80ad19cb0fb tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2723 microversion: 2.1 time: 0.098647 Oct 26 05:08:15.232652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 916/1835] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:08:15 2022] GET /compute/v2.1/os-migrations => generated 2723 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:15.250067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:15.252983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:15.275409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.275918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.276369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.277095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.277593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.286715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.383390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.384593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.385057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.386619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lazy-loading 'fault' on Instance uuid a8631070-27e5-49d8-9465-e295b5f8ccb8 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:15.465370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:15.477165 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3e564b1d-64c2-446b-b44b-ce98e360100b tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 200 len: 1303 microversion: 2.1 time: 0.239349 Oct 26 05:08:15.478160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 917/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:15 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:15.506452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:15.511943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:15.526186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.526696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.527147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.527874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.528345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.528779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.852735 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15076e49-6312-445e-a8ce-6972ecbe6ec8 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1630 microversion: 2.1 time: 0.350930 Oct 26 05:08:15.871799 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 918/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:15 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1630 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:15.894558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-66ae802f-ab5d-4f4c-a14b-23ce968062ea req-d751e0de-7be8-4c54-a68c-6f6489d84bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1775471-ce05-493c-8ec3-03ef2f475e70", "name": "network-vif-unplugged", "status": "completed", "tag": "09ae13fc-660e-48a5-9396-5902986e5f6c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:15.920395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66ae802f-ab5d-4f4c-a14b-23ce968062ea req-d751e0de-7be8-4c54-a68c-6f6489d84bad service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:15.922300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66ae802f-ab5d-4f4c-a14b-23ce968062ea req-d751e0de-7be8-4c54-a68c-6f6489d84bad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:15.923674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66ae802f-ab5d-4f4c-a14b-23ce968062ea req-d751e0de-7be8-4c54-a68c-6f6489d84bad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:15.963359 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-66ae802f-ab5d-4f4c-a14b-23ce968062ea req-d751e0de-7be8-4c54-a68c-6f6489d84bad service nova] Creating event network-vif-unplugged:09ae13fc-660e-48a5-9396-5902986e5f6c for instance c1775471-ce05-493c-8ec3-03ef2f475e70 on n-h1-862416-4 Oct 26 05:08:15.979830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-66ae802f-ab5d-4f4c-a14b-23ce968062ea req-d751e0de-7be8-4c54-a68c-6f6489d84bad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100978 Oct 26 05:08:15.980706 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 919/1838] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:16.239008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-408970028", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:16.337607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] validate_networks() for [('41ea2838-6a6b-46dd-a977-2fd3e47b8c50', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:08:17.427649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:08:17.428236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:08:17.428533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:08:17.428941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:08:17.430126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:08:17.456302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:17.459210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:17.465346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:17.468340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:17.474296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:17.475217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:17.527508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Getting quotas for project 84d0144f42b64642aa5baef6a8077c30. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:17.534690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Getting quotas for user 2dc7ca84bead495f89d0931005853a11 and project 84d0144f42b64642aa5baef6a8077c30. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:17.550351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:08:17.552770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:08:17.645659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c7103d6-67dc-4882-ba9c-38822f893e82 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662948 Oct 26 05:08:17.648779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 920/1839] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:08:17.653532 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1193fcc-8027-42c2-a55f-0a605a7203cb tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.997699 Oct 26 05:08:17.655456 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 920/1840] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:08:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:17.660469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70ffe998-4763-4cd6-9e8b-5f5c94e41874 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Action: 'create', calling method: .version_select at 0x7f470a0015e0>, body: {"keypair": {"name": "tempest-keypair-1769107788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCtSzAT0EMI5MWgoCUz+6X96XNy29wSd6Sb5QCwG8MF1c98bf8PjyPrPic26WXEqdS7uYCn9Wu/LJ9j9gG4izn58nCyGlpSxNWked1thqCTXUFBAjTo6gcsALLjYSuPNQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:17.672061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a9ce65f-b399-4ae9-afc4-51603ba10d7e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a15b0d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:17.713945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-70ffe998-4763-4cd6-9e8b-5f5c94e41874 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for project 8ef7259043394cb8a05b8c57782d0475. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:17.722465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-70ffe998-4763-4cd6-9e8b-5f5c94e41874 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for user dbd1775d9dd04820aec1aa2efde776e1 and project 8ef7259043394cb8a05b8c57782d0475. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:17.763237 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a9ce65f-b399-4ae9-afc4-51603ba10d7e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.111231 Oct 26 05:08:17.775643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 921/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:17 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:17.785156 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70ffe998-4763-4cd6-9e8b-5f5c94e41874 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128376 Oct 26 05:08:17.786369 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 921/1842] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:08:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:17.787741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7763d439-89d6-484c-8e96-f6767927bd71 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1614c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:17.791905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:17.802231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: a8631070-27e5-49d8-9465-e295b5f8ccb8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:17.828875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:17.829533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:17.830501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:17.830629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:17.838010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:17.838634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:17.880989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] HTTP exception thrown: Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 could not be found. Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Request method failure captured: Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 HTTP/1.1 Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL9HHlndELMWvNWwBIaH0hAmgX-fYDwCSZ7X2zEVccYXDPdAASfPjnFVHwxqW3SSEZfiIAhHUuTTUxiijs3QeZcMB4Z_4yozcShGLDT_sIYpMe2k2NZlNU5LNWagPb-XpJobBlYj5FGnpLlO4PcSPb-Lu9o8jPXSuhjl1zLb-mtXbzc Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:17.882820 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5e48790bfe71452288c91f49586a624e Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 could not be found. Oct 26 05:08:17.885013 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a8631070-27e5-49d8-9465-e295b5f8ccb8'} Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 could not be found. Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:17.886216 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 could not be found. Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 could not be found. Oct 26 05:08:17.888152 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:17.889779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Returning 404 to user: Instance a8631070-27e5-49d8-9465-e295b5f8ccb8 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:17.889779 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92647f88-0a24-4dbc-ba21-bec50202a403 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8" status: 404 len: 111 microversion: 2.1 time: 0.096824 Oct 26 05:08:17.891288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7763d439-89d6-484c-8e96-f6767927bd71 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.113874 Oct 26 05:08:17.893068 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 922/1843] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:17 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:17.899653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:17.900868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:17.902995 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 922/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:17 2022] GET /compute/v2.1/servers/a8631070-27e5-49d8-9465-e295b5f8ccb8 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:08:17.917995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bcce066c-7eee-4de6-b075-8882515c74e1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:17.919069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bcce066c-7eee-4de6-b075-8882515c74e1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:17.941695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:17.944058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:17.946078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:17.947760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:17.949859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:17.950397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:18.019460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:18.022128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bcce066c-7eee-4de6-b075-8882515c74e1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:18.043713 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bcce066c-7eee-4de6-b075-8882515c74e1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1216 microversion: 2.1 time: 0.139348 Oct 26 05:08:18.044131 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 923/1845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:17 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:18.083794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.175"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:18.093768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:18.139012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:18.141088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:18.144380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:18.145203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:18.145720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:18.146167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:18.269587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:08:18.269925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquired lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:08:18.279191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-175a436e-dc23-42a0-818f-6e5c7c23c7a4 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 204 len: 0 microversion: 2.25 time: 0.383304 Oct 26 05:08:18.282332 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 923/1846] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:08:17 2022] DELETE /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:08:18.297539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:18.298573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:18.314576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:18.315456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:18.316839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:18.318266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:18.321348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:18.322223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:18.524612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:18.638038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:18.708584 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86e65723-ba04-4614-9ceb-1acacd6cd11a tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 204 len: 0 microversion: 2.1 time: 0.423805 Oct 26 05:08:18.709862 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 924/1847] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:18 2022] DELETE /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:18.727898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:18.728791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:18.734497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:18.740374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:18.741029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:18.742097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:18.743010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:18.743763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:18.744329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:19.765191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:19.779518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:19.785561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:19.787249 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c322a99-ab1a-4475-b339-386fbcde4233 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1733 microversion: 2.25 time: 1.072172 Oct 26 05:08:19.813928 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 925/1848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:18 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1733 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:19.823720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:19.824345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:19.840904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:19.841432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:19.841885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:19.842593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:19.846464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:19.848550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.233397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2.", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:08:20.234740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Releasing lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:08:20.235616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.235616 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Request method failure captured: Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action HTTP/1.1 Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 46 Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMCcwdriI7qa0Rk84xw7WpR878mNwYD4bvqTBdndJ5TPZbPG0USCSGwHMzRTOyppA0AIRUDue6SOeh5MQn1Z_69KkZMVB5P7CpXLaWx3iHZMuxNHvZkUtfPIcwHQjUo99m9g9hk0Iq67aUYN53EPwp4WN0Q2ZDvAB8iOxcjbubAL60o Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:20.238707 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7021f7e236d64e70aa73f3184fb597e2 Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: {"addFloatingIp": {"address": "172.25.6.175"}} Oct 26 05:08:20.240688 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '88432c1e-38bd-4136-9442-edbf5e85b261', 'body': {'addFloatingIp': {'address': '172.25.6.175'}}} Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:08:20.242439 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:08:20.243966 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.245228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.250866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] Oct 26 05:08:20.254757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:20.256390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e48790bfe71452288c91f49586a624e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf57b356c404d8f9d3986b355cb5ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:20.256610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Returning 400 to user: Cannot associate floating IP 172.25.6.175 (5591e7e2-274a-4982-a7db-798eef4574a3) with port c48fca7c-54af-40f1-a347-5c4142210586 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2. Oct 26 05:08:20.256610 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-227cd71d-a1d8-496c-b0e8-19501f27d97e'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:20.256610 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7d0699fa-61fa-4eb1-aee0-2885f402c6ad tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action" status: 400 len: 381 microversion: 2.1 time: 2.185155 Oct 26 05:08:20.256610 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 924/1849] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:18 2022] POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action => generated 381 bytes in 2208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:08:20.257853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a5eb62c-a2ae-4f42-b121-93aa46cd5247 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470ea58ca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:20.260111 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb36201d-b57f-4dab-aab0-3ac73cee0347 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 200 len: 1468 microversion: 2.1 time: 0.444865 Oct 26 05:08:20.260849 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 926/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:19 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 1468 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:20.266661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f77d7557-1939-4526-9903-5c90d282eb79 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a217670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:20.364498 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f77d7557-1939-4526-9903-5c90d282eb79 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.101883 Oct 26 05:08:20.365366 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 927/1851] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:20 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:20.379611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48d16c19-0072-4824-822c-66c78387393d"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:20.382440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:20.394069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a5eb62c-a2ae-4f42-b121-93aa46cd5247 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.140629 Oct 26 05:08:20.394610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.395238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.395900 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 925/1852] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:20 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:20.402074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:20.402897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:20.404327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.405251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.405885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.406430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.411195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.411689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.412123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.413008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.414274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.414874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.522412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:20.525880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:20.541720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58d511e1-5978-4f95-be53-e704a340de97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1274 microversion: 2.1 time: 0.144296 Oct 26 05:08:20.554320 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 926/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:20 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:20.560922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b079cf7-1107-4bc3-8fb2-dfd5ca50fa49 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '.version_select at 0x7f470ea0c700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:20.849961 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a7cf2a0-b856-4efc-96ae-1142ec79947f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "POST /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480340 Oct 26 05:08:20.858947 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 928/1854] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:08:20 2022] POST /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:20.868947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a6d67d42-4f6c-45b7-80b8-c0bbef515f42 req-2f0ce351-1e9b-4809-b869-e2e34ae15ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799dd620-87a8-4e32-9c1a-772b54ecb883", "name": "network-vif-deleted", "tag": "ce571795-111e-46ca-80eb-a9eabfa95f90"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:20.886195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a6d67d42-4f6c-45b7-80b8-c0bbef515f42 req-2f0ce351-1e9b-4809-b869-e2e34ae15ea8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.886854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a6d67d42-4f6c-45b7-80b8-c0bbef515f42 req-2f0ce351-1e9b-4809-b869-e2e34ae15ea8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.887099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a6d67d42-4f6c-45b7-80b8-c0bbef515f42 req-2f0ce351-1e9b-4809-b869-e2e34ae15ea8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.907322 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a6d67d42-4f6c-45b7-80b8-c0bbef515f42 req-2f0ce351-1e9b-4809-b869-e2e34ae15ea8 service nova] Creating event network-vif-deleted:ce571795-111e-46ca-80eb-a9eabfa95f90 for instance 799dd620-87a8-4e32-9c1a-772b54ecb883 on n-h1-862416-4 Oct 26 05:08:20.915242 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a6d67d42-4f6c-45b7-80b8-c0bbef515f42 req-2f0ce351-1e9b-4809-b869-e2e34ae15ea8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052124 Oct 26 05:08:20.917186 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 929/1855] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:20.928170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:20.928832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:20.944405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.944955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.947079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:20.948408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:20.948895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:20.949675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:21.753165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:21.789547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:21.800155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:21.811697 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d42502cc-5329-4ac2-bb6e-cda576decce5 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1733 microversion: 2.25 time: 0.886368 Oct 26 05:08:21.818154 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 930/1856] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:20 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1733 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:21.834801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:21.837269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] [instance: 799dd620-87a8-4e32-9c1a-772b54ecb883] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:21.863202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:21.863202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:21.863202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:21.863202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:21.868445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:21.868445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:21.925118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] HTTP exception thrown: Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 could not be found. Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Request method failure captured: Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 HTTP/1.1 Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL9HHlndELMWvNWwBIaH0hAmgX-fYDwCSZ7X2zEVccYXDPdAASfPjnFVHwxqW3SSEZfiIAhHUuTTUxiijs3QeZcMB4Z_4yozcShGLDT_sIYpMe2k2NZlNU5LNWagPb-XpJobBlYj5FGnpLlO4PcSPb-Lu9o8jPXSuhjl1zLb-mtXbzc Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:21.932966 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/daf57b356c404d8f9d3986b355cb5ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: daf57b356c404d8f9d3986b355cb5ab2 Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-MigrationsAdminTest-1998182544 Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5e48790bfe71452288c91f49586a624e Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-MigrationsAdminTest-1998182544-project Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 could not be found. Oct 26 05:08:21.934913 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '799dd620-87a8-4e32-9c1a-772b54ecb883'} Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 could not be found. Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:21.936079 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 could not be found. Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 could not be found. Oct 26 05:08:21.937658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:21.943458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] Returning 404 to user: Instance 799dd620-87a8-4e32-9c1a-772b54ecb883 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:21.949057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a1b2004e-5623-47b1-81ac-db9ed5324919 tempest-MigrationsAdminTest-1998182544 tempest-MigrationsAdminTest-1998182544-project] 10.222.0.16 "GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883" status: 404 len: 111 microversion: 2.1 time: 0.131893 Oct 26 05:08:21.953494 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 931/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:21 2022] GET /compute/v2.1/servers/799dd620-87a8-4e32-9c1a-772b54ecb883 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:08:21.962409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d81c3617-3cbf-444a-b2cb-78f0f7c63ef1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1c0d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:22.078935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d81c3617-3cbf-444a-b2cb-78f0f7c63ef1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.123971 Oct 26 05:08:22.086963 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 932/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:21 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:22.092846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ea162e2-f40a-4cc4-8987-b5766341346e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1610d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:22.189100 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ea162e2-f40a-4cc4-8987-b5766341346e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.100643 Oct 26 05:08:22.190264 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 933/1859] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:22 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:22.200259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:22.210873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:22.247204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:22.247989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:22.248601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:22.249721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:22.254349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:22.255250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:22.429575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:22.438557 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3defc014-f045-4bdd-86d0-aeaed2b8495a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1274 microversion: 2.1 time: 0.246832 Oct 26 05:08:22.439522 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 934/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:22 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:22.445177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-16a13bb2-7007-4dbd-8a5d-25c07fca70ce req-b9e618d6-832c-4708-a111-d07044f067de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "name": "network-vif-plugged", "status": "completed", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:22.465174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-16a13bb2-7007-4dbd-8a5d-25c07fca70ce req-b9e618d6-832c-4708-a111-d07044f067de service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:22.466020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-16a13bb2-7007-4dbd-8a5d-25c07fca70ce req-b9e618d6-832c-4708-a111-d07044f067de service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:22.466632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-16a13bb2-7007-4dbd-8a5d-25c07fca70ce req-b9e618d6-832c-4708-a111-d07044f067de service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:22.485920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-16a13bb2-7007-4dbd-8a5d-25c07fca70ce req-b9e618d6-832c-4708-a111-d07044f067de service nova] Creating event network-vif-plugged:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:08:22.505391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-16a13bb2-7007-4dbd-8a5d-25c07fca70ce req-b9e618d6-832c-4708-a111-d07044f067de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051207 Oct 26 05:08:22.515215 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 935/1861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:22.849267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:22.850418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:22.860943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:22.862033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:22.862868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:22.863871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:22.865137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:22.865860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:23.103986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:23.120708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:23.123921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:23.128353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5db611ae-b70c-4023-b0e0-0fdb6f11ea18 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1666 microversion: 2.25 time: 0.283216 Oct 26 05:08:23.130863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 936/1862] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:22 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1666 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:08:23.143565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0153563f-163f-4c0f-a564-54b351a022b6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a0c4b80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:23.253228 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0153563f-163f-4c0f-a564-54b351a022b6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1440 microversion: 2.1 time: 0.120980 Oct 26 05:08:23.254868 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 937/1863] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:23 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:23.260460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55ab0233-f935-47b8-93c6-d4bbdf71977d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a161af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:23.346175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55ab0233-f935-47b8-93c6-d4bbdf71977d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.081729 Oct 26 05:08:23.374470 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 938/1864] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:23 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:23.466860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:23.467637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:23.478296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:23.479128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:23.479813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:23.482539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:23.483286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:23.483943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:23.526952 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b079cf7-1107-4bc3-8fb2-dfd5ca50fa49 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5591e7e2-274a-4982-a7db-798eef4574a3" status: 202 len: 0 microversion: 2.1 time: 2.970573 Oct 26 05:08:23.528850 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 927/1865] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:08:20 2022] DELETE /compute/v2.1/os-floating-ips/5591e7e2-274a-4982-a7db-798eef4574a3 => generated 0 bytes in 2974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:08:23.536633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c0d22ade-e133-4ca2-be31-deb9ca57c388 req-91b4f51f-35ff-451e-8a8d-f07bff7e8df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d8713-2b19-48a3-987e-27843e15111f", "name": "network-vif-deleted", "tag": "895a25f8-b756-40d5-83d8-7c6eeaa273b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:23.550743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c0d22ade-e133-4ca2-be31-deb9ca57c388 req-91b4f51f-35ff-451e-8a8d-f07bff7e8df4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:23.552043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c0d22ade-e133-4ca2-be31-deb9ca57c388 req-91b4f51f-35ff-451e-8a8d-f07bff7e8df4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:23.552656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c0d22ade-e133-4ca2-be31-deb9ca57c388 req-91b4f51f-35ff-451e-8a8d-f07bff7e8df4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:23.592388 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c0d22ade-e133-4ca2-be31-deb9ca57c388 req-91b4f51f-35ff-451e-8a8d-f07bff7e8df4 service nova] Creating event network-vif-deleted:895a25f8-b756-40d5-83d8-7c6eeaa273b0 for instance e07d8713-2b19-48a3-987e-27843e15111f on n-h2-862416-4 Oct 26 05:08:23.615955 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c0d22ade-e133-4ca2-be31-deb9ca57c388 req-91b4f51f-35ff-451e-8a8d-f07bff7e8df4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080165 Oct 26 05:08:23.623104 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 928/1866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:23.639471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.136"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:24.374458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:24.388558 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c240adc-b181-4ca8-85c7-0cd377c763c1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1316 microversion: 2.1 time: 0.927846 Oct 26 05:08:24.409470 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 939/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:23 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1316 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:24.444318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:24.457779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:24.489782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:24.493002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:24.495803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:24.497646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:24.498618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:24.501709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:24.548287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:24.562409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:24.562909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:24.563347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:24.564066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:24.564534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:24.564956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:24.670856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:24.671365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:24.671813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:24.674664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lazy-loading 'fault' on Instance uuid e07d8713-2b19-48a3-987e-27843e15111f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:25.036926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:25.057462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:25.058920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:25.060107 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-14ab86b2-7413-48d4-893c-a518d77e3a24 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 200 len: 1376 microversion: 2.25 time: 0.649343 Oct 26 05:08:25.088559 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 940/1868] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:24 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 1376 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:25.110390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1238a00-040d-4bad-ae16-cdeb9de5cb16 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a8e18b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:25.401678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:08:25.402094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquired lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:08:27.406481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Building network info cache for instance {{(pid=120585) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:08:27.515365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:27.545267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:28.042822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:28.613273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Updating instance_info_cache with network_info: [{"id": "c48fca7c-54af-40f1-a347-5c4142210586", "address": "fa:16:3e:b9:12:4d", "network": {"id": "1b69c2ce-96da-4953-b60d-2a85ab190963", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-749998299-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "affce5ab3801486298f7dc3b8bed6000", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc48fca7c-54", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120585) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:08:28.691025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Releasing lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:08:28.699838 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f04db077-0026-494e-b855-dd2abd39cc57 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action" status: 202 len: 0 microversion: 2.1 time: 5.075091 Oct 26 05:08:28.720862 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 929/1869] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:23 2022] POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action => generated 0 bytes in 5096 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:08:28.768011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b7e47ef-9d71-4e67-a2e8-ef124c182651 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eba8700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:34.557748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:34.668006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=22 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:34.752248 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b7e47ef-9d71-4e67-a2e8-ef124c182651 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 6.028679 Oct 26 05:08:34.752817 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 930/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:28 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 6031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:34.753860 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1238a00-040d-4bad-ae16-cdeb9de5cb16 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1449 microversion: 2.1 time: 9.663969 Oct 26 05:08:34.756391 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 941/1871] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:25 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1449 bytes in 9666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:34.762287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b18d1182-ba44-4eb8-ac6c-847a1a86e707 req-4533b2ad-e78f-4a37-952f-0e41e9885008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:34.765047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:34.765838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:34.776314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b18d1182-ba44-4eb8-ac6c-847a1a86e707 req-4533b2ad-e78f-4a37-952f-0e41e9885008 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:34.776882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b18d1182-ba44-4eb8-ac6c-847a1a86e707 req-4533b2ad-e78f-4a37-952f-0e41e9885008 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:34.777433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b18d1182-ba44-4eb8-ac6c-847a1a86e707 req-4533b2ad-e78f-4a37-952f-0e41e9885008 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:34.779176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:34.779661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:34.780185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:34.780890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:34.781451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:34.781958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:34.790914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b18d1182-ba44-4eb8-ac6c-847a1a86e707 req-4533b2ad-e78f-4a37-952f-0e41e9885008 service nova] Creating event network-changed:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h1-862416-4 Oct 26 05:08:34.796625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b18d1182-ba44-4eb8-ac6c-847a1a86e707 req-4533b2ad-e78f-4a37-952f-0e41e9885008 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038881 Oct 26 05:08:34.800416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 942/1872] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:34.806270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:34.807200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: e07d8713-2b19-48a3-987e-27843e15111f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:34.816353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:34.822376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:34.824064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:34.827111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:34.827685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:34.828197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:34.847757 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] HTTP exception thrown: Instance e07d8713-2b19-48a3-987e-27843e15111f could not be found. Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Request method failure captured: Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f HTTP/1.1 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8osSsi_EUloEJmouMUyOoGGBvSfXKSVDh_QkRlacQl1wPp8f_G3Kc9khqdPgv7qCiDxlYTEwpW68LQkZR3rw3t12sAnLJoyFJrXV0_i93MXPVteKFOavaHGhhZE-kC10vFbayZkYhxRH75WbT1mJlcbgcuSiZb5xuyIOAgNFqzvM0 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:34.851628 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a891e93c2035474fb99ebafc3de91101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b36c8ac2dee24d33b680608a740463bb Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e07d8713-2b19-48a3-987e-27843e15111f could not be found. Oct 26 05:08:34.853593 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e07d8713-2b19-48a3-987e-27843e15111f'} Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07d8713-2b19-48a3-987e-27843e15111f could not be found. Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:34.854513 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07d8713-2b19-48a3-987e-27843e15111f could not be found. Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07d8713-2b19-48a3-987e-27843e15111f could not be found. Oct 26 05:08:34.856147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:34.869569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Returning 404 to user: Instance e07d8713-2b19-48a3-987e-27843e15111f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:34.870464 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fdf07328-0a4f-4375-b3db-0f1294480d9f tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f" status: 404 len: 111 microversion: 2.25 time: 0.068671 Oct 26 05:08:34.871042 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 943/1873] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:34 2022] GET /compute/v2.1/servers/e07d8713-2b19-48a3-987e-27843e15111f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:08:34.879925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-9795228", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "1d3f1995-4a9c-473d-83e2-e714a42436e5"}], "security_groups": [{"name": "tempest-securitygroup--397372682"}], "key_name": "tempest-keypair-1769107788", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:35.021257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:35.041023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9f9eaaa-8aea-4801-b078-5b22fd750a09 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1316 microversion: 2.1 time: 0.284679 Oct 26 05:08:35.053337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 931/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:34 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:35.059660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c51ad7ff-ca1c-4e18-b637-06a18e01e0c9 req-d8182719-efcb-42aa-8331-3a81ad88386a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88432c1e-38bd-4136-9442-edbf5e85b261", "tag": "c48fca7c-54af-40f1-a347-5c4142210586"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:35.073305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c51ad7ff-ca1c-4e18-b637-06a18e01e0c9 req-d8182719-efcb-42aa-8331-3a81ad88386a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:35.074337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c51ad7ff-ca1c-4e18-b637-06a18e01e0c9 req-d8182719-efcb-42aa-8331-3a81ad88386a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:35.074968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c51ad7ff-ca1c-4e18-b637-06a18e01e0c9 req-d8182719-efcb-42aa-8331-3a81ad88386a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:35.099468 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c51ad7ff-ca1c-4e18-b637-06a18e01e0c9 req-d8182719-efcb-42aa-8331-3a81ad88386a service nova] Creating event network-changed:c48fca7c-54af-40f1-a347-5c4142210586 for instance 88432c1e-38bd-4136-9442-edbf5e85b261 on n-h1-862416-4 Oct 26 05:08:35.109859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] validate_networks() for [('1d3f1995-4a9c-473d-83e2-e714a42436e5', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:08:35.115447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c51ad7ff-ca1c-4e18-b637-06a18e01e0c9 req-d8182719-efcb-42aa-8331-3a81ad88386a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070640 Oct 26 05:08:35.116207 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 932/1875] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:35.125691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47295d19-32e6-4b52-93a1-66a58a454b7e tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '.version_select at 0x7f470a7224c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:36.325946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:08:36.326550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:08:36.326848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:08:36.327492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:08:36.327682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:08:36.343301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:36.343796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:36.344238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:36.344982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:36.345471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:36.345921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:36.384809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:36.402474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for user dbd1775d9dd04820aec1aa2efde776e1 and project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:36.445387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:08:36.448273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:08:36.501290 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5926f36-8f89-42c9-87f0-b4e428d7395b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.625214 Oct 26 05:08:36.509661 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 944/1876] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:08:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:08:36.685958 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47295d19-32e6-4b52-93a1-66a58a454b7e tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/62946f80-83b7-461b-af48-e4f62f57e664" status: 202 len: 0 microversion: 2.1 time: 1.567945 Oct 26 05:08:36.687103 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 933/1877] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:08:35 2022] DELETE /compute/v2.1/os-floating-ips/62946f80-83b7-461b-af48-e4f62f57e664 => generated 0 bytes in 1570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:08:36.692052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8e06834a-640d-4cab-9bad-64f867829ea5 req-c5c0da5f-babe-43f1-b7e9-ab8ef2492747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "name": "network-vif-plugged", "status": "completed", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:36.712932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8e06834a-640d-4cab-9bad-64f867829ea5 req-c5c0da5f-babe-43f1-b7e9-ab8ef2492747 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:36.718279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8e06834a-640d-4cab-9bad-64f867829ea5 req-c5c0da5f-babe-43f1-b7e9-ab8ef2492747 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:36.719527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8e06834a-640d-4cab-9bad-64f867829ea5 req-c5c0da5f-babe-43f1-b7e9-ab8ef2492747 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:36.731322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce56a96d-66da-4d61-9dd9-f46647611acd tempest-NetworksTest-1371813957 tempest-NetworksTest-1371813957-project-admin] Calling method '.version_select at 0x7f470a0d5f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:36.737234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8e06834a-640d-4cab-9bad-64f867829ea5 req-c5c0da5f-babe-43f1-b7e9-ab8ef2492747 service nova] Creating event network-vif-plugged:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h1-862416-4 Oct 26 05:08:36.751191 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8e06834a-640d-4cab-9bad-64f867829ea5 req-c5c0da5f-babe-43f1-b7e9-ab8ef2492747 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062486 Oct 26 05:08:36.753236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 934/1878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:36.761878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d597167-1f42-4dab-b44c-fc4d3ad42f2b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a8da4c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:36.856663 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d597167-1f42-4dab-b44c-fc4d3ad42f2b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 200 len: 1449 microversion: 2.1 time: 0.101627 Oct 26 05:08:36.857733 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 935/1879] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:36 2022] GET /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 1449 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:36.866840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2d8f966-a3e5-4d45-a8de-26f8fd329e06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '.version_select at 0x7f470a179040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:36.906559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2d8f966-a3e5-4d45-a8de-26f8fd329e06 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687105724" status: 204 len: 0 microversion: 2.25 time: 0.047580 Oct 26 05:08:36.907676 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 936/1880] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 26 05:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687105724 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:08:36.915085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd4cafa4-262d-41fa-ab50-bbe7f98d748f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f4709ffbee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:37.000380 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd4cafa4-262d-41fa-ab50-bbe7f98d748f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.091494 Oct 26 05:08:37.009557 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 937/1881] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:36 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:37.014686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:37.015721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:37.022818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:37.023605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:37.024247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:37.025137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:37.026039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:37.026512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:37.095883 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce56a96d-66da-4d61-9dd9-f46647611acd tempest-NetworksTest-1371813957 tempest-NetworksTest-1371813957-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 8111 microversion: 2.1 time: 0.584470 Oct 26 05:08:37.101389 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 945/1882] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:08:36 2022] GET /compute/v2.1/os-networks => generated 8111 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:37.106591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc0e33d5-a65e-4009-adf2-7c8a62d73fc4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:37.107519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc0e33d5-a65e-4009-adf2-7c8a62d73fc4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:37.243045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc0e33d5-a65e-4009-adf2-7c8a62d73fc4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:37.259734 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc0e33d5-a65e-4009-adf2-7c8a62d73fc4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1232 microversion: 2.1 time: 0.156817 Oct 26 05:08:37.260517 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 946/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:37 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1232 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:37.266998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0de66ec4-8bf6-40e3-970f-cabc0b640612 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0de66ec4-8bf6-40e3-970f-cabc0b640612 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Request method failure captured: Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action HTTP/1.1 Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 34 Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMCcwdriI7qa0Rk84xw7WpR878mNwYD4bvqTBdndJ5TPZbPG0USCSGwHMzRTOyppA0AIRUDue6SOeh5MQn1Z_69KkZMVB5P7CpXLaWx3iHZMuxNHvZkUtfPIcwHQjUo99m9g9hk0Iq67aUYN53EPwp4WN0Q2ZDvAB8iOxcjbubAL60o Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:37.271516 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 7021f7e236d64e70aa73f3184fb597e2 Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: {"addFloatingIp": {"address": ""}} Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:08:37.273457 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '88432c1e-38bd-4136-9442-edbf5e85b261', 'body': {'addFloatingIp': {'address': ''}}} Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi '' Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:37.274472 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:08:37.276256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:08:37.279427 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 26 05:08:37.279427 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.281253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0de66ec4-8bf6-40e3-970f-cabc0b640612 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:37.282531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0de66ec4-8bf6-40e3-970f-cabc0b640612 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action" status: 400 len: 142 microversion: 2.1 time: 0.020625 Oct 26 05:08:37.283669 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 947/1884] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:37 2022] POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:08:37.292856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c1b6572-7776-4a41-a023-b823f80fc02d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a0c4040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:37.332617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:37.344390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-75c28e25-808e-4851-a470-411552d042b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1316 microversion: 2.1 time: 0.331739 Oct 26 05:08:37.364129 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 938/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:37 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:37.397716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f7edd79-3713-467c-8103-d30239ad3718 tempest-NetworksTest-1371813957 tempest-NetworksTest-1371813957-project-admin] Calling method '.version_select at 0x7f4709ffb040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:37.597263 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f7edd79-3713-467c-8103-d30239ad3718 tempest-NetworksTest-1371813957 tempest-NetworksTest-1371813957-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2" status: 200 len: 652 microversion: 2.1 time: 0.231933 Oct 26 05:08:37.597961 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 939/1886] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:08:37 2022] GET /compute/v2.1/os-networks/1a11b1d6-bb9d-4472-8a43-f1ee7fcac9e2 => generated 652 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:37.603011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:37.605539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:37.626103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:37.626612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:37.627181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:37.627757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:37.633536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:37.634141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:37.662611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:08:37.662611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquired lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:08:37.787474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Releasing lock "refresh_cache-88432c1e-38bd-4136-9442-edbf5e85b261" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:08:37.788884 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] HTTP exception thrown: floating IP not found Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Request method failure captured: Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action HTTP/1.1 Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 41 Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMCcwdriI7qa0Rk84xw7WpR878mNwYD4bvqTBdndJ5TPZbPG0USCSGwHMzRTOyppA0AIRUDue6SOeh5MQn1Z_69KkZMVB5P7CpXLaWx3iHZMuxNHvZkUtfPIcwHQjUo99m9g9hk0Iq67aUYN53EPwp4WN0Q2ZDvAB8iOxcjbubAL60o Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:37.790804 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7021f7e236d64e70aa73f3184fb597e2 Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:08:37.792783 n-d-862416-4 devstack@n-api.service[120585]: exception: floating IP not found Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '88432c1e-38bd-4136-9442-edbf5e85b261', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:37.793979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 26 05:08:37.795688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:37.798575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Returning 404 to user: floating IP not found {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:37.799653 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a00225b7-fa5b-41f7-b67a-6f4f0ec8908c tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action" status: 404 len: 67 microversion: 2.1 time: 0.200772 Oct 26 05:08:37.800737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 940/1887] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:37 2022] POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action => generated 67 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:08:37.807164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b8b330b-2ca1-41b3-acef-081ca051637c tempest-NetworksTest-1371813957 tempest-NetworksTest-1371813957-project-admin] Calling method '.version_select at 0x7f470a937a60>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.060046 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b8b330b-2ca1-41b3-acef-081ca051637c tempest-NetworksTest-1371813957 tempest-NetworksTest-1371813957-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 8111 microversion: 2.1 time: 0.258027 Oct 26 05:08:38.061011 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 941/1888] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:08:37 2022] GET /compute/v2.1/os-networks => generated 8111 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:38.073940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0255937-2de1-4084-a621-1f2792580fc6 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:38.173108 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a0255937-2de1-4084-a621-1f2792580fc6 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0255937-2de1-4084-a621-1f2792580fc6 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Request method failure captured: Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action HTTP/1.1 Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 44 Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMCcwdriI7qa0Rk84xw7WpR878mNwYD4bvqTBdndJ5TPZbPG0USCSGwHMzRTOyppA0AIRUDue6SOeh5MQn1Z_69KkZMVB5P7CpXLaWx3iHZMuxNHvZkUtfPIcwHQjUo99m9g9hk0Iq67aUYN53EPwp4WN0Q2ZDvAB8iOxcjbubAL60o Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:38.175094 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7021f7e236d64e70aa73f3184fb597e2 Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:08:38.177242 n-d-862416-4 devstack@n-api.service[120585]: exception: Floating IP not found for address 0.0.0.0. Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '88432c1e-38bd-4136-9442-edbf5e85b261', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:38.178579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 26 05:08:38.180205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:38.182004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0255937-2de1-4084-a621-1f2792580fc6 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:38.182342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0255937-2de1-4084-a621-1f2792580fc6 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action" status: 404 len: 88 microversion: 2.1 time: 0.118268 Oct 26 05:08:38.188286 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 942/1889] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:08:38 2022] POST /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261/action => generated 88 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:08:38.195533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d522a9e7-e4a7-45b8-a657-0be7953711ba tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470ea0cca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.365009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c1b6572-7776-4a41-a023-b823f80fc02d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 204 len: 0 microversion: 2.1 time: 1.080075 Oct 26 05:08:38.367986 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 948/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:37 2022] DELETE /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:38.376139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.377679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:38.389254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.391321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.391767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.392491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.392947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.393395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.428386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:38.436025 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d522a9e7-e4a7-45b8-a657-0be7953711ba tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.251976 Oct 26 05:08:38.446375 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 943/1891] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:38 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:38.451447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.451885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:38.484250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.486441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.489055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.491615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.492868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.494633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.596152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f71a70d6-12e8-4b0d-88fb-5d145c455c2f tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 204 len: 0 microversion: 2.1 time: 0.226211 Oct 26 05:08:38.598443 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 949/1892] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:38 2022] DELETE /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:38.613559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.614820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:38.621973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.622770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.623421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.624499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.625185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.625843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.636375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:38.645742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69930f7f-28c2-48e2-b5af-9409c4382dec tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1284 microversion: 2.1 time: 0.198156 Oct 26 05:08:38.647942 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 944/1893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:38 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:38.652971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.653495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:38.659527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.660219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.661093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.662019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.662636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.664089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.694418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:38.808376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:38.817666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-188b548e-d06a-48a5-8623-2e6463f44490 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 204 len: 0 microversion: 2.1 time: 0.166799 Oct 26 05:08:38.819318 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15294bfa-660f-430d-ac05-dd39e4573f7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.218368 Oct 26 05:08:38.819889 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 945/1894] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:38 2022] DELETE /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:38.831745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 950/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:38 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:38.833812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.834316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:38.842565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:38.843919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:38.846665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.847166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.847610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.849999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.852813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.853273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.854387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.855158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.856096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.857065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:38.857793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:38.858468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:38.916078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:39.108633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:39.118832 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-013de466-f775-4085-b9b4-ac8810ff50c8 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1540 microversion: 2.1 time: 0.285719 Oct 26 05:08:39.120156 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 951/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:38 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1540 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:39.122518 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4303b5e5-f59c-4a6b-95c9-f8b6ef74633d tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 204 len: 0 microversion: 2.25 time: 0.300806 Oct 26 05:08:39.123176 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 946/1897] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:08:38 2022] DELETE /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:08:39.126379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1618839915", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:39.142854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-100717406", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "92d513bb-c446-48d6-b8f5-d149382fd9ca"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:39.252963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] validate_networks() for [('41ea2838-6a6b-46dd-a977-2fd3e47b8c50', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:08:39.261448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] validate_networks() for [('92d513bb-c446-48d6-b8f5-d149382fd9ca', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:08:40.021907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:08:40.023322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:08:40.023604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:08:40.024039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:08:40.024453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:08:40.039499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.039981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.040416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.041130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.043534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.043967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.088659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:40.096161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for user 6390eed87d6a41df96e727227de791bb and project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:40.113829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:08:40.115114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:08:40.116540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:08:40.117270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:08:40.117941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:08:40.121863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:08:40.124278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:08:40.159996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.162739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.163385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.164540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.172654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.174670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.185859 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8298477d-1c90-46b2-969b-295c4ac1eaa7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061347 Oct 26 05:08:40.187091 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 947/1898] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:08:40.193629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:40.195053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:40.202146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.203040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.203764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.204926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.205589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.206184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.219115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:40.261091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Getting quotas for project 84d0144f42b64642aa5baef6a8077c30. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:40.275391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Getting quotas for user 2dc7ca84bead495f89d0931005853a11 and project 84d0144f42b64642aa5baef6a8077c30. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:40.305150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:08:40.309971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:08:40.399335 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-887b1fbe-6fa9-4703-a9e8-85d3ec3cc9c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.277477 Oct 26 05:08:40.400005 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 952/1899] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:08:40.425515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:40.431501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:40.451294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.457785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.458240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.459590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.460165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.460598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.530379 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f1e6c07-5740-4a05-b70d-a8b09c90857e tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126321 Oct 26 05:08:40.534466 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 953/1900] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:08:40 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:40.542734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0c76501-a0e8-46c6-9e4a-4d017c64d3f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8e1700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:40.641834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0c76501-a0e8-46c6-9e4a-4d017c64d3f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1452 microversion: 2.1 time: 0.106204 Oct 26 05:08:40.646196 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 954/1901] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:40 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:40.657540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-27554f65-5391-4f24-91aa-1933f1cec4f2 req-826a4c99-a1a4-41db-bd30-2911d20244b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1009243c-75eb-4ae9-9c19-1993034b9935", "name": "network-vif-unplugged", "status": "completed", "tag": "65506aae-0853-4ba6-bfb3-845cc1057a42"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:40.687061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27554f65-5391-4f24-91aa-1933f1cec4f2 req-826a4c99-a1a4-41db-bd30-2911d20244b8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.687901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27554f65-5391-4f24-91aa-1933f1cec4f2 req-826a4c99-a1a4-41db-bd30-2911d20244b8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.689840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27554f65-5391-4f24-91aa-1933f1cec4f2 req-826a4c99-a1a4-41db-bd30-2911d20244b8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.719899 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-27554f65-5391-4f24-91aa-1933f1cec4f2 req-826a4c99-a1a4-41db-bd30-2911d20244b8 service nova] Creating event network-vif-unplugged:65506aae-0853-4ba6-bfb3-845cc1057a42 for instance 1009243c-75eb-4ae9-9c19-1993034b9935 on n-h2-862416-4 Oct 26 05:08:40.753489 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-27554f65-5391-4f24-91aa-1933f1cec4f2 req-826a4c99-a1a4-41db-bd30-2911d20244b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099854 Oct 26 05:08:40.754150 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 955/1902] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:40.776132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:40.779194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:40.797225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.798177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.798783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.800057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.801253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.802105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.943105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:40.956087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:40.961003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:40.962535 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7f2675d-625c-4731-ae39-2a5c310b9b68 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1548 microversion: 2.25 time: 0.774145 Oct 26 05:08:40.963511 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 948/1903] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:40 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1548 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:40.975733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:40.975733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:40.986442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.990414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:40.991596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:40.992666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:40.999215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:41.006155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:41.009070 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc65a600-95b9-4c36-8e05-6346e0746855 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1302 microversion: 2.1 time: 0.252665 Oct 26 05:08:41.009779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:41.012132 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 956/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:40 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1302 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:41.025518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:41.028957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:41.042922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:41.043507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:41.046160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:41.046979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:41.051245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:41.051764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:41.246210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:41.254769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d42af77f-2eed-4463-814e-c010c0c0e1c8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1211 microversion: 2.1 time: 0.239346 Oct 26 05:08:41.257887 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 957/1905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:41 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1211 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:41.279937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1e197ae-72eb-43d7-b1d0-42e4d4557c0f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:41.281393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1e197ae-72eb-43d7-b1d0-42e4d4557c0f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:41.525927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1e197ae-72eb-43d7-b1d0-42e4d4557c0f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:41.536714 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1e197ae-72eb-43d7-b1d0-42e4d4557c0f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1217 microversion: 2.1 time: 0.267118 Oct 26 05:08:41.540692 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 958/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:41 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:41.558822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:41.559567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:41.568134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:41.571152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:41.571825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:41.572588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:41.577959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:41.578422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:41.690766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:41.699448 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f67fb41-800a-4c0f-af40-cea8df764e89 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1540 microversion: 2.1 time: 0.727757 Oct 26 05:08:41.700195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 949/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:40 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1540 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:41.708131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-646bb582-b6f1-4ebd-8adb-8b0f13883ce4 req-a8825002-74db-4e5d-b60d-7398af3e4a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88432c1e-38bd-4136-9442-edbf5e85b261", "name": "network-vif-deleted", "tag": "c48fca7c-54af-40f1-a347-5c4142210586"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:41.752849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-646bb582-b6f1-4ebd-8adb-8b0f13883ce4 req-a8825002-74db-4e5d-b60d-7398af3e4a62 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:41.753353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-646bb582-b6f1-4ebd-8adb-8b0f13883ce4 req-a8825002-74db-4e5d-b60d-7398af3e4a62 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:41.753781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-646bb582-b6f1-4ebd-8adb-8b0f13883ce4 req-a8825002-74db-4e5d-b60d-7398af3e4a62 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:41.792312 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-646bb582-b6f1-4ebd-8adb-8b0f13883ce4 req-a8825002-74db-4e5d-b60d-7398af3e4a62 service nova] Creating event network-vif-deleted:c48fca7c-54af-40f1-a347-5c4142210586 for instance 88432c1e-38bd-4136-9442-edbf5e85b261 on n-h1-862416-4 Oct 26 05:08:41.804401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-646bb582-b6f1-4ebd-8adb-8b0f13883ce4 req-a8825002-74db-4e5d-b60d-7398af3e4a62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102784 Oct 26 05:08:41.805059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 950/1908] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:41.829749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6b0d16a-8a44-4bb8-9708-a2b3e762f9a7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470ea134c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:41.881158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lazy-loading 'services' on Instance uuid 73891979-1cb8-4772-be88-1e6eebb0c6ca {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:41.938802 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6b0d16a-8a44-4bb8-9708-a2b3e762f9a7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1461 microversion: 2.1 time: 0.128121 Oct 26 05:08:41.952214 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 951/1909] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:41 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1461 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:41.977070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1781e366-01c7-433f-9f14-d6f040920dcb tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470e962ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:42.087947 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1781e366-01c7-433f-9f14-d6f040920dcb tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 200 len: 1461 microversion: 2.1 time: 0.134208 Oct 26 05:08:42.089586 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 952/1910] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:41 2022] GET /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 1461 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:42.106422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:42.109289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d0376a3-4691-4ac2-9c8e-17c9de6dce7b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments/48d16c19-0072-4824-822c-66c78387393d" status: 202 len: 0 microversion: 2.1 time: 0.564452 Oct 26 05:08:42.110168 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 959/1911] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:08:41 2022] DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments/48d16c19-0072-4824-822c-66c78387393d => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:08:42.113859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:42.137585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:42.138258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:42.138713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:42.139521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:42.139742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:42.140030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:42.140781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:42.143627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:42.165851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:42.169659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:42.170164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:42.171990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:42.173702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:42.174166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:42.598268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:42.617342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-afc388df-0ca5-4c14-8bc3-b3fd46aedd51 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1290 microversion: 2.1 time: 0.486954 Oct 26 05:08:42.631019 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 960/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:42 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1290 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:42.650020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:42.652079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:42.665876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:42.672354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:42.673619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:42.674566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:42.675332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:42.676056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.016867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.032671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.034441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.037439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7190ee3c-e44b-4ece-acde-cf9bbc0fcaf3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1548 microversion: 2.25 time: 0.946704 Oct 26 05:08:43.044104 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 953/1913] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:42 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1548 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:43.059681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:43.060688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:43.073929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.087640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f6603879-be67-440a-956f-ee44a8181ffd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1468 microversion: 2.1 time: 0.448144 Oct 26 05:08:43.089728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.090557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.092972 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 961/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:42 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1468 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:43.098161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:43.098431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.099712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.101521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.101965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.108574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:43.126495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.127015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.128217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.130713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.134604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.135056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.261967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.265713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:43.279035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03ed56bf-e258-449e-9dbf-7bfd8eaf9e27 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1265 microversion: 2.1 time: 0.233572 Oct 26 05:08:43.279739 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 954/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:43.302070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fc7db960-0fd8-47ba-9b55-4f81ecaba9af req-edfbc3e6-3915-44bc-b5a1-bebc6c1daa0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1009243c-75eb-4ae9-9c19-1993034b9935", "name": "network-vif-deleted", "tag": "65506aae-0853-4ba6-bfb3-845cc1057a42"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:43.334439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fc7db960-0fd8-47ba-9b55-4f81ecaba9af req-edfbc3e6-3915-44bc-b5a1-bebc6c1daa0a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.340499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fc7db960-0fd8-47ba-9b55-4f81ecaba9af req-edfbc3e6-3915-44bc-b5a1-bebc6c1daa0a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.340953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fc7db960-0fd8-47ba-9b55-4f81ecaba9af req-edfbc3e6-3915-44bc-b5a1-bebc6c1daa0a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.358417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.368503 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35027856-5355-469c-8980-2edd4e6d0d52 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1269 microversion: 2.1 time: 0.274107 Oct 26 05:08:43.369305 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 962/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1269 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:43.381292 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fc7db960-0fd8-47ba-9b55-4f81ecaba9af req-edfbc3e6-3915-44bc-b5a1-bebc6c1daa0a service nova] Creating event network-vif-deleted:65506aae-0853-4ba6-bfb3-845cc1057a42 for instance 1009243c-75eb-4ae9-9c19-1993034b9935 on n-h2-862416-4 Oct 26 05:08:43.385106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:43.385756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:43.396436 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fc7db960-0fd8-47ba-9b55-4f81ecaba9af req-edfbc3e6-3915-44bc-b5a1-bebc6c1daa0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114502 Oct 26 05:08:43.400720 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 955/1917] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:43.417122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.420510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.421266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.423359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89ff3d0c-d10e-4b96-8f7b-a89ada667d80 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470e962310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:43.424112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.425823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.426558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.477595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.480475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.483663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.484609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lazy-loading 'fault' on Instance uuid 88432c1e-38bd-4136-9442-edbf5e85b261 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:43.615182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021f7e236d64e70aa73f3184fb597e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affce5ab3801486298f7dc3b8bed6000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:43.643927 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-293544b9-0bbb-410d-a634-08f69c683314 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 200 len: 1321 microversion: 2.1 time: 0.270022 Oct 26 05:08:43.645329 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 963/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:43.673001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:43.674127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:43.706442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.707876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.712145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.714567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:43.717869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:43.718480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:43.775001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89ff3d0c-d10e-4b96-8f7b-a89ada667d80 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-26T05%3A06%3A41Z" status: 200 len: 2375 microversion: 2.1 time: 0.366846 Oct 26 05:08:43.785171 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 956/1919] 10.222.0.16 () {58 vars in 1199 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/images?changes-since=2022-10-26T05%3A06%3A41Z => generated 2375 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:43.794645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-717a2448-93e2-4bbd-8a05-8c4a7dfdddfd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a8b9790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:43.935771 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-717a2448-93e2-4bbd-8a05-8c4a7dfdddfd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1836436660" status: 200 len: 485 microversion: 2.1 time: 0.149205 Oct 26 05:08:43.945366 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 957/1920] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1836436660 => generated 485 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:43.950654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-836e0e08-55a5-4f95-af32-5de9075688ea tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a179670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.048655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:44.058037 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af953ec3-2271-46a0-933b-55af1090f22e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.408914 Oct 26 05:08:44.062034 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 964/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:44.072653 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-836e0e08-55a5-4f95-af32-5de9075688ea tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?server=e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 957 microversion: 2.1 time: 0.125927 Oct 26 05:08:44.080643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.081663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:44.085831 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 958/1922] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 26 05:08:43 2022] GET /compute/v2.1/images?server=e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 957 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:44.090726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c21d7b66-8ea8-464f-888f-4d1560982b7a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eb15700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.092942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.093881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.094557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.096330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.097420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.101305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.198554 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c21d7b66-8ea8-464f-888f-4d1560982b7a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 485 microversion: 2.1 time: 0.111079 Oct 26 05:08:44.199518 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 959/1923] 10.222.0.16 () {58 vars in 1317 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70 => generated 485 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:44.213414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09461f72-bbe1-4df7-8e35-bd942e0c662f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a018790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.222836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:44.238270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:44.240131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:44.241713 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1de4a70b-3fad-4634-91a5-d766b89a45a0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 200 len: 1506 microversion: 2.25 time: 0.170489 Oct 26 05:08:44.250298 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 965/1924] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:44.263690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7342e4cd-4410-4fe0-a5de-2cdb9b363b39 req-a1c42f65-162f-4635-9bc7-10d226c58ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7463491c-3949-4199-adbb-2436a92672c6", "name": "network-vif-deleted", "tag": "d08b8fb6-fb5b-44e3-b172-581589a3963b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:44.282194 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09461f72-bbe1-4df7-8e35-bd942e0c662f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 485 microversion: 2.1 time: 0.073820 Oct 26 05:08:44.283078 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 960/1925] 10.222.0.16 () {58 vars in 1303 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:44.299065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1dd534fd-3904-467d-8637-a26a57edce0e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f4709ffbee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.306915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7342e4cd-4410-4fe0-a5de-2cdb9b363b39 req-a1c42f65-162f-4635-9bc7-10d226c58ac8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.306915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7342e4cd-4410-4fe0-a5de-2cdb9b363b39 req-a1c42f65-162f-4635-9bc7-10d226c58ac8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.306915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7342e4cd-4410-4fe0-a5de-2cdb9b363b39 req-a1c42f65-162f-4635-9bc7-10d226c58ac8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.496839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1dd534fd-3904-467d-8637-a26a57edce0e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.202792 Oct 26 05:08:44.497451 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 961/1926] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:44.529718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.532722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:44.546054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.558341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.561968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.565691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.611569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.614361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.724250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:44.734889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d78fe067-b86e-4b40-9031-7c6a04afb08b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1265 microversion: 2.1 time: 0.224121 Oct 26 05:08:44.735781 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 962/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:44.741595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.742645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:44.750269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.751133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.751846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.752817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.753542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.754205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.783224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7342e4cd-4410-4fe0-a5de-2cdb9b363b39 req-a1c42f65-162f-4635-9bc7-10d226c58ac8 service nova] Creating event network-vif-deleted:d08b8fb6-fb5b-44e3-b172-581589a3963b for instance 7463491c-3949-4199-adbb-2436a92672c6 on n-h2-862416-4 Oct 26 05:08:44.790067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7342e4cd-4410-4fe0-a5de-2cdb9b363b39 req-a1c42f65-162f-4635-9bc7-10d226c58ac8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.535656 Oct 26 05:08:44.791143 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 966/1928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:44.798186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-11057999-cfe9-4294-91d3-0644493cfa5e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a0d51f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.832506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:44.843043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3aae5a40-e8c6-48c1-ba3c-f7a800f94634 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1275 microversion: 2.1 time: 0.105405 Oct 26 05:08:44.843647 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 963/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:44.866291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:44.866900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] [instance: 88432c1e-38bd-4136-9442-edbf5e85b261] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:44.881024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.892557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.893383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.896138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:44.897152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:44.898041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:44.917826 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] HTTP exception thrown: Instance 88432c1e-38bd-4136-9442-edbf5e85b261 could not be found. Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Request method failure captured: Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 HTTP/1.1 Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMCcwdriI7qa0Rk84xw7WpR878mNwYD4bvqTBdndJ5TPZbPG0USCSGwHMzRTOyppA0AIRUDue6SOeh5MQn1Z_69KkZMVB5P7CpXLaWx3iHZMuxNHvZkUtfPIcwHQjUo99m9g9hk0Iq67aUYN53EPwp4WN0Q2ZDvAB8iOxcjbubAL60o Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:44.919525 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/affce5ab3801486298f7dc3b8bed6000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: affce5ab3801486298f7dc3b8bed6000 Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658 Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 7021f7e236d64e70aa73f3184fb597e2 Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:08:44.921210 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 88432c1e-38bd-4136-9442-edbf5e85b261 could not be found. Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '88432c1e-38bd-4136-9442-edbf5e85b261'} Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88432c1e-38bd-4136-9442-edbf5e85b261 could not be found. Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:44.922080 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88432c1e-38bd-4136-9442-edbf5e85b261 could not be found. Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88432c1e-38bd-4136-9442-edbf5e85b261 could not be found. Oct 26 05:08:44.923556 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:44.928555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] Returning 404 to user: Instance 88432c1e-38bd-4136-9442-edbf5e85b261 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:44.928555 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36213c1f-63a3-495c-8813-e25a52400173 tempest-FloatingIPsAssociationNegativeTestJSON-469287658 tempest-FloatingIPsAssociationNegativeTestJSON-469287658-project] 10.222.0.16 "GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261" status: 404 len: 111 microversion: 2.1 time: 0.076354 Oct 26 05:08:44.929158 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-11057999-cfe9-4294-91d3-0644493cfa5e tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.127892 Oct 26 05:08:44.929442 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 964/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/servers/88432c1e-38bd-4136-9442-edbf5e85b261 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:08:44.929637 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 967/1931] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:44.942906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5946831-2235-4d53-ab4f-3b8cb059597f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a018280>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.066431 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5946831-2235-4d53-ab4f-3b8cb059597f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.127115 Oct 26 05:08:45.069826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 965/1932] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:08:44 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:45.088520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b87fa52-3cf4-4cac-a958-55f5a856f349 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a0abaf0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.097677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.099919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:45.152142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:45.160152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:45.161486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:45.164982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:45.169013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:45.170085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:45.287792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b87fa52-3cf4-4cac-a958-55f5a856f349 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-26T05%3A06%3A37Z" status: 200 len: 6328 microversion: 2.1 time: 0.207005 Oct 26 05:08:45.289180 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 968/1933] 10.222.0.16 () {58 vars in 1220 bytes} [Wed Oct 26 05:08:45 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-26T05%3A06%3A37Z => generated 6328 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:45.514944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42bcccbd-eb11-4928-86f3-11af0a537f38 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] Calling method '.version_select at 0x7f470b34b4c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.534428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42bcccbd-eb11-4928-86f3-11af0a537f38 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.244124 Oct 26 05:08:45.535007 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 969/1934] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:08:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:45.540792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.541625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 7463491c-3949-4199-adbb-2436a92672c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:45.555618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:45.556195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:45.556641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:45.557414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:45.557876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:45.558304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:45.573876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] HTTP exception thrown: Instance 7463491c-3949-4199-adbb-2436a92672c6 could not be found. Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Request method failure captured: Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 HTTP/1.1 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8osSsi_EUloEJmouMUyOoGGBvSfXKSVDh_QkRlacQl1wPp8f_G3Kc9khqdPgv7qCiDxlYTEwpW68LQkZR3rw3t12sAnLJoyFJrXV0_i93MXPVteKFOavaHGhhZE-kC10vFbayZkYhxRH75WbT1mJlcbgcuSiZb5xuyIOAgNFqzvM0 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:45.575634 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a891e93c2035474fb99ebafc3de91101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b36c8ac2dee24d33b680608a740463bb Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7463491c-3949-4199-adbb-2436a92672c6 could not be found. Oct 26 05:08:45.577670 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7463491c-3949-4199-adbb-2436a92672c6'} Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7463491c-3949-4199-adbb-2436a92672c6 could not be found. Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:45.578823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7463491c-3949-4199-adbb-2436a92672c6 could not be found. Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7463491c-3949-4199-adbb-2436a92672c6 could not be found. Oct 26 05:08:45.580694 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:45.582452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Returning 404 to user: Instance 7463491c-3949-4199-adbb-2436a92672c6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:45.582452 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a8d4a760-0d93-451c-bda1-fc4cbe81f9e6 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6" status: 404 len: 111 microversion: 2.25 time: 0.041050 Oct 26 05:08:45.582452 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 970/1935] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:45 2022] GET /compute/v2.1/servers/7463491c-3949-4199-adbb-2436a92672c6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:08:45.586255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-487eb267-51ed-4d91-8b4c-e016cd5be660 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a0d5280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.740527 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-487eb267-51ed-4d91-8b4c-e016cd5be660 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1836436660" status: 200 len: 665 microversion: 2.1 time: 0.158232 Oct 26 05:08:45.741612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 971/1936] 10.222.0.16 () {58 vars in 1252 bytes} [Wed Oct 26 05:08:45 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1836436660 => generated 665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:45.750046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a89cef9-e8ba-4b36-a924-a62fc616c055 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] Action: 'update', calling method: .version_select at 0x7f470a0d55e0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:45.872479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:45.892917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:45.905594 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-780af445-ce9f-456f-b8ea-ecb4e232ee3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.815780 Oct 26 05:08:45.906323 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 966/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:45 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:45.917203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:45.919611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:45.939457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:45.940262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:45.945715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:45.946737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:45.947339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:45.947897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.010222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:46.173042 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-952d8167-3cca-42fa-8505-4b1d88101db0 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 204 len: 0 microversion: 2.25 time: 0.264108 Oct 26 05:08:46.177774 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 967/1938] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:08:45 2022] DELETE /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:08:46.185604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-21aee1d0-c4ff-4465-97a5-413b4a67ad84 req-8f582f52-9110-4b8a-8741-2bee3e555b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "name": "network-vif-unplugged", "status": "completed", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:46.201990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-21aee1d0-c4ff-4465-97a5-413b4a67ad84 req-8f582f52-9110-4b8a-8741-2bee3e555b63 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.203024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-21aee1d0-c4ff-4465-97a5-413b4a67ad84 req-8f582f52-9110-4b8a-8741-2bee3e555b63 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.203966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-21aee1d0-c4ff-4465-97a5-413b4a67ad84 req-8f582f52-9110-4b8a-8741-2bee3e555b63 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.227410 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-21aee1d0-c4ff-4465-97a5-413b4a67ad84 req-8f582f52-9110-4b8a-8741-2bee3e555b63 service nova] Creating event network-vif-unplugged:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:08:46.241682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-21aee1d0-c4ff-4465-97a5-413b4a67ad84 req-8f582f52-9110-4b8a-8741-2bee3e555b63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060226 Oct 26 05:08:46.243049 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 968/1939] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:46.251518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:46.253014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:46.261096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.261929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.262300 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a89cef9-e8ba-4b36-a924-a62fc616c055 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.519414 Oct 26 05:08:46.262585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.263586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.264151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.264683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.270236 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 972/1940] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Oct 26 05:08:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:46.274507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5f3adb1-9bc7-412e-90af-e0df52aa10e7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1a3820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:46.354771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5f3adb1-9bc7-412e-90af-e0df52aa10e7 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1465 microversion: 2.1 time: 0.083983 Oct 26 05:08:46.357680 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 973/1941] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1465 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:46.374953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:46.375586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:46.401583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.402096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.402548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.403290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.403748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.404200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.590000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:46.601960 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e3b30e6c-68f5-4fce-b11b-eaac08e84595 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1275 microversion: 2.1 time: 0.232799 Oct 26 05:08:46.607271 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 974/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:46.618649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:46.621401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:46.631648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.632520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.633071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.634021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:46.635139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:46.636169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:46.652724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:46.670127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bba845c-cb46-4d76-a42c-a7d9b78c590f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.425240 Oct 26 05:08:46.671987 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 969/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:46.685925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c91fcb2d-cbdf-4135-9d59-67f36417c528 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] Calling method '.version_select at 0x7f470a001ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:46.708781 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c91fcb2d-cbdf-4135-9d59-67f36417c528 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035441 Oct 26 05:08:46.710212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 970/1944] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:46.722971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8919a5c-be9c-4490-99f4-165b0abeffa9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eb158b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:46.783608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8919a5c-be9c-4490-99f4-165b0abeffa9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1465 microversion: 2.1 time: 0.064262 Oct 26 05:08:46.784473 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 971/1945] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fc1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1465 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:46.797698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a9d16ab-68f0-42a6-92bc-fe874348eb60 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] Action: 'update', calling method: .version_select at 0x7f470a001b80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:46.889467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=12,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:46.944359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a9d16ab-68f0-42a6-92bc-fe874348eb60 tempest-QuotaClassesAdminTestJSON-1600911808 tempest-QuotaClassesAdminTestJSON-1600911808-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.158611 Oct 26 05:08:46.945918 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 972/1946] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Oct 26 05:08:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:46.961899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-373eab2e-d59c-40c7-bc7b-c5f4f2d625cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470eb63790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.102576 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-373eab2e-d59c-40c7-bc7b-c5f4f2d625cd tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7791 microversion: 2.1 time: 0.145656 Oct 26 05:08:47.103319 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 973/1947] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:47.120551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.121860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:47.131243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:47.132223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:47.132992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:47.133987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:47.134806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:47.135348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:47.159653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:47.172487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:47.177261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:47.178942 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59ac4f99-09e1-4d2f-a362-edd89363abac tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1563 microversion: 2.25 time: 0.570319 Oct 26 05:08:47.179716 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 975/1948] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:46 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1563 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:47.192770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-11e394e4-6f6a-47bf-856d-e713db6f587a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1c05e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.320110 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-11e394e4-6f6a-47bf-856d-e713db6f587a tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.133271 Oct 26 05:08:47.320110 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 976/1949] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:08:47 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:47.340747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cddd9e7a-db86-42a0-8c88-3a0635373161 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a227c10>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.392095 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cddd9e7a-db86-42a0-8c88-3a0635373161 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/d596d51f-4bb2-4340-8449-72226e2537e8" status: 200 len: 784 microversion: 2.1 time: 0.058064 Oct 26 05:08:47.404202 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 977/1950] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:08:47 2022] GET /compute/v2.1/images/d596d51f-4bb2-4340-8449-72226e2537e8 => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:47.408809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-31797c3c-c227-4a06-ae2e-47eedf631ee2 req-bcbd82f2-d9ea-43b9-aa46-36dd54c0ba56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46448c6-28d1-4533-9ff3-2e160f3b28dd", "tag": "4e07b583-4c8d-4359-ab3b-32365dd9a3ba"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:47.419144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-31797c3c-c227-4a06-ae2e-47eedf631ee2 req-bcbd82f2-d9ea-43b9-aa46-36dd54c0ba56 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:47.419546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-31797c3c-c227-4a06-ae2e-47eedf631ee2 req-bcbd82f2-d9ea-43b9-aa46-36dd54c0ba56 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:47.419984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-31797c3c-c227-4a06-ae2e-47eedf631ee2 req-bcbd82f2-d9ea-43b9-aa46-36dd54c0ba56 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:47.431814 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-31797c3c-c227-4a06-ae2e-47eedf631ee2 req-bcbd82f2-d9ea-43b9-aa46-36dd54c0ba56 service nova] Creating event network-changed:4e07b583-4c8d-4359-ab3b-32365dd9a3ba for instance b46448c6-28d1-4533-9ff3-2e160f3b28dd on n-h2-862416-4 Oct 26 05:08:47.436662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:47.449432 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f5d1a2e-8903-4cd9-b1b2-2e50bbb5a8f5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.335259 Oct 26 05:08:47.449432 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 974/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:47 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:47.449834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-31797c3c-c227-4a06-ae2e-47eedf631ee2 req-bcbd82f2-d9ea-43b9-aa46-36dd54c0ba56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043323 Oct 26 05:08:47.450951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 978/1952] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:47.454505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a9fdc90-d023-4717-b80d-16821f46b937 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f4709fb9820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.511693 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5a9fdc90-d023-4717-b80d-16821f46b937 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.061341 Oct 26 05:08:47.512850 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 975/1953] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:08:47 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:47.530097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60cf0571-a0b2-41b8-a4b2-399028684035 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a1a3820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.628300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:47.629614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:47.651911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:47.662779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:47.665714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:47.670131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:47.670761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:47.674143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:48.431824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:48.444645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4c37a62-4f77-4ee9-ba02-23397fe7140b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.824317 Oct 26 05:08:48.445409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 976/1954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:47 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:48.474828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:48.475991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:48.489893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:48.492911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:48.493403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:48.495436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:48.495924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:48.496366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:48.565614 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60cf0571-a0b2-41b8-a4b2-399028684035 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d" status: 204 len: 0 microversion: 2.1 time: 1.039669 Oct 26 05:08:48.566250 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 979/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:47 2022] DELETE /compute/v2.1/images/fedb01db-db31-4aa0-ae05-4a2c57e5196d => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:48.571602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:48.572547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:48.581194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:48.582683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:48.583306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:48.584199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:48.604685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:48.605168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:48.941094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:48.953910 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8cb7db9c-dbcb-4f9b-aae7-e0ac7f85ca40 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.493878 Oct 26 05:08:48.954517 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 977/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:48 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:48.970989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:48.971801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:48.981175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:48.983328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:48.985050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:48.987696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:48.988314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:48.990059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:49.188765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:49.198100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:49.199545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:49.211793 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb3f9af0-32d7-4af5-ba29-250a3e1a4026 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1563 microversion: 2.25 time: 0.644240 Oct 26 05:08:49.212720 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 980/1957] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:48 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1563 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:49.217431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dff5908f-8f9a-441b-85de-27db9e4fa720 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a217f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:49.388140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:49.397087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9caf6969-5ba4-40c1-a1f4-81e4baed0808 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.441347 Oct 26 05:08:49.400826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 978/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:48 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:49.471491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:49.472155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:49.483282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:49.483697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:49.484134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:49.484850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:49.489827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:49.490518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.056538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:50.098623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:50.107288 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-adee2a60-6db9-4e75-af09-e2a8909998be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.639845 Oct 26 05:08:50.115049 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 979/1959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:49 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:08:50.133475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:50.136030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:50.161741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.162250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.162754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.163623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.164089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.164519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.218927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:50.244167 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dff5908f-8f9a-441b-85de-27db9e4fa720 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc" status: 204 len: 0 microversion: 2.1 time: 1.030145 Oct 26 05:08:50.247161 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 981/1960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:49 2022] DELETE /compute/v2.1/images/f9a961d2-7997-4af0-b570-7b1db05b2bcc => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:50.254604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7d33fe09-53d5-4a75-88f0-93731be2b3a2 req-e38ab3ef-6e45-46d7-bc32-16e79b3da79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79855693-370b-458d-b7dc-6a777007e914", "name": "network-vif-deleted", "tag": "d7959dec-6be1-405b-8ba4-aefe5e3be104"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:50.285385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7d33fe09-53d5-4a75-88f0-93731be2b3a2 req-e38ab3ef-6e45-46d7-bc32-16e79b3da79b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.286153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7d33fe09-53d5-4a75-88f0-93731be2b3a2 req-e38ab3ef-6e45-46d7-bc32-16e79b3da79b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.289646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7d33fe09-53d5-4a75-88f0-93731be2b3a2 req-e38ab3ef-6e45-46d7-bc32-16e79b3da79b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.320873 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7d33fe09-53d5-4a75-88f0-93731be2b3a2 req-e38ab3ef-6e45-46d7-bc32-16e79b3da79b service nova] Creating event network-vif-deleted:d7959dec-6be1-405b-8ba4-aefe5e3be104 for instance 79855693-370b-458d-b7dc-6a777007e914 on n-h1-862416-4 Oct 26 05:08:50.333376 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7d33fe09-53d5-4a75-88f0-93731be2b3a2 req-e38ab3ef-6e45-46d7-bc32-16e79b3da79b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083450 Oct 26 05:08:50.337581 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 982/1961] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:50.355310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:50.357285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:50.375851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.376778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.378519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.381109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.384553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.385255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.483617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.486249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.486933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.487775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lazy-loading 'fault' on Instance uuid 79855693-370b-458d-b7dc-6a777007e914 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:50.501618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:50.522600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:50.542213 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5422e58-2796-4b38-b903-f002ec523546 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.419415 Oct 26 05:08:50.546953 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 980/1962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:50 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:50.586371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2906040e-4ba6-4559-9b50-b3a6a1f3c716 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a018550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:50.629815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:50.650383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:50.654650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b36c8ac2dee24d33b680608a740463bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a891e93c2035474fb99ebafc3de91101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:50.658445 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d32dd15-6338-4f59-b428-7d8f72d69ee3 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 200 len: 1351 microversion: 2.25 time: 0.319512 Oct 26 05:08:50.663089 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 983/1963] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:50 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 1351 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:08:50.697390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:50.698376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:50.735969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.737440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.741970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:50.744043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:50.746624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:50.749834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.261018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:51.278072 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d41bf0d-c307-45aa-9017-088fc19a04c9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.598181 Oct 26 05:08:51.278778 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 984/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:50 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:51.296252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:51.297221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:51.309889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.316946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.317584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.321040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.322011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.322721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.486004 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2906040e-4ba6-4559-9b50-b3a6a1f3c716 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69" status: 204 len: 0 microversion: 2.1 time: 0.917835 Oct 26 05:08:51.486611 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 981/1965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:50 2022] DELETE /compute/v2.1/images/0c84021b-eb9c-44d8-803b-ef9ab1b74c69 => generated 0 bytes in 939 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:51.492413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:51.495341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:51.503340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.503844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.504286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.504992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.505724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.506890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.566233 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-acda2136-6f66-4bd7-8e35-37aff8ea33ce tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078429 Oct 26 05:08:51.568576 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 982/1966] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:08:51 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:51.575928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:51.577110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:51.585791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.586691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.587398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.588547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.589260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.589795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.626390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:51.705521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:51.763221 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9731157-274f-45b4-b433-7464f03bdc4d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 204 len: 0 microversion: 2.1 time: 0.192220 Oct 26 05:08:51.766755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 983/1967] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:51 2022] DELETE /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:51.771540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:51.772385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:51.779363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.779913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.780363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.781079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.781562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.782051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.802283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:51.812287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e2d700e-8c83-4cb3-aec9-76d32afb770c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.529240 Oct 26 05:08:51.813468 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 985/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:51 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:51.818378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:51.819723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] [instance: 79855693-370b-458d-b7dc-6a777007e914] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:51.831737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.832626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.833106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.833841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.834363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.835201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.856162 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] HTTP exception thrown: Instance 79855693-370b-458d-b7dc-6a777007e914 could not be found. Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Request method failure captured: Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 HTTP/1.1 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL8osSsi_EUloEJmouMUyOoGGBvSfXKSVDh_QkRlacQl1wPp8f_G3Kc9khqdPgv7qCiDxlYTEwpW68LQkZR3rw3t12sAnLJoyFJrXV0_i93MXPVteKFOavaHGhhZE-kC10vFbayZkYhxRH75WbT1mJlcbgcuSiZb5xuyIOAgNFqzvM0 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.25 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:08:51.858208 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a891e93c2035474fb99ebafc3de91101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a891e93c2035474fb99ebafc3de91101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a891e93c2035474fb99ebafc3de91101 Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-959628641 Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b36c8ac2dee24d33b680608a740463bb Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-959628641-project Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 79855693-370b-458d-b7dc-6a777007e914 could not be found. Oct 26 05:08:51.860159 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '79855693-370b-458d-b7dc-6a777007e914'} Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79855693-370b-458d-b7dc-6a777007e914 could not be found. Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:51.861292 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79855693-370b-458d-b7dc-6a777007e914 could not be found. Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79855693-370b-458d-b7dc-6a777007e914 could not be found. Oct 26 05:08:51.863107 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:08:51.865557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] Returning 404 to user: Instance 79855693-370b-458d-b7dc-6a777007e914 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:51.866643 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-afd0db76-f1b7-433e-bb75-9d1b91ec6c33 tempest-LiveAutoBlockMigrationV225Test-959628641 tempest-LiveAutoBlockMigrationV225Test-959628641-project] 10.222.0.16 "GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914" status: 404 len: 111 microversion: 2.25 time: 0.052046 Oct 26 05:08:51.870960 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 986/1969] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:08:51 2022] GET /compute/v2.1/servers/79855693-370b-458d-b7dc-6a777007e914 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:08:51.876829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:51.877887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:51.887357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.887862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.888499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:51.889588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:51.890229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:51.891096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.223094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:52.235259 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c9f2b1c-cae6-4d3e-bb4d-2b5d848c714f tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1472 microversion: 2.1 time: 0.362885 Oct 26 05:08:52.236913 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 987/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:51 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:52.240750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:52.253145 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8d70eaa-222f-4dcb-9a71-2baee7f3bed0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.487152 Oct 26 05:08:52.262580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 984/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:51 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:52.309984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:52.310601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:52.327372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.327862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.328496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.329460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.329864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.330289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.483132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08f53ec4-1f53-478c-8032-8717f9ae4180 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470a217a60>, body: {"keypair": {"name": "tempest-keypair-1631328503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkpGFs51Z3p8k1GvAVLDztx0jq2NmXsRky9G4yENN7i7epIQWYD1seTd1IPXd7N8dyX/Qqjf668OlOHqvIMIRFuhliMoApXnchRwZ9zjPW8QFVMruGBweaWV7b/7XnH/A=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:52.500855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-08f53ec4-1f53-478c-8032-8717f9ae4180 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:52.513675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-08f53ec4-1f53-478c-8032-8717f9ae4180 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:52.534318 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08f53ec4-1f53-478c-8032-8717f9ae4180 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 05:08:52.586870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:52.597953 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a62549bf-c463-40b3-9b2d-52f2424b9726 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.292087 Oct 26 05:08:52.598938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 985/1972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:52 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:52.605152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522771cc-3392-4767-ba87-48a030cf98b2", "tag": "d7fe2f79-78e7-4921-b829-5f957ae6129e"}, {"name": "network-changed", "server_uuid": "d2afc5cb-8479-4969-bb3a-c2afb38d9999", "tag": "a635d9b6-684a-4ada-b899-e8fd83ac2e3d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:52.618418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.619071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.620909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.639797 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] Creating event network-changed:d7fe2f79-78e7-4921-b829-5f957ae6129e for instance 522771cc-3392-4767-ba87-48a030cf98b2 on n-h1-862416-4 Oct 26 05:08:52.640464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] Creating event network-changed:a635d9b6-684a-4ada-b899-e8fd83ac2e3d for instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 on n-h1-862416-4 Oct 26 05:08:52.649586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e2b3f4e9-9606-4085-b01e-926c5381d77d req-1d838c70-04b7-411a-b8e5-857b1b08e0f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047758 Oct 26 05:08:52.650200 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 986/1973] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:52.656073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:52.658633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:52.669798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.670300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.670749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.672178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.672646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.673641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.710843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30a302c1-1c78-4721-86c1-2d1d5a750d33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058895 Oct 26 05:08:52.712067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 987/1974] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:08:52 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:08:52.809087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:52.813607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:52.827362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.827889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.828858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.832057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.832556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.835611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.883677 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b683805-2b48-4dab-ba6a-af841e53fe25 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081473 Oct 26 05:08:52.884938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 988/1975] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:08:52 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:08:52.890364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:52.891431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:52.900607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.902928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.904304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:52.905234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:52.906724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:52.907375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.382905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:53.392363 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-487c4aa8-0747-46ab-b8fc-c74e322b1ee3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.505802 Oct 26 05:08:53.393269 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 989/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:52 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:53.402811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:53.403407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:53.410206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.411027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.411527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.412830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.413864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.414291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.462289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:53.543146 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-08f53ec4-1f53-478c-8032-8717f9ae4180 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53554. Oct 26 05:08:53.565901 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08f53ec4-1f53-478c-8032-8717f9ae4180 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 1.278710 Oct 26 05:08:53.566958 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 988/1977] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1280 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:08:53.574521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:53.577148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:53.586440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.587424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.588040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.589078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.589871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.590624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.597425 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ccff61a0-37e8-4ee5-8ed1-8333786307bf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 204 len: 0 microversion: 2.1 time: 0.202824 Oct 26 05:08:53.598564 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 990/1978] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:53 2022] DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:53.606323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:53.607468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:53.620219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.621104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.621855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.623040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.623849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.624447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.863548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:53.871754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e44cc76-885e-4f80-bcdc-ff254017bb06 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1472 microversion: 2.1 time: 0.303574 Oct 26 05:08:53.885739 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 989/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:53 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:53.894421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-74ea4a74-451d-4fac-b08c-7c61dad31390 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a227670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:53.903523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-74ea4a74-451d-4fac-b08c-7c61dad31390 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1631328503" status: 200 len: 513 microversion: 2.2 time: 0.015947 Oct 26 05:08:53.904004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 990/1980] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 26 05:08:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1631328503 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:53.916540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:53.919917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:53.921593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:53.934215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.935113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.935741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.940947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.941700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.942329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.953556 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bc1db76-8b06-4263-8456-862d5cade430 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.353575 Oct 26 05:08:53.954647 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 991/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:53 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:53.959538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:53.960400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:53.968974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.988554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.988882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:53.989673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:53.990141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:53.990637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:54.296988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:54.310202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e5455d9-1921-4dfe-aa1f-f75491e0eec5 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1681 microversion: 2.1 time: 0.404853 Oct 26 05:08:54.310815 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 991/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:53 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:54.321592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01371946-cd57-4329-a612-9ce135fcb865 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a227160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:54.371111 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01371946-cd57-4329-a612-9ce135fcb865 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631328503" status: 204 len: 0 microversion: 2.2 time: 0.058846 Oct 26 05:08:54.372216 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 992/1983] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 26 05:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631328503 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:54.386376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a3ae257-8ba1-460a-bf80-7eefdbc727a5 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470a0d5160>, body: {"keypair": {"name": "tempest-keypair-307432761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUlyXRkg58lg/uJtgfy1qZ1UFlWtywP9zuMWjZ+F3FwdLjs3gcrm1r4OOE7oG4Kb7UnwNtL701kUHa53SBVTG2UfxOUyzDl61XstVFCBYvOONjWe/7TkW8NyJYwCjKbXA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:54.390054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:54.401819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50e47cbf-c967-48c9-8d01-4650a6c25612 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.445822 Oct 26 05:08:54.402403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 992/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:53 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:54.419928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:54.420564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:54.426673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:54.427398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:54.428849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1a3ae257-8ba1-460a-bf80-7eefdbc727a5 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:54.431758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:54.432422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:54.432906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:54.433355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:54.441110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1a3ae257-8ba1-460a-bf80-7eefdbc727a5 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:54.489079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a3ae257-8ba1-460a-bf80-7eefdbc727a5 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.106400 Oct 26 05:08:54.489996 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 993/1985] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:08:54.505511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf3e070c-15bb-499e-a21d-0e7980394e96 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a94b430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:54.538313 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf3e070c-15bb-499e-a21d-0e7980394e96 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307432761" status: 204 len: 0 microversion: 2.2 time: 0.038656 Oct 26 05:08:54.540517 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 994/1986] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 26 05:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307432761 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:08:54.558352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cca93368-c888-4602-b1e9-9cd745f48326 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470a15b820>, body: {"keypair": {"name": "tempest-keypair-1444711144", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:54.602206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cca93368-c888-4602-b1e9-9cd745f48326 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:54.611732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=9,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:54.612794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cca93368-c888-4602-b1e9-9cd745f48326 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:54.664269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cca93368-c888-4602-b1e9-9cd745f48326 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.115112 Oct 26 05:08:54.665295 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 995/1987] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:54 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:08:54.679738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b761f7e6-5607-4d06-a4d8-71ce7c169629 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a227b80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:54.745657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b761f7e6-5607-4d06-a4d8-71ce7c169629 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444711144" status: 204 len: 0 microversion: 2.2 time: 0.071824 Oct 26 05:08:54.748513 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 996/1988] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 26 05:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444711144 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:54.767701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:54.771088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1487b459-8c4e-46bc-abf7-292f30071340 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470a0d58b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-19555281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMz+fLKUSmPx5aHt/dJgCRqcIwu2+71MhEp0jSHCZh2kc2CNH8MOE7FeEmL0mle0SwGQCNLNopKm3yHpiNp+qMz8bm5UMsfUuhKRKEs2Orz9QOorLcp+zkXmakoBDOPVw=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:54.780254 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a087210a-68a9-4892-a943-9ebddb11cf8f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.364125 Oct 26 05:08:54.794445 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 993/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:54 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:08:54.814389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1487b459-8c4e-46bc-abf7-292f30071340 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:54.825494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1487b459-8c4e-46bc-abf7-292f30071340 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:54.899219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1487b459-8c4e-46bc-abf7-292f30071340 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.143149 Oct 26 05:08:54.900509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:54.901331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:54.909152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 997/1990] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:54 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:08:54.911321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:54.915985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:54.916665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:54.916940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-43338670-e9da-420c-a572-4d124a44984f tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470a94b940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-513246607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRbkDSvYuo2pDf3TcnbpVrnvjLvZWP1plCwmpro/d6H8SWCIWXVAOhNrKWAmDjTQ28/wZ01eGfe/A+kRpnO2gE+5FyzEHflm7uru6hpnCo+3TTF7nxNzpuC4FBW7G2VuA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:54.917831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:54.918458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:54.926221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:54.939426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-43338670-e9da-420c-a572-4d124a44984f tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:54.946310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-43338670-e9da-420c-a572-4d124a44984f tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:54.992319 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-43338670-e9da-420c-a572-4d124a44984f tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.081421 Oct 26 05:08:55.002298 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 998/1991] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:54 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:08:55.011822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:55.013166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:55.020824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:55.021509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:55.022847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:55.023823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:55.024539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:55.025082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:55.377095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:55.386600 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f79580f4-00a6-4c1e-bd40-fc25bf0d6512 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1472 microversion: 2.1 time: 0.490342 Oct 26 05:08:55.394166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 994/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:54 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:55.400060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-56b4004f-bb63-4a3a-be9b-d508d6a4d146 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470aeb7ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-693932161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrWXkgaVAkxozy1RTnSFBKIxgf6FwTjPK7faRNsOnS3NGJ59S0yibdZgIUa0NWao9/TvqbPMCdv+Xt3PsE73Ba/nMPb6sS+7acU0qvdDCI9PnOVe7pvUx2825GrO4saA=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:55.408423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:55.418136 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abcfed78-f260-4aa1-80d4-d538dc224c10 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.413078 Oct 26 05:08:55.418967 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 999/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:55 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:55.424080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:55.424987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:55.447322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:55.448115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:55.448750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:55.452195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:55.452195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:55.452664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:55.454032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-56b4004f-bb63-4a3a-be9b-d508d6a4d146 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:55.470211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-56b4004f-bb63-4a3a-be9b-d508d6a4d146 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:55.515582 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-56b4004f-bb63-4a3a-be9b-d508d6a4d146 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.120023 Oct 26 05:08:55.520955 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 995/1994] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:55 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:08:55.535108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:55.536397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:55.550160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:55.550795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:55.551309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:55.552086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:55.553856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:55.554535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:55.972206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:55.985083 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66f70676-fe35-48c0-9144-5647a8b8f9a6 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1681 microversion: 2.1 time: 0.564834 Oct 26 05:08:55.990003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:56.005159 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1000/1995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:55 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1681 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:56.011963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-575a8de4-452b-4a58-9577-f618febd02cf tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a217af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.031313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2bbcfe02-f9a5-4803-aa49-fc81fc6acad4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.505682 Oct 26 05:08:56.045380 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 996/1996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:55 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:56.047766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.052437 n-d-862416-4 devstack@n-api.service[120586]: WARNING oslo_db.sqlalchemy.utils [None req-575a8de4-452b-4a58-9577-f618febd02cf tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 05:08:56.052623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:56.067148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:56.067803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:56.068213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-575a8de4-452b-4a58-9577-f618febd02cf tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1138 microversion: 2.2 time: 0.059191 Oct 26 05:08:56.069330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:56.070398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1001/1997] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 26 05:08:56 2022] GET /compute/v2.1/os-keypairs => generated 1138 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:56.071444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:56.072147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:56.072829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:56.081188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-989ae401-e8fd-4dc5-bc4c-00bd2a048f0a tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a15b670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.123670 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-989ae401-e8fd-4dc5-bc4c-00bd2a048f0a tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-693932161" status: 204 len: 0 microversion: 2.2 time: 0.046160 Oct 26 05:08:56.124995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1002/1998] 10.222.0.16 () {60 vars in 1318 bytes} [Wed Oct 26 05:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-693932161 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:56.135588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f92e1524-8e70-4b46-bebf-1e1b00c10d78 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a941790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.170432 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f92e1524-8e70-4b46-bebf-1e1b00c10d78 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-513246607" status: 204 len: 0 microversion: 2.2 time: 0.040857 Oct 26 05:08:56.171495 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1003/1999] 10.222.0.16 () {60 vars in 1318 bytes} [Wed Oct 26 05:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-513246607 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:08:56.181434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19510f58-3edf-43c1-9eb0-76028dbaed32 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a941ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.207877 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19510f58-3edf-43c1-9eb0-76028dbaed32 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-19555281" status: 204 len: 0 microversion: 2.2 time: 0.031630 Oct 26 05:08:56.210254 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1004/2000] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 26 05:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-19555281 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:08:56.223173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f03dfaf1-7c68-40f2-9cdb-bf30e53f3eef tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470aa76160>, body: {"keypair": {"name": "tempest-keypair-695430903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCJYvTh+gKtHcHGVX3oN6g6anFfEr9Qd4pn2RJWNpvEboFPzZeBijgp/RI0NRPMioMkBVc9FmBph7UvioqfMW2FiA2UiRExArBAjg+lg++Khex/C5ZfZxAaMISn5vr9RA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:56.246617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f03dfaf1-7c68-40f2-9cdb-bf30e53f3eef tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:56.253432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f03dfaf1-7c68-40f2-9cdb-bf30e53f3eef tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:56.301467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f03dfaf1-7c68-40f2-9cdb-bf30e53f3eef tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.082048 Oct 26 05:08:56.303346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1005/2001] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 26 05:08:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 26 05:08:56.323560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dd8c83b-f3b4-455b-948d-f275580c72b1 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a217430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.341340 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dd8c83b-f3b4-455b-948d-f275580c72b1 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-695430903" status: 200 len: 512 microversion: 2.2 time: 0.029196 Oct 26 05:08:56.344185 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1006/2002] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 26 05:08:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-695430903 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:56.360486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d3e3be1-29c9-4893-b7c7-5a2af845f830 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a15bdc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.366878 n-d-862416-4 devstack@n-api.service[120586]: WARNING oslo_db.sqlalchemy.utils [None req-3d3e3be1-29c9-4893-b7c7-5a2af845f830 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 05:08:56.375099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d3e3be1-29c9-4893-b7c7-5a2af845f830 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.023174 Oct 26 05:08:56.376735 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1007/2003] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 26 05:08:56 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:56.389906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6d76926-41a5-43cd-b424-91bb45d92de4 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a80e4c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.424529 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6d76926-41a5-43cd-b424-91bb45d92de4 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695430903" status: 204 len: 0 microversion: 2.2 time: 0.040011 Oct 26 05:08:56.431035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1008/2004] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 26 05:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695430903 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:56.438079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.441256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:56.452050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:56.452642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:56.453109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:56.453940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:56.454425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:56.456186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:56.608846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:56.617418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79cfdd00-844e-4c0d-97f7-095796a5dadf tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1430 microversion: 2.1 time: 0.184706 Oct 26 05:08:56.634856 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1009/2005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:56 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1430 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:56.640026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Action: 'create', calling method: .version_select at 0x7f470a9049d0>, body: {"keypair": {"name": "tempest-keypair-558020560", "type": "x509"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:56.645004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:56.657857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:56.658109 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a558f111-819b-48e9-96b6-b469fa29e56b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.618228 Oct 26 05:08:56.658691 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 997/2006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:56 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:56.673787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:56.674811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:56.680546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:56.685681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:56.686520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:56.687248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:56.688184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:56.688876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:56.689558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:56.701396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.processutils [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpfaw6hf_c/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpfaw6hf_c/temp.key -subj /CN=12fe5571f7e246048f445ae42074dc52 -extensions v3_req_client {{(pid=120586) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 26 05:08:56.982521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.processutils [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpfaw6hf_c/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpfaw6hf_c/temp.key -subj /CN=12fe5571f7e246048f445ae42074dc52 -extensions v3_req_client" returned: 0 in 0.280s {{(pid=120586) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 26 05:08:56.983608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.processutils [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpfaw6hf_c/temp.key -password pass: {{(pid=120586) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 26 05:08:57.054466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.processutils [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpfaw6hf_c/temp.key -password pass:" returned: 0 in 0.070s {{(pid=120586) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 26 05:08:57.066743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:57.077278 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c9f37752-b08a-4ccf-9da1-e8c28708df81 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.416950 Oct 26 05:08:57.085246 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 998/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:56 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:57.094530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2f0b1fc7-8059-4a05-b982-73aad9909c32 req-c3db2468-df4c-4a9e-9549-ae6e031ec0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46448c6-28d1-4533-9ff3-2e160f3b28dd", "name": "network-vif-plugged", "status": "completed", "tag": "4e07b583-4c8d-4359-ab3b-32365dd9a3ba"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:57.120863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2f0b1fc7-8059-4a05-b982-73aad9909c32 req-c3db2468-df4c-4a9e-9549-ae6e031ec0ef service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.121364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2f0b1fc7-8059-4a05-b982-73aad9909c32 req-c3db2468-df4c-4a9e-9549-ae6e031ec0ef service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.125929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2f0b1fc7-8059-4a05-b982-73aad9909c32 req-c3db2468-df4c-4a9e-9549-ae6e031ec0ef service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.153438 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2f0b1fc7-8059-4a05-b982-73aad9909c32 req-c3db2468-df4c-4a9e-9549-ae6e031ec0ef service nova] Creating event network-vif-plugged:4e07b583-4c8d-4359-ab3b-32365dd9a3ba for instance b46448c6-28d1-4533-9ff3-2e160f3b28dd on n-h2-862416-4 Oct 26 05:08:57.159896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:08:57.170880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Getting quotas for user 12fe5571f7e246048f445ae42074dc52 and project 1aab59dc6dca4f59a7095088dcddab19. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:08:57.173427 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2f0b1fc7-8059-4a05-b982-73aad9909c32 req-c3db2468-df4c-4a9e-9549-ae6e031ec0ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081543 Oct 26 05:08:57.192672 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 999/2008] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:57.201089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22ccd10e-6ff3-40b0-a337-05b3381ee089 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.564814 Oct 26 05:08:57.202267 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1010/2009] 10.222.0.16 () {62 vars in 1198 bytes} [Wed Oct 26 05:08:56 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 567 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:57.208600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.210344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:57.229525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0e0d1d36-7fbf-4983-984c-2d7925cbd952 req-904be4c7-e656-47b2-865a-b3b1e29eff0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1775471-ce05-493c-8ec3-03ef2f475e70", "name": "network-vif-deleted", "tag": "09ae13fc-660e-48a5-9396-5902986e5f6c"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:57.230470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.231035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.231863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.232862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.236475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.237172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.272457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0e0d1d36-7fbf-4983-984c-2d7925cbd952 req-904be4c7-e656-47b2-865a-b3b1e29eff0d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.273103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0e0d1d36-7fbf-4983-984c-2d7925cbd952 req-904be4c7-e656-47b2-865a-b3b1e29eff0d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.273615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0e0d1d36-7fbf-4983-984c-2d7925cbd952 req-904be4c7-e656-47b2-865a-b3b1e29eff0d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.286928 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0e0d1d36-7fbf-4983-984c-2d7925cbd952 req-904be4c7-e656-47b2-865a-b3b1e29eff0d service nova] Creating event network-vif-deleted:09ae13fc-660e-48a5-9396-5902986e5f6c for instance c1775471-ce05-493c-8ec3-03ef2f475e70 on n-h1-862416-4 Oct 26 05:08:57.295277 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0e0d1d36-7fbf-4983-984c-2d7925cbd952 req-904be4c7-e656-47b2-865a-b3b1e29eff0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100481 Oct 26 05:08:57.296282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1000/2010] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:57.302360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.303147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:57.310187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.310680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.311119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.311891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.312399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.314545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.339526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:57.345232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:57.356216 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e79a85d2-e9b0-4fc6-8c56-691399c45197 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1613 microversion: 2.1 time: 0.152578 Oct 26 05:08:57.372853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1011/2011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:57 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:57.372853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-439e44c0-0daf-4a54-8388-eecabe75b056 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a227c10>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.378798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:57.383864 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-439e44c0-0daf-4a54-8388-eecabe75b056 tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-558020560" status: 200 len: 1533 microversion: 2.2 time: 0.025739 Oct 26 05:08:57.385475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1012/2012] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 26 05:08:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-558020560 => generated 1533 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:57.398640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34932064-9511-45ae-b3f2-daf8f3a387fb tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470a904d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.404370 n-d-862416-4 devstack@n-api.service[120586]: WARNING oslo_db.sqlalchemy.utils [None req-34932064-9511-45ae-b3f2-daf8f3a387fb tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 05:08:57.418218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34932064-9511-45ae-b3f2-daf8f3a387fb tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.025076 Oct 26 05:08:57.419705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1013/2013] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 26 05:08:57 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:57.432020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3195dd7b-ec45-46f5-be80-b8ad2103b47f tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] Calling method '.version_select at 0x7f470aa76d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.473611 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3195dd7b-ec45-46f5-be80-b8ad2103b47f tempest-KeyPairsV22TestJSON-1613577488 tempest-KeyPairsV22TestJSON-1613577488-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558020560" status: 204 len: 0 microversion: 2.2 time: 0.034831 Oct 26 05:08:57.482026 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1014/2014] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 26 05:08:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558020560 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:57.629436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:57.643210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.644344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:57.649603 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0dacfcd9-f1cd-4a83-b683-0619e8f118c5 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.352007 Oct 26 05:08:57.650926 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1001/2015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:57 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:57.669101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.677132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.687946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.689510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.690011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.690460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.695256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:57.695884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:57.714848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.715351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.715791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.716536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.716991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.726236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.766261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:57.767127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:57.767769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:57.768443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lazy-loading 'fault' on Instance uuid c1775471-ce05-493c-8ec3-03ef2f475e70 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:08:57.846241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:57.858666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b204c58d-e658-457d-a401-51f25a9c9bb9 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 200 len: 1307 microversion: 2.1 time: 0.220051 Oct 26 05:08:57.863651 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1015/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:57 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:58.023059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:58.034164 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-25766e76-71f4-4ec6-8cd9-ef78abcd70fa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.353099 Oct 26 05:08:58.040461 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1002/2017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:57 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:58.104067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:58.105347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:58.117068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.119393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.120018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.121093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.121774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.122393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.368300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:58.379353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7fe1a5b-67b6-4b64-81bf-cb3eb82faa6d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.280591 Oct 26 05:08:58.380226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:58.394224 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1016/2018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:58 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:58.396185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:58.407341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.407991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.408555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.409456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.410026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.410820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.524150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:58.533909 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c7ad6f0-07b1-436e-b84d-62bc2f5aea54 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1613 microversion: 2.1 time: 0.157483 Oct 26 05:08:58.540013 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1003/2019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:58 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:58.681083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:58.681827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:58.692755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.694466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.694932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.695998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.696730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.697823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.888483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:58.889301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: c1775471-ce05-493c-8ec3-03ef2f475e70] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:58.907438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.911431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.912352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.913449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:58.916897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:58.917663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:58.970296 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] HTTP exception thrown: Instance c1775471-ce05-493c-8ec3-03ef2f475e70 could not be found. Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Request method failure captured: Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 HTTP/1.1 Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMBcPleC9cvZWYiG4qJPZXFraTzJ1yF8qoI85KioVwDjG9rhhhDDewxVJzU7csG9CPgdTlA9m6X8n1fN4HJF2hdPEjSWl24ZKhSvpydzRc9lOT8DgyDfhqYXvT_vnN6pr5CAI8OMoLNOTWvud79yL8JXnGrDXSF2L_N8R11wuKFUD9c Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ab86a0b60ef64ada93def6110b51a7a1 Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListImageFiltersTestJSON-753670404 Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:08:58.974081 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListImageFiltersTestJSON-753670404 Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ab86a0b60ef64ada93def6110b51a7a1 Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-753670404 Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListImageFiltersTestJSON-753670404-project Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: cac28401d16c47d4a2c3392352a4bb55 Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListImageFiltersTestJSON-753670404-project Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c1775471-ce05-493c-8ec3-03ef2f475e70 could not be found. Oct 26 05:08:58.976044 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c1775471-ce05-493c-8ec3-03ef2f475e70'} Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1775471-ce05-493c-8ec3-03ef2f475e70 could not be found. Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:08:58.977000 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1775471-ce05-493c-8ec3-03ef2f475e70 could not be found. Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1775471-ce05-493c-8ec3-03ef2f475e70 could not be found. Oct 26 05:08:58.980732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:08:58.988766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Returning 404 to user: Instance c1775471-ce05-493c-8ec3-03ef2f475e70 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:08:58.990071 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d6e83438-7c91-4346-9df5-70fed923f689 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70" status: 404 len: 111 microversion: 2.1 time: 0.105553 Oct 26 05:08:58.991905 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1004/2020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:58 2022] GET /compute/v2.1/servers/c1775471-ce05-493c-8ec3-03ef2f475e70 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:08:59.004577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:59.005728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:59.013078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.013831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.014482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.016040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.017209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.018032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.096185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:08:59.172102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:59.182936 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10b3709e-b1c9-4ed4-8459-6003acef1f61 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1357 microversion: 2.1 time: 0.508419 Oct 26 05:08:59.204565 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1017/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:58 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1357 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:59.220046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:59.222183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:59.244738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.245878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.246968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.250238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.251349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.253458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.273306 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91c03344-d91d-4408-896f-2e8fb86d53f2 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 204 len: 0 microversion: 2.1 time: 0.277064 Oct 26 05:08:59.282713 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1005/2022] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:08:58 2022] DELETE /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:08:59.301943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:59.304867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:59.316315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.319267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.319724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.323514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.324390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.325007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.664837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:59.674728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93a5c55e-1ec6-464f-ba4b-545dd92df1ef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.469717 Oct 26 05:08:59.674919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:08:59.676128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1018/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:59 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:59.682851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a0723c68-de79-4278-a2c7-624f7a205a63 req-59eb9e11-b038-459f-84d6-592956f9177e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73891979-1cb8-4772-be88-1e6eebb0c6ca", "name": "network-vif-deleted", "tag": "95d26a1c-494a-40cf-b790-57f45dfab372"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:59.685242 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d8311ae-f566-43de-b54e-ddd926f3232d tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1474 microversion: 2.1 time: 0.395034 Oct 26 05:08:59.688766 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1006/2024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:59 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1474 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:08:59.697488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a0723c68-de79-4278-a2c7-624f7a205a63 req-59eb9e11-b038-459f-84d6-592956f9177e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.697844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:59.698476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:59.698729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a0723c68-de79-4278-a2c7-624f7a205a63 req-59eb9e11-b038-459f-84d6-592956f9177e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.699787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a0723c68-de79-4278-a2c7-624f7a205a63 req-59eb9e11-b038-459f-84d6-592956f9177e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.713686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=6,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:08:59.722695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.723600 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a0723c68-de79-4278-a2c7-624f7a205a63 req-59eb9e11-b038-459f-84d6-592956f9177e service nova] Creating event network-vif-deleted:95d26a1c-494a-40cf-b790-57f45dfab372 for instance 73891979-1cb8-4772-be88-1e6eebb0c6ca on n-h2-862416-4 Oct 26 05:08:59.724127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.725089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.726076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.726741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.727349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.733473 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a0723c68-de79-4278-a2c7-624f7a205a63 req-59eb9e11-b038-459f-84d6-592956f9177e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055527 Oct 26 05:08:59.734537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1019/2025] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:59.750258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8e3c7f2b-0ad7-4754-8ef5-f7a813d1e124 req-2faaef81-9531-44e0-a968-01a990642d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522771cc-3392-4767-ba87-48a030cf98b2", "name": "network-vif-plugged", "status": "completed", "tag": "d7fe2f79-78e7-4921-b829-5f957ae6129e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:08:59.762084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8e3c7f2b-0ad7-4754-8ef5-f7a813d1e124 req-2faaef81-9531-44e0-a968-01a990642d3a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.762922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8e3c7f2b-0ad7-4754-8ef5-f7a813d1e124 req-2faaef81-9531-44e0-a968-01a990642d3a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.763615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8e3c7f2b-0ad7-4754-8ef5-f7a813d1e124 req-2faaef81-9531-44e0-a968-01a990642d3a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.780326 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8e3c7f2b-0ad7-4754-8ef5-f7a813d1e124 req-2faaef81-9531-44e0-a968-01a990642d3a service nova] Creating event network-vif-plugged:d7fe2f79-78e7-4921-b829-5f957ae6129e for instance 522771cc-3392-4767-ba87-48a030cf98b2 on n-h1-862416-4 Oct 26 05:08:59.792232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8e3c7f2b-0ad7-4754-8ef5-f7a813d1e124 req-2faaef81-9531-44e0-a968-01a990642d3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053987 Oct 26 05:08:59.794662 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1020/2026] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:08:59.809074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:08:59.809848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:08:59.825026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.825572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.826022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.828522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.829013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.832599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.925523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:08:59.926031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:08:59.926481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:08:59.926956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lazy-loading 'fault' on Instance uuid 73891979-1cb8-4772-be88-1e6eebb0c6ca {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:09:00.003675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690f0e61ed8642abb3c0e6ba980416ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05daa3b4e1914e6f82f7491d810c2b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:00.016012 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-825e7dfd-94a4-41a0-aef9-632d7d63bc4f tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 200 len: 1331 microversion: 2.1 time: 0.219118 Oct 26 05:09:00.017345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1021/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:59 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 1331 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:00.051098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:00.062626 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aefb84ad-e8a9-402a-8d8c-fd1115c08f78 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1307 microversion: 2.1 time: 0.372479 Oct 26 05:09:00.073228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1007/2028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:08:59 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:00.213003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:00.213652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:00.220605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.222482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.223754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.225264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.225834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.226453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.266464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:00.404016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:00.413730 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16dc489b-c937-4811-884e-63aa2f3cec3c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1540 microversion: 2.1 time: 0.204242 Oct 26 05:09:00.429666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1022/2029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:00 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1540 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:00.435529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:00.436314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:00.448210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.448712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.449159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.449917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.450377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.450813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.556642 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e3bdbc43-3f42-48b6-9bb2-e60406143e68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124917 Oct 26 05:09:00.557628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1008/2030] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:09:00 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:00.718987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:00.719695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:00.719904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:00.720491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:00.728087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.728582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.729029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.729770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.732102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.733032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.733718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.735926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.736475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:00.737163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:00.737848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:00.738077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:01.753576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:01.765465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:01.766069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f71e78c1-9e0d-406d-91bc-82d6c30e9920 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1474 microversion: 2.1 time: 1.049978 Oct 26 05:09:01.777337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1009/2031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:00 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1474 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:01.777337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:01.777337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:01.777961 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5851b9e-af17-4046-902b-52e6e9891c62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 1.061916 Oct 26 05:09:01.782011 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1023/2032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:00 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:01.791442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:01.791951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:01.798810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:01.799649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:01.800196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:01.801022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:01.801611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:01.802302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:01.810342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:01.810840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:01.811284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:01.811996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:01.812453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:01.812869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:01.823232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] HTTP exception thrown: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Request method failure captured: Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca HTTP/1.1 Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_5gbrltZAz0elyVmM7v_XrFsu3biUOM284BnNAS7vHC1zeqP_9-lt5pWs0OnaQCJ0JaYpAszaFSepLAsrNBjAGz-urj9XhwnioiX4MqcsJgStje8QmRTvzr3FH6tWnOeO30YVNq6JXBqwoLiSxGnCqhgg-jh67tb1vv3CMH3z5NaI Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05daa3b4e1914e6f82f7491d810c2b0d Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:01.825062 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05daa3b4e1914e6f82f7491d810c2b0d Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachSCSIVolumeTestJSON-705903595-project Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 690f0e61ed8642abb3c0e6ba980416ae Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-705903595-project Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:01.827119 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '73891979-1cb8-4772-be88-1e6eebb0c6ca'} Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:01.828234 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:01.830104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:01.831830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Returning 404 to user: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:01.833358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61573c95-97f9-4057-8b24-dc935e920a33 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 404 len: 111 microversion: 2.1 time: 0.063606 Oct 26 05:09:01.833358 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1010/2033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:01 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:01.844984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-926d66a6-0f0e-4675-82d1-752f8cbaa8cf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '.version_select at 0x7f470eb15f70>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:01.884716 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-926d66a6-0f0e-4675-82d1-752f8cbaa8cf tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512605010" status: 202 len: 0 microversion: 2.1 time: 0.043141 Oct 26 05:09:01.888436 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1011/2034] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512605010 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:09:02.275010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:02.287837 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-784382fb-110c-4ec1-8a6d-e95a4cd0a8c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 200 len: 1488 microversion: 2.1 time: 0.504911 Oct 26 05:09:02.289079 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1024/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:01 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:02.313250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-813319895"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:02.315796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:02.328415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:02.329560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:02.330243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:02.331320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:02.332034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:02.333030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:02.646085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-51b26986-08ba-45c4-88b9-b5ea3da0f6f5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2/action" status: 202 len: 0 microversion: 2.1 time: 0.338224 Oct 26 05:09:02.656710 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1012/2036] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:09:02 2022] POST /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:09:02.658494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66a2adc0-4e94-43a1-b4d1-43d41eb980a5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1c03a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:02.738371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66a2adc0-4e94-43a1-b4d1-43d41eb980a5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.083630 Oct 26 05:09:02.739281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1025/2037] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:02 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:02.792388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:02.793133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:02.801301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:02.803032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:02.816884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:02.817659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:02.820185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:02.821174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:02.822479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:02.823435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:02.824108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:02.825481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:02.825911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:02.828760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:02.829562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:02.832352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:03.464581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:03.477022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac28401d16c47d4a2c3392352a4bb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab86a0b60ef64ada93def6110b51a7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:03.496471 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c5344971-2a0f-4860-a9a6-9bdf882da189 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 200 len: 1474 microversion: 2.1 time: 0.708727 Oct 26 05:09:03.497236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1013/2038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:02 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 1474 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:03.500361 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98c784b4-5154-4710-ad7e-f47836e462c7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.693956 Oct 26 05:09:03.505127 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1026/2039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:02 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:03.525048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7fa23811-339d-4ad0-9240-b09a37ec6e9d req-7755bdf6-b65b-4b02-8ea7-3f4b64577447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b2734d-3da3-4143-b801-4b6a216fce26", "name": "network-vif-deleted", "tag": "366c75f6-c900-433e-8c7b-2be3c6bb5fed"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:03.529130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-58f4af77-9d2f-46bc-9a37-fed6abdf56f6 req-a7f22e82-9f24-4a95-8273-e5b2b7be279c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2afc5cb-8479-4969-bb3a-c2afb38d9999", "name": "network-vif-plugged", "status": "completed", "tag": "a635d9b6-684a-4ada-b899-e8fd83ac2e3d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:03.556387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7fa23811-339d-4ad0-9240-b09a37ec6e9d req-7755bdf6-b65b-4b02-8ea7-3f4b64577447 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:03.556878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7fa23811-339d-4ad0-9240-b09a37ec6e9d req-7755bdf6-b65b-4b02-8ea7-3f4b64577447 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:03.558124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-58f4af77-9d2f-46bc-9a37-fed6abdf56f6 req-a7f22e82-9f24-4a95-8273-e5b2b7be279c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:03.561927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-58f4af77-9d2f-46bc-9a37-fed6abdf56f6 req-a7f22e82-9f24-4a95-8273-e5b2b7be279c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:03.562657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-58f4af77-9d2f-46bc-9a37-fed6abdf56f6 req-a7f22e82-9f24-4a95-8273-e5b2b7be279c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:03.563938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7fa23811-339d-4ad0-9240-b09a37ec6e9d req-7755bdf6-b65b-4b02-8ea7-3f4b64577447 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:03.598578 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-58f4af77-9d2f-46bc-9a37-fed6abdf56f6 req-a7f22e82-9f24-4a95-8273-e5b2b7be279c service nova] Creating event network-vif-plugged:a635d9b6-684a-4ada-b899-e8fd83ac2e3d for instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 on n-h1-862416-4 Oct 26 05:09:03.599273 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7fa23811-339d-4ad0-9240-b09a37ec6e9d req-7755bdf6-b65b-4b02-8ea7-3f4b64577447 service nova] Creating event network-vif-deleted:366c75f6-c900-433e-8c7b-2be3c6bb5fed for instance e1b2734d-3da3-4143-b801-4b6a216fce26 on n-h2-862416-4 Oct 26 05:09:03.605572 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-58f4af77-9d2f-46bc-9a37-fed6abdf56f6 req-a7f22e82-9f24-4a95-8273-e5b2b7be279c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104281 Oct 26 05:09:03.606873 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1014/2040] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:03.617232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7fa23811-339d-4ad0-9240-b09a37ec6e9d req-7755bdf6-b65b-4b02-8ea7-3f4b64577447 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109557 Oct 26 05:09:03.618291 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1027/2041] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:03.755241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bae2c7e8-8c41-4f5d-a6f7-db2bd8791ced tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a018430>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:03.872372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bae2c7e8-8c41-4f5d-a6f7-db2bd8791ced tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.118843 Oct 26 05:09:03.875532 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1015/2042] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:03 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:04.150052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a874f60b-eff9-4d3d-a9e0-fc58d4affa00 req-323168c7-c11e-40fe-83e4-26f167cf2638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46448c6-28d1-4533-9ff3-2e160f3b28dd", "tag": "4e07b583-4c8d-4359-ab3b-32365dd9a3ba"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:04.174343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a874f60b-eff9-4d3d-a9e0-fc58d4affa00 req-323168c7-c11e-40fe-83e4-26f167cf2638 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:04.175319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a874f60b-eff9-4d3d-a9e0-fc58d4affa00 req-323168c7-c11e-40fe-83e4-26f167cf2638 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:04.177155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a874f60b-eff9-4d3d-a9e0-fc58d4affa00 req-323168c7-c11e-40fe-83e4-26f167cf2638 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:04.218196 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a874f60b-eff9-4d3d-a9e0-fc58d4affa00 req-323168c7-c11e-40fe-83e4-26f167cf2638 service nova] Creating event network-changed:4e07b583-4c8d-4359-ab3b-32365dd9a3ba for instance b46448c6-28d1-4533-9ff3-2e160f3b28dd on n-h2-862416-4 Oct 26 05:09:04.236002 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a874f60b-eff9-4d3d-a9e0-fc58d4affa00 req-323168c7-c11e-40fe-83e4-26f167cf2638 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092640 Oct 26 05:09:04.249006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1028/2043] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:04.518983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:04.521281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] [instance: e1b2734d-3da3-4143-b801-4b6a216fce26] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:04.532156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:04.532971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:04.540333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:04.540822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:04.541250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:04.542205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:04.542829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:04.543513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:04.544719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:04.547075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:04.547755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:04.550427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:04.553604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:04.555601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:04.591123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] HTTP exception thrown: Instance e1b2734d-3da3-4143-b801-4b6a216fce26 could not be found. Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Request method failure captured: Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 HTTP/1.1 Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMBcPleC9cvZWYiG4qJPZXFraTzJ1yF8qoI85KioVwDjG9rhhhDDewxVJzU7csG9CPgdTlA9m6X8n1fN4HJF2hdPEjSWl24ZKhSvpydzRc9lOT8DgyDfhqYXvT_vnN6pr5CAI8OMoLNOTWvud79yL8JXnGrDXSF2L_N8R11wuKFUD9c Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ab86a0b60ef64ada93def6110b51a7a1 Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListImageFiltersTestJSON-753670404 Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:04.594490 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab86a0b60ef64ada93def6110b51a7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListImageFiltersTestJSON-753670404 Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ab86a0b60ef64ada93def6110b51a7a1 Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-753670404 Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListImageFiltersTestJSON-753670404-project Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: cac28401d16c47d4a2c3392352a4bb55 Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListImageFiltersTestJSON-753670404-project Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e1b2734d-3da3-4143-b801-4b6a216fce26 could not be found. Oct 26 05:09:04.596336 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e1b2734d-3da3-4143-b801-4b6a216fce26'} Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b2734d-3da3-4143-b801-4b6a216fce26 could not be found. Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:04.597287 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b2734d-3da3-4143-b801-4b6a216fce26 could not be found. Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b2734d-3da3-4143-b801-4b6a216fce26 could not be found. Oct 26 05:09:04.598910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:04.600954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Returning 404 to user: Instance e1b2734d-3da3-4143-b801-4b6a216fce26 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:04.600954 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fc99e1d-8e82-46ad-a812-4984ba956c49 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26" status: 404 len: 111 microversion: 2.1 time: 0.079241 Oct 26 05:09:04.600954 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1016/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:04 2022] GET /compute/v2.1/servers/e1b2734d-3da3-4143-b801-4b6a216fce26 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:04.622280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4656d2d-ef38-4680-b148-c1c1b2e16676 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470e9f23a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:05.338082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:05.348967 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8577f83-05b9-4f03-8481-6c3158193d8c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1317 microversion: 2.1 time: 0.821509 Oct 26 05:09:05.351049 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1029/2045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:04 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1317 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:05.367811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9064036a-555a-4044-9ba6-6b56568af7de tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a2175e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:05.377422 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4656d2d-ef38-4680-b148-c1c1b2e16676 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/images/33f9bfce-15bf-434a-bf81-1bed36799267" status: 204 len: 0 microversion: 2.1 time: 0.769593 Oct 26 05:09:05.378101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1017/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:04 2022] DELETE /compute/v2.1/images/33f9bfce-15bf-434a-bf81-1bed36799267 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:09:05.387437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d1f4433-360f-4801-8e88-a81588802573 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f470a018820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:05.491091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=14 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:05.896832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d1f4433-360f-4801-8e88-a81588802573 tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/images/ef2cf785-b722-413f-a8c5-29cfa0a3f950" status: 204 len: 0 microversion: 2.1 time: 0.513532 Oct 26 05:09:05.901413 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1018/2047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:05 2022] DELETE /compute/v2.1/images/ef2cf785-b722-413f-a8c5-29cfa0a3f950 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:09:05.914615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f03d770-b82b-497d-8d64-5cbc59ec9aee tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] Calling method '.version_select at 0x7f4709f70e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:05.921047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9064036a-555a-4044-9ba6-6b56568af7de tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.568621 Oct 26 05:09:05.926997 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1030/2048] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:05 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:06.413028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:06.413869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:06.469837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:06.478885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:06.489788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:06.506828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:06.507769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:06.508406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:06.511527 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f03d770-b82b-497d-8d64-5cbc59ec9aee tempest-ListImageFiltersTestJSON-753670404 tempest-ListImageFiltersTestJSON-753670404-project] 10.222.0.16 "DELETE /compute/v2.1/images/d819c8cf-71ec-4eeb-817d-af60974d0d2f" status: 204 len: 0 microversion: 2.1 time: 0.608166 Oct 26 05:09:06.511978 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1019/2049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:05 2022] DELETE /compute/v2.1/images/d819c8cf-71ec-4eeb-817d-af60974d0d2f => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:09:06.947046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a172e9e5-03bf-44c0-955b-d1faa782df63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709f70430>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:07.065065 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a172e9e5-03bf-44c0-955b-d1faa782df63 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.123745 Oct 26 05:09:07.072300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1020/2050] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:06 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:07.182870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=73,nova_cell0:UPDATE=7 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:07.646718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:07.663843 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8fa0e5d-b431-4a9b-82be-96519587d8b3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1506 microversion: 2.1 time: 1.289788 Oct 26 05:09:07.664503 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1031/2051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:06 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1506 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:07.696139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:07.696765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:07.720751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:07.726919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:07.727050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:07.727827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:07.728298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:07.728729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:07.812064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:09:08.084322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cfa812d-c163-4fc6-92ee-1d024e409f1e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a0d5af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:08.095391 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-798395b9-bd7e-4b00-8c92-b004baf0ec17 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 204 len: 0 microversion: 2.1 time: 0.407300 Oct 26 05:09:08.100503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1021/2052] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:09:07 2022] DELETE /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:09:08.149870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:08.153961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:08.176955 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cfa812d-c163-4fc6-92ee-1d024e409f1e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.098892 Oct 26 05:09:08.180479 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1032/2053] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:08 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:08.200562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:08.201068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:08.209831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:08.210808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:08.211790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:08.212416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:08.217586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:08.719898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:08.733519 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9974a9c3-f34e-418e-a9c0-231db0ad8f3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1512 microversion: 2.1 time: 0.627652 Oct 26 05:09:08.758125 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1022/2054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:08 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:09.212723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97d274fb-1fae-4cbf-ad41-5f48b4f946d3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a15bee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:09.395470 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97d274fb-1fae-4cbf-ad41-5f48b4f946d3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.187924 Oct 26 05:09:09.404670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1033/2055] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:09 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:09.764302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:09.764900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:09.778615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:09.779383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:09.780169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:09.781076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:09.781722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:09.786976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:10.311601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:10.312232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5f535c5f-f2fb-41f7-bda0-5c79d1b960e6 req-0bb98a29-153c-4c52-92d6-9bc27956ce75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522771cc-3392-4767-ba87-48a030cf98b2", "name": "network-vif-plugged", "status": "completed", "tag": "d7fe2f79-78e7-4921-b829-5f957ae6129e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:10.328562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a23e9b77-0f6e-4949-bc31-420cc337c922 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1512 microversion: 2.1 time: 0.568963 Oct 26 05:09:10.358615 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1023/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:09 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:10.377066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5f535c5f-f2fb-41f7-bda0-5c79d1b960e6 req-0bb98a29-153c-4c52-92d6-9bc27956ce75 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:10.377613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5f535c5f-f2fb-41f7-bda0-5c79d1b960e6 req-0bb98a29-153c-4c52-92d6-9bc27956ce75 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:10.378071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5f535c5f-f2fb-41f7-bda0-5c79d1b960e6 req-0bb98a29-153c-4c52-92d6-9bc27956ce75 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:10.419345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-139c901c-aff9-448f-9964-9166b6bee881 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470eba4310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:10.433070 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5f535c5f-f2fb-41f7-bda0-5c79d1b960e6 req-0bb98a29-153c-4c52-92d6-9bc27956ce75 service nova] Creating event network-vif-plugged:d7fe2f79-78e7-4921-b829-5f957ae6129e for instance 522771cc-3392-4767-ba87-48a030cf98b2 on n-h1-862416-4 Oct 26 05:09:10.450777 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5f535c5f-f2fb-41f7-bda0-5c79d1b960e6 req-0bb98a29-153c-4c52-92d6-9bc27956ce75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144057 Oct 26 05:09:10.451396 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1034/2057] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:10.508993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-139c901c-aff9-448f-9964-9166b6bee881 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.094325 Oct 26 05:09:10.511117 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1024/2058] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:10 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:11.048032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed4383b6-f0c8-4822-8091-df1fafaaed62 tempest-ListImageFiltersNegativeTestJSON-350223718 tempest-ListImageFiltersNegativeTestJSON-350223718-project] Calling method '.version_select at 0x7f4709ffb3a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:11.098451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-ed4383b6-f0c8-4822-8091-df1fafaaed62 tempest-ListImageFiltersNegativeTestJSON-350223718 tempest-ListImageFiltersNegativeTestJSON-350223718-project] HTTP exception thrown: Image not found. Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed4383b6-f0c8-4822-8091-df1fafaaed62 tempest-ListImageFiltersNegativeTestJSON-350223718 tempest-ListImageFiltersNegativeTestJSON-350223718-project] Request method failure captured: Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/images/912f5fbc-76fa-4a0f-b1f8-acfb56b7f1e7 HTTP/1.1 Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMD2vP5rqVTXPwQxBWF_dlptypblX71I2td5oIuFIic7U-SMB6Usa11Sea2drGSxGVXfBK9IZZ0DXRHfhtqELCPotUYNYCCkJ_WqAmKG7hvS3mDojcOcC8lXs6Cq9X4Pey39zTMR2cish_o05sHAOZ4pm4C57K_Ow22ROnxWIcuVpIs Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bef96efe6e204bbb8db547da76215e4b Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-350223718 Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:11.102499 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bef96efe6e204bbb8db547da76215e4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bef96efe6e204bbb8db547da76215e4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bef96efe6e204bbb8db547da76215e4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bef96efe6e204bbb8db547da76215e4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-350223718 Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bef96efe6e204bbb8db547da76215e4b Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-350223718 Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListImageFiltersNegativeTestJSON-350223718-project Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ebd6970c0cb347328de2b803a5189003 Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-350223718-project Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '912f5fbc-76fa-4a0f-b1f8-acfb56b7f1e7'} Oct 26 05:09:11.104118 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:09:11.105161 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 912f5fbc-76fa-4a0f-b1f8-acfb56b7f1e7 Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:09:11.106642 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 912f5fbc-76fa-4a0f-b1f8-acfb56b7f1e7 could not be found. Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:09:11.108107 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:09:11.109555 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:11.117454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed4383b6-f0c8-4822-8091-df1fafaaed62 tempest-ListImageFiltersNegativeTestJSON-350223718 tempest-ListImageFiltersNegativeTestJSON-350223718-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:11.117454 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed4383b6-f0c8-4822-8091-df1fafaaed62 tempest-ListImageFiltersNegativeTestJSON-350223718 tempest-ListImageFiltersNegativeTestJSON-350223718-project] 10.222.0.16 "GET /compute/v2.1/images/912f5fbc-76fa-4a0f-b1f8-acfb56b7f1e7" status: 404 len: 62 microversion: 2.1 time: 0.194036 Oct 26 05:09:11.118669 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1025/2059] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:10 2022] GET /compute/v2.1/images/912f5fbc-76fa-4a0f-b1f8-acfb56b7f1e7 => generated 62 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 05:09:11.126768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2b9b55e-af82-45c4-88d2-6faca1c8f430 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Action: 'create', calling method: .version_select at 0x7f470a890b80>, body: {"pool": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:11.366390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:11.369870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:11.386954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:11.390779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:11.392133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:11.393368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:11.394582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:11.398348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:12.386550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:12.399969 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-56f276cd-f550-4449-950e-068db8acf83e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1512 microversion: 2.1 time: 1.046829 Oct 26 05:09:12.408667 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1026/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:11 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1512 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:12.429134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cd73ce99-962d-4095-ae92-c7f8705f191a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a8da3a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:12.549990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cd73ce99-962d-4095-ae92-c7f8705f191a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.134800 Oct 26 05:09:12.550683 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1027/2061] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:12 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:13.434380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:13.435821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:13.455106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:13.457393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:13.458105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:13.460351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:13.462399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:13.463655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:13.808264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:13.826107 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce45947e-5823-4947-bb19-1f5a6f521107 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1470 microversion: 2.1 time: 0.397837 Oct 26 05:09:13.833346 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1028/2062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:13 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:13.838674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d82a3e27-efe4-4995-8a8a-86b044e7173b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709f70670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:13.962263 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d82a3e27-efe4-4995-8a8a-86b044e7173b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.127310 Oct 26 05:09:13.962819 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1029/2063] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:13 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:13.970899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-431526dc-fff2-419b-87d5-17d01beeb03d req-fbce6d7c-e9b9-486d-915c-43e2dfc9623f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2afc5cb-8479-4969-bb3a-c2afb38d9999", "name": "network-vif-deleted", "tag": "a635d9b6-684a-4ada-b899-e8fd83ac2e3d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:13.998975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-431526dc-fff2-419b-87d5-17d01beeb03d req-fbce6d7c-e9b9-486d-915c-43e2dfc9623f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:14.000849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-431526dc-fff2-419b-87d5-17d01beeb03d req-fbce6d7c-e9b9-486d-915c-43e2dfc9623f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:14.002738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-431526dc-fff2-419b-87d5-17d01beeb03d req-fbce6d7c-e9b9-486d-915c-43e2dfc9623f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:14.030656 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-431526dc-fff2-419b-87d5-17d01beeb03d req-fbce6d7c-e9b9-486d-915c-43e2dfc9623f service nova] Creating event network-vif-deleted:a635d9b6-684a-4ada-b899-e8fd83ac2e3d for instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 on n-h1-862416-4 Oct 26 05:09:14.048303 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-431526dc-fff2-419b-87d5-17d01beeb03d req-fbce6d7c-e9b9-486d-915c-43e2dfc9623f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080472 Oct 26 05:09:14.049096 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1030/2064] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:14.855622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:14.857924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:14.874122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:14.875174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:14.876560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:14.878266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:14.880540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:14.882693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:15.022176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:15.024632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:15.025300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:15.026021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lazy-loading 'fault' on Instance uuid d2afc5cb-8479-4969-bb3a-c2afb38d9999 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:09:15.469434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:15.480639 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b178c60-577a-436e-9296-edde2872c011 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 200 len: 1307 microversion: 2.1 time: 0.632791 Oct 26 05:09:15.486599 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1031/2065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:14 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 1307 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:15.509156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:15.509876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:15.530422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:15.530796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:15.537834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:15.542030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:15.546328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:15.547126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:15.604883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] HTTP exception thrown: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Request method failure captured: Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca HTTP/1.1 Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_5gbrltZAz0elyVmM7v_XrFsu3biUOM284BnNAS7vHC1zeqP_9-lt5pWs0OnaQCJ0JaYpAszaFSepLAsrNBjAGz-urj9XhwnioiX4MqcsJgStje8QmRTvzr3FH6tWnOeO30YVNq6JXBqwoLiSxGnCqhgg-jh67tb1vv3CMH3z5NaI Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05daa3b4e1914e6f82f7491d810c2b0d Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:15.607197 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05daa3b4e1914e6f82f7491d810c2b0d Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachSCSIVolumeTestJSON-705903595-project Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 690f0e61ed8642abb3c0e6ba980416ae Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-705903595-project Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.609135 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '73891979-1cb8-4772-be88-1e6eebb0c6ca'} Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:15.610332 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.612767 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.622283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Returning 404 to user: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:15.626351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d206ffff-7225-48b7-8d7b-9f45541d85d0 tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 404 len: 111 microversion: 2.1 time: 0.138453 Oct 26 05:09:15.629003 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1032/2066] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:09:15 2022] DELETE /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:15.642002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e59d7258-c800-4ffb-8f2b-8e044e855ac6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709fb9af0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:15.763995 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e59d7258-c800-4ffb-8f2b-8e044e855ac6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.127854 Oct 26 05:09:15.765154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1033/2067] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:15 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:15.777771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:15.778674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] [instance: 73891979-1cb8-4772-be88-1e6eebb0c6ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:15.799738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:15.805135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:15.805923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:15.806859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:15.808832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:15.811502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:15.864364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] HTTP exception thrown: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Request method failure captured: Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca HTTP/1.1 Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_5gbrltZAz0elyVmM7v_XrFsu3biUOM284BnNAS7vHC1zeqP_9-lt5pWs0OnaQCJ0JaYpAszaFSepLAsrNBjAGz-urj9XhwnioiX4MqcsJgStje8QmRTvzr3FH6tWnOeO30YVNq6JXBqwoLiSxGnCqhgg-jh67tb1vv3CMH3z5NaI Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 05daa3b4e1914e6f82f7491d810c2b0d Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:15.868604 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/05daa3b4e1914e6f82f7491d810c2b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 05daa3b4e1914e6f82f7491d810c2b0d Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-705903595 Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachSCSIVolumeTestJSON-705903595-project Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 690f0e61ed8642abb3c0e6ba980416ae Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-705903595-project Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.870427 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '73891979-1cb8-4772-be88-1e6eebb0c6ca'} Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:15.871308 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. Oct 26 05:09:15.873660 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:15.889235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] Returning 404 to user: Instance 73891979-1cb8-4772-be88-1e6eebb0c6ca could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:15.890614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09637e14-161b-415a-a4da-aa6ed4c9072b tempest-AttachSCSIVolumeTestJSON-705903595 tempest-AttachSCSIVolumeTestJSON-705903595-project] 10.222.0.16 "GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca" status: 404 len: 111 microversion: 2.1 time: 0.124278 Oct 26 05:09:15.896633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1034/2068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:15 2022] GET /compute/v2.1/servers/73891979-1cb8-4772-be88-1e6eebb0c6ca => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:16.556988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:16.556988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:16.556988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:16.560591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:16.560591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:16.560591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:16.560591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:16.569424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:16.656453 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 HTTP/1.1 Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:16.676027 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:09:16.677107 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd2afc5cb-8479-4969-bb3a-c2afb38d9999'} Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:16.677713 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:09:16.678721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:16.679678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:16.679678 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5a7a642e-6e9d-41e8-81f0-4aebd470186d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 404 len: 111 microversion: 2.1 time: 0.167336 Oct 26 05:09:16.679678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1035/2069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:16 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:09:16.687219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:16.695909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:16.712031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:16.712534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:16.712982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:16.713747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:16.714175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:16.714605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:17.865910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:17.882121 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b00bc37f-71c1-4933-b305-8971e9ef5f49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 1.198584 Oct 26 05:09:17.883050 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1036/2070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:16 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:17.901382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4609ee2-10ca-4d9c-a229-581e7c619f58 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709fdc5e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:17.995686 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4609ee2-10ca-4d9c-a229-581e7c619f58 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.111485 Oct 26 05:09:17.996490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1037/2071] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:17 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:18.266525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a6865513-8d4d-4ae6-8761-cd42b4b6448a tempest-ListImagesTestJSON-665710221 tempest-ListImagesTestJSON-665710221-project] Calling method '.version_select at 0x7f470ea135e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:18.361125 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a6865513-8d4d-4ae6-8761-cd42b4b6448a tempest-ListImagesTestJSON-665710221 tempest-ListImagesTestJSON-665710221-project] 10.222.0.16 "GET /compute/v2.1/images/d596d51f-4bb2-4340-8449-72226e2537e8" status: 200 len: 784 microversion: 2.1 time: 0.363407 Oct 26 05:09:18.362910 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1038/2072] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:17 2022] GET /compute/v2.1/images/d596d51f-4bb2-4340-8449-72226e2537e8 => generated 784 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:18.376469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b59d260b-9ac3-4fe8-b738-f284f2ddbc2a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b59d260b-9ac3-4fe8-b738-f284f2ddbc2a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 163 Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:18.388412 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": 12345, "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:18.389540 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 12345 Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:18.390120 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:18.391101 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:09:18.392047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:09:18.392047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 26 05:09:18.392047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:18.393712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b59d260b-9ac3-4fe8-b738-f284f2ddbc2a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:18.394744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b59d260b-9ac3-4fe8-b738-f284f2ddbc2a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.030821 Oct 26 05:09:18.395494 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1039/2073] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:18 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:18.404734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-68a742ae-99eb-4086-830f-a84c1081de15 tempest-ListImagesTestJSON-665710221 tempest-ListImagesTestJSON-665710221-project] Calling method '.version_select at 0x7f4709f70d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:18.520915 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-68a742ae-99eb-4086-830f-a84c1081de15 tempest-ListImagesTestJSON-665710221 tempest-ListImagesTestJSON-665710221-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.124125 Oct 26 05:09:18.522483 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1040/2074] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 26 05:09:18 2022] GET /compute/v2.1/images => generated 445 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:18.530899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:18.531850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:18.541198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:18.542029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:18.542739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:18.543719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:18.544405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:18.545037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:19.238385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:19.254881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bde15c58-fb45-4eb8-b21f-2b2b219cfcba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.730570 Oct 26 05:09:19.269537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1041/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:18 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:19.274111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1a9c19a-0a84-4156-a726-ec022e68dbda tempest-ListImagesTestJSON-665710221 tempest-ListImagesTestJSON-665710221-project] Calling method '.version_select at 0x7f4709fdc310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:19.351057 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1a9c19a-0a84-4156-a726-ec022e68dbda tempest-ListImagesTestJSON-665710221 tempest-ListImagesTestJSON-665710221-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.093017 Oct 26 05:09:19.369576 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1042/2076] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:09:19 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:19.974565 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2b9b55e-af82-45c4-88d2-6faca1c8f430 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.438600 Oct 26 05:09:19.984991 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1035/2077] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:09:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:19.993752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff08380e-4188-4f6a-ad7f-32cce1080e7a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a227160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:20.073242 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff08380e-4188-4f6a-ad7f-32cce1080e7a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.086791 Oct 26 05:09:20.074110 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1036/2078] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:19 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:20.098028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:20.098796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:20.100824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e3949da9-0dcf-4bfc-b8ce-650cd9881d42 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Action: 'create', calling method: .version_select at 0x7f4709f70af0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:20.125660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:20.126169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:20.126615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:20.127345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:20.127810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:20.128242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:20.156923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e3949da9-0dcf-4bfc-b8ce-650cd9881d42 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Getting quotas for project 3d2f34e5c68d46e082e350a47c00207c. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:09:20.169913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e3949da9-0dcf-4bfc-b8ce-650cd9881d42 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Getting quotas for user 1fef2a5009cc44a1aa961b300cb57a0f and project 3d2f34e5c68d46e082e350a47c00207c. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:09:20.262417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e3949da9-0dcf-4bfc-b8ce-650cd9881d42 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Getting quotas for project 3d2f34e5c68d46e082e350a47c00207c. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:09:20.279260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e3949da9-0dcf-4bfc-b8ce-650cd9881d42 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Getting quotas for user 1fef2a5009cc44a1aa961b300cb57a0f and project 3d2f34e5c68d46e082e350a47c00207c. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:09:20.311087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e3949da9-0dcf-4bfc-b8ce-650cd9881d42 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.940174 Oct 26 05:09:20.319106 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1043/2079] 10.222.0.16 () {62 vars in 1214 bytes} [Wed Oct 26 05:09:19 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:09:20.325130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4341d99-bd42-4280-a78f-c55c9036f8ff tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Action: 'create', calling method: .version_select at 0x7f4709fdc0d0>, body: {"pool": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:20.694566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:20.704386 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-edca6992-7571-4fca-8c3e-765c4880e98e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.629462 Oct 26 05:09:20.713406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1037/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:20 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:20.727791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7058e91-0eac-458a-bf63-0f657968a5f0 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:20.853932 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7058e91-0eac-458a-bf63-0f657968a5f0 tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.121783 Oct 26 05:09:20.860659 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1038/2081] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 26 05:09:20 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:09:20.876907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22135557-210a-42a3-b425-7ea2616a5aca tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:20.918428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22135557-210a-42a3-b425-7ea2616a5aca tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6" status: 200 len: 235 microversion: 2.64 time: 0.053288 Oct 26 05:09:20.932078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1039/2082] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 26 05:09:20 2022] GET /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6 => generated 235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:09:20.941491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5274c1ef-6d80-4f8c-87f7-a37e33b8c65b tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:21.017738 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5274c1ef-6d80-4f8c-87f7-a37e33b8c65b tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6" status: 204 len: 0 microversion: 2.64 time: 0.084054 Oct 26 05:09:21.020346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1040/2083] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Oct 26 05:09:20 2022] DELETE /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:09:21.042432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ee25729-31d6-4dc4-aed4-98cc90203bcc tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:21.074337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6ee25729-31d6-4dc4-aed4-98cc90203bcc tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] HTTP exception thrown: Instance group 879cd407-1fe3-4bbc-9453-f1184db14bf6 could not be found. Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ee25729-31d6-4dc4-aed4-98cc90203bcc tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Request method failure captured: Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6 HTTP/1.1 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMD-FKf28mCstT7wlKBixKOXloJ4L8tRWplRhUk7awpLJkR6JBZXkHcfQgwTaUOh5vlN7Xsf5ZeQIxVRA_PlPy_vSjf410_tBS_cZ5M24H2LxYLnQiXeCndUGfkxKs2T9xIA7NUrhFzguEUOd2jIHBayctELIZvunzjXVoUJz8cCCi4 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.64 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3d2f34e5c68d46e082e350a47c00207c Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroup264TestJSON-315938599 Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:09:21.088651 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d2f34e5c68d46e082e350a47c00207c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d2f34e5c68d46e082e350a47c00207c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d2f34e5c68d46e082e350a47c00207c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d2f34e5c68d46e082e350a47c00207c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroup264TestJSON-315938599 Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3d2f34e5c68d46e082e350a47c00207c Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroup264TestJSON-315938599 Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroup264TestJSON-315938599-project Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 1fef2a5009cc44a1aa961b300cb57a0f Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroup264TestJSON-315938599-project Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance group 879cd407-1fe3-4bbc-9453-f1184db14bf6 could not be found. Oct 26 05:09:21.090048 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '879cd407-1fe3-4bbc-9453-f1184db14bf6'} Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 879cd407-1fe3-4bbc-9453-f1184db14bf6 could not be found. Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:21.090698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 879cd407-1fe3-4bbc-9453-f1184db14bf6 could not be found. Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 879cd407-1fe3-4bbc-9453-f1184db14bf6 could not be found. Oct 26 05:09:21.091692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:21.092574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ee25729-31d6-4dc4-aed4-98cc90203bcc tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] Returning 404 to user: Instance group 879cd407-1fe3-4bbc-9453-f1184db14bf6 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:21.094527 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ee25729-31d6-4dc4-aed4-98cc90203bcc tempest-ServerGroup264TestJSON-315938599 tempest-ServerGroup264TestJSON-315938599-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6" status: 404 len: 117 microversion: 2.64 time: 0.068079 Oct 26 05:09:21.103179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1041/2084] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Oct 26 05:09:21 2022] DELETE /compute/v2.1/os-server-groups/879cd407-1fe3-4bbc-9453-f1184db14bf6 => generated 117 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:21.123552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b8311db-2e77-44c4-9ecb-97482e45d171 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1c0af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:21.303146 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b8311db-2e77-44c4-9ecb-97482e45d171 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.194614 Oct 26 05:09:21.303789 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1042/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:21 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:22.318275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3415948a-89c6-4583-8467-7f1f54ef6ae1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470c0821f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:22.436925 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3415948a-89c6-4583-8467-7f1f54ef6ae1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.122503 Oct 26 05:09:22.457183 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1043/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:22 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:23.749342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:23.750989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:23.751475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:23.751917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:23.752658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:23.753164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:23.753558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:23.887593 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e1ee710-8449-4a16-aeec-6790ca9fce88 tempest-AZV2TestJSON-492628473 tempest-AZV2TestJSON-492628473-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.736344 Oct 26 05:09:23.898978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1044/2087] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 26 05:09:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:09:23.906090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd33fbf9-5fda-42ee-a9ac-39192e055cfc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a0d5820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:23.987560 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd33fbf9-5fda-42ee-a9ac-39192e055cfc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.086311 Oct 26 05:09:23.988174 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1045/2088] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:23 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:24.102173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1185008373", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:24.216337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:09:24.735516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4341d99-bd42-4280-a78f-c55c9036f8ff tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.414395 Oct 26 05:09:24.737592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1044/2089] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:09:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:24.750967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0e4ebb1-4ab7-4754-a47a-46e62b768536 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Action: 'create', calling method: .version_select at 0x7f4709f81af0>, body: {"pool": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:25.015632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:09:25.017020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:09:25.017756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:09:25.018865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:09:25.019459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:09:25.041460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:25.043564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:25.044867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:25.046182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:25.047154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:25.047773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:25.079871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Getting quotas for project 60cef7fa9ad14fcb880668f75572014c. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:09:25.090387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Getting quotas for user c121297c135e40cd81102e13139a6b1b and project 60cef7fa9ad14fcb880668f75572014c. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:09:25.115073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:09:25.118441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:09:25.220066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ebe79dbb-bcf5-4c19-b5c8-72588d13ab0c tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230766 Oct 26 05:09:25.234026 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1046/2090] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:09:25.268235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dbcb5eea-9eec-42f0-9b92-7209fb78c591 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a941c10>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:25.420496 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dbcb5eea-9eec-42f0-9b92-7209fb78c591 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.184033 Oct 26 05:09:25.428907 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1047/2091] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:25 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:25.448894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8648b039-a59a-48e7-83db-d9b05acc1414 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:25.450897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8648b039-a59a-48e7-83db-d9b05acc1414 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:25.678616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8648b039-a59a-48e7-83db-d9b05acc1414 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:25.692137 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8648b039-a59a-48e7-83db-d9b05acc1414 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1223 microversion: 2.1 time: 0.268688 Oct 26 05:09:25.692984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1048/2092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:25 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1223 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:25.698801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f7d05ae-84db-4a06-bf17-9cde645f5eee tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1486066828", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "24bf2964-47a3-4e1d-ba32-67e5938e1ba3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:25.876200 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1f7d05ae-84db-4a06-bf17-9cde645f5eee tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Block Device 24bf2964-47a3-4e1d-ba32-67e5938e1ba3 is not bootable. Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f7d05ae-84db-4a06-bf17-9cde645f5eee tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 358 Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:09:25.887302 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:25.888598 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1486066828", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "24bf2964-47a3-4e1d-ba32-67e5938e1ba3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: exception: Block Device 24bf2964-47a3-4e1d-ba32-67e5938e1ba3 is not bootable. Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1486066828', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '24bf2964-47a3-4e1d-ba32-67e5938e1ba3'}], 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 26 05:09:25.889162 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 24bf2964-47a3-4e1d-ba32-67e5938e1ba3 is not bootable. Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 05:09:25.890013 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 24bf2964-47a3-4e1d-ba32-67e5938e1ba3 is not bootable. Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 24bf2964-47a3-4e1d-ba32-67e5938e1ba3 is not bootable. Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f7d05ae-84db-4a06-bf17-9cde645f5eee tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Block Device 24bf2964-47a3-4e1d-ba32-67e5938e1ba3 is not bootable. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f7d05ae-84db-4a06-bf17-9cde645f5eee tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.194425 Oct 26 05:09:25.891089 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1049/2093] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:25 2022] POST /compute/v2.1/servers => generated 110 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:25.906794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:25.907564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:25.931246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:25.934013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:25.937915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:25.939609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:25.940414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:25.940994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:26.525354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:26.535169 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-501d03b9-935e-4790-982a-a4d37b75e226 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.638319 Oct 26 05:09:26.539214 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1050/2094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:25 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:27.018046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6e32352-ccd5-44e1-82b6-2a27938bd0ed tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a77d670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:27.110560 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6e32352-ccd5-44e1-82b6-2a27938bd0ed tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.570085 Oct 26 05:09:27.111669 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1051/2095] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:26 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:27.117166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:27.123804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:27.145604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:27.146500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:27.147451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:27.148423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:27.149116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:27.149763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:27.811880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:27.838919 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c327f823-be26-4e1b-b915-d7b810ea79c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.725691 Oct 26 05:09:27.840977 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1052/2096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:27 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:27.858354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:27.859692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:27.863944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:27.884220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:27.885169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:27.887246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:27.889225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:27.891171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:27.893277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:28.184232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:28.229352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb7d9453-794b-43d3-9950-cb537c50a970 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1281 microversion: 2.1 time: 0.386798 Oct 26 05:09:28.234377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1053/2097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:27 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1281 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:28.245513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a613851-59e4-40ed-9e9b-1766152e3de8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a0ab280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:28.382495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a613851-59e4-40ed-9e9b-1766152e3de8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.146626 Oct 26 05:09:28.403537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1054/2098] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:28 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:29.244947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=50 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:29.295688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:29.297011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:29.308407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:29.309233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:29.309871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:29.310745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:29.311676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:29.313869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:29.612194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:29.624823 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d1e31c5-41d9-4eab-998b-42760b34697f tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1281 microversion: 2.1 time: 0.338109 Oct 26 05:09:29.630443 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1055/2099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:29 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1281 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:29.654786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-91304966-80aa-4941-b9c6-6068e90262b7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ad46160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:29.737996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-91304966-80aa-4941-b9c6-6068e90262b7 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.105756 Oct 26 05:09:29.739857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1056/2100] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:29 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:30.303588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:30.310557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:30.651390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:30.652033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:30.676456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:30.682138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:30.682918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:30.686130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:30.688204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:30.691264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:30.720942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=74 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:31.796308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:31.807588 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63d4989d-088d-420b-ac2a-3b3e6bce3c85 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 1.162549 Oct 26 05:09:31.810739 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1057/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:30 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:31.823886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bdad2e32-ae4b-4fb9-893f-a14aed620e2c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a15bdc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:31.937598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bdad2e32-ae4b-4fb9-893f-a14aed620e2c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.123902 Oct 26 05:09:31.941985 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1058/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:31 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:31.950760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9138c39-31e6-492b-a7ce-8de569590627 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1015902288", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d596d51f-4bb2-4340-8449-72226e2537e8", "destination_type": "local"}, {"source_type": "volume", "uuid": "29c8ca87-beb0-4940-b9ff-1c035183508c", "destination_type": "invalid"}], "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9138c39-31e6-492b-a7ce-8de569590627 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 495 Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:09:31.961154 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:31.962528 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1015902288", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d596d51f-4bb2-4340-8449-72226e2537e8", "destination_type": "local"}, {"source_type": "volume", "uuid": "29c8ca87-beb0-4940-b9ff-1c035183508c", "destination_type": "invalid"}], "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1015902288', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '29c8ca87-beb0-4940-b9ff-1c035183508c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 26 05:09:31.963133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'invalid' Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:09:31.963767 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 26 05:09:31.964835 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:31.987593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9138c39-31e6-492b-a7ce-8de569590627 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:31.988757 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9138c39-31e6-492b-a7ce-8de569590627 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.045748 Oct 26 05:09:31.993761 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1059/2103] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:31 2022] POST /compute/v2.1/servers => generated 155 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:32.007458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:32.011082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:32.032579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:32.034171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:32.039771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:32.040893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:32.042697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:32.043933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:33.016291 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0e4ebb1-4ab7-4754-a47a-46e62b768536 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.269895 Oct 26 05:09:33.017573 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1045/2104] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:09:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:33.029766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:33.042285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:33.096549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:33.097416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:33.098098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:33.099023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:33.101029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:33.101705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:33.495781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:33.504395 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1175fb42-4be6-4c19-ba5e-6404fc276c21 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 1.507078 Oct 26 05:09:33.505011 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1060/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:31 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:33.511452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc6d7698-3fff-448a-9966-eefc777f7b5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a77d310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:33.601617 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc6d7698-3fff-448a-9966-eefc777f7b5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.095429 Oct 26 05:09:33.611541 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1061/2106] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:33 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:33.618623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-72891aed-3353-4008-a4d7-48b6ce9011b3 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Action: 'create', calling method: .version_select at 0x7f470aac8430>, body: {"pool": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:33.826153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:33.834385 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82cba0f3-efb9-4f41-a88c-b60daf3a17f0 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 0.815471 Oct 26 05:09:33.837514 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1046/2107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:33 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:33.842540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:33.853344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:33.868773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:33.869275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:33.869734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:33.870443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:33.871049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:33.871617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:34.378269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:34.393947 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6cbf1b98-2b9e-4ec2-bcbe-2d791a8b4aba tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.555189 Oct 26 05:09:34.419845 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1047/2108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:33 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:34.505214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b2a64c6-3b1d-4294-bdbc-f0bde4548a5b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1165792899", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b2a64c6-3b1d-4294-bdbc-f0bde4548a5b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 492 Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:34.512448 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:34.513770 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1165792899", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1165792899', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:34.514436 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:34.514920 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:34.515981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 26 05:09:34.516910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:34.518457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b2a64c6-3b1d-4294-bdbc-f0bde4548a5b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:34.519539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b2a64c6-3b1d-4294-bdbc-f0bde4548a5b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.018316 Oct 26 05:09:34.522638 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1048/2109] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:34 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:34.531176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:34.539548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:34.558247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:34.563369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:34.564043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:34.564933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:34.565586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:34.566217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:35.065115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:35.082127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:35.092167 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f5b651e-44bf-48fe-8f9a-45a6e78b9776 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.564573 Oct 26 05:09:35.096304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1049/2110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:34 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:35.126051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ef049aa-e96f-4962-b132-c2c69729ee29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709f87ca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:35.226658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ef049aa-e96f-4962-b132-c2c69729ee29 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.113677 Oct 26 05:09:35.227995 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1050/2111] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:35 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:35.239585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-71b979f0-8433-4b82-bf6c-5594a1415139 req-cf4ae564-cf7b-4b78-9c25-db8af3c32528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9898b83-2dd3-497a-bd79-bd073cfef3f5", "tag": "4b6d06d0-5516-46ea-909d-e4f737a3cade"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:35.267298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-71b979f0-8433-4b82-bf6c-5594a1415139 req-cf4ae564-cf7b-4b78-9c25-db8af3c32528 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:35.269828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-71b979f0-8433-4b82-bf6c-5594a1415139 req-cf4ae564-cf7b-4b78-9c25-db8af3c32528 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:35.270382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-71b979f0-8433-4b82-bf6c-5594a1415139 req-cf4ae564-cf7b-4b78-9c25-db8af3c32528 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:35.302384 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-71b979f0-8433-4b82-bf6c-5594a1415139 req-cf4ae564-cf7b-4b78-9c25-db8af3c32528 service nova] Creating event network-changed:4b6d06d0-5516-46ea-909d-e4f737a3cade for instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 on n-h2-862416-4 Oct 26 05:09:35.326390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-71b979f0-8433-4b82-bf6c-5594a1415139 req-cf4ae564-cf7b-4b78-9c25-db8af3c32528 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096822 Oct 26 05:09:35.328873 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1051/2112] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:35.336576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:35.339038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:35.347258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:35.349413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:35.351278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:35.352250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:35.353126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:35.353807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:35.683521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:35.740956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:35.750069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a05f385d-673e-4855-8048-287aadb8bbfb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 0.419596 Oct 26 05:09:35.762148 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1052/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:35 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:35.767962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:35.768774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:35.787579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:35.789085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:35.789798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:35.790753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:35.791412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:35.792021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:36.398708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:36.412887 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3038da7-5a6e-4d94-b0fb-49ecfb865964 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.648261 Oct 26 05:09:36.413890 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1053/2114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:35 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:36.429734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5897f252-0b6d-450b-8ea1-e13ed9e08c4f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ea134c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:36.497442 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5897f252-0b6d-450b-8ea1-e13ed9e08c4f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1413 microversion: 2.1 time: 0.082369 Oct 26 05:09:36.499673 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1054/2115] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:36 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:36.538188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e79085c-afeb-46b5-a316-7ddbee91091b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e79085c-afeb-46b5-a316-7ddbee91091b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 416 Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:36.542672 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:36.543853 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:09:36.544399 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:36.544833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.545745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:36.546513 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:36.546513 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:36.546513 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:09:36.546513 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:09:36.546513 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:09:36.546513 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:36.550170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e79085c-afeb-46b5-a316-7ddbee91091b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:36.555428 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e79085c-afeb-46b5-a316-7ddbee91091b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.021990 Oct 26 05:09:36.556314 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1055/2116] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:36 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:09:36.564538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:36.571010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:36.584244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:36.585742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:36.586296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:36.587282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:36.588001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:36.588662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:36.934872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:36.945462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d188c68-81f7-4843-bad2-3127027ec0e4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.384536 Oct 26 05:09:36.962963 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1056/2117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:36 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:36.971838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:36.973364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:36.982415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:36.984115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:36.985242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:36.986860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:36.987557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:36.988241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:37.820109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:37.834193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec1aa988-8b94-4954-a21b-499ad59f2ac1 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 0.869687 Oct 26 05:09:37.834795 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1057/2118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:36 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:37.850595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:37.851117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:37.864362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:37.864863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:37.865339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:37.866240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:37.866706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:37.867137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:38.097613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-72891aed-3353-4008-a4d7-48b6ce9011b3 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.484535 Oct 26 05:09:38.098491 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1062/2119] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:09:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:38.104628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff614cab-6aaa-42a2-aaf3-ab74a2e986c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470b3b73a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:38.171940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff614cab-6aaa-42a2-aaf3-ab74a2e986c9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1422 microversion: 2.1 time: 0.072291 Oct 26 05:09:38.172807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1063/2120] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:38 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:38.177514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb15db52-0630-4abb-b64a-4f77c1d01d24 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f470ac54430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:38.274609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:38.282710 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58204508-b13d-4b3d-bebb-51435513238c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.446889 Oct 26 05:09:38.290335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1058/2121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:37 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:38.306568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8b0f4a69-065d-40f9-9710-9172171af584 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470ea0c5e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:38.388685 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8b0f4a69-065d-40f9-9710-9172171af584 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 200 len: 1422 microversion: 2.1 time: 0.096802 Oct 26 05:09:38.403622 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1059/2122] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:09:38 2022] GET /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:38.500317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c18b320-2853-41bd-817f-39d089b8e4bc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-203868126", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": -1, "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:38.529533 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-5c18b320-2853-41bd-817f-39d089b8e4bc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Flavor -1 could not be found. Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c18b320-2853-41bd-817f-39d089b8e4bc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 205 Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:38.535971 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:38.537595 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-203868126", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": -1, "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: exception: Flavor -1 could not be found. Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-203868126', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': -1, 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 05:09:38.538200 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 26 05:09:38.539169 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 26 05:09:38.540228 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:38.542660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c18b320-2853-41bd-817f-39d089b8e4bc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:38.543720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c18b320-2853-41bd-817f-39d089b8e4bc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.048133 Oct 26 05:09:38.546050 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1060/2123] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:38 2022] POST /compute/v2.1/servers => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 26 05:09:38.560026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:38.560985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:38.577253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:38.580929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:38.581642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:38.584724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:38.584724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:38.588012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:38.806631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb15db52-0630-4abb-b64a-4f77c1d01d24 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/4e43a0df-99e9-4634-bbb4-c3c3e0526d9a" status: 200 len: 142 microversion: 2.1 time: 0.632617 Oct 26 05:09:38.807223 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1064/2124] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:09:38 2022] GET /compute/v2.1/os-floating-ips/4e43a0df-99e9-4634-bbb4-c3c3e0526d9a => generated 142 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:38.812315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-803946775", "imageRef": "1f05f78f-6c46-461d-853a-7ce305c7b9a5", "flavorRef": "452", "networks": [{"uuid": "92d513bb-c446-48d6-b8f5-d149382fd9ca"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:38.883264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:38.908222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9c5c5226-6945-4bbd-bc99-4d890f26276e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.357766 Oct 26 05:09:38.911405 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1061/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:38 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:38.941122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f63bde8c-9084-48df-a853-eb51b43b7177 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f470a00f3a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:38.949571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] validate_networks() for [('92d513bb-c446-48d6-b8f5-d149382fd9ca', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:09:40.165951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:09:40.168175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:09:40.170207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:09:40.170910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:09:40.171874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:09:40.186702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:40.187434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:40.188182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:40.189092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:40.199049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:40.199701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:40.245843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:09:40.253220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for user 6390eed87d6a41df96e727227de791bb and project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:09:40.268335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:09:40.275127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1f05f78f-6c46-461d-853a-7ce305c7b9a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:09:40.371607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-817f2230-49c0-49db-8a94-34b95bed0f36 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563258 Oct 26 05:09:40.378666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1065/2126] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:09:40.388788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:40.389944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:40.396215 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f63bde8c-9084-48df-a853-eb51b43b7177 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/4e43a0df-99e9-4634-bbb4-c3c3e0526d9a" status: 202 len: 0 microversion: 2.1 time: 1.480784 Oct 26 05:09:40.399967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:40.400640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:40.401237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:40.402264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:40.402872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:40.403451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:40.403658 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1062/2127] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:09:38 2022] DELETE /compute/v2.1/os-floating-ips/4e43a0df-99e9-4634-bbb4-c3c3e0526d9a => generated 0 bytes in 1491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:09:40.409823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:40.410539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:40.466528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:40.470018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:40.486250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:40.487199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:40.493126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:40.493711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:40.803472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:40.821209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68acfc10-43d8-49b5-b377-43a61d4d0acb tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 0.434258 Oct 26 05:09:40.825784 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1066/2128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:40 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:40.832692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-948cc71e-0865-4f84-9277-5e4c751d53d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:40.833456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-948cc71e-0865-4f84-9277-5e4c751d53d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:40.876102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:40.895632 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-40196d1d-cad5-4939-9807-a902a0c87176 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.490853 Oct 26 05:09:40.897483 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1063/2129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:40 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:40.910897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ace1f593-ef87-472b-87ec-a4ecb3650a8f tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f470aeb7f70>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:40.976722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-948cc71e-0865-4f84-9277-5e4c751d53d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:40.997327 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-948cc71e-0865-4f84-9277-5e4c751d53d1 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1207 microversion: 2.1 time: 0.167144 Oct 26 05:09:40.999205 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1067/2130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:40 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1207 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:41.150064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12262eb0-94ad-43ae-a639-aa31e704222e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1069403467", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12262eb0-94ad-43ae-a639-aa31e704222e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 173 Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:09:41.156167 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1069403467", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:41.157584 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1069403467', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi -1 Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:41.161520 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:41.163444 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12262eb0-94ad-43ae-a639-aa31e704222e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-12262eb0-94ad-43ae-a639-aa31e704222e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.012559 Oct 26 05:09:41.164517 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1068/2131] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:09:41.174388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:41.175259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:41.185026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:41.186785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:41.195381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:41.196926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:41.197612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:41.198253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:41.432404 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ace1f593-ef87-472b-87ec-a4ecb3650a8f tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.532800 Oct 26 05:09:41.436761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1064/2132] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 26 05:09:40 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:09:41.451152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f9d51b56-4293-424d-ad1f-82637e386a98 req-1271eaee-317c-4ad5-8938-c060614414c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522771cc-3392-4767-ba87-48a030cf98b2", "name": "network-vif-unplugged", "status": "completed", "tag": "d7fe2f79-78e7-4921-b829-5f957ae6129e"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:41.478083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f9d51b56-4293-424d-ad1f-82637e386a98 req-1271eaee-317c-4ad5-8938-c060614414c2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:41.479221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f9d51b56-4293-424d-ad1f-82637e386a98 req-1271eaee-317c-4ad5-8938-c060614414c2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:41.481550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f9d51b56-4293-424d-ad1f-82637e386a98 req-1271eaee-317c-4ad5-8938-c060614414c2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:41.510371 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f9d51b56-4293-424d-ad1f-82637e386a98 req-1271eaee-317c-4ad5-8938-c060614414c2 service nova] Creating event network-vif-unplugged:d7fe2f79-78e7-4921-b829-5f957ae6129e for instance 522771cc-3392-4767-ba87-48a030cf98b2 on n-h1-862416-4 Oct 26 05:09:41.523617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f9d51b56-4293-424d-ad1f-82637e386a98 req-1271eaee-317c-4ad5-8938-c060614414c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084942 Oct 26 05:09:41.524984 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1065/2133] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:41.531235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:41.539137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-767623e9-e2b1-42cc-a48f-fb4a0259f186 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f4709fdc700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:41.551472 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c576c7ca-ca71-4415-949c-08f3236d14fe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.384562 Oct 26 05:09:41.577827 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1069/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:41 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:41.600972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:41.602130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:41.626211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:41.626734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:41.630155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:41.632199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:41.633077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:41.634263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.077482 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-767623e9-e2b1-42cc-a48f-fb4a0259f186 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.549275 Oct 26 05:09:42.078572 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1066/2135] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:09:41 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:42.091087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:42.091879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:42.106852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.107338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.107792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.108813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.109287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.109921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.129112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:42.142150 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3496149d-cb55-46fe-a37b-d0c88e50ca6a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.563090 Oct 26 05:09:42.143357 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1070/2136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:41 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:42.148878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:42.151399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:42.178443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.182694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.183832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.188737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.190051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.190686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.289944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:42.304972 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2614dd63-2955-4c76-8bf4-cd90b615440a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1259 microversion: 2.1 time: 0.160379 Oct 26 05:09:42.307494 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1071/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:42 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:42.316222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02e6632f-e165-4f28-aa42-cec0be4559ff tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f470a941af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:42.342527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:42.355343 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c40f304-7fa5-4d44-a350-b27d60060972 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 0.275453 Oct 26 05:09:42.357764 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1067/2138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:42 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:42.367622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84885595-c49d-45be-ad7b-5d319c87b17b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2027734124", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:42.376569 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-84885595-c49d-45be-ad7b-5d319c87b17b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84885595-c49d-45be-ad7b-5d319c87b17b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 216 Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:42.391657 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:42.392910 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2027734124", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2027734124', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:42.393536 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 26 05:09:42.394495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:42.398142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84885595-c49d-45be-ad7b-5d319c87b17b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:42.399501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-84885595-c49d-45be-ad7b-5d319c87b17b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.040614 Oct 26 05:09:42.400296 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1068/2139] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:42 2022] POST /compute/v2.1/servers => generated 123 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:42.410899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:42.411876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:42.422207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.423028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.424374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.426962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.428565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.429754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.721285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:42.729703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4adcb017-4fea-41b0-8495-cea274f99a38 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.323840 Oct 26 05:09:42.730285 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1069/2140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:42 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:42.760495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:42.762440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:42.774953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.783424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.784112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:42.784950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:42.785767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:42.789758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:43.707274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:43.727009 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7abc5ad-0353-475b-a06b-6be210dfd429 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.964235 Oct 26 05:09:43.745367 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1070/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:42 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:43.755727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:43.756366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:43.771250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:43.772985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:43.777984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:43.779042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:43.779735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:43.780368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:43.884484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:43.895639 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e986c5ca-5778-41a8-8161-d4a0e4aa8401 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1265 microversion: 2.1 time: 0.148930 Oct 26 05:09:43.900412 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1071/2142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:43 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:43.923365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:43.924387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:43.942177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:43.943224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:43.944426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:43.946380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:43.949240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:43.951157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:44.356611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:44.366879 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32117da7-9fba-44c3-8aba-2202539d3263 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1323 microversion: 2.1 time: 0.465125 Oct 26 05:09:44.386055 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1072/2143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:43 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:44.386055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6138ffdc-0299-42eb-8a04-5b3111361d99 req-51ffa966-99f9-4241-938a-c7fff67c728c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9898b83-2dd3-497a-bd79-bd073cfef3f5", "name": "network-vif-plugged", "status": "completed", "tag": "4b6d06d0-5516-46ea-909d-e4f737a3cade"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:44.411695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6138ffdc-0299-42eb-8a04-5b3111361d99 req-51ffa966-99f9-4241-938a-c7fff67c728c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:44.412609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6138ffdc-0299-42eb-8a04-5b3111361d99 req-51ffa966-99f9-4241-938a-c7fff67c728c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:44.413134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6138ffdc-0299-42eb-8a04-5b3111361d99 req-51ffa966-99f9-4241-938a-c7fff67c728c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:44.428896 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6138ffdc-0299-42eb-8a04-5b3111361d99 req-51ffa966-99f9-4241-938a-c7fff67c728c service nova] Creating event network-vif-plugged:4b6d06d0-5516-46ea-909d-e4f737a3cade for instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 on n-h2-862416-4 Oct 26 05:09:44.437406 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6138ffdc-0299-42eb-8a04-5b3111361d99 req-51ffa966-99f9-4241-938a-c7fff67c728c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063036 Oct 26 05:09:44.440769 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1073/2144] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:44.463748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fafc1150-7d51-45b6-92d3-3f708e1e3f4e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1324707924", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-key-254993474", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:44.572804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-fafc1150-7d51-45b6-92d3-3f708e1e3f4e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] validate_networks() for [('41ea2838-6a6b-46dd-a977-2fd3e47b8c50', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:09:44.829416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-fafc1150-7d51-45b6-92d3-3f708e1e3f4e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Invalid key_name provided. Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fafc1150-7d51-45b6-92d3-3f708e1e3f4e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 246 Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:44.836947 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:44.838173 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1324707924", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-key-254993474", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid key_name provided. Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1324707924', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'key_name': 'tempest-key-254993474', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 26 05:09:44.838752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-254993474 not found for user 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:44.839690 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:44.841478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fafc1150-7d51-45b6-92d3-3f708e1e3f4e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid key_name provided. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:44.844670 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fafc1150-7d51-45b6-92d3-3f708e1e3f4e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.396576 Oct 26 05:09:44.844670 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1074/2145] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:44 2022] POST /compute/v2.1/servers => generated 70 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:09:45.165259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-75ba47de-97f8-4d3b-ae75-eecb74e435e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Action: 'create', calling method: .version_select at 0x7f470ea135e0>, body: {"keypair": {"name": "tempest-keypair-792616239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVilt5Qt63tJ3nTKXIecEnTLCha3oe60sIFfRvF/9rEAk2YJiSI2+lFZEG79l/F4UczGbe7/cvmijZNdy3xnJtn91k00kxIW92Qu5xRz8tjMqbIiJM8AjXZdyBZ4GApcg=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:45.199449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-75ba47de-97f8-4d3b-ae75-eecb74e435e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Getting quotas for project 64091bf1c8d14f1ebf7c9be4eb68753e. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:09:45.215881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-75ba47de-97f8-4d3b-ae75-eecb74e435e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Getting quotas for user 2ea42164668b4720b9613f7be63ec59e and project 64091bf1c8d14f1ebf7c9be4eb68753e. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:09:45.276464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-75ba47de-97f8-4d3b-ae75-eecb74e435e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.435097 Oct 26 05:09:45.283512 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1075/2146] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:09:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:45.291477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:45.292251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:45.308349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:45.308860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:45.309330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:45.314511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:45.315013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:45.318244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:45.368355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:45.587861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-02e6632f-e165-4f28-aa42-cec0be4559ff tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/9c5f3c78-ed86-4b75-8e79-9d34141650f6" status: 202 len: 0 microversion: 2.1 time: 3.276229 Oct 26 05:09:45.592492 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1072/2147] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:09:42 2022] DELETE /compute/v2.1/os-floating-ips/9c5f3c78-ed86-4b75-8e79-9d34141650f6 => generated 0 bytes in 3281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:09:45.603207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:45.604150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:45.620010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:45.621186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:45.621836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:45.627468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:45.628309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:45.628978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:47.015190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:47.025155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7cfeb199-0517-49e3-a125-bcaa0d37d621 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 1.745129 Oct 26 05:09:47.030393 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1076/2148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:45 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:47.050895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:47.052416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:47.063507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:47.064102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:47.064674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:47.065594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:47.066155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:47.066708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:47.524642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:47.541808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fea24b0-41a3-4c1e-bf95-6ecb03f45187 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1307 microversion: 2.1 time: 1.942823 Oct 26 05:09:47.542413 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1073/2149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:45 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1307 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:47.566123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8324ab1e-3d8c-4e64-a420-79b895276a68 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f470a201790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:48.169626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:48.178803 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c01622d3-c5c1-40d5-a7e7-09ee91e6368b tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1472 microversion: 2.1 time: 1.146055 Oct 26 05:09:48.179999 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1077/2150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:47 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1472 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:48.185107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:48.185773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:48.192057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:48.192830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:48.193473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:48.194667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:48.195284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:48.195865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:48.831959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:48.848560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed5b94b2-4ad0-4ee3-9b11-40e5cd853768 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.660445 Oct 26 05:09:48.849201 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1078/2151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:48 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:48.893110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:48.899013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:48.927182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:48.927620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:48.928593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:48.929346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:48.936668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:48.946571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:48.996778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Request method failure captured: Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5/diagnostics HTTP/1.1 Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMEBqbNP4PEorb_eCruA8RE_maC0YFU8KwgLargKBBfWo7Nv8kVYp0ijiWHkplQF1OCbA-gb2q488COuMcXKRMR0akwA6ZRpnHy354_NPrcMpfWfoCWvG56I39XfXIRSZ39bIeyGy48OteuLUGuEc9hBdJEc8d9B0As4ltwOGoeD6MM Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 60cef7fa9ad14fcb880668f75572014c Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-913219722 Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:49.024101 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-913219722 Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 60cef7fa9ad14fcb880668f75572014c Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-913219722 Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiagnosticsNegativeTest-913219722-project Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c121297c135e40cd81102e13139a6b1b Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-913219722-project Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:49.025743 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': 'b9898b83-2dd3-497a-bd79-bd073cfef3f5'} Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:09:49.026594 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 26 05:09:49.028285 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:49.031097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:49.032494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6eb8476-f9da-4379-8c39-6d7c234805a6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.182267 Oct 26 05:09:49.040015 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1079/2152] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:09:48 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5/diagnostics => generated 117 bytes in 190 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:49.057735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:49.059163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:49.086194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:49.086660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:49.089575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:49.091418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:49.092164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:49.092892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:50.221287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:50.563281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:50.579079 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b31e7db-1e52-4cc0-baec-fd42c727cad0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1307 microversion: 2.1 time: 1.537676 Oct 26 05:09:50.581259 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1080/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:49 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1307 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:50.596358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:50.601757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:50.619402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:50.621817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:50.623318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:50.626815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:50.627537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:50.628829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:50.684514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:09:50.914118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d06d8ced-7925-4b7c-9882-f49b359ba9f6 tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 204 len: 0 microversion: 2.1 time: 0.327922 Oct 26 05:09:50.914822 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1081/2154] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:09:50 2022] DELETE /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:09:50.927738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5294c4af-f5bc-4c9a-a292-52523380f565 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2082348329", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:50.983188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:51.376236 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8324ab1e-3d8c-4e64-a420-79b895276a68 tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/a921979e-3c45-4454-b1c2-5ee79f145754" status: 202 len: 0 microversion: 2.1 time: 3.832764 Oct 26 05:09:51.377622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1074/2155] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:09:47 2022] DELETE /compute/v2.1/os-floating-ips/a921979e-3c45-4454-b1c2-5ee79f145754 => generated 0 bytes in 3835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:09:51.383629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a997e00b-ba46-4450-95fe-385186bddad4 req-8bb186f4-22df-41d3-b6e1-11c81432dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56e3676-5bff-4ea3-8e64-3d3cdf77f37a", "tag": "99f390e2-0c9d-473e-ac7e-2bac6495cbde"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:51.410097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-5294c4af-f5bc-4c9a-a292-52523380f565 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Neutron security group does_not_exist not found {{(pid=120585) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 26 05:09:51.410774 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-5294c4af-f5bc-4c9a-a292-52523380f565 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 26 05:09:51.415399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a997e00b-ba46-4450-95fe-385186bddad4 req-8bb186f4-22df-41d3-b6e1-11c81432dfe2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:51.416781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a997e00b-ba46-4450-95fe-385186bddad4 req-8bb186f4-22df-41d3-b6e1-11c81432dfe2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5294c4af-f5bc-4c9a-a292-52523380f565 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 258 Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:51.419279 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:51.420815 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2082348329", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2082348329', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 26 05:09:51.421532 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:09:51.422826 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 26 05:09:51.424103 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 26 05:09:51.426070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5294c4af-f5bc-4c9a-a292-52523380f565 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5294c4af-f5bc-4c9a-a292-52523380f565 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.505330 Oct 26 05:09:51.429702 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1082/2156] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 509 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:09:51.432549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a997e00b-ba46-4450-95fe-385186bddad4 req-8bb186f4-22df-41d3-b6e1-11c81432dfe2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:51.452464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:51.453205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:51.475922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:51.477378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:51.478880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:51.478880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:51.486001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:51.486770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:51.502371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a997e00b-ba46-4450-95fe-385186bddad4 req-8bb186f4-22df-41d3-b6e1-11c81432dfe2 service nova] Creating event network-changed:99f390e2-0c9d-473e-ac7e-2bac6495cbde for instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a on n-h1-862416-4 Oct 26 05:09:51.517715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a997e00b-ba46-4450-95fe-385186bddad4 req-8bb186f4-22df-41d3-b6e1-11c81432dfe2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138226 Oct 26 05:09:51.522563 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1075/2157] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:51.543839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "98061443-06be-4e60-b1b2-a9f138d3358a"}], "security_groups": [{"name": "tempest-securitygroup--1732685170"}], "key_name": "tempest-keypair-792616239", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:51.793717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121297c135e40cd81102e13139a6b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60cef7fa9ad14fcb880668f75572014c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:51.807249 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4df43f7-a5ca-45ee-9cb0-14cc690b060a tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 200 len: 1478 microversion: 2.1 time: 0.379336 Oct 26 05:09:51.808290 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1083/2158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:51 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 1478 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:51.825606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7290ce26-241b-4234-ace0-24e2523ed4ee tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] Calling method '.version_select at 0x7f470a937a60>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:52.122977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] validate_networks() for [('98061443-06be-4e60-b1b2-a9f138d3358a', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:09:54.363885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:09:54.364645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:09:54.364876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:09:54.365288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:09:54.366090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:09:54.384603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:54.385120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:54.385605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:54.390634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:54.391162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:54.393830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:54.431481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Getting quotas for project 64091bf1c8d14f1ebf7c9be4eb68753e. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:09:54.448841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Getting quotas for user 2ea42164668b4720b9613f7be63ec59e and project 64091bf1c8d14f1ebf7c9be4eb68753e. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:09:54.492161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:09:54.499284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:09:54.624295 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bea5e09c-d7c2-4619-94ab-7ec4fe2cab43 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.098338 Oct 26 05:09:54.634403 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1076/2159] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:09:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 3110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:09:54.644093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:54.649279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:54.664672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:54.665702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:54.668069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:54.670255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:54.684432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:54.686059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:54.892016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7290ce26-241b-4234-ace0-24e2523ed4ee tempest-FloatingIPDetailsTestJSON-17255703 tempest-FloatingIPDetailsTestJSON-17255703-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/61d99bbd-8fda-4df1-8da2-f97e17b31bda" status: 202 len: 0 microversion: 2.1 time: 3.082512 Oct 26 05:09:54.892601 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1084/2160] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:09:51 2022] DELETE /compute/v2.1/os-floating-ips/61d99bbd-8fda-4df1-8da2-f97e17b31bda => generated 0 bytes in 3084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:09:54.923846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:54.924494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:54.942535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:54.943033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:54.943476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:54.944272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:54.944725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:54.945147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:55.136292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:55.153430 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-43e257fe-17eb-40ba-97e2-1388e4484d86 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.517518 Oct 26 05:09:55.154045 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1077/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:54 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:55.160000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:55.166153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] [instance: b9898b83-2dd3-497a-bd79-bd073cfef3f5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:55.179023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:55.181212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:55.185732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:55.186789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:55.187514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:55.189483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:55.236997 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] HTTP exception thrown: Instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 could not be found. Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Request method failure captured: Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 HTTP/1.1 Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEBqbNP4PEorb_eCruA8RE_maC0YFU8KwgLargKBBfWo7Nv8kVYp0ijiWHkplQF1OCbA-gb2q488COuMcXKRMR0akwA6ZRpnHy354_NPrcMpfWfoCWvG56I39XfXIRSZ39bIeyGy48OteuLUGuEc9hBdJEc8d9B0As4ltwOGoeD6MM Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 60cef7fa9ad14fcb880668f75572014c Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-913219722 Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:09:55.238810 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60cef7fa9ad14fcb880668f75572014c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-913219722 Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 60cef7fa9ad14fcb880668f75572014c Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-913219722 Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerDiagnosticsNegativeTest-913219722-project Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c121297c135e40cd81102e13139a6b1b Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-913219722-project Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 could not be found. Oct 26 05:09:55.240125 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'b9898b83-2dd3-497a-bd79-bd073cfef3f5'} Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 could not be found. Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:55.241475 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 could not be found. Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 could not be found. Oct 26 05:09:55.242607 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:55.243607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] Returning 404 to user: Instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:55.245407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:55.245921 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef258e12-ff22-47fe-b14c-3cf6a570116e tempest-ServerDiagnosticsNegativeTest-913219722 tempest-ServerDiagnosticsNegativeTest-913219722-project] 10.222.0.16 "GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5" status: 404 len: 111 microversion: 2.1 time: 0.084594 Oct 26 05:09:55.246420 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1078/2162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:55 2022] GET /compute/v2.1/servers/b9898b83-2dd3-497a-bd79-bd073cfef3f5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:55.256543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b5865c1c-d38c-41e1-ac93-fa06359632b6 req-51e14772-24ff-4888-b865-55e973a9501c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9898b83-2dd3-497a-bd79-bd073cfef3f5", "name": "network-vif-deleted", "tag": "4b6d06d0-5516-46ea-909d-e4f737a3cade"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:55.278144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b5865c1c-d38c-41e1-ac93-fa06359632b6 req-51e14772-24ff-4888-b865-55e973a9501c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:55.278544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b5865c1c-d38c-41e1-ac93-fa06359632b6 req-51e14772-24ff-4888-b865-55e973a9501c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:55.282642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b5865c1c-d38c-41e1-ac93-fa06359632b6 req-51e14772-24ff-4888-b865-55e973a9501c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:55.311453 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b5865c1c-d38c-41e1-ac93-fa06359632b6 req-51e14772-24ff-4888-b865-55e973a9501c service nova] Creating event network-vif-deleted:4b6d06d0-5516-46ea-909d-e4f737a3cade for instance b9898b83-2dd3-497a-bd79-bd073cfef3f5 on n-h2-862416-4 Oct 26 05:09:55.323496 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b5865c1c-d38c-41e1-ac93-fa06359632b6 req-51e14772-24ff-4888-b865-55e973a9501c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075191 Oct 26 05:09:55.324695 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1079/2163] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:55.338557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:55.339495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:55.346560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:55.347292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:55.347988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:55.348868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:55.350648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:55.351432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:56.034252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:56.047460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1736235-3ca8-467e-ba52-26a7aef83a1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1229 microversion: 2.1 time: 0.716938 Oct 26 05:09:56.061424 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1080/2164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:55 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1229 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:56.066744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:56.067197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:56.084943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:56.085889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:56.090288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:56.092548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:56.093042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:56.102299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:56.323284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:56.339693 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57c61623-fc19-4711-aa12-0b5f80193060 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1307 microversion: 2.1 time: 1.441269 Oct 26 05:09:56.340671 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1085/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:54 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1307 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:56.456653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:56.484473 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6cdb4296-52fc-4b27-a2a5-aa9f9e37f8d0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.431625 Oct 26 05:09:56.497449 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1081/2166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:56 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:56.516348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44f75631-532d-4808-9827-e1239f96d40e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:56.517752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44f75631-532d-4808-9827-e1239f96d40e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 03684586-a919-4aaa-9664-63bfd410bed8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:56.530467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-44f75631-532d-4808-9827-e1239f96d40e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 03684586-a919-4aaa-9664-63bfd410bed8 could not be found. Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44f75631-532d-4808-9827-e1239f96d40e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/03684586-a919-4aaa-9664-63bfd410bed8 HTTP/1.1 Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:56.532040 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 03684586-a919-4aaa-9664-63bfd410bed8 could not be found. Oct 26 05:09:56.533213 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '03684586-a919-4aaa-9664-63bfd410bed8'} Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03684586-a919-4aaa-9664-63bfd410bed8 could not be found. Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:56.533932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03684586-a919-4aaa-9664-63bfd410bed8 could not be found. Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03684586-a919-4aaa-9664-63bfd410bed8 could not be found. Oct 26 05:09:56.535012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:56.535979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44f75631-532d-4808-9827-e1239f96d40e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 03684586-a919-4aaa-9664-63bfd410bed8 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:56.535979 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44f75631-532d-4808-9827-e1239f96d40e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03684586-a919-4aaa-9664-63bfd410bed8" status: 404 len: 111 microversion: 2.1 time: 0.022733 Oct 26 05:09:56.535979 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1086/2167] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:09:56 2022] DELETE /compute/v2.1/servers/03684586-a919-4aaa-9664-63bfd410bed8 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:56.552762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:56.554456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:56.562103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:56.562532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:56.562983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:56.566059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:56.567096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:56.567548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:56.879550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:56.893414 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac8d73ee-3ae7-4ae2-8f24-07f87ac23c0e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.341828 Oct 26 05:09:56.896439 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1082/2168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:56 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:56.922832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:56.923644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:56.939012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:56.939792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:56.941228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:56.944293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:56.945002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:56.945679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.085459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:57.092464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:57.109713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.113212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.114309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.118430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.119427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.120364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.282534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:57.313981 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fcfe95c8-158c-4074-add8-74bd1954bdae tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1283 microversion: 2.1 time: 0.241127 Oct 26 05:09:57.323727 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1083/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:57 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1283 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:57.343192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:57.355387 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ce6bc47-d883-4dcf-8f62-73b235166fae tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.436831 Oct 26 05:09:57.355974 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1087/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:56 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:57.381840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:57.382796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a63b26c-89d2-486c-af1c-8bdfc47ab009 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:57.383166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:57.383305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a63b26c-89d2-486c-af1c-8bdfc47ab009 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:09:57.383793 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8a63b26c-89d2-486c-af1c-8bdfc47ab009 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a63b26c-89d2-486c-af1c-8bdfc47ab009 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:57.386714 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 9223372036854775808 could not be found. Oct 26 05:09:57.387943 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '9223372036854775808'} Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:09:57.388616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 26 05:09:57.389748 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:57.392997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a63b26c-89d2-486c-af1c-8bdfc47ab009 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:57.395654 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a63b26c-89d2-486c-af1c-8bdfc47ab009 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017428 Oct 26 05:09:57.396455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1088/2171] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 26 05:09:57 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:09:57.398905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.404660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:57.405283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:57.406661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.407113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.407859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.408327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.408754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.438191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.438765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.439227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.439986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.440450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.440879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.865474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:57.883068 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a11d546-f3bb-4bdb-a5e4-19b1c7dd836e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1307 microversion: 2.1 time: 0.503837 Oct 26 05:09:57.905003 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1084/2172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:57 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1307 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:57.930795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:57.944214 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-146811c1-5949-46b6-a24b-37652ce7fbf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.543103 Oct 26 05:09:57.945938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1089/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:57 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:57.970822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:57.971443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:57.973513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:57.987702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.988194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.988633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:57.989369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:57.989836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:57.990265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.342653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:58.343288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:58.346022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:58.357640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-67fbdf25-d00e-4049-a68d-ae25b4b20189 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.390610 Oct 26 05:09:58.360461 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1085/2174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:57 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:58.362069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.362745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.363336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.364196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.364794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.366626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.386990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5c61c62-fff1-41a8-9ae1-fbe68d802b43 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:58.387720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5c61c62-fff1-41a8-9ae1-fbe68d802b43 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Failed to fetch instance by id -1 {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:09:58.388400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e5c61c62-fff1-41a8-9ae1-fbe68d802b43 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance -1 could not be found. Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5c61c62-fff1-41a8-9ae1-fbe68d802b43 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:09:58.394242 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance -1 could not be found. Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '-1'} Oct 26 05:09:58.395574 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:09:58.396627 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 26 05:09:58.398783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:09:58.400675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5c61c62-fff1-41a8-9ae1-fbe68d802b43 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:58.401744 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5c61c62-fff1-41a8-9ae1-fbe68d802b43 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.019407 Oct 26 05:09:58.402916 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1086/2175] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:09:58 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 05:09:58.419769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:58.423311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:58.447498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.449935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.450540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.451452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.452694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.453354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.654835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:58.664489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31392ae4-f0ec-474b-a0e1-d3e1f91077c8 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1283 microversion: 2.1 time: 0.326026 Oct 26 05:09:58.665073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1090/2176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:58 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1283 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:58.826304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:58.834886 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3d4ac15-80af-45bb-83dd-7ede9de81830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.425348 Oct 26 05:09:58.845971 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1087/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:58 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:58.860696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:58.861616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:58.871296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.871807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.872258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.877199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.880560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.881103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.911168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:58.911811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:58.931338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.931839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.932452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.933773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:58.934387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:58.935004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:58.940130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:09:59.368459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:59.384467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23bef216-2a09-4516-b21c-2dd89d74cad1 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.527404 Oct 26 05:09:59.386272 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1091/2178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:58 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:09:59.394078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cbc2f70c-7ab5-4b14-8d46-ab3c7063001f req-a7419f71-d58c-45df-9e68-31dbe3f8df53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56e3676-5bff-4ea3-8e64-3d3cdf77f37a", "name": "network-vif-plugged", "status": "completed", "tag": "99f390e2-0c9d-473e-ac7e-2bac6495cbde"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:59.426292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cbc2f70c-7ab5-4b14-8d46-ab3c7063001f req-a7419f71-d58c-45df-9e68-31dbe3f8df53 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.428855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cbc2f70c-7ab5-4b14-8d46-ab3c7063001f req-a7419f71-d58c-45df-9e68-31dbe3f8df53 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.429718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cbc2f70c-7ab5-4b14-8d46-ab3c7063001f req-a7419f71-d58c-45df-9e68-31dbe3f8df53 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:59.470009 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cbc2f70c-7ab5-4b14-8d46-ab3c7063001f req-a7419f71-d58c-45df-9e68-31dbe3f8df53 service nova] Creating event network-vif-plugged:99f390e2-0c9d-473e-ac7e-2bac6495cbde for instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a on n-h1-862416-4 Oct 26 05:09:59.477611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cbc2f70c-7ab5-4b14-8d46-ab3c7063001f req-a7419f71-d58c-45df-9e68-31dbe3f8df53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089735 Oct 26 05:09:59.479180 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1092/2179] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:09:59.485515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2777ca24-5d23-4cd2-9ad5-17f7cd45d573 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:09:59.487361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2777ca24-5d23-4cd2-9ad5-17f7cd45d573 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d9172f1c-2521-4dba-aa86-101664728317] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:59.495792 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-2777ca24-5d23-4cd2-9ad5-17f7cd45d573 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance d9172f1c-2521-4dba-aa86-101664728317 could not be found. Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2777ca24-5d23-4cd2-9ad5-17f7cd45d573 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/d9172f1c-2521-4dba-aa86-101664728317/action HTTP/1.1 Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 19 Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:09:59.501039 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: {"forceDelete": {}} Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:09:59.502303 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance d9172f1c-2521-4dba-aa86-101664728317 could not be found. Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd9172f1c-2521-4dba-aa86-101664728317', 'body': {'forceDelete': {}}} Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9172f1c-2521-4dba-aa86-101664728317 could not be found. Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:09:59.503023 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9172f1c-2521-4dba-aa86-101664728317 could not be found. Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9172f1c-2521-4dba-aa86-101664728317 could not be found. Oct 26 05:09:59.504114 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:09:59.508346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2777ca24-5d23-4cd2-9ad5-17f7cd45d573 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance d9172f1c-2521-4dba-aa86-101664728317 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:09:59.510285 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2777ca24-5d23-4cd2-9ad5-17f7cd45d573 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/d9172f1c-2521-4dba-aa86-101664728317/action" status: 404 len: 111 microversion: 2.1 time: 0.029655 Oct 26 05:09:59.510404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:59.511899 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1093/2180] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:09:59 2022] POST /compute/v2.1/servers/d9172f1c-2521-4dba-aa86-101664728317/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:09:59.519965 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45d43aba-0c07-421c-a26a-8200fd8c755f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1307 microversion: 2.1 time: 0.612953 Oct 26 05:09:59.524443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:59.525195 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1088/2181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:58 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1307 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:59.538288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:59.557974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.558481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.558930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:59.559659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.560123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.560557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:59.708073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:59.710369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:59.728715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.729784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.731160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:59.732071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.732900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.733696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:59.883546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:09:59.905562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ceb922bb-c019-44b0-bee9-733339665bea tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.388628 Oct 26 05:09:59.906982 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1094/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:59 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:09:59.935075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:09:59.936979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:09:59.948888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.950340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.951597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:09:59.953778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:09:59.954409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:09:59.955014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.267009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:00.274552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:00.297405 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d3a8249-f571-4213-b627-67ae372e2446 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.367059 Oct 26 05:10:00.299804 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1095/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:59 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:00.302470 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-940f901d-d8ed-4fe7-a018-be15334d7139 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.605949 Oct 26 05:10:00.327602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a96b406f-6f49-409b-b79f-b37dca43aa02 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:00.329487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1089/2184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:09:59 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:00.330131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a96b406f-6f49-409b-b79f-b37dca43aa02 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 2174e075-e9e0-4b77-9a77-3a534a484438] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:00.336828 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a96b406f-6f49-409b-b79f-b37dca43aa02 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 2174e075-e9e0-4b77-9a77-3a534a484438 could not be found. Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a96b406f-6f49-409b-b79f-b37dca43aa02 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/2174e075-e9e0-4b77-9a77-3a534a484438/action HTTP/1.1 Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 39 Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:00.346784 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: {"os-getConsoleOutput": {"length": 10}} Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:00.348051 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 2174e075-e9e0-4b77-9a77-3a534a484438 could not be found. Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '2174e075-e9e0-4b77-9a77-3a534a484438', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2174e075-e9e0-4b77-9a77-3a534a484438 could not be found. Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:00.348860 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2174e075-e9e0-4b77-9a77-3a534a484438 could not be found. Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2174e075-e9e0-4b77-9a77-3a534a484438 could not be found. Oct 26 05:10:00.350617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:00.352697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a96b406f-6f49-409b-b79f-b37dca43aa02 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 2174e075-e9e0-4b77-9a77-3a534a484438 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:00.352697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a96b406f-6f49-409b-b79f-b37dca43aa02 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/2174e075-e9e0-4b77-9a77-3a534a484438/action" status: 404 len: 111 microversion: 2.1 time: 0.028085 Oct 26 05:10:00.355459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1096/2185] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:00 2022] POST /compute/v2.1/servers/2174e075-e9e0-4b77-9a77-3a534a484438/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:10:00.360480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:00.361192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:00.375202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:00.375805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:00.377601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.378432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:00.379057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:00.382229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.549273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:00.552269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:00.564556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:00.568489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:00.571218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:00.572622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.573677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:00.574338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:00.574928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.719195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:00.728382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f29f7b7-725c-4297-a721-18a2ca8838cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.371532 Oct 26 05:10:00.729140 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1090/2186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:00 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:00.757292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:00.758377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:00.765464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:00.766362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:00.767049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.767998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:00.768682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:00.769429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:00.981858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:00.998020 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0763654-e414-43bd-aecd-85550a33b0d5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1307 microversion: 2.1 time: 0.453379 Oct 26 05:10:00.998945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1097/2187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:00 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1307 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:01.164574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:01.181238 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6454cb02-a6f9-4456-b4cb-b8b4e7f7f0e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.426509 Oct 26 05:10:01.185375 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1091/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:00 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:01.209554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-624e4b85-8625-47af-8fd1-c8dabcfa0d00 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:01.210161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-624e4b85-8625-47af-8fd1-c8dabcfa0d00 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: b6b515fd-ee79-4213-b619-2a2bd6a92cf5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:01.219818 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-624e4b85-8625-47af-8fd1-c8dabcfa0d00 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance b6b515fd-ee79-4213-b619-2a2bd6a92cf5 could not be found. Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-624e4b85-8625-47af-8fd1-c8dabcfa0d00 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b6b515fd-ee79-4213-b619-2a2bd6a92cf5 HTTP/1.1 Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:01.225686 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance b6b515fd-ee79-4213-b619-2a2bd6a92cf5 could not be found. Oct 26 05:10:01.227273 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'b6b515fd-ee79-4213-b619-2a2bd6a92cf5'} Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b515fd-ee79-4213-b619-2a2bd6a92cf5 could not be found. Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:01.228075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b515fd-ee79-4213-b619-2a2bd6a92cf5 could not be found. Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b515fd-ee79-4213-b619-2a2bd6a92cf5 could not be found. Oct 26 05:10:01.229430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:01.231791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-624e4b85-8625-47af-8fd1-c8dabcfa0d00 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance b6b515fd-ee79-4213-b619-2a2bd6a92cf5 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:01.233181 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-624e4b85-8625-47af-8fd1-c8dabcfa0d00 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b515fd-ee79-4213-b619-2a2bd6a92cf5" status: 404 len: 111 microversion: 2.1 time: 0.029061 Oct 26 05:10:01.247987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:01.249064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:01.255832 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1098/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:01 2022] GET /compute/v2.1/servers/b6b515fd-ee79-4213-b619-2a2bd6a92cf5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:01.258845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:01.259533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:01.260153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:01.261084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:01.261741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:01.262944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:01.328763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:01.329589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:01.342802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:01.346340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:01.346959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:01.348430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:01.351924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:01.352567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:01.413407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:01.727312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:01.751929 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4fc9d2a-95e4-4f07-b0eb-45b34864c26f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.511559 Oct 26 05:10:01.753651 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1092/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:01 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:01.848245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:01.861391 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a8695bb-a7f3-48be-be99-ff6bf6394065 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.534499 Oct 26 05:10:01.862675 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1099/2191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:01 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:01.874991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:01.875851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:01.889686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:01.890421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:01.891037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:01.895317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:01.896012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:01.896606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:02.255511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:02.268416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b297e3e-9cee-46f8-8cc5-7c53ba56cf6c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.402057 Oct 26 05:10:02.269169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1100/2192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:01 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:02.277633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:02.283215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:02.291326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6dbe2047-e1d6-4cb7-818a-100be8c3a27d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Action: 'create', calling method: .version_select at 0x7f470acaedc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1081268441", "policies": ["affinity"]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:02.295746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:02.296245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:02.296689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:02.297483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:02.297895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:02.298331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:02.344844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-6dbe2047-e1d6-4cb7-818a-100be8c3a27d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:02.364112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-6dbe2047-e1d6-4cb7-818a-100be8c3a27d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:02.479558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-6dbe2047-e1d6-4cb7-818a-100be8c3a27d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:02.493165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-6dbe2047-e1d6-4cb7-818a-100be8c3a27d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:02.523980 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6dbe2047-e1d6-4cb7-818a-100be8c3a27d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.769185 Oct 26 05:10:02.528837 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1093/2193] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 26 05:10:01 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:02.540137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39b524ac-5cd6-42fd-9054-416785c77a95 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Action: 'create', calling method: .version_select at 0x7f470ab97310>, body: {"server_group": {"name": "tempest-server-group-296821415", "policies": ["affinity"]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:02.596799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-39b524ac-5cd6-42fd-9054-416785c77a95 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:02.612283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-39b524ac-5cd6-42fd-9054-416785c77a95 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:02.694388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:02.707922 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-075e0543-6829-40f8-b70d-a29f8f7fa87a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1488 microversion: 2.1 time: 0.436127 Oct 26 05:10:02.709595 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1101/2194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:02 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1488 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:02.730363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-39b524ac-5cd6-42fd-9054-416785c77a95 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:02.734341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0feb2fcd-2f93-476f-8838-6dda4267ce7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-98640159", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:02.736316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-39b524ac-5cd6-42fd-9054-416785c77a95 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:02.769445 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39b524ac-5cd6-42fd-9054-416785c77a95 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.233774 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0feb2fcd-2f93-476f-8838-6dda4267ce7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 236 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:02.775361 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:02.776713 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-98640159", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-98640159', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:02.777448 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:02.779506 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 26 05:10:02.780850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:02.782244 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1094/2195] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 26 05:10:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:10:02.782436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0feb2fcd-2f93-476f-8838-6dda4267ce7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:02.783042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:02.783462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0feb2fcd-2f93-476f-8838-6dda4267ce7a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.072352 Oct 26 05:10:02.783589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:02.788639 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1102/2196] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:10:02.794788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e31f3106-bc9c-4fb0-adb7-9f0eb1fb496a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Action: 'create', calling method: .version_select at 0x7f4709eea550>, body: {"server_group": {"name": "tempest-server-group-296821415", "policies": ["affinity"]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:02.799597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:02.800107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:02.800549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:02.801264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:02.801760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:02.802191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:02.837586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e31f3106-bc9c-4fb0-adb7-9f0eb1fb496a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:02.846075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e31f3106-bc9c-4fb0-adb7-9f0eb1fb496a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:02.873412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:10:02.924103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e31f3106-bc9c-4fb0-adb7-9f0eb1fb496a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:02.936819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e31f3106-bc9c-4fb0-adb7-9f0eb1fb496a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:02.957814 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e31f3106-bc9c-4fb0-adb7-9f0eb1fb496a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.167545 Oct 26 05:10:02.960233 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1103/2197] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 26 05:10:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:02.965413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:02.966447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:02.975763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:02.976954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:02.978432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:02.979932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:02.980693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:02.981798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:03.068477 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75e8cc83-5c5c-40bc-b0fa-a1c24f790111 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 204 len: 0 microversion: 2.1 time: 0.288929 Oct 26 05:10:03.073679 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1095/2198] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:02 2022] DELETE /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:03.081258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:03.086147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:03.106170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:03.106757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:03.110291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:03.111283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:03.111828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:03.112328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:04.106319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:04.118964 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97bbd006-3f2f-4bcf-b49b-32c5f9ccc4d2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 1.043359 Oct 26 05:10:04.134677 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1096/2199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:03 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:04.165229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95259f05-f209-4bdf-981f-7c45cab801a4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:04.227996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:04.236574 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95259f05-f209-4bdf-981f-7c45cab801a4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/922aa2fa-aae0-4411-b80f-11986c5ee07f" status: 204 len: 0 microversion: 2.1 time: 0.097576 Oct 26 05:10:04.240445 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1097/2200] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:04 2022] DELETE /compute/v2.1/os-server-groups/922aa2fa-aae0-4411-b80f-11986c5ee07f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:04.246751 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b284f12-9a3b-40cc-a999-0f72953b722a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 1.285059 Oct 26 05:10:04.276100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1104/2201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:02 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:04.288876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:04.290241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:04.301398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4846505f-0ca7-4fc1-a187-c9e87c2592da req-8944c7c2-5488-40cb-96cb-88fc431c1d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbe1b84-a304-484a-85d3-c4a14ae7f738", "tag": "d5f6930c-ad93-40a8-9436-52d09e288111"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:04.322754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:04.323632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:04.324826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:04.326308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:04.327041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:04.327985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:04.331766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4846505f-0ca7-4fc1-a187-c9e87c2592da req-8944c7c2-5488-40cb-96cb-88fc431c1d03 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:04.332248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4846505f-0ca7-4fc1-a187-c9e87c2592da req-8944c7c2-5488-40cb-96cb-88fc431c1d03 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:04.332681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4846505f-0ca7-4fc1-a187-c9e87c2592da req-8944c7c2-5488-40cb-96cb-88fc431c1d03 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:04.368416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4846505f-0ca7-4fc1-a187-c9e87c2592da req-8944c7c2-5488-40cb-96cb-88fc431c1d03 service nova] Creating event network-changed:d5f6930c-ad93-40a8-9436-52d09e288111 for instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 on n-h2-862416-4 Oct 26 05:10:04.380212 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4846505f-0ca7-4fc1-a187-c9e87c2592da req-8944c7c2-5488-40cb-96cb-88fc431c1d03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102540 Oct 26 05:10:04.381778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1105/2202] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:04.418175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:04.590395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:04.601389 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84a44d4a-42c6-4536-920a-fdf2ccfc79f8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1494 microversion: 2.1 time: 0.353278 Oct 26 05:10:04.603587 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1098/2203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:04 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1494 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:04.610890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c4605028-c834-43b1-8b3a-1ec5a3af9c03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:04.650116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c4605028-c834-43b1-8b3a-1ec5a3af9c03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.045122 Oct 26 05:10:04.651201 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1099/2204] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:10:04 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:04.652539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-838327976", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:04.657087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:04.658251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:04.668619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:04.674043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:04.674641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:04.676267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:04.676979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:04.677677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:04.780481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:10:05.151955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:05.166985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c28dcaf9-c496-4745-bf2e-0d3644c1a97b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.514613 Oct 26 05:10:05.182095 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1100/2205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:04 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:05.220559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fb05375-a473-49f2-9da2-173e80230a1a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:05.313439 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5fb05375-a473-49f2-9da2-173e80230a1a tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d0081477-69d2-4781-94ac-038adf49cab8" status: 204 len: 0 microversion: 2.1 time: 0.130039 Oct 26 05:10:05.314261 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1101/2206] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:05 2022] DELETE /compute/v2.1/os-server-groups/d0081477-69d2-4781-94ac-038adf49cab8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:05.320596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:05.321230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:05.327227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:05.341515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:05.348852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:05.350072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:05.351097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:05.351587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:05.352168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:05.507425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:10:05.509036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:10:05.509960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:10:05.510684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:10:05.511117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:10:05.569469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:05.570778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:05.573645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:05.575004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:05.576535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:05.578014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:05.651649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Getting quotas for project 454a8c023fbb41749f8046a3bd1f6fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:05.667072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Getting quotas for user 0984efbdfee347d8b72d1a5f089fdd6f and project 454a8c023fbb41749f8046a3bd1f6fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:05.719650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:10:05.734202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:10:05.861302 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29dd7242-ac3f-45b3-90f1-8a7e1c40d3cb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478103 Oct 26 05:10:05.877769 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1106/2207] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:10:05.884654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e03b72d-d386-41d1-836c-0f4ed820f970 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:05.905035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:05.918624 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1868fca9-510b-429e-bc47-f64d96eaa16b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.602840 Oct 26 05:10:05.920221 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1102/2208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:05 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:05.926112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94ac1399-5ae2-4f74-b87f-b3d4085a4f35 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1235537371", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94ac1399-5ae2-4f74-b87f-b3d4085a4f35 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 235 Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:05.933670 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:10:05.935092 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1235537371", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1235537371', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:05.935840 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:05.937156 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 26 05:10:05.938946 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:05.940747 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e03b72d-d386-41d1-836c-0f4ed820f970 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.059127 Oct 26 05:10:05.946395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94ac1399-5ae2-4f74-b87f-b3d4085a4f35 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:05.950361 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-94ac1399-5ae2-4f74-b87f-b3d4085a4f35 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.027430 Oct 26 05:10:05.951217 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1107/2209] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:10:05 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:05.952327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1103/2210] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:05 2022] POST /compute/v2.1/servers => generated 133 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:10:05.972233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:05.973296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:05.984852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d623d199-68bf-4bad-b557-ce6a134b4fa1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Action: 'create', calling method: .version_select at 0x7f470ad46940>, body: {"server_group": {"name": "tempest-server-group-1165930824", "policies": ["affinity"]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:06.003978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.004531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.004982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.005787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.007441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.008526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.095387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d623d199-68bf-4bad-b557-ce6a134b4fa1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:06.107138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.109141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.110999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.112474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lazy-loading 'fault' on Instance uuid e56e3676-5bff-4ea3-8e64-3d3cdf77f37a {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:10:06.120002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d623d199-68bf-4bad-b557-ce6a134b4fa1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:06.187316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:06.200348 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0be726a9-3b83-41a3-ac81-30653ff7b7a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 200 len: 1297 microversion: 2.1 time: 0.244377 Oct 26 05:10:06.202148 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1108/2211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:05 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 1297 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:06.209848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:06.212347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:06.248489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.249754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.250728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.251696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.253100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.253860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.267115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d623d199-68bf-4bad-b557-ce6a134b4fa1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:06.283428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d623d199-68bf-4bad-b557-ce6a134b4fa1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:06.340620 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d623d199-68bf-4bad-b557-ce6a134b4fa1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.387195 Oct 26 05:10:06.341901 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1104/2212] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 26 05:10:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:06.353760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1659765220", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:06.455218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:10:06.699443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:06.712598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3518103a-e5f9-490c-ba9c-11953435e58e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.507922 Oct 26 05:10:06.714465 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1109/2213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:06 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:06.719584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab41f2a7-4607-4d93-a942-7dffe1be90c7 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:06.823866 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab41f2a7-4607-4d93-a942-7dffe1be90c7 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd" status: 204 len: 0 microversion: 2.1 time: 0.107079 Oct 26 05:10:06.824876 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1110/2214] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:06 2022] DELETE /compute/v2.1/os-server-groups/a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:06.844304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:06.845928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:06.869232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.871307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.872771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.876771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.877836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.879585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.944121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:10:06.944591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:10:06.945295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:10:06.945892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:10:06.946686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:10:06.968202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.968985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.969674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:06.970580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:06.971383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:06.971998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:07.033657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Getting quotas for project 454a8c023fbb41749f8046a3bd1f6fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:07.049910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Getting quotas for user 0984efbdfee347d8b72d1a5f089fdd6f and project 454a8c023fbb41749f8046a3bd1f6fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:07.122970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:10:07.132281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:10:07.265170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:07.277539 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3279fa80-c7d9-4e70-bdd8-eb9f80c61b2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934261 Oct 26 05:10:07.287131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1105/2215] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:10:07.289037 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ef3220d-41ea-4481-9860-e02f9e84f905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.461658 Oct 26 05:10:07.304286 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1111/2216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:06 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:07.309074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffde018b-b8a7-4956-88b8-52c3d6eaddc2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:07.329638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ef6fb8e4-e500-4d26-8a85-67697f1e15b2 req-28326b04-240f-4859-9dcd-db23bb18e219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56e3676-5bff-4ea3-8e64-3d3cdf77f37a", "name": "network-vif-deleted", "tag": "99f390e2-0c9d-473e-ac7e-2bac6495cbde"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:07.333266 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffde018b-b8a7-4956-88b8-52c3d6eaddc2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.046674 Oct 26 05:10:07.339471 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1106/2217] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:10:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:07.352282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:07.352910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:07.360558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef6fb8e4-e500-4d26-8a85-67697f1e15b2 req-28326b04-240f-4859-9dcd-db23bb18e219 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:07.362954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef6fb8e4-e500-4d26-8a85-67697f1e15b2 req-28326b04-240f-4859-9dcd-db23bb18e219 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:07.364385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef6fb8e4-e500-4d26-8a85-67697f1e15b2 req-28326b04-240f-4859-9dcd-db23bb18e219 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:07.366838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:07.367346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:07.369411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:07.370146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:07.370651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:07.371026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:07.390315 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ef6fb8e4-e500-4d26-8a85-67697f1e15b2 req-28326b04-240f-4859-9dcd-db23bb18e219 service nova] Creating event network-vif-deleted:99f390e2-0c9d-473e-ac7e-2bac6495cbde for instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a on n-h1-862416-4 Oct 26 05:10:07.410293 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ef6fb8e4-e500-4d26-8a85-67697f1e15b2 req-28326b04-240f-4859-9dcd-db23bb18e219 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104815 Oct 26 05:10:07.411186 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1112/2218] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:07.418778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:07.419568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:07.445481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:07.446034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:07.447788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:07.450879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:07.451563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:07.452311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:07.476563 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a HTTP/1.1 Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:07.479498 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:07.482372 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e56e3676-5bff-4ea3-8e64-3d3cdf77f37a'} Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:07.484012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:07.486418 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.489378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:07.490421 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d05e76f2-6a30-462c-919f-68d8263592f2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 404 len: 111 microversion: 2.1 time: 0.077909 Oct 26 05:10:07.491506 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1113/2219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:07 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:07.497007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01554b91-aca3-49d8-8eb9-3e6460441bf8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:07.497899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-01554b91-aca3-49d8-8eb9-3e6460441bf8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:07.695132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-01554b91-aca3-49d8-8eb9-3e6460441bf8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:07.704975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-01554b91-aca3-49d8-8eb9-3e6460441bf8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1214 microversion: 2.1 time: 0.212091 Oct 26 05:10:07.707810 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1114/2220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:07 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:07.714218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-223af7bd-7d0a-42b9-ab01-2117b1c21db3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:07.715202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-223af7bd-7d0a-42b9-ab01-2117b1c21db3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4394d44b-addc-4111-81f5-725b247b0738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:07.721647 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-223af7bd-7d0a-42b9-ab01-2117b1c21db3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 4394d44b-addc-4111-81f5-725b247b0738 could not be found. Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-223af7bd-7d0a-42b9-ab01-2117b1c21db3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/4394d44b-addc-4111-81f5-725b247b0738/action HTTP/1.1 Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 13 Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:07.725892 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: {"pause": {}} Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:07.727243 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 4394d44b-addc-4111-81f5-725b247b0738 could not be found. Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4394d44b-addc-4111-81f5-725b247b0738', 'body': {'pause': {}}} Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4394d44b-addc-4111-81f5-725b247b0738 could not be found. Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:07.727997 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4394d44b-addc-4111-81f5-725b247b0738 could not be found. Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4394d44b-addc-4111-81f5-725b247b0738 could not be found. Oct 26 05:10:07.729069 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:07.731849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-223af7bd-7d0a-42b9-ab01-2117b1c21db3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 4394d44b-addc-4111-81f5-725b247b0738 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:07.732878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-223af7bd-7d0a-42b9-ab01-2117b1c21db3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4394d44b-addc-4111-81f5-725b247b0738/action" status: 404 len: 111 microversion: 2.1 time: 0.023909 Oct 26 05:10:07.733578 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1115/2221] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:07 2022] POST /compute/v2.1/servers/4394d44b-addc-4111-81f5-725b247b0738/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:07.739834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a2f1e6a-2b11-4ec7-a06f-6dfd82fd001c tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Action: 'create', calling method: .version_select at 0x7f4709eeae50>, body: {"server_group": {"name": "tempest-server-group-413452296", "policies": ["anti-affinity"]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:07.759424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1a2f1e6a-2b11-4ec7-a06f-6dfd82fd001c tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:07.766311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1a2f1e6a-2b11-4ec7-a06f-6dfd82fd001c tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:07.774657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:07.801133 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f6d4b19b-83b9-4662-b457-9c694033e5d4 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.459153 Oct 26 05:10:07.808664 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1107/2222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:07 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:07.839529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b682ca5-1639-4958-96f7-8a74ba3b089c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470abb7ca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:07.871172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:07.928424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1a2f1e6a-2b11-4ec7-a06f-6dfd82fd001c tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:07.968512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1a2f1e6a-2b11-4ec7-a06f-6dfd82fd001c tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:08.003908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a2f1e6a-2b11-4ec7-a06f-6dfd82fd001c tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.268996 Oct 26 05:10:08.008942 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1116/2223] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 26 05:10:07 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:08.027375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:08.028408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:08.050203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:08.051074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:08.051702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:08.052838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:08.056174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:08.056878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:08.451872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:08.464196 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-354d421c-a835-48fd-8e1c-9a682cc45310 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.454063 Oct 26 05:10:08.477339 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1117/2224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:08 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:08.479667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b2e37c0-38ec-44de-99d9-ce977b08f28f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:08.548771 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b2e37c0-38ec-44de-99d9-ce977b08f28f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/6020c20f-df88-4561-80be-362fb46d43e5" status: 204 len: 0 microversion: 2.1 time: 0.077627 Oct 26 05:10:08.551571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1118/2225] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:08 2022] DELETE /compute/v2.1/os-server-groups/6020c20f-df88-4561-80be-362fb46d43e5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:08.567409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:08.568296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:08.596756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:08.597502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:08.598394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:08.599276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:08.599891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:08.601961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:08.940387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:08.950790 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8e0d04e-5bee-4dc8-ba44-0087711e628a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.396389 Oct 26 05:10:08.952063 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1119/2226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:08 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:08.957150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67f5fb5f-a169-4f0e-bd67-594391c307bb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:08.973996 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67f5fb5f-a169-4f0e-bd67-594391c307bb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018850 Oct 26 05:10:08.974924 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1120/2227] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:10:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:08.981090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:08.982072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:08.989659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:08.991184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:08.992038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:08.993251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:08.994192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:08.995364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.092356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:09.100390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a55fd03-c391-48d4-869e-e6c03019d537 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1266 microversion: 2.1 time: 0.123885 Oct 26 05:10:09.103704 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1121/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:08 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:09.164032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b682ca5-1639-4958-96f7-8a74ba3b089c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 204 len: 0 microversion: 2.1 time: 1.351296 Oct 26 05:10:09.165584 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1108/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:07 2022] DELETE /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 0 bytes in 1356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:09.173988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:09.174857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:09.191453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.192631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.193295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.196381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.197162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.199786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.378173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Calling method '.version_select at 0x7f4709f4ad30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:09.395618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.396454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.397290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.400971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:09.407944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.408145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.409095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.411077 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c71dcb9-3d4f-4f60-9782-a8fb55a8e8cc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.243879 Oct 26 05:10:09.414821 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1109/2230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:09 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:09.420244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:09.421217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:09.429148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.429969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.430416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.431123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.431851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.431984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.448026 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b94675f-bafe-437e-afd0-6e531c5b5a54 tempest-AbsoluteLimitsTestJSON-1985409223 tempest-AbsoluteLimitsTestJSON-1985409223-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.342809 Oct 26 05:10:09.461195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1122/2231] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 26 05:10:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:09.466343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:09.466999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:09.474215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.474861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.475837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.477041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.477551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.485935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.536314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:10:09.570735 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fec5fc67-fecd-4225-8f8f-81d80712b367 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 202 len: 0 microversion: 2.1 time: 0.153580 Oct 26 05:10:09.571409 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1110/2232] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:09 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:09.594714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1777880666", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "4a9e747d-a213-4316-95e8-065b37127df1"}]}, "os:scheduler_hints": {"group": "20b625d4-636a-4119-badd-28f3f167d863"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:09.716766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] validate_networks() for [('4a9e747d-a213-4316-95e8-065b37127df1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:10:09.806617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-233889db-8b0f-4e26-b5f3-85c39bad3942 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 204 len: 0 microversion: 2.1 time: 0.338174 Oct 26 05:10:09.814594 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1123/2233] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:09 2022] DELETE /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:09.827412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:09.830414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:09.845249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.846750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.847925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:09.850400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:09.851415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:09.852462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:10.313161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:10.323355 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e925fdcb-f21c-46a4-82de-220f5945fb3f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1511 microversion: 2.1 time: 0.507066 Oct 26 05:10:10.324395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1124/2234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:09 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:10.555489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:10:10.556627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:10:10.559300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:10:10.560099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:10:10.561575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:10:10.582435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:10.583626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:10.583822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4b6cc58-bdc5-4884-9c37-8403f1c02f9b tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Calling method '.version_select at 0x7f4709f4a3a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:10.585364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:10.586381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:10.587184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:10.587874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:10.618319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:10.626512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:10.637901 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4b6cc58-bdc5-4884-9c37-8403f1c02f9b tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.311085 Oct 26 05:10:10.638921 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1125/2235] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:10:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:10:10.645772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1445233013", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "92d513bb-c446-48d6-b8f5-d149382fd9ca"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:10.657498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:10:10.661095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:10:10.712811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120586) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 26 05:10:10.721138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] validate_networks() for [('92d513bb-c446-48d6-b8f5-d149382fd9ca', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:10:10.783563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:10.803039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:10.878652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for project e94744e7057849fcb54961fc2206c95f. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:10.887561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Getting quotas for user 53c1fb3ec8504355ad5b19e1a57b3538 and project e94744e7057849fcb54961fc2206c95f. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:10.920016 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5b11f39-340a-415b-a72f-2abbf293eb57 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340549 Oct 26 05:10:10.928014 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1111/2236] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:10:10.939470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:10.940610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:10.952723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:10.953452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:10.954046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:10.954917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:10.959359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:10.960156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:10.994009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:11.098885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:11.109996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-52624a5c-00ad-4bd7-b149-6f0138f29d73 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1284 microversion: 2.1 time: 0.180822 Oct 26 05:10:11.110593 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1112/2237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:10 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:11.137974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5aad09ff-57b1-4571-82a2-e5954cde5eca req-d6a52753-6276-44d6-b934-68a03e3cea7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbe1b84-a304-484a-85d3-c4a14ae7f738", "name": "network-vif-plugged", "status": "completed", "tag": "d5f6930c-ad93-40a8-9436-52d09e288111"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:11.144847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:11.161196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5aad09ff-57b1-4571-82a2-e5954cde5eca req-d6a52753-6276-44d6-b934-68a03e3cea7c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.161739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5aad09ff-57b1-4571-82a2-e5954cde5eca req-d6a52753-6276-44d6-b934-68a03e3cea7c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.162423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5aad09ff-57b1-4571-82a2-e5954cde5eca req-d6a52753-6276-44d6-b934-68a03e3cea7c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.188444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5aad09ff-57b1-4571-82a2-e5954cde5eca req-d6a52753-6276-44d6-b934-68a03e3cea7c service nova] Creating event network-vif-plugged:d5f6930c-ad93-40a8-9436-52d09e288111 for instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 on n-h2-862416-4 Oct 26 05:10:11.195520 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5aad09ff-57b1-4571-82a2-e5954cde5eca req-d6a52753-6276-44d6-b934-68a03e3cea7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065066 Oct 26 05:10:11.196637 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1113/2238] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:11.202510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:11.203329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:11.222929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.224583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.225072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.246333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.247682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.248281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.699068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:10:11.700108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:10:11.702180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:10:11.702789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:10:11.703386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:10:11.719683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:11.735490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.736356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1470268e-093a-440c-bcfc-b32f1b1abf8c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.537096 Oct 26 05:10:11.737005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.738461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.738938 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1114/2239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:11 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:11.740797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.743283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.746842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dff967a-597e-49ec-ad38-50c8af71bea8 tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Action: 'create', calling method: .version_select at 0x7f470a227670>, body: {"pool": "non_exist_pool"} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:11.747598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.777582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:11.785942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Getting quotas for user 6390eed87d6a41df96e727227de791bb and project 28e01a8f000f431095aa38c6c15050c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:11.795285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3dff967a-597e-49ec-ad38-50c8af71bea8 tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] HTTP exception thrown: Floating IP pool not found. Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dff967a-597e-49ec-ad38-50c8af71bea8 tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Request method failure captured: Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 26 Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMExV2xbLTPWJuLmlX96z-8nFx9i_3fA42APTg2W-9bhfETvA6SQ46zgp_S2YgOUD1wXSJ2nk9WKAsWTVVOyPZxiSOsf3RerHDPTFzkyGBzGKZDN2rNfoJpy0F55gc5ID8WJDchwUmlqqruJ2C2PcvSFWsJvPNqbnERCAdCBXjx5sSQ Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 2da6b80597624e78b3fd07d63380a9b4 Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2091655678 Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:11.797251 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2091655678 Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 2da6b80597624e78b3fd07d63380a9b4 Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2091655678 Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FloatingIPsNegativeTestJSON-2091655678-project Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b9150aa6c0914bc8bd5382b3efac9d43 Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2091655678-project Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: {"pool": "non_exist_pool"} Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: exception: Floating IP pool not found. Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 26 05:10:11.798965 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:11.805055 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dff967a-597e-49ec-ad38-50c8af71bea8 tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Returning 404 to user: Floating IP pool not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:11.806207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dff967a-597e-49ec-ad38-50c8af71bea8 tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.056469 Oct 26 05:10:11.807105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1115/2240] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:10:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:11.807105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8f0a24d-4df1-44db-94b5-ec125327a714 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:11.807105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d8f0a24d-4df1-44db-94b5-ec125327a714 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:11.822802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:10:11.825131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:10:11.903342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c502970-1e5f-4313-aae1-cd8bdce778e4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262310 Oct 26 05:10:11.910289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1126/2241] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:10:11.917496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:11.918391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:11.922552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8f0a24d-4df1-44db-94b5-ec125327a714 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:11.934428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8f0a24d-4df1-44db-94b5-ec125327a714 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1213 microversion: 2.1 time: 0.133889 Oct 26 05:10:11.935747 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1116/2242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:11 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:11.936740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.937247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.939535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.940297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:11.942541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:11.943179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:11.943795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73d13f02-b440-4403-876b-626216090f4f tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Calling method '.version_select at 0x7f470b3450d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.006666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-73d13f02-b440-4403-876b-626216090f4f tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 679b4a12-c2dc-453d-bc01-3d85ab93ff6c could not be found", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:10:12.007697 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-73d13f02-b440-4403-876b-626216090f4f tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] HTTP exception thrown: Floating IP not found for ID 679b4a12-c2dc-453d-bc01-3d85ab93ff6c Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73d13f02-b440-4403-876b-626216090f4f tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Request method failure captured: Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-floating-ips/679b4a12-c2dc-453d-bc01-3d85ab93ff6c HTTP/1.1 Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMExV2xbLTPWJuLmlX96z-8nFx9i_3fA42APTg2W-9bhfETvA6SQ46zgp_S2YgOUD1wXSJ2nk9WKAsWTVVOyPZxiSOsf3RerHDPTFzkyGBzGKZDN2rNfoJpy0F55gc5ID8WJDchwUmlqqruJ2C2PcvSFWsJvPNqbnERCAdCBXjx5sSQ Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 2da6b80597624e78b3fd07d63380a9b4 Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2091655678 Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:12.010388 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2da6b80597624e78b3fd07d63380a9b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2091655678 Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 2da6b80597624e78b3fd07d63380a9b4 Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2091655678 Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FloatingIPsNegativeTestJSON-2091655678-project Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b9150aa6c0914bc8bd5382b3efac9d43 Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2091655678-project Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: exception: Floating IP not found for ID 679b4a12-c2dc-453d-bc01-3d85ab93ff6c Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '679b4a12-c2dc-453d-bc01-3d85ab93ff6c'} Oct 26 05:10:12.011784 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:10:12.012530 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 679b4a12-c2dc-453d-bc01-3d85ab93ff6c could not be found Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ae09e58-d4a3-4df0-a785-d45d893d1d91'] Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 679b4a12-c2dc-453d-bc01-3d85ab93ff6c. Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:12.013674 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 679b4a12-c2dc-453d-bc01-3d85ab93ff6c Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:12.016621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:12.018978 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 679b4a12-c2dc-453d-bc01-3d85ab93ff6c Oct 26 05:10:12.018978 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.020179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73d13f02-b440-4403-876b-626216090f4f tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] Returning 404 to user: Floating IP not found for ID 679b4a12-c2dc-453d-bc01-3d85ab93ff6c {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:12.021413 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73d13f02-b440-4403-876b-626216090f4f tempest-FloatingIPsNegativeTestJSON-2091655678 tempest-FloatingIPsNegativeTestJSON-2091655678-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/679b4a12-c2dc-453d-bc01-3d85ab93ff6c" status: 404 len: 111 microversion: 2.1 time: 0.084395 Oct 26 05:10:12.022755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1117/2243] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:10:11 2022] DELETE /compute/v2.1/os-floating-ips/679b4a12-c2dc-453d-bc01-3d85ab93ff6c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:12.028507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.029736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.040014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.041050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.044657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.045816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.046653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.047403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.236965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:12.247513 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a6d60821-822d-411f-bb03-ea5cf48fb6d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1491 microversion: 2.1 time: 0.335458 Oct 26 05:10:12.266903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1127/2244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:11 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1491 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:12.272802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-feccaaeb-a192-4fb2-ba79-d6abfad97a47 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.273458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-feccaaeb-a192-4fb2-ba79-d6abfad97a47 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.395703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd967465-1464-4267-ba4f-55f75d33dd63 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1809 microversion: 2.1 time: 0.371049 Oct 26 05:10:12.400687 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1118/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:12 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1809 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:12.408017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.408947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.446070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-feccaaeb-a192-4fb2-ba79-d6abfad97a47 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:12.449912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.451084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.452063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.455022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-feccaaeb-a192-4fb2-ba79-d6abfad97a47 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1208 microversion: 2.1 time: 0.185909 Oct 26 05:10:12.456063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.458015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.459132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.468331 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1128/2246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:12 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1208 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:12.480581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:12.481112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.494579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.495179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.495631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.498447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.500084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.500590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.546443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:12.552065 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'pause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state paused Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 13 Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:12.555503 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: {"pause": {}} Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:12.557764 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'pause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state paused Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'pause': {}}} Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state paused. Cannot pause while the instance is in this state. Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:12.558551 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state paused Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state paused Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:12.559697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'pause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state paused {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:12.562435 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f745a17c-3885-4ea1-aeba-9b8b1d48bf0d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 143 microversion: 2.1 time: 0.092942 Oct 26 05:10:12.566755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1129/2247] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:12 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 143 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:12.574644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.578853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.579586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.580260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.581488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.582542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.583238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.667762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:12.670616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44822e89-dc46-492e-ae01-b1d3b05846a2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102452 Oct 26 05:10:12.671851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1130/2248] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:10:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:12.693115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:12.693597 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56b5a128-62d5-49ac-b277-e50879ed1e52 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1272 microversion: 2.1 time: 0.291512 Oct 26 05:10:12.694447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.698876 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1119/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:12 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:12.702880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.704134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.705425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.707349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.707839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.708281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.768445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.769796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.778792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.780919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.784549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.785714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.787803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.789924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.845836 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53643a44-be53-4c9d-9ae1-a159e720e69b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 202 len: 0 microversion: 2.1 time: 0.172291 Oct 26 05:10:12.846826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1131/2250] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:12 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:12.858760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:12.859463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:12.880810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.881421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.881847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:12.882717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:12.883182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:12.896009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:13.372073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:13.386198 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-29173478-0750-409e-b1da-2a18d20710fd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1351 microversion: 2.1 time: 0.622256 Oct 26 05:10:13.402276 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1120/2251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:12 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1351 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:13.407836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:13.408701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:13.416001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:13.416798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:13.417538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:13.418527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:13.419193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:13.419818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:13.434525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:13.442862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c52c3b4-9643-4813-ad27-475e6e6f8b37 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1498 microversion: 2.1 time: 0.590874 Oct 26 05:10:13.448644 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1132/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:12 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1498 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:13.481886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:13.482929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:13.501712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:13.503750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:13.504494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:13.505551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:13.506352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:13.507319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:13.659395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:13.676405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aee6138a-ce4c-453e-ad0a-a1d109420fbb tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1265 microversion: 2.1 time: 0.270979 Oct 26 05:10:13.677042 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1121/2253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:13 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:13.708858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:13.721027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:13.722067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:13.727186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-014d24bd-f4a8-4f1b-829d-7cdf1d72b8ca tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1204 microversion: 2.1 time: 0.241886 Oct 26 05:10:13.730326 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1133/2254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:13 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1204 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:13.738478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:13.746135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:13.747425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:13.750896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:13.751374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:13.751875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.016493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:14.040620 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ebf3808d-b93c-4d50-ab2f-3c2c7a68ebae tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1272 microversion: 2.1 time: 0.323770 Oct 26 05:10:14.049473 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1122/2255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:13 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:14.414831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:14.416096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:14.426285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.432678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.433478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.434453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.435152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.436050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.472764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:14.473415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:14.480622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.481121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.481592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.482306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.482770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.483204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.857539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:14.868796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a6612f3e-a786-4c72-ade6-c29c9c0136f6 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1542 microversion: 2.1 time: 0.459220 Oct 26 05:10:14.871267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1134/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:14 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1542 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:14.878225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-786b84c8-e956-425b-93de-225dae88303f req-3627db50-544c-4e18-a3ea-b5556910127d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522771cc-3392-4767-ba87-48a030cf98b2", "name": "network-vif-deleted", "tag": "d7fe2f79-78e7-4921-b829-5f957ae6129e"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:14.899424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:14.906887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-786b84c8-e956-425b-93de-225dae88303f req-3627db50-544c-4e18-a3ea-b5556910127d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.907544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-786b84c8-e956-425b-93de-225dae88303f req-3627db50-544c-4e18-a3ea-b5556910127d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.908317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-786b84c8-e956-425b-93de-225dae88303f req-3627db50-544c-4e18-a3ea-b5556910127d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.932968 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-786b84c8-e956-425b-93de-225dae88303f req-3627db50-544c-4e18-a3ea-b5556910127d service nova] Creating event network-vif-deleted:d7fe2f79-78e7-4921-b829-5f957ae6129e for instance 522771cc-3392-4767-ba87-48a030cf98b2 on n-h1-862416-4 Oct 26 05:10:14.933495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6279fc56-0449-4ad8-b81b-f2efabb3a200 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.462061 Oct 26 05:10:14.938160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1123/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:14 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:14.949582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:14.950470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:14.955105 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-786b84c8-e956-425b-93de-225dae88303f req-3627db50-544c-4e18-a3ea-b5556910127d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082376 Oct 26 05:10:14.960020 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1135/2258] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:14.966083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:14.966813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.967162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:14.968090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.969068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.970447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.971257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.972016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.978911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.986236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.986693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:14.987692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:14.988300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:14.988811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.091695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:15.111777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:15.113476 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6a1bc29-3249-4baf-a9d9-5e3aa4def297 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1271 microversion: 2.1 time: 0.173865 Oct 26 05:10:15.119712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1124/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:14 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:15.141759 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-68f0e553-1cc4-4845-88a9-ca4d7f0ae715 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1266 microversion: 2.1 time: 0.180149 Oct 26 05:10:15.142369 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1136/2260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:14 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:15.143234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:15.145101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:15.161186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:15.161869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:15.167759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.168863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.170497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.171429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.172264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.172679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.173171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.173638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.174351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.174802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.175244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.176038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.474661 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec2587ce-3172-4ef4-8603-931715639a49 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.350778 Oct 26 05:10:15.476161 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1125/2261] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:10:15 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:15.481085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:15.481968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:15.496641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.497511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.498150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.499066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.500112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.501811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.679497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:15.692835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c89de639-a3e4-4957-9939-c980fae67bbe tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1272 microversion: 2.1 time: 0.215395 Oct 26 05:10:15.697430 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1126/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:15 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:15.709248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7975ea2f-0a49-4d6c-aa46-26f6949b9fff", "device": "/dev/xvdb"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:15.712695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:15.729018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.734744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.735499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:15.736471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:15.737152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:15.737935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.265762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65c15e47-a1c1-42c2-9087-21f9ab83b7ba tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "POST /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.565674 Oct 26 05:10:16.267725 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1127/2263] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:10:15 2022] POST /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:16.301613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:16.303726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:16.344688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.346213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.346658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.357668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.358196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.358996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.516260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:16.536401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8f45dca6-c8b2-4310-a288-80e294b0defe tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 1.392956 Oct 26 05:10:16.549343 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1137/2264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:15 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:16.558590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:16.558590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:16.563337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.564375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.564892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.565716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.566257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.566846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.686715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:16.701225 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4292fdd-7dcb-4c30-8f40-c79073bffe18 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1266 microversion: 2.1 time: 0.156834 Oct 26 05:10:16.702627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1138/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:16 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:16.708674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:16.720281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:16.763982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.764683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.765277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.767572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.771036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.771804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.790291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:16.795400 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999/action HTTP/1.1 Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 28 Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:16.808465 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: {"reboot": {"type": "SOFT"}} Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:16.810218 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd2afc5cb-8479-4969-bb3a-c2afb38d9999', 'body': {'reboot': {'type': 'SOFT'}}} Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:16.811184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:16.812404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:16.814325 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:16.815718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:16.816868 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-537a90ed-a516-4d81-9251-e224eab8dcf0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999/action" status: 404 len: 111 microversion: 2.1 time: 0.113181 Oct 26 05:10:16.817682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1139/2266] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:16 2022] POST /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999/action => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:16.823113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:16.824088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:16.828514 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-280a3cb6-59e8-46ec-80cd-5bc631939189 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1271 microversion: 2.1 time: 0.558974 Oct 26 05:10:16.829628 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1128/2267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:16 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1271 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:16.834135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.836818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.836939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:16.837300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.837773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:16.838061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.838530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.841144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.845074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.845647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.846350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:16.857715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:16.859368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:16.860432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:17.384905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:17.398096 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92430a89-5e42-45ff-9fa5-5ef2a14061ab tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.563044 Oct 26 05:10:17.409369 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1129/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:16 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:17.409369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9e2b7624-8db4-41e0-a1a6-feec61dd7867 req-1d156330-e493-4955-b3ba-dd3b56710716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b22c173-3089-46c5-91c6-2bac95ac7cf7", "tag": "1f98965e-9ae0-4cce-b52a-48dd51766116"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:17.419664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:17.427843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-13765482-42ab-4a3c-8908-346bd78db600 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.608945 Oct 26 05:10:17.434547 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1140/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:16 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:17.450959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:17.453561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9e2b7624-8db4-41e0-a1a6-feec61dd7867 req-1d156330-e493-4955-b3ba-dd3b56710716 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:17.454385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9e2b7624-8db4-41e0-a1a6-feec61dd7867 req-1d156330-e493-4955-b3ba-dd3b56710716 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:17.454501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9e2b7624-8db4-41e0-a1a6-feec61dd7867 req-1d156330-e493-4955-b3ba-dd3b56710716 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:17.457525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:17.485342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:17.485959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:17.486398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:17.487149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:17.487608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:17.488042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:17.498670 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9e2b7624-8db4-41e0-a1a6-feec61dd7867 req-1d156330-e493-4955-b3ba-dd3b56710716 service nova] Creating event network-changed:1f98965e-9ae0-4cce-b52a-48dd51766116 for instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 on n-h1-862416-4 Oct 26 05:10:17.525563 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9e2b7624-8db4-41e0-a1a6-feec61dd7867 req-1d156330-e493-4955-b3ba-dd3b56710716 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124901 Oct 26 05:10:17.531141 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1130/2270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:17.732673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:17.737065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:17.760199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:17.760930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:17.761629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:17.763381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:17.764153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:17.765072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:18.286495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:18.300776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-40a9c658-06b4-4262-84c5-cc4bf267fe80 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.857948 Oct 26 05:10:18.301445 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1141/2271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:17 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:18.313649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:18.313649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:18.323700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:18.324549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:18.325845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:18.327470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:18.330257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:18.330884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:18.356094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:18.369078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15e23b39-5cdc-4978-9e4a-042c4b745862 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.640556 Oct 26 05:10:18.369995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1131/2272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:17 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:18.379308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42e32879-64a9-43bc-bd9c-086887c2f988 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:18.385845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42e32879-64a9-43bc-bd9c-086887c2f988 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: e3524de5-811d-4457-9f72-78daa366181f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:18.398984 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-42e32879-64a9-43bc-bd9c-086887c2f988 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance e3524de5-811d-4457-9f72-78daa366181f could not be found. Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42e32879-64a9-43bc-bd9c-086887c2f988 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/e3524de5-811d-4457-9f72-78daa366181f/action HTTP/1.1 Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 28 Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:18.401000 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: {"reboot": {"type": "SOFT"}} Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:18.402256 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e3524de5-811d-4457-9f72-78daa366181f could not be found. Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e3524de5-811d-4457-9f72-78daa366181f', 'body': {'reboot': {'type': 'SOFT'}}} Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3524de5-811d-4457-9f72-78daa366181f could not be found. Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:18.402992 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3524de5-811d-4457-9f72-78daa366181f could not be found. Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3524de5-811d-4457-9f72-78daa366181f could not be found. Oct 26 05:10:18.404102 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:18.417467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42e32879-64a9-43bc-bd9c-086887c2f988 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance e3524de5-811d-4457-9f72-78daa366181f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:18.423129 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42e32879-64a9-43bc-bd9c-086887c2f988 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/e3524de5-811d-4457-9f72-78daa366181f/action" status: 404 len: 111 microversion: 2.1 time: 0.051760 Oct 26 05:10:18.424100 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1132/2273] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:18 2022] POST /compute/v2.1/servers/e3524de5-811d-4457-9f72-78daa366181f/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:18.433359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:18.438430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:18.457237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:18.461983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:18.462739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:18.463744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:18.464439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:18.465101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:18.531601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:19.001325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:19.009717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a711cf25-81ff-4b09-8381-6eae31998e68 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.707248 Oct 26 05:10:19.010289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1142/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:18 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:19.015654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:19.016464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:19.031075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.031840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.032437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.035019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.035722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.036313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.191406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:19.205493 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49b598b2-dc43-435f-b291-3fdd2d3d738f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.776645 Oct 26 05:10:19.208595 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1133/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:18 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:19.237193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:19.238077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:19.254498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.255235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.255842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.258225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.258872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.259488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.526591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:19.544856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d882bfa5-b693-47de-918a-bea591927b5f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.532902 Oct 26 05:10:19.573878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:19.577188 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1143/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:19 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:19.588581 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-028ce2c2-1dc0-432b-9449-ea52965b07ec tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.356611 Oct 26 05:10:19.589881 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1134/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:19 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:19.614683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:19.616088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:19.618037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:19.621560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:19.632804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.637000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.637839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.638754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.639416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.640642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.641354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.641945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.642717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.643506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.673795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.686535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.746565 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999/action HTTP/1.1 Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 65 Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:19.752353 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:19.753698 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd2afc5cb-8479-4969-bb3a-c2afb38d9999', 'body': {'rebuild': {'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8'}}} Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:19.754692 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:19.755797 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:19.757004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:19.757812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0fcac47b-2fd1-458d-a77f-e7a8a9bde0f9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999/action" status: 404 len: 111 microversion: 2.1 time: 0.146460 Oct 26 05:10:19.759416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1135/2278] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:19 2022] POST /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999/action => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:19.768058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-fda2d18f-d882-48a9-94fa-29734e2cdc43 req-d91bc39a-da20-41e6-8a25-930182750ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbe1b84-a304-484a-85d3-c4a14ae7f738", "tag": "d5f6930c-ad93-40a8-9436-52d09e288111"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:19.800517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fda2d18f-d882-48a9-94fa-29734e2cdc43 req-d91bc39a-da20-41e6-8a25-930182750ddf service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.801533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fda2d18f-d882-48a9-94fa-29734e2cdc43 req-d91bc39a-da20-41e6-8a25-930182750ddf service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.802204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fda2d18f-d882-48a9-94fa-29734e2cdc43 req-d91bc39a-da20-41e6-8a25-930182750ddf service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.838228 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-fda2d18f-d882-48a9-94fa-29734e2cdc43 req-d91bc39a-da20-41e6-8a25-930182750ddf service nova] Creating event network-changed:d5f6930c-ad93-40a8-9436-52d09e288111 for instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 on n-h2-862416-4 Oct 26 05:10:19.853616 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-fda2d18f-d882-48a9-94fa-29734e2cdc43 req-d91bc39a-da20-41e6-8a25-930182750ddf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091523 Oct 26 05:10:19.854939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1136/2279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:19.863110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:19.863998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:19.875394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.876044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.877549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:19.878666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:19.879280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:19.879941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:20.602583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:20.604920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:20.622817 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af24390d-3753-4cdf-aab3-846575c80a1f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.766541 Oct 26 05:10:20.623419 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1137/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:19 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:20.628167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:20.628977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:20.645359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:20.646187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:20.646921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:20.647879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:20.648766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:20.649439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:20.677962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:20.689761 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c04d732f-fdca-4ea7-a80c-733099619cc6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 1.102076 Oct 26 05:10:20.692597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1144/2281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:19 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:20.703830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:20.712133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:20.727030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:20.736753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:20.737377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:20.737898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:20.738685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:20.739240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:20.739728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.146614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:21.157009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6818be6d-5e97-4ce0-986d-810035c23758 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.532329 Oct 26 05:10:21.158863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1138/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:20 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:21.164362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:21.165403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:21.172525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:21.173322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:21.173971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.175032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:21.175564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:21.176147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.379018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:21.418032 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e286b9fc-863f-4957-8bf4-7fe1e0a16155 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.719910 Oct 26 05:10:21.419894 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1145/2283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:20 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:21.520771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:21.535855 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95041c16-db09-4946-9847-0899ee254b04 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.374348 Oct 26 05:10:21.536485 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1139/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:21 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:21.564873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3fbfbf35-c2c4-4ed6-88ae-6a56260974e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:21.569715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3fbfbf35-c2c4-4ed6-88ae-6a56260974e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 8501a740-2512-4300-927a-2da688984252] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:21.589425 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3fbfbf35-c2c4-4ed6-88ae-6a56260974e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 8501a740-2512-4300-927a-2da688984252 could not be found. Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3fbfbf35-c2c4-4ed6-88ae-6a56260974e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/8501a740-2512-4300-927a-2da688984252/action HTTP/1.1 Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 65 Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:21.592790 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:21.594050 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8501a740-2512-4300-927a-2da688984252 could not be found. Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8501a740-2512-4300-927a-2da688984252', 'body': {'rebuild': {'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8'}}} Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8501a740-2512-4300-927a-2da688984252 could not be found. Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:21.594855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8501a740-2512-4300-927a-2da688984252 could not be found. Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:21.595977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:21.597148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:21.597148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:21.597148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8501a740-2512-4300-927a-2da688984252 could not be found. Oct 26 05:10:21.597148 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:21.599942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3fbfbf35-c2c4-4ed6-88ae-6a56260974e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 8501a740-2512-4300-927a-2da688984252 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:21.602563 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3fbfbf35-c2c4-4ed6-88ae-6a56260974e3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/8501a740-2512-4300-927a-2da688984252/action" status: 404 len: 111 microversion: 2.1 time: 0.041863 Oct 26 05:10:21.603927 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1146/2285] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:21 2022] POST /compute/v2.1/servers/8501a740-2512-4300-927a-2da688984252/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:21.613020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:21.614217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:21.621205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:21.622082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:21.622842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.623725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:21.624341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:21.624921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.717415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:21.718260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:21.735356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:21.736031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:21.738577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.744142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:21.745008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:21.745855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:21.927344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=52 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:22.161940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:22.174909 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8eeb2867-0f9f-4f89-afc1-c2cd54a9e389 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.461970 Oct 26 05:10:22.178030 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1147/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:21 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:22.188716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:22.189130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:22.202817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.203305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.203736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.206787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.207520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.209404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.218680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:22.274717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:22.283638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e183beb-df0b-4733-b6d0-a430c2db5bc0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.675469 Oct 26 05:10:22.290138 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1140/2287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:21 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:22.315104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:22.316473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:22.329402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.330158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.330799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.332481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.334084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.339067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.453958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=34 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:22.547187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:22.558089 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e70f34f-80bd-44ed-96ec-9814e6097ca4 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.378763 Oct 26 05:10:22.558684 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1148/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:22 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:22.567890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:22.573064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:22.588809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.589372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.591664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.592506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.592985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.595087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.637910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:22.815985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:22.828583 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eae8b308-fdac-4790-852f-d81be15bbaca tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.517417 Oct 26 05:10:22.832556 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1141/2289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:22 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:22.858671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f629d81-ae9d-44ad-8544-8c2b44b55bde tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:22.859405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f629d81-ae9d-44ad-8544-8c2b44b55bde tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: c46cdbe9-5075-4565-beca-0d1bfa394a09] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:22.866745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-9f629d81-ae9d-44ad-8544-8c2b44b55bde tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance c46cdbe9-5075-4565-beca-0d1bfa394a09 could not be found. Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f629d81-ae9d-44ad-8544-8c2b44b55bde tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/c46cdbe9-5075-4565-beca-0d1bfa394a09/action HTTP/1.1 Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 15 Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:22.868880 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: {"restore": {}} Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:22.870354 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance c46cdbe9-5075-4565-beca-0d1bfa394a09 could not be found. Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c46cdbe9-5075-4565-beca-0d1bfa394a09', 'body': {'restore': {}}} Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c46cdbe9-5075-4565-beca-0d1bfa394a09 could not be found. Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:22.871225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c46cdbe9-5075-4565-beca-0d1bfa394a09 could not be found. Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c46cdbe9-5075-4565-beca-0d1bfa394a09 could not be found. Oct 26 05:10:22.872551 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:22.874474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f629d81-ae9d-44ad-8544-8c2b44b55bde tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance c46cdbe9-5075-4565-beca-0d1bfa394a09 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:22.875518 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f629d81-ae9d-44ad-8544-8c2b44b55bde tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/c46cdbe9-5075-4565-beca-0d1bfa394a09/action" status: 404 len: 111 microversion: 2.1 time: 0.021264 Oct 26 05:10:22.879815 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1142/2290] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:22 2022] POST /compute/v2.1/servers/c46cdbe9-5075-4565-beca-0d1bfa394a09/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:10:22.886615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:22.887529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:22.898001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.898707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.899358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:22.900274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:22.900883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:22.901712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:23.269177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:23.285995 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5318e851-fd0a-422d-b562-60f33c6afc29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.721936 Oct 26 05:10:23.286914 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1149/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:22 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:23.292356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-da113bd8-3cf9-43b4-83ea-ded8ec83cade req-d757f111-bc97-43b3-ae56-1a4bb75a3bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f162319b-4bc3-433f-9975-81139a161635", "tag": "587ce3ec-4562-4308-b1a1-7b8d6678a719"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:23.310921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-da113bd8-3cf9-43b4-83ea-ded8ec83cade req-d757f111-bc97-43b3-ae56-1a4bb75a3bc8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:23.311410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-da113bd8-3cf9-43b4-83ea-ded8ec83cade req-d757f111-bc97-43b3-ae56-1a4bb75a3bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:23.311857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-da113bd8-3cf9-43b4-83ea-ded8ec83cade req-d757f111-bc97-43b3-ae56-1a4bb75a3bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:23.341006 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-da113bd8-3cf9-43b4-83ea-ded8ec83cade req-d757f111-bc97-43b3-ae56-1a4bb75a3bc8 service nova] Creating event network-changed:587ce3ec-4562-4308-b1a1-7b8d6678a719 for instance f162319b-4bc3-433f-9975-81139a161635 on n-h2-862416-4 Oct 26 05:10:23.344920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:23.353488 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0c6df06-a5c7-4af7-a10d-bafdd6032931 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.472261 Oct 26 05:10:23.356802 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-da113bd8-3cf9-43b4-83ea-ded8ec83cade req-d757f111-bc97-43b3-ae56-1a4bb75a3bc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067252 Oct 26 05:10:23.367694 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1143/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:22 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:23.372621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:23.373476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:23.389129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:23.391379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:23.394723 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1150/2293] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:23.403071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:23.403850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:23.404336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:23.404775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:23.406565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:23.407492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:23.417205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:23.417724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:23.418394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:23.419296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:23.420114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:23.421678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.374929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:24.384456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:24.390250 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10a3fcbb-9273-4222-b1ee-5da6714eca62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.993944 Oct 26 05:10:24.391167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1151/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:23 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:24.396076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:24.399654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:24.405010 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05832297-bf50-40f7-ac81-d85c7959998a tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 1.039871 Oct 26 05:10:24.409215 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1144/2295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:23 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:24.411054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:24.411556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:24.412007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.413712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:24.417925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:24.418387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.421009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:24.421872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:24.445399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:24.449754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:24.450396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.451228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:24.451909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:24.454625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.865054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:24.885084 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f955aaeb-526f-45d4-a2fe-b6599147dd03 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.492399 Oct 26 05:10:24.886584 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1152/2296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:24 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:24.896694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:24.898737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:24.908919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:24.909854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:24.911228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.912662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:24.913379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:24.919250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:24.933791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:24.943556 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82e091b5-8a06-4f7f-a52a-048aa3e12120 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.531155 Oct 26 05:10:24.944316 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1145/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:24 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:24.991361 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'restore' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 15 Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:24.994419 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: {"restore": {}} Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:24.995714 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'restore' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'restore': {}}} Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state active. Cannot restore while the instance is in this state. Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:24.996535 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:24.997705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:25.000450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'restore' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:25.001592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3db52c89-d19e-4c81-8bd4-dffebda3e900 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 145 microversion: 2.1 time: 0.113533 Oct 26 05:10:25.002861 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1153/2298] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:24 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 145 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:25.011598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:25.012628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:25.023599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.027496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.029292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.030709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.031404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.032496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.379618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e024cf59-b4a7-4ca4-8ce2-877e72485ff1", "tag": "49af1a4d-b60d-4257-be62-01b84d2a9387"}, {"name": "network-changed", "server_uuid": "763a0afe-e4d9-4662-8fa9-a6e13da4d9b0", "tag": "0dd48839-e258-4235-8e71-67acf022ca5f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:25.398558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.399311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.400048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.418901 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] Creating event network-changed:49af1a4d-b60d-4257-be62-01b84d2a9387 for instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 on n-h1-862416-4 Oct 26 05:10:25.419826 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] Creating event network-changed:0dd48839-e258-4235-8e71-67acf022ca5f for instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 on n-h2-862416-4 Oct 26 05:10:25.439042 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ad834cbe-d399-423a-8eaf-e103255698e6 req-5b7855c5-f5dd-48aa-a40a-4ea348357bc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063191 Oct 26 05:10:25.441595 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1154/2299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:10:25.459320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:25.461030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:25.482488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.483396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.483995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.485419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.486033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.486676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.621718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:25.638110 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-847e89a7-d649-4258-b00e-5093ebbc2a1d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.628830 Oct 26 05:10:25.638757 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1146/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:25 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:25.671294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:25.671837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:25.687815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.688927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.689582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.698960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:25.700152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:25.701260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:25.979416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:25.993073 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7e5714b-ddc7-4d45-89cc-a5f1d9c0fc5b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.546740 Oct 26 05:10:25.997041 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1155/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:25 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:26.003220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:26.004171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:26.012897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.013967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.014510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.016577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.017138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.018323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.063328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:26.071244 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9182883d-f0b4-46e3-bd6f-e051c452cb13 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.403971 Oct 26 05:10:26.071828 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1147/2302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:25 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:26.076329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:26.076981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:26.084112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.084659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.085105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.085847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.086490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.087113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.414225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:26.423479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31a54e28-22f2-4e36-8d32-18f31836be8f tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.425032 Oct 26 05:10:26.437843 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1156/2303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:25 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:26.445503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-031abea6-2158-48c6-ae75-4b4ba3ae1410 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:26.446061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-031abea6-2158-48c6-ae75-4b4ba3ae1410 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 86c50775-e0e6-40e0-8c7b-8ab7fb70f916] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:26.457474 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-031abea6-2158-48c6-ae75-4b4ba3ae1410 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 86c50775-e0e6-40e0-8c7b-8ab7fb70f916 could not be found. Oct 26 05:10:26.458572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-031abea6-2158-48c6-ae75-4b4ba3ae1410 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/86c50775-e0e6-40e0-8c7b-8ab7fb70f916/action HTTP/1.1 Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 14 Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:26.471104 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: {"resume": {}} Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:26.472488 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 86c50775-e0e6-40e0-8c7b-8ab7fb70f916 could not be found. Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '86c50775-e0e6-40e0-8c7b-8ab7fb70f916', 'body': {'resume': {}}} Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c50775-e0e6-40e0-8c7b-8ab7fb70f916 could not be found. Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:26.474624 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c50775-e0e6-40e0-8c7b-8ab7fb70f916 could not be found. Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c50775-e0e6-40e0-8c7b-8ab7fb70f916 could not be found. Oct 26 05:10:26.476026 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:26.477613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7b32ef4-9d7a-4b60-bfb3-d260b4d525eb tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.398482 Oct 26 05:10:26.477720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-031abea6-2158-48c6-ae75-4b4ba3ae1410 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 86c50775-e0e6-40e0-8c7b-8ab7fb70f916 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:26.477720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-031abea6-2158-48c6-ae75-4b4ba3ae1410 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/86c50775-e0e6-40e0-8c7b-8ab7fb70f916/action" status: 404 len: 111 microversion: 2.1 time: 0.033891 Oct 26 05:10:26.477720 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1157/2304] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:26 2022] POST /compute/v2.1/servers/86c50775-e0e6-40e0-8c7b-8ab7fb70f916/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:26.481529 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1148/2305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:26 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:26.494596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:26.495344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:26.503813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.504561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.505084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.505925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.506745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.507295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.859676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:26.870455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc660aa6-8476-4454-bb0c-e8636964c85f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.384325 Oct 26 05:10:26.871346 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1158/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:26 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:26.899636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:26.900871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:26.907618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.908808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.909271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:26.910024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:26.910495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:26.910934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.020555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:27.021295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:27.027661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.028847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.029555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.030520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.031042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.031679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.400154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:27.416968 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1a805e5-ad92-4871-b538-f5f262d2b5c8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.518598 Oct 26 05:10:27.417847 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1149/2307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:26 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:27.423903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0a898d71-910b-4ced-aa55-203d198a6b79 req-c82751e1-2a82-4045-aeef-9dd7c940fbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b22c173-3089-46c5-91c6-2bac95ac7cf7", "name": "network-vif-plugged", "status": "completed", "tag": "1f98965e-9ae0-4cce-b52a-48dd51766116"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:27.431076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:27.434308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0a898d71-910b-4ced-aa55-203d198a6b79 req-c82751e1-2a82-4045-aeef-9dd7c940fbb0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.435038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0a898d71-910b-4ced-aa55-203d198a6b79 req-c82751e1-2a82-4045-aeef-9dd7c940fbb0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.436187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0a898d71-910b-4ced-aa55-203d198a6b79 req-c82751e1-2a82-4045-aeef-9dd7c940fbb0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.450218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0a898d71-910b-4ced-aa55-203d198a6b79 req-c82751e1-2a82-4045-aeef-9dd7c940fbb0 service nova] Creating event network-vif-plugged:1f98965e-9ae0-4cce-b52a-48dd51766116 for instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 on n-h1-862416-4 Oct 26 05:10:27.455540 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef0a1dbc-2eaa-48f4-b040-c9c9cc88e365 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.439965 Oct 26 05:10:27.468478 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1159/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:27 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:27.468478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:27.468478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:27.470014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.470014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.470564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.471604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.471781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.472338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.479604 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0a898d71-910b-4ced-aa55-203d198a6b79 req-c82751e1-2a82-4045-aeef-9dd7c940fbb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038432 Oct 26 05:10:27.481004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1150/2309] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:27.487641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:27.489128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:27.498230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.499007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.499860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.501077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.501949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.502579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.524976 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'resume' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 14 Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:27.529774 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: {"resume": {}} Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:27.531210 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'resume' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'resume': {}}} Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state active. Cannot resume while the instance is in this state. Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:27.532130 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:10:27.533593 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:27.543458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'resume' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:27.544608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83d6f5f9-b68b-42ca-a67b-046b89ca1c41 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 144 microversion: 2.1 time: 0.085983 Oct 26 05:10:27.545199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1160/2310] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:27 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 144 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:27.555890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:27.557189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:27.570414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.570922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.571370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.572089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.572548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.572985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.895359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:27.908142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90732944-14a1-4cdc-9d50-6684bf15cf6e tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.425590 Oct 26 05:10:27.910745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1151/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:27 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:27.914078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:27.916680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:27.918319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:27.925121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.925332 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c00d6a3f-06de-4da2-a9f4-8fadec37cc01 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.378643 Oct 26 05:10:27.926079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.926275 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1161/2312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:27 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:27.926903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:27.927812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:27.928999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:27.929638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:28.478000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:28.486122 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-adf997fc-b35b-4eb8-9564-1024374932a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.574112 Oct 26 05:10:28.486351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:28.486798 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1152/2313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:27 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:28.487547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:28.497793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:28.498304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:28.498751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:28.499502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:28.499959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:28.500391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:28.514652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:28.515280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:28.533457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:28.535904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:28.537983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:28.540083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:28.542707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:28.543318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:28.566647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:28.743314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:28.753555 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15683b0f-4e36-4b22-bb4c-866f2923ee14 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.271900 Oct 26 05:10:28.755239 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1162/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:28 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:28.784957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:28.805220 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6485df78-4830-4736-b8a1-57c925820574 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.295584 Oct 26 05:10:28.805859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1153/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:28 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:28.945645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:28.947673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:28.962892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:28.963601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:28.965288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:28.966065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:28.966526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:28.966982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.171957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46203bb0-9975-4eed-a72d-9f95b90dacbf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'create', calling method: .version_select at 0x7f4709ea53a0>, body: {"keypair": {"name": "tempest-keypair-41330578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEQRcdtPVdj0gH/IY/KvdVzTd22DynsA3RzgwvwAEOYF5xU6WQYN+gXuZgYc7ZBnFvYpPkw9i76WZt8IjRz2Zq4etDujLlZ6JzgeozI8oynHvga6XDRHo98I5qa1Bvohw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:29.195576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:29.208318 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f84cf021-1526-456d-bf97-5d3a607c3ebd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.269807 Oct 26 05:10:29.217478 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1154/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:28 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:29.227441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-46203bb0-9975-4eed-a72d-9f95b90dacbf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:29.229285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:29.236984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-46203bb0-9975-4eed-a72d-9f95b90dacbf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for user 4c2aa94263344a7eb33bcc7c6594229a and project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:29.243626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:29.257053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.258288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.259299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.260326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.261112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.262119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.286919 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46203bb0-9975-4eed-a72d-9f95b90dacbf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.530328 Oct 26 05:10:29.290015 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1163/2317] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:29.295116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82f35cd9-ae64-4673-abf6-3868babc53a4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82f35cd9-ae64-4673-abf6-3868babc53a4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 160 Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:29.300082 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "41ea2838-6a6b-46dd-a977-2fd3e47b8c50"}]}} Oct 26 05:10:29.301572 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'networks': [{'uuid': '41ea2838-6a6b-46dd-a977-2fd3e47b8c50'}]}}} Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi '' Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:29.302472 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:10:29.304500 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:10:29.305841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:10:29.305841 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:29.307059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82f35cd9-ae64-4673-abf6-3868babc53a4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:29.307942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82f35cd9-ae64-4673-abf6-3868babc53a4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016792 Oct 26 05:10:29.308820 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1164/2318] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:29 2022] POST /compute/v2.1/servers => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:10:29.323127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:29.323742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:29.330051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.330593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.332137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.332137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.332699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.333446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.558766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:29.568556 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59305639-4033-48ba-82c8-d097fb7b8610 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.348175 Oct 26 05:10:29.570879 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1155/2319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:29 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:29.589256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:29.599197 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-410edc97-2630-4f83-8cad-059c4d0c0403 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.286036 Oct 26 05:10:29.602996 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1165/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:29 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:29.633993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:29.635795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:29.646174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.647558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.650144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.651576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.652204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.652840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.782353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:29.783700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:29.810881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.812823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.813641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:29.815344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:29.815993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:29.816436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.002016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:30.014708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c1ca5b6-87f1-4c50-97c9-87493ad25b62 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.392194 Oct 26 05:10:30.016436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1156/2321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:29 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:30.048660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3392867-1799-41ec-9d43-e6fa6783a1b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:30.050136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b3392867-1799-41ec-9d43-e6fa6783a1b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 91ea6354-9036-45da-bfb7-56045ce094fb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:30.067914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b3392867-1799-41ec-9d43-e6fa6783a1b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 91ea6354-9036-45da-bfb7-56045ce094fb could not be found. Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3392867-1799-41ec-9d43-e6fa6783a1b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/91ea6354-9036-45da-bfb7-56045ce094fb/action HTTP/1.1 Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 14 Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:30.075406 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: {"shelve": {}} Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 91ea6354-9036-45da-bfb7-56045ce094fb could not be found. Oct 26 05:10:30.076714 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '91ea6354-9036-45da-bfb7-56045ce094fb', 'body': {'shelve': {}}} Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ea6354-9036-45da-bfb7-56045ce094fb could not be found. Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:30.078097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ea6354-9036-45da-bfb7-56045ce094fb could not be found. Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ea6354-9036-45da-bfb7-56045ce094fb could not be found. Oct 26 05:10:30.079314 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:30.081493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3392867-1799-41ec-9d43-e6fa6783a1b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 91ea6354-9036-45da-bfb7-56045ce094fb could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:30.082590 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b3392867-1799-41ec-9d43-e6fa6783a1b8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/91ea6354-9036-45da-bfb7-56045ce094fb/action" status: 404 len: 111 microversion: 2.1 time: 0.044080 Oct 26 05:10:30.087249 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1157/2322] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:30 2022] POST /compute/v2.1/servers/91ea6354-9036-45da-bfb7-56045ce094fb/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:30.093620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:30.096961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:30.102842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:30.114351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37b36468-2116-4f6f-a1d1-6195b814b4e6 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.339339 Oct 26 05:10:30.129930 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1166/2323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:29 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:30.134643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.135523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.136144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.137178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.137672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.138108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.231502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:30.232815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:30.239705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.243139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.244277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.245604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.246356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.247410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.430576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:30.446080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5503d2fd-37e2-4d09-8659-64f7cdf2a924 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.356474 Oct 26 05:10:30.451183 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1158/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:30 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:30.474852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:30.476656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:30.484442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.485286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.486391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.487644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.491295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.492391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.501349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:30.511847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f789c6d9-388b-4fe6-a785-83478111e057 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.284057 Oct 26 05:10:30.512933 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1167/2325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:30 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:30.593087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:30.593853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:30.604628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.605227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.605790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.606589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:30.609408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:30.609878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:30.967720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:30.988467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3e14dfcf-066f-4c4d-901f-31b82e19f149 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.507502 Oct 26 05:10:30.989410 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1159/2326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:30 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:30.998951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3272fa4c-673e-444f-a36e-bf148f931d0b req-c86fcf78-954a-4125-9279-6a6e194d529e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f162319b-4bc3-433f-9975-81139a161635", "name": "network-vif-plugged", "status": "completed", "tag": "587ce3ec-4562-4308-b1a1-7b8d6678a719"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:31.022855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3272fa4c-673e-444f-a36e-bf148f931d0b req-c86fcf78-954a-4125-9279-6a6e194d529e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.023516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3272fa4c-673e-444f-a36e-bf148f931d0b req-c86fcf78-954a-4125-9279-6a6e194d529e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.023781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3272fa4c-673e-444f-a36e-bf148f931d0b req-c86fcf78-954a-4125-9279-6a6e194d529e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.025866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:31.043727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b360a727-3df7-41e5-ae65-7ab81fbacd29 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.454451 Oct 26 05:10:31.050157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3272fa4c-673e-444f-a36e-bf148f931d0b req-c86fcf78-954a-4125-9279-6a6e194d529e service nova] Creating event network-vif-plugged:587ce3ec-4562-4308-b1a1-7b8d6678a719 for instance f162319b-4bc3-433f-9975-81139a161635 on n-h2-862416-4 Oct 26 05:10:31.059003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3272fa4c-673e-444f-a36e-bf148f931d0b req-c86fcf78-954a-4125-9279-6a6e194d529e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066020 Oct 26 05:10:31.060730 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1160/2327] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:31.060879 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1168/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:30 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:31.090198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:31.092256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:31.094432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:31.096726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:31.114674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.115181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.116342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.118162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.118788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.120024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.120728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.122479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.122790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.123450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.125027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.126558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.214104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lazy-loading 'flavor' on Instance uuid 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:10:31.267480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:31.447271 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd948426-91e4-43c6-bc00-5e557d0eeca2 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1855 microversion: 2.1 time: 0.382425 Oct 26 05:10:31.449069 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1161/2329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:31 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1855 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:31.471901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:31.477041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:31.486175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.491718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.494129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.495696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.497288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.498038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.591328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed9b9fab-7c12-4bda-be2f-814ee3f5c44f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 202 len: 0 microversion: 2.1 time: 0.527066 Oct 26 05:10:31.591941 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1169/2330] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:31 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:31.603183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862416-4", "block_migration": true, "disk_over_commit": false}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:31.622601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:31.638552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.640552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.641085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.642188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.644682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.645217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.673856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lazy-loading 'flavor' on Instance uuid b46448c6-28d1-4533-9ff3-2e160f3b28dd {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:10:31.706101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Going to try to live migrate instance to n-h1-862416-4 {{(pid=120585) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:10:31.794298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:31.802920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4cde731-c765-45cb-904a-ec763f4e1d4d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.352545 Oct 26 05:10:31.810712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1162/2331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:31 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:31.844902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:31.845884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:31.856885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.858430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.859526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:31.860474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:31.860907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:31.862368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:32.097254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:32.110384 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-932e93e6-5d50-4ff1-9cdc-8051ec0bf06d tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1313 microversion: 2.1 time: 0.296996 Oct 26 05:10:32.112616 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1163/2332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:31 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:32.120551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:32.121182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:32.145152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:32.148821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:32.149970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:32.149970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:32.151918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:32.152402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:32.167653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:32.683310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:32.694013 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c02c2999-f7da-4a3b-8a3a-77a738475b05 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.578726 Oct 26 05:10:32.695024 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1164/2333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:32 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:32.699824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:32.700451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:32.707340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:32.707849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:32.708300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:32.709025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:32.709590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:32.710032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:32.917209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:32.926888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e5a8336-c342-493c-b9f8-cb07072152d2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.230646 Oct 26 05:10:32.945982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1165/2334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:32 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:32.951764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2009528751", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51e64d69-11bc-4d31-bfc7-b6ed610b422e"}], "security_groups": [{"name": "tempest-securitygroup--694070865"}], "key_name": "tempest-keypair-41330578", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:33.186998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] validate_networks() for [('51e64d69-11bc-4d31-bfc7-b6ed610b422e', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:10:34.359834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:10:34.361591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:10:34.362678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:10:34.363552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:10:34.364405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:10:34.375760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:34.376349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:34.376849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:34.377692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:34.378262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:34.378755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:34.407552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:34.416274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for user 4c2aa94263344a7eb33bcc7c6594229a and project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:34.433630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:10:34.436634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:10:34.514014 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ccc2894-d453-4875-aea7-500b7acd61cf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.564501 Oct 26 05:10:34.514951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1166/2335] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:10:34.525751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:34.526385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:34.532766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:34.533266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:34.533769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:34.534496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:34.534962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:34.535398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.087735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf5b5a5b-1247-446f-9085-22b6c18641db tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/action" status: 202 len: 0 microversion: 2.1 time: 3.494048 Oct 26 05:10:35.088493 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1170/2336] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:31 2022] POST /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/action => generated 0 bytes in 3496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:35.094168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f411f685-bc27-4d0d-8add-804244446905 req-05e9fd82-5761-4549-abc2-e7cc6b3f64c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e024cf59-b4a7-4ca4-8ce2-877e72485ff1", "name": "network-vif-plugged", "status": "completed", "tag": "49af1a4d-b60d-4257-be62-01b84d2a9387"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:35.123698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f411f685-bc27-4d0d-8add-804244446905 req-05e9fd82-5761-4549-abc2-e7cc6b3f64c5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.124257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f411f685-bc27-4d0d-8add-804244446905 req-05e9fd82-5761-4549-abc2-e7cc6b3f64c5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.126736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f411f685-bc27-4d0d-8add-804244446905 req-05e9fd82-5761-4549-abc2-e7cc6b3f64c5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.146583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:35.155353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e87176c5-ab8f-48bb-a643-c5985de0dcf0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.639587 Oct 26 05:10:35.158742 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1167/2337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:34 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:35.163527 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f411f685-bc27-4d0d-8add-804244446905 req-05e9fd82-5761-4549-abc2-e7cc6b3f64c5 service nova] Creating event network-vif-plugged:49af1a4d-b60d-4257-be62-01b84d2a9387 for instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 on n-h1-862416-4 Oct 26 05:10:35.173983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:35.174806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:35.176258 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f411f685-bc27-4d0d-8add-804244446905 req-05e9fd82-5761-4549-abc2-e7cc6b3f64c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086376 Oct 26 05:10:35.179704 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1171/2338] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:35.189540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:35.196771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:35.197341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.197858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.198303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.199024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.199485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.199917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.214594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.220672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.222669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.223428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.223944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.224387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.581512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:35.589780 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-313e0bcb-0dbd-4537-a9c9-181d8e30e75d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.408623 Oct 26 05:10:35.590613 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1172/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:35 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:35.606145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:35.607563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:35.617649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.618477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.619085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.619796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.620284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.620755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.640682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:35.648802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7478a1b-a771-48f4-9d5d-5c0f5c7707fe tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1498 microversion: 2.1 time: 0.488772 Oct 26 05:10:35.653120 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1168/2340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:35 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1498 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:35.658027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:35.658634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:35.665491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.666272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.667091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.668922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.669641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.670277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.788656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:35.801985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41f3b345-cc7a-401f-9455-3734a3f0dfa5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1233 microversion: 2.1 time: 0.145576 Oct 26 05:10:35.821430 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1169/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:35 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1233 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:35.833938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:35.835219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:35.853733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.854452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.856317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.857101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:35.860314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:35.860770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:35.963369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:35.972210 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7abf3351-c532-46e5-be8f-c77e05056663 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1314 microversion: 2.1 time: 0.380400 Oct 26 05:10:35.987875 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1173/2342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:35 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:35.994292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0d19dfeb-0f69-4036-9e7d-71ee5eaf7343 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.008772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_groups [None req-0d19dfeb-0f69-4036-9e7d-71ee5eaf7343 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Querying cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) for 1 instances {{(pid=120585) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 05:10:36.010756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d19dfeb-0f69-4036-9e7d-71ee5eaf7343 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.011488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d19dfeb-0f69-4036-9e7d-71ee5eaf7343 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.012140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d19dfeb-0f69-4036-9e7d-71ee5eaf7343 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.045061 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0d19dfeb-0f69-4036-9e7d-71ee5eaf7343 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/20b625d4-636a-4119-badd-28f3f167d863" status: 200 len: 222 microversion: 2.1 time: 0.055360 Oct 26 05:10:36.046337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1174/2343] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:10:35 2022] GET /compute/v2.1/os-server-groups/20b625d4-636a-4119-badd-28f3f167d863 => generated 222 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:36.057752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.058612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:36.065398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.066178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.066816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.067713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.068500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.069217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.081476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:36.092002 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6207d14f-05fc-4fa6-a4e5-ab9470c2c388 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.269159 Oct 26 05:10:36.100763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:10:36.101809 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1170/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:35 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:36.188911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.196037 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9667b894-a658-451a-ae05-3f1fdcbc9c23 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 204 len: 0 microversion: 2.1 time: 0.142771 Oct 26 05:10:36.200670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:36.200923 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1175/2345] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:36 2022] DELETE /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:36.210118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.211497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:36.220159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.220923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.222161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.222492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.223568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.224343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.224849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.225635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.226265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.228519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.231042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.231766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.502715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:36.515436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:36.519066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d6bfa662-c018-4259-8d8f-fd87ec4dc1b9 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.335170 Oct 26 05:10:36.524412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47ee4353-3f2d-45fb-a4a2-70f6bcadbaf6 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1504 microversion: 2.1 time: 0.321828 Oct 26 05:10:36.535353 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1171/2346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:36 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:36.541076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1176/2347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:36 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:36.614883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.617113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:36.624421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.625142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.625759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.627141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.627884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.628598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.634506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:36.793323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:36.801969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c513712-2758-4fdf-acb8-92febdb0622a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.191443 Oct 26 05:10:36.803109 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1172/2348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:36 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:36.828230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.828850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:36.835973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.836711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.837370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.838169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:36.838753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:36.839275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:36.917704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:36.928736 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fda81474-9e81-4d44-b033-372e715f8682 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1289 microversion: 2.1 time: 0.104379 Oct 26 05:10:36.946726 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1177/2349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:36 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:36.996567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:36.997464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:37.004288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.005411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.006131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.008577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.009332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.010265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.117505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:37.118715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:37.126971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.127711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.128297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.129163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.129786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.130356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.346087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:37.358339 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e94d18ea-31c0-4816-9a99-bd93525e60c6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1464 microversion: 2.1 time: 0.365113 Oct 26 05:10:37.360105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1173/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:36 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1464 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:37.367742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a4701c88-5167-47e0-a26f-57c29126de48 req-4ed9f086-d15f-406c-b813-033656a04b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763a0afe-e4d9-4662-8fa9-a6e13da4d9b0", "name": "network-vif-plugged", "status": "completed", "tag": "0dd48839-e258-4235-8e71-67acf022ca5f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:37.386427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a4701c88-5167-47e0-a26f-57c29126de48 req-4ed9f086-d15f-406c-b813-033656a04b42 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.387025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a4701c88-5167-47e0-a26f-57c29126de48 req-4ed9f086-d15f-406c-b813-033656a04b42 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.387589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a4701c88-5167-47e0-a26f-57c29126de48 req-4ed9f086-d15f-406c-b813-033656a04b42 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.401033 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a4701c88-5167-47e0-a26f-57c29126de48 req-4ed9f086-d15f-406c-b813-033656a04b42 service nova] Creating event network-vif-plugged:0dd48839-e258-4235-8e71-67acf022ca5f for instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 on n-h2-862416-4 Oct 26 05:10:37.407261 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a4701c88-5167-47e0-a26f-57c29126de48 req-4ed9f086-d15f-406c-b813-033656a04b42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045727 Oct 26 05:10:37.408386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1174/2351] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:37.410997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:37.416867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:37.417875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:37.421791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f68487b8-a664-48fa-8bff-9613c7fc2155 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.309074 Oct 26 05:10:37.422298 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1178/2352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:37 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:37.426853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.427634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.428656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.429868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.430711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.432156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.543712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:37.544330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:37.558599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.559096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.559539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.560248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.560702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.568977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.862226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:37.876564 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24febe09-46f2-4490-8607-bd676d184ae6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1462 microversion: 2.1 time: 0.465281 Oct 26 05:10:37.877180 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1175/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:37 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1462 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:37.901829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:37.913519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:37.922819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.923476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.924029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.924887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.932444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.933248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.933424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:37.944343 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d5928d1-1bc8-4640-8ef2-2e2d721e30a4 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.405382 Oct 26 05:10:37.956458 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1179/2354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:37 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:37.977811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:37.978360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:37.998227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:37.998733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:37.999208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:37.999938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.002888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.003514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.295855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:38.310593 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c963dea-d336-446b-8cdc-415c6a5af41a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.351596 Oct 26 05:10:38.311446 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1180/2355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:37 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:38.322483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:38.330998 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84cda7a6-2f5b-4941-a0de-a8b2d42335c2 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1504 microversion: 2.1 time: 0.442215 Oct 26 05:10:38.333512 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1176/2356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:37 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:38.334299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:38.337103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:38.341611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-990646290", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8b22c173-3089-46c5-91c6-2bac95ac7cf7"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:38.349648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.350256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.353567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.354361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.354828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.355255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.441612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:10:38.457170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:38.464019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:38.466356 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ec1047b-c26d-4b48-9cde-a508b0170a8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1295 microversion: 2.1 time: 0.151936 Oct 26 05:10:38.467290 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1181/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:38 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:38.472466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:38.473251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:38.479592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.480363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.480975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.481896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.482565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.483361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.816524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:38.827276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:10:38.827640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:10:38.828125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:10:38.828544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:10:38.828968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:10:38.840161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.840884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.841519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.842062 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f35769dd-b677-43a5-b282-9b9150bdf898 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.371620 Oct 26 05:10:38.842691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.843330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.843921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.844292 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1182/2358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:38 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:38.871506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Getting quotas for project 454a8c023fbb41749f8046a3bd1f6fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:38.878369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Getting quotas for user 0984efbdfee347d8b72d1a5f089fdd6f and project 454a8c023fbb41749f8046a3bd1f6fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:38.895543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:10:38.898385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:10:38.950819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57412cb6-084e-44b3-acf5-c0578c06aa00 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613943 Oct 26 05:10:38.952837 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1177/2359] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:10:38.964635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a419835f-6ff7-4e51-baba-da02b314ae2b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:38.965758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a419835f-6ff7-4e51-baba-da02b314ae2b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:38.971377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:38.972436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:38.982656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.983134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.983794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:38.984311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:38.984766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:38.985468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:39.159067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a419835f-6ff7-4e51-baba-da02b314ae2b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:39.169599 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a419835f-6ff7-4e51-baba-da02b314ae2b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1213 microversion: 2.1 time: 0.208965 Oct 26 05:10:39.171221 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1183/2360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:38 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:39.328269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:39.339024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:39.339654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:39.345854 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6359530-0db7-4cf4-bdb3-0096a19f74e3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1308 microversion: 2.1 time: 0.381118 Oct 26 05:10:39.353446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:39.358319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:39.360992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:39.361960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:39.367939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1178/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:38 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:39.373671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:39.374161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:39.382410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:39.383403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:39.394176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:39.394870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:39.395476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:39.396432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:39.397359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:39.398096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:39.895910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c1fb3ec8504355ad5b19e1a57b3538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94744e7057849fcb54961fc2206c95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:39.912420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:39.914528 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ccf989a8-8027-478b-8858-272eada139dd tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 200 len: 1462 microversion: 2.1 time: 0.544050 Oct 26 05:10:39.916455 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1179/2362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:39 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 1462 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:39.926655 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11a6b99e-d769-4daa-8de5-f85ed75ccf18 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.589613 Oct 26 05:10:39.927198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ffa7bd72-db01-4d8f-9020-eb2b37ce80d6 req-e960c296-1fb2-4323-8cfd-bb85a8b960d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f162319b-4bc3-433f-9975-81139a161635", "name": "network-vif-deleted", "tag": "587ce3ec-4562-4308-b1a1-7b8d6678a719"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:39.927611 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1184/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:39 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:39.937645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:39.952581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:39.970602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ffa7bd72-db01-4d8f-9020-eb2b37ce80d6 req-e960c296-1fb2-4323-8cfd-bb85a8b960d1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:39.970960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ffa7bd72-db01-4d8f-9020-eb2b37ce80d6 req-e960c296-1fb2-4323-8cfd-bb85a8b960d1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:39.971446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ffa7bd72-db01-4d8f-9020-eb2b37ce80d6 req-e960c296-1fb2-4323-8cfd-bb85a8b960d1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:39.980133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:39.982966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:39.983681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:39.983892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.001388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.002008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.002481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.060770 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ffa7bd72-db01-4d8f-9020-eb2b37ce80d6 req-e960c296-1fb2-4323-8cfd-bb85a8b960d1 service nova] Creating event network-vif-deleted:587ce3ec-4562-4308-b1a1-7b8d6678a719 for instance f162319b-4bc3-433f-9975-81139a161635 on n-h2-862416-4 Oct 26 05:10:40.083541 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ffa7bd72-db01-4d8f-9020-eb2b37ce80d6 req-e960c296-1fb2-4323-8cfd-bb85a8b960d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162518 Oct 26 05:10:40.090896 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1180/2364] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:40.105021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:40.120694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:40.139537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.142313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.146164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.148116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.148116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.148844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.348336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:40.362158 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-90f0c5ac-4834-46b9-bb49-fabad31d9aa3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.432633 Oct 26 05:10:40.362757 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1185/2365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:39 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:40.368374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:40.369005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:40.387876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.388611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.389211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.390102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.392910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.393562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.515243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:40.526716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-225f9bc9-db16-4856-bf67-f51b8b2828c8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.434327 Oct 26 05:10:40.544529 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1181/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:40 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:40.551602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:40.552702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:40.560925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.562259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.562914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.563919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:40.565054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:40.565797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:40.733091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:40.742468 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18f87e27-2b20-4c45-9e6a-4ce3e9bb41a3 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1489 microversion: 2.1 time: 0.196259 Oct 26 05:10:40.757918 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1182/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:40 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1489 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:40.875366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed2522d1-1522-4b5f-aff4-5982766edc84 tempest-FloatingIPDetailsNegativeTestJSON-31887344 tempest-FloatingIPDetailsNegativeTestJSON-31887344-project] Calling method '.version_select at 0x7f470a823ca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:40.961856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-ed2522d1-1522-4b5f-aff4-5982766edc84 tempest-FloatingIPDetailsNegativeTestJSON-31887344 tempest-FloatingIPDetailsNegativeTestJSON-31887344-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c7c3ff96-b341-44f9-a525-f870a5bd2be5 could not be found", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:10:40.962568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ed2522d1-1522-4b5f-aff4-5982766edc84 tempest-FloatingIPDetailsNegativeTestJSON-31887344 tempest-FloatingIPDetailsNegativeTestJSON-31887344-project] HTTP exception thrown: Floating IP not found for ID c7c3ff96-b341-44f9-a525-f870a5bd2be5 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed2522d1-1522-4b5f-aff4-5982766edc84 tempest-FloatingIPDetailsNegativeTestJSON-31887344 tempest-FloatingIPDetailsNegativeTestJSON-31887344-project] Request method failure captured: Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-floating-ips/c7c3ff96-b341-44f9-a525-f870a5bd2be5 HTTP/1.1 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFQR7NP6kOFl0_Ejm-l2tyB4uUyjnOEw8XVCcTcnKP8W80r0CVcOTCq85H5m_37CgsC414Y-BE5R4ncjfKV0h46iaoQdaizPD0sMpzz1H0lVQHJcSMH6Fr1Z9K84mbIQN2F7Ieux2x146zNtBMYVGIPSDt5Fdf_Xeyu0Nxoy6ZYzwE Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 95f1b58f3ef34309aab597de7c5c4ec5 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-31887344 Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:40.964883 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95f1b58f3ef34309aab597de7c5c4ec5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95f1b58f3ef34309aab597de7c5c4ec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95f1b58f3ef34309aab597de7c5c4ec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95f1b58f3ef34309aab597de7c5c4ec5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-31887344 Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 95f1b58f3ef34309aab597de7c5c4ec5 Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-31887344 Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-31887344-project Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: f65d1efe74514fa894af95fb2f665168 Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-31887344-project Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: exception: Floating IP not found for ID c7c3ff96-b341-44f9-a525-f870a5bd2be5 Oct 26 05:10:40.966698 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c7c3ff96-b341-44f9-a525-f870a5bd2be5'} Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:40.967514 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c7c3ff96-b341-44f9-a525-f870a5bd2be5 could not be found Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee300e08-1d3f-4815-a159-a74ae88252d0'] Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c7c3ff96-b341-44f9-a525-f870a5bd2be5. Oct 26 05:10:40.968575 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c7c3ff96-b341-44f9-a525-f870a5bd2be5 Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:40.969689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:40.970893 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:40.970893 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c7c3ff96-b341-44f9-a525-f870a5bd2be5 Oct 26 05:10:40.970893 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:40.970893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed2522d1-1522-4b5f-aff4-5982766edc84 tempest-FloatingIPDetailsNegativeTestJSON-31887344 tempest-FloatingIPDetailsNegativeTestJSON-31887344-project] Returning 404 to user: Floating IP not found for ID c7c3ff96-b341-44f9-a525-f870a5bd2be5 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:40.970893 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed2522d1-1522-4b5f-aff4-5982766edc84 tempest-FloatingIPDetailsNegativeTestJSON-31887344 tempest-FloatingIPDetailsNegativeTestJSON-31887344-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/c7c3ff96-b341-44f9-a525-f870a5bd2be5" status: 404 len: 111 microversion: 2.1 time: 0.207588 Oct 26 05:10:40.970893 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1183/2368] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:10:40 2022] GET /compute/v2.1/os-floating-ips/c7c3ff96-b341-44f9-a525-f870a5bd2be5 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:40.971695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1175494457"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:40.979618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:40.999936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.000666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.002618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.004586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.006217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.008320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.269562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:41.279092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4765e3e-5442-48bf-919c-125942a890d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1209 microversion: 2.1 time: 0.914804 Oct 26 05:10:41.283101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1186/2369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:40 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1209 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:41.302072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:41.306025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:41.327212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.338981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.342354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.343341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.344149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.344773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.419963 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 HTTP/1.1 Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:41.422462 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:41.423890 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f162319b-4bc3-433f-9975-81139a161635'} Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:41.424578 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:41.425805 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:41.426816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:41.426816 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93c5774a-3cd3-4787-a5aa-d90c31bc2811 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 404 len: 111 microversion: 2.1 time: 0.139755 Oct 26 05:10:41.453555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1187/2370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:41 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:41.464884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:41.467058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:41.483865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.484648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.485274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.487018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.487693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.488357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.516679 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1e55ee8-6520-48f3-a911-5f12e86cdbbe tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "POST /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0/action" status: 202 len: 0 microversion: 2.1 time: 0.548192 Oct 26 05:10:41.519811 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1184/2371] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:10:40 2022] POST /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:10:41.542742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:41.545097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:41.567354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.568285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.570221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:41.570854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:41.573843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:41.574409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.087620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:42.104030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:42.112092 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c451088e-36bd-4cfc-811a-250bfb7eb0d8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.576504 Oct 26 05:10:42.113718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22c9fd8a-edbd-4cf1-906f-a8d80d32184c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.658859 Oct 26 05:10:42.129085 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1188/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:41 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:42.129849 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1185/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:41 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:42.135959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ae860a7c-f8c3-48ca-ac3d-652b6675def8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a79b9d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.136292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36cb6f2e-ace1-4378-acdf-fd39bae78ffc tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.187239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_groups [None req-36cb6f2e-ace1-4378-acdf-fd39bae78ffc tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Querying cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) for 1 instances {{(pid=120585) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 05:10:42.208238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36cb6f2e-ace1-4378-acdf-fd39bae78ffc tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.211376 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ae860a7c-f8c3-48ca-ac3d-652b6675def8 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b" status: 200 len: 1414 microversion: 2.1 time: 0.080020 Oct 26 05:10:42.213876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36cb6f2e-ace1-4378-acdf-fd39bae78ffc tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.214471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36cb6f2e-ace1-4378-acdf-fd39bae78ffc tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.224066 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1186/2374] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:42.229358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.244812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:42.246972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36cb6f2e-ace1-4378-acdf-fd39bae78ffc tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.118161 Oct 26 05:10:42.248119 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1189/2375] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:42.252837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d5f7b5d-8417-4eeb-8070-30ceb32d0752 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709ea0e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.267287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.267800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.268401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.269128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.269759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.274137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.328922 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d5f7b5d-8417-4eeb-8070-30ceb32d0752 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b" status: 200 len: 1414 microversion: 2.1 time: 0.079480 Oct 26 05:10:42.330011 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1190/2376] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:42.342778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98fe1926-6dc6-4bce-b6ac-9791f17891da tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.370270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_groups [None req-98fe1926-6dc6-4bce-b6ac-9791f17891da tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Querying cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) for 1 instances {{(pid=120585) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 05:10:42.375741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98fe1926-6dc6-4bce-b6ac-9791f17891da tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.376589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98fe1926-6dc6-4bce-b6ac-9791f17891da tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.377252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98fe1926-6dc6-4bce-b6ac-9791f17891da tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.390345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98fe1926-6dc6-4bce-b6ac-9791f17891da tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/20b625d4-636a-4119-badd-28f3f167d863" status: 200 len: 184 microversion: 2.1 time: 0.059005 Oct 26 05:10:42.391586 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1191/2377] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/os-server-groups/20b625d4-636a-4119-badd-28f3f167d863 => generated 184 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:42.396452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.397457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:42.404252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.405067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.405903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.406835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.407497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.408153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.534181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:42.546823 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e3b4c0c9-ad8e-4025-a36b-b7cf75b7a69d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1271 microversion: 2.1 time: 0.153883 Oct 26 05:10:42.548149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1192/2378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:42.555117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-664ab975-4d4a-439f-87c8-0489237d8842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709e48ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.760103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:42.771003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-258fe530-6773-4ca3-91c9-bd3da707249a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.545690 Oct 26 05:10:42.774415 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1187/2379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:42.790076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.790076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:42.797479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-664ab975-4d4a-439f-87c8-0489237d8842 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b" status: 204 len: 0 microversion: 2.1 time: 0.246397 Oct 26 05:10:42.798211 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1193/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:42 2022] DELETE /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:42.806868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-584e518f-1eac-42b3-9e32-f667b18e6f42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709ea0040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.816760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.830416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.832985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.835306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.836546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.841393 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-584e518f-1eac-42b3-9e32-f667b18e6f42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Image not found. Oct 26 05:10:42.841875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-584e518f-1eac-42b3-9e32-f667b18e6f42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b HTTP/1.1 Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:42.850132 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3eb9650e-2908-4a02-a9f6-c27cc82d5e4b'} Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:42.851677 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3eb9650e-2908-4a02-a9f6-c27cc82d5e4b Oct 26 05:10:42.852494 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:42.853520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eb9650e-2908-4a02-a9f6-c27cc82d5e4b could not be found. Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:42.854636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:10:42.857775 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.862023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-584e518f-1eac-42b3-9e32-f667b18e6f42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:42.864300 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-584e518f-1eac-42b3-9e32-f667b18e6f42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b" status: 404 len: 62 microversion: 2.1 time: 0.062011 Oct 26 05:10:42.867008 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1194/2381] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 05:10:42.887561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.888626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:42.903408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:42.913649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 HTTP/1.1 Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:42.914586 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:42.915822 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f162319b-4bc3-433f-9975-81139a161635'} Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:42.916522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:42.917647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:42.920361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:42.922851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.924134 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca1f6826-f5d7-45eb-8b80-5ab36b1af005 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 404 len: 111 microversion: 2.1 time: 0.148733 Oct 26 05:10:42.924905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.928997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.930356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1188/2382] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:42 2022] DELETE /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:42.931362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.932023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.945351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:42.946413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] [instance: f162319b-4bc3-433f-9975-81139a161635] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:42.962920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.965439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.967839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.968885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:42.969612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:42.972119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:42.996965 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 HTTP/1.1 Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:43.009944 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:43.011545 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f162319b-4bc3-433f-9975-81139a161635'} Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:43.012384 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. Oct 26 05:10:43.013785 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.015358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance f162319b-4bc3-433f-9975-81139a161635 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:43.016274 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8dbd875d-5201-4fd5-9b98-b5eee3965144 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635" status: 404 len: 111 microversion: 2.1 time: 0.082152 Oct 26 05:10:43.020850 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1189/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/servers/f162319b-4bc3-433f-9975-81139a161635 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:43.029256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f88b907-56b6-46f4-a4b9-e374f42eda67 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.036768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6f88b907-56b6-46f4-a4b9-e374f42eda67 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance group 6020c20f-df88-4561-80be-362fb46d43e5 could not be found. Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f88b907-56b6-46f4-a4b9-e374f42eda67 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-server-groups/6020c20f-df88-4561-80be-362fb46d43e5 HTTP/1.1 Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:43.039002 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance group 6020c20f-df88-4561-80be-362fb46d43e5 could not be found. Oct 26 05:10:43.040844 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '6020c20f-df88-4561-80be-362fb46d43e5'} Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6020c20f-df88-4561-80be-362fb46d43e5 could not be found. Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.041709 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6020c20f-df88-4561-80be-362fb46d43e5 could not be found. Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6020c20f-df88-4561-80be-362fb46d43e5 could not be found. Oct 26 05:10:43.042997 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.047247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f88b907-56b6-46f4-a4b9-e374f42eda67 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance group 6020c20f-df88-4561-80be-362fb46d43e5 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:43.048914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f88b907-56b6-46f4-a4b9-e374f42eda67 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/6020c20f-df88-4561-80be-362fb46d43e5" status: 404 len: 117 microversion: 2.1 time: 0.023650 Oct 26 05:10:43.050679 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1190/2384] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:43 2022] DELETE /compute/v2.1/os-server-groups/6020c20f-df88-4561-80be-362fb46d43e5 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:43.074270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08d33633-d4f3-4a4c-82e4-d074b6db1156 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.084222 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-08d33633-d4f3-4a4c-82e4-d074b6db1156 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance group a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd could not be found. Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08d33633-d4f3-4a4c-82e4-d074b6db1156 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-server-groups/a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd HTTP/1.1 Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:43.087874 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance group a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd could not be found. Oct 26 05:10:43.089891 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd'} Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd could not be found. Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.090708 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd could not be found. Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd could not be found. Oct 26 05:10:43.091952 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.094617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08d33633-d4f3-4a4c-82e4-d074b6db1156 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance group a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:43.095968 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08d33633-d4f3-4a4c-82e4-d074b6db1156 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd" status: 404 len: 117 microversion: 2.1 time: 0.040790 Oct 26 05:10:43.097273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1191/2385] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:43 2022] DELETE /compute/v2.1/os-server-groups/a14d3d0a-5e46-4aa1-9f4c-5b73fab20dbd => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:43.122527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3daa7d4d-4f12-463c-bf3f-edf9b6040f90 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.131196 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3daa7d4d-4f12-463c-bf3f-edf9b6040f90 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance group d0081477-69d2-4781-94ac-038adf49cab8 could not be found. Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3daa7d4d-4f12-463c-bf3f-edf9b6040f90 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-server-groups/d0081477-69d2-4781-94ac-038adf49cab8 HTTP/1.1 Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:43.133767 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance group d0081477-69d2-4781-94ac-038adf49cab8 could not be found. Oct 26 05:10:43.136044 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd0081477-69d2-4781-94ac-038adf49cab8'} Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d0081477-69d2-4781-94ac-038adf49cab8 could not be found. Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.138060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d0081477-69d2-4781-94ac-038adf49cab8 could not be found. Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d0081477-69d2-4781-94ac-038adf49cab8 could not be found. Oct 26 05:10:43.140196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.144958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3daa7d4d-4f12-463c-bf3f-edf9b6040f90 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance group d0081477-69d2-4781-94ac-038adf49cab8 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:43.147525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3daa7d4d-4f12-463c-bf3f-edf9b6040f90 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d0081477-69d2-4781-94ac-038adf49cab8" status: 404 len: 117 microversion: 2.1 time: 0.040170 Oct 26 05:10:43.148705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1192/2386] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:43 2022] DELETE /compute/v2.1/os-server-groups/d0081477-69d2-4781-94ac-038adf49cab8 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:43.158621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.160189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:43.178320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.179167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.179945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.180919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.181601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.182194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.272596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:43.286022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-730e7070-51f7-45ea-9023-39cf2a138ddd tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1501 microversion: 2.1 time: 0.413221 Oct 26 05:10:43.288373 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1195/2387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:42 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1501 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:43.298639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.299188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:43.317327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.320674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.321291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.322107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.322566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.322996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.544693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:43.554547 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-03550c80-13db-4c62-810b-f662cf2b1db9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.402246 Oct 26 05:10:43.558097 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1193/2388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:43 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:43.575257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ab9c56f-f4db-4a3d-90dc-31d9b329bef1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.587106 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7ab9c56f-f4db-4a3d-90dc-31d9b329bef1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] HTTP exception thrown: Instance group 922aa2fa-aae0-4411-b80f-11986c5ee07f could not be found. Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ab9c56f-f4db-4a3d-90dc-31d9b329bef1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Request method failure captured: Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-server-groups/922aa2fa-aae0-4411-b80f-11986c5ee07f HTTP/1.1 Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEpqz9lw4eYW0yFUTYkxc-0U0AuiGxF0FACCuARoGreP3dReLdhlpa6LP3mefG2y23IKbw31pbXZsuqS13UZgDBkM2INi1ubnqydSSgq05FqVRCfc9GY4bNhsOhn3KbHzTHp66T51yttBx2HdooKulnBUxQJ6tsYaG8MD8a-Ar2xrA Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:43.596120 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e94744e7057849fcb54961fc2206c95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e94744e7057849fcb54961fc2206c95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e94744e7057849fcb54961fc2206c95f Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerGroupTestJSON-303939042 Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 53c1fb3ec8504355ad5b19e1a57b3538 Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerGroupTestJSON-303939042-project Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance group 922aa2fa-aae0-4411-b80f-11986c5ee07f could not be found. Oct 26 05:10:43.597669 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '922aa2fa-aae0-4411-b80f-11986c5ee07f'} Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 922aa2fa-aae0-4411-b80f-11986c5ee07f could not be found. Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.598387 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 922aa2fa-aae0-4411-b80f-11986c5ee07f could not be found. Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 922aa2fa-aae0-4411-b80f-11986c5ee07f could not be found. Oct 26 05:10:43.599458 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:43.601368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ab9c56f-f4db-4a3d-90dc-31d9b329bef1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Returning 404 to user: Instance group 922aa2fa-aae0-4411-b80f-11986c5ee07f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:43.601368 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ab9c56f-f4db-4a3d-90dc-31d9b329bef1 tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/922aa2fa-aae0-4411-b80f-11986c5ee07f" status: 404 len: 117 microversion: 2.1 time: 0.038830 Oct 26 05:10:43.606586 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1194/2389] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:43 2022] DELETE /compute/v2.1/os-server-groups/922aa2fa-aae0-4411-b80f-11986c5ee07f => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:43.620586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.621580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:43.635316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.635826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.636276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.637605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.638080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.638511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.797858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:43.812523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d07f227-4cbd-41d5-a97e-3bc06eec26e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1271 microversion: 2.1 time: 0.200776 Oct 26 05:10:43.813510 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1195/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:43 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:43.818868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-697c0001-7cf4-4ad4-946f-8bb016da841b tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.859031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:43.867127 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-697c0001-7cf4-4ad4-946f-8bb016da841b tempest-ServerGroupTestJSON-303939042 tempest-ServerGroupTestJSON-303939042-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/20b625d4-636a-4119-badd-28f3f167d863" status: 204 len: 0 microversion: 2.1 time: 0.052584 Oct 26 05:10:43.880383 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1196/2391] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:10:43 2022] DELETE /compute/v2.1/os-server-groups/20b625d4-636a-4119-badd-28f3f167d863 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:43.895502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c0fb5581-05be-42b7-8377-3c23be817850 req-dac79b23-92db-4687-9d52-4c01df0bbd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:43.902630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83ab6ad8-d1ef-45fa-adc0-4bed7ada491c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1533 microversion: 2.1 time: 0.612226 Oct 26 05:10:43.904565 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1196/2392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:43 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1533 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:43.910262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:43.911086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:43.924575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.926314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.926915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.927798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.928862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.930647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:43.955191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0fb5581-05be-42b7-8377-3c23be817850 req-dac79b23-92db-4687-9d52-4c01df0bbd21 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:43.956699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0fb5581-05be-42b7-8377-3c23be817850 req-dac79b23-92db-4687-9d52-4c01df0bbd21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:43.960684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0fb5581-05be-42b7-8377-3c23be817850 req-dac79b23-92db-4687-9d52-4c01df0bbd21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:44.010745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c0fb5581-05be-42b7-8377-3c23be817850 req-dac79b23-92db-4687-9d52-4c01df0bbd21 service nova] Creating event network-changed:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:10:44.021535 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c0fb5581-05be-42b7-8377-3c23be817850 req-dac79b23-92db-4687-9d52-4c01df0bbd21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138447 Oct 26 05:10:44.023811 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1197/2393] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:44.313213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:44.314120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:44.320978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:44.346076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:44.346731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:44.350427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:44.351332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:44.351938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:44.352481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:44.409963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:45.087642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:45.097777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8be501e4-a3e3-4154-9a27-a2f8dbffc322 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 1.191974 Oct 26 05:10:45.099346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:45.101846 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1197/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:43 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:45.119548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:45.123740 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb114fb1-8cc2-423c-8c6a-a0a337e6ed06 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1507 microversion: 2.1 time: 0.815076 Oct 26 05:10:45.125592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1198/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:44 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1507 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:45.132463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:45.134095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:45.135743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:45.143196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:45.143698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:45.144147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:45.144864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:45.145343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:45.145769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:45.156367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:45.162822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:45.164655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:45.167900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:45.168706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:45.170642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:46.294518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:46.304647 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e455ed3-60b6-474a-89a8-3ae3e35f6ddf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 1.199010 Oct 26 05:10:46.309844 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1198/2396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:45 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:46.325444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:46.326839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:46.342770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:46.347870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:46.348922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:46.354635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:46.355315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:46.355909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:46.777924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:46.790177 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2afe2712-0537-4125-aa28-2aa33684dc18 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 1.662547 Oct 26 05:10:46.790995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1199/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:45 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:46.795989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:46.801742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:46.811953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:46.812689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:46.813454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:46.814387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:46.815083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:46.815725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:46.995837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:47.014313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3551fb77-1ead-46a1-8652-be8836e25bf2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.702243 Oct 26 05:10:47.015111 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1199/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:46 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:47.050295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:47.056853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:47.077730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.078303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.078764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:47.079518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.079984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.088497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:47.533177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:47.548719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05efaadd-b098-4518-8a70-a854cf02b37e tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.756298 Oct 26 05:10:47.563697 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1200/2399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:46 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:47.576011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-82f95306-5526-48fc-bf05-3be2ef62f29a req-ce49150f-8b97-463a-80d4-036af291c535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8934c2-5330-401c-a60c-782e427a7966", "tag": "a976d88b-74aa-4aa1-b413-41ada8fb3dae"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:47.594920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-82f95306-5526-48fc-bf05-3be2ef62f29a req-ce49150f-8b97-463a-80d4-036af291c535 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.600742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-82f95306-5526-48fc-bf05-3be2ef62f29a req-ce49150f-8b97-463a-80d4-036af291c535 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.602010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-82f95306-5526-48fc-bf05-3be2ef62f29a req-ce49150f-8b97-463a-80d4-036af291c535 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:47.618802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-82f95306-5526-48fc-bf05-3be2ef62f29a req-ce49150f-8b97-463a-80d4-036af291c535 service nova] Creating event network-changed:a976d88b-74aa-4aa1-b413-41ada8fb3dae for instance 5c8934c2-5330-401c-a60c-782e427a7966 on n-h1-862416-4 Oct 26 05:10:47.627399 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-82f95306-5526-48fc-bf05-3be2ef62f29a req-ce49150f-8b97-463a-80d4-036af291c535 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060534 Oct 26 05:10:47.632677 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1201/2400] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:47.648800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:47.653239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:47.666094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:47.673812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.677443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.678108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:47.678786 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f59e78fe-7170-454f-bab6-3e0db42ef43d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1507 microversion: 2.1 time: 0.639731 Oct 26 05:10:47.679628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1200/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:47 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:47.681591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.682462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.684797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:47.817587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:47.818327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:47.837645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.838247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.838696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:47.839516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:47.840039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:47.840538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.279124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:48.290994 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2ff76fd-8b4e-473a-ba78-fcc8440d04c2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.477504 Oct 26 05:10:48.300029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:48.306559 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1201/2402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:47 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:48.309684 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7604b46c-963c-4878-9b83-3ac26ecacb69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.671879 Oct 26 05:10:48.314039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:48.317627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:48.326144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.326859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:48.327911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.328446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1202/2403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:47 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:48.329049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.329732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:48.330353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.579045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:48.579965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:48.587751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.588477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:48.589075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.589977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.590661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:48.591287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.861569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:48.885051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:48.886901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:48.895994 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1949a770-3a84-4588-add5-ce669c12046e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.588210 Oct 26 05:10:48.898186 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1202/2404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:48 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:48.903921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-36c50038-bc8e-4f86-bf37-b6c8c7b4ef6f req-3a40eb37-be8e-46eb-9a3c-711a64d6bb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763a0afe-e4d9-4662-8fa9-a6e13da4d9b0", "name": "network-vif-plugged", "status": "completed", "tag": "0dd48839-e258-4235-8e71-67acf022ca5f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:48.916219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-36c50038-bc8e-4f86-bf37-b6c8c7b4ef6f req-3a40eb37-be8e-46eb-9a3c-711a64d6bb24 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.917054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-36c50038-bc8e-4f86-bf37-b6c8c7b4ef6f req-3a40eb37-be8e-46eb-9a3c-711a64d6bb24 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:48.917787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-36c50038-bc8e-4f86-bf37-b6c8c7b4ef6f req-3a40eb37-be8e-46eb-9a3c-711a64d6bb24 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.929935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-36c50038-bc8e-4f86-bf37-b6c8c7b4ef6f req-3a40eb37-be8e-46eb-9a3c-711a64d6bb24 service nova] Creating event network-vif-plugged:0dd48839-e258-4235-8e71-67acf022ca5f for instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 on n-h2-862416-4 Oct 26 05:10:48.935878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-36c50038-bc8e-4f86-bf37-b6c8c7b4ef6f req-3a40eb37-be8e-46eb-9a3c-711a64d6bb24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 Oct 26 05:10:48.940803 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1203/2405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:48.965507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:48.968326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:48.987701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.994141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:48.994898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:48.995844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:48.996731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:49.001996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:49.042776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:49.096282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fbdede8d-d7a6-4800-ab6d-574e6234c57f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.522179 Oct 26 05:10:49.098489 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1203/2406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:48 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:49.163982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:49.323057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:49.323606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:49.357258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:49.373868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:49.374324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:49.376477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:49.378509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:49.382592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:50.231194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:50.243706 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad2c340c-8082-40c3-b528-659e69d8f1e8 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.927751 Oct 26 05:10:50.245969 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1204/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:49 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:50.253470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:50.254335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:50.261283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:50.262014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:50.262922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:50.263799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:50.264453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:50.265073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:50.298438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:50.313573 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-defdcb2f-8501-4c96-9810-7d60f8f7df88 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1489 microversion: 2.1 time: 1.359986 Oct 26 05:10:50.351139 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1204/2408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:48 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1489 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:50.372386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:50.373814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:50.394833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:50.398320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:50.398902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:50.399765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:50.401718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:50.402546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:50.438658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:51.201429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:51.230577 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c4f4dc83-f166-404c-b515-41d78698f1d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.982917 Oct 26 05:10:51.245530 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1205/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:50 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:51.284836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:51.285524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:51.303369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.304023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.304706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:51.305517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.305987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.306266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:51.306852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:51.315540 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-41129f4f-5958-461b-96ef-9d141dd41626 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.962827 Oct 26 05:10:51.331236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1205/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:50 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:51.348574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:51.349377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:51.363882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.365763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.367374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:51.369638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.370380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.372195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:51.453406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:10:51.701892 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b8ed68e8-e596-4b1c-94f0-c200c5e6fa91 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 204 len: 0 microversion: 2.1 time: 0.368925 Oct 26 05:10:51.703544 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1206/2411] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:51 2022] DELETE /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:51.713146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7932138a-29f3-422e-a3cc-b05ee4d053d1 req-85644183-c9da-4a03-8736-4c1593b5c894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "name": "network-vif-plugged", "status": "completed", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:51.735917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7932138a-29f3-422e-a3cc-b05ee4d053d1 req-85644183-c9da-4a03-8736-4c1593b5c894 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.736643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7932138a-29f3-422e-a3cc-b05ee4d053d1 req-85644183-c9da-4a03-8736-4c1593b5c894 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.737264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7932138a-29f3-422e-a3cc-b05ee4d053d1 req-85644183-c9da-4a03-8736-4c1593b5c894 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:51.761586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7932138a-29f3-422e-a3cc-b05ee4d053d1 req-85644183-c9da-4a03-8736-4c1593b5c894 service nova] Creating event network-vif-plugged:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h1-862416-4 Oct 26 05:10:51.766345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7932138a-29f3-422e-a3cc-b05ee4d053d1 req-85644183-c9da-4a03-8736-4c1593b5c894 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060113 Oct 26 05:10:51.767042 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1207/2412] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:51.772763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:51.775770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:51.781262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.781822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.782322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:51.783016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:51.783502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:51.783954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.146894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:52.157622 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-02db71b5-f142-4f18-a375-a9feabcdb430 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.910331 Oct 26 05:10:52.162481 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1206/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:51 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:52.173130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fb65d4d-bcfe-42f0-8c00-30f7cf571ab5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470acb21f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:52.206151 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1fb65d4d-bcfe-42f0-8c00-30f7cf571ab5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Image not found. Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fb65d4d-bcfe-42f0-8c00-30f7cf571ab5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b HTTP/1.1 Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:52.208701 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3eb9650e-2908-4a02-a9f6-c27cc82d5e4b'} Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:52.211052 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3eb9650e-2908-4a02-a9f6-c27cc82d5e4b to delete Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.212215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eb9650e-2908-4a02-a9f6-c27cc82d5e4b could not be found. Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:52.213531 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:10:52.216550 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:52.221130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fb65d4d-bcfe-42f0-8c00-30f7cf571ab5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:52.223338 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fb65d4d-bcfe-42f0-8c00-30f7cf571ab5 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b" status: 404 len: 62 microversion: 2.1 time: 0.059498 Oct 26 05:10:52.229642 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1207/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:52 2022] DELETE /compute/v2.1/images/3eb9650e-2908-4a02-a9f6-c27cc82d5e4b => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:52.234987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:52.239849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:52.259095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.260234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.260844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.263787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.266053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.266503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.325723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:10:52.367298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:52.378297 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93359b34-a55f-4169-9236-63e2e20e6b80 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.609873 Oct 26 05:10:52.382794 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1208/2415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:51 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:52.395195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:52.395994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:52.406897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.407573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.408170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.414023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.415787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.417522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.457341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Instance is already in deleting state, ignoring this request Oct 26 05:10:52.458554 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-995eea3f-8297-41dc-a94e-d469043002e0 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 204 len: 0 microversion: 2.1 time: 0.227640 Oct 26 05:10:52.460804 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1208/2416] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:52 2022] DELETE /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:10:52.466934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:52.468539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:52.479535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.487047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.488441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.490190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.491940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.492622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.852126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:52.861881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0247ca6d-876c-4b91-b228-a2d265a8da8b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.477679 Oct 26 05:10:52.863155 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1209/2417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:52 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:52.870138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:52.872825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:52.882880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.883390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.883926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:52.895445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:52.898782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:52.899456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.017162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:53.034334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b8f371c-8f19-4f8d-b019-0d7ff83640d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.571651 Oct 26 05:10:53.034972 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1209/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:52 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:53.185923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:53.186551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:53.197434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.198148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.199938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.202438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.204124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.205300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.311334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:53.329149 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4112ced6-3717-4dd1-9ba2-5eef33dfc996 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1495 microversion: 2.1 time: 0.464199 Oct 26 05:10:53.330349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1210/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:52 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1495 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:53.408155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:53.409659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:53.423454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.423951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.424969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.425910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.429904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.430938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.774610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:53.783949 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3873498b-553d-4ecd-bc96-4bb8302cd781 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.602454 Oct 26 05:10:53.787400 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1210/2420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:53 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:53.800882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-plugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}, {"server_uuid": "763a0afe-e4d9-4662-8fa9-a6e13da4d9b0", "name": "network-vif-unplugged", "status": "completed", "tag": "0dd48839-e258-4235-8e71-67acf022ca5f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:53.814568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.815312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.815959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.841971 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] Creating event network-vif-plugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:10:53.842779 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] Creating event network-vif-unplugged:0dd48839-e258-4235-8e71-67acf022ca5f for instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 on n-h2-862416-4 Oct 26 05:10:53.851698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:53.854193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-603c95e7-7044-4a77-af48-4cd6ab135a9a req-1d8cc7ca-e2bc-4c1c-b82e-241bfef86975 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.057317 Oct 26 05:10:53.855382 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1211/2421] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:53.868068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47eb6f88-e6a8-4c92-8b38-bea979ebf412 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.463743 Oct 26 05:10:53.885635 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1211/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:53 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:53.888289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:53.889284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:53.900055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.903529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.904212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:53.906865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:53.907565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:53.909277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.058470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:54.059269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:54.067311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:54.071354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:54.072326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.074164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:54.075080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:54.077105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.409019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:54.427669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-94a5a706-bbdd-4587-9ee0-1728e020466b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.543428 Oct 26 05:10:54.430487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1212/2423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:53 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:54.604911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c006fc9c-6472-4a05-9573-fbebb78d45fe tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Action: 'create', calling method: .version_select at 0x7f470a79cc10>, body: {"keypair": {"name": "tempest-keypair-1887750970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOrPzkV37IAIW10grRzlXCaYs8P254qM0bbYj5NDT4m04TCDmQPyl9LXYj88A9wwEvUKcMw0KDJSAGeQxpu27gA7PAR5BtFiGB8dl8eiKCKW/OaA7krXMQJcV1S1hs6Rg=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:54.606757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:54.620547 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-06536681-06bb-4087-986f-21e6a95d6765 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.566344 Oct 26 05:10:54.624684 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1212/2424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:54 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:54.634368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:54.638615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:54.652692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c006fc9c-6472-4a05-9573-fbebb78d45fe tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:54.652959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:54.653638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:54.654168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.655471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:54.658063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:54.658714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.667895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c006fc9c-6472-4a05-9573-fbebb78d45fe tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for user a1e2e525a1764b7784a4bc983e6b9043 and project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:54.721351 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c006fc9c-6472-4a05-9573-fbebb78d45fe tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.289171 Oct 26 05:10:54.722352 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1213/2425] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:54.733882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a16cad76-7f12-4a8d-8eb2-1658fe52aafd tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f470a15bdc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:54.743267 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a16cad76-7f12-4a8d-8eb2-1658fe52aafd tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1887750970" status: 200 len: 498 microversion: 2.1 time: 0.013274 Oct 26 05:10:54.744552 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1214/2426] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:10:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1887750970 => generated 498 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:54.755637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b9ccea5-e918-438d-81b6-06d18ce20dbe tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f470a161ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:54.798039 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b9ccea5-e918-438d-81b6-06d18ce20dbe tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887750970" status: 202 len: 0 microversion: 2.1 time: 0.045439 Oct 26 05:10:54.807779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1215/2427] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887750970 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:54.815198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7794a4d3-66dd-4f33-9f16-6fbb470cd436 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Action: 'create', calling method: .version_select at 0x7f470a034b80>, body: {"keypair": {"name": "tempest-keypair-436898372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFNINNxFpVFljNhOKO2UqQEo308blR1oPAvK4Ff6AbNBhX951VQG6ZQJMRq6HSbMPZBG9ud8jvVW1rLO2oYixhBaZvkO0rLUJug3acjlMvJH+Kc2PXi59QXNHqcSnkXIw=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:54.844134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7794a4d3-66dd-4f33-9f16-6fbb470cd436 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:54.854507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7794a4d3-66dd-4f33-9f16-6fbb470cd436 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for user a1e2e525a1764b7784a4bc983e6b9043 and project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:54.891517 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7794a4d3-66dd-4f33-9f16-6fbb470cd436 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081706 Oct 26 05:10:54.899497 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1216/2428] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:54.906396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:54.907031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:54.925957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:54.926489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:54.926966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.927696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:54.929091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:54.934336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:54.962358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:54.971831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d376f690-91a5-459b-ae64-b58b8961861c tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1495 microversion: 2.1 time: 0.345784 Oct 26 05:10:54.986816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1213/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:54 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1495 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:55.001216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6134946-945b-42ba-8e9a-2906a25331ee tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f4709e39280>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:55.038505 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6134946-945b-42ba-8e9a-2906a25331ee tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436898372" status: 202 len: 0 microversion: 2.1 time: 0.047502 Oct 26 05:10:55.045685 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1214/2430] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436898372 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:55.064146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:55.064977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:55.076887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.077974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.078558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:55.079418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.081550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.082102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:55.468870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:55.485512 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0dab7b0b-2a38-47d8-bff1-f302deeb0f11 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.584136 Oct 26 05:10:55.486194 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1217/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:54 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:55.512604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7180fffb-3735-4832-9ccb-95dec002574d tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Action: 'create', calling method: .version_select at 0x7f470a227c10>, body: {"keypair": {"name": "tempest-keypair-558754498", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:55.535808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:55.567239 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8fe77b1b-7d9e-4698-884e-1e1a86d51faf tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.513560 Oct 26 05:10:55.571150 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1215/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:55 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:55.581289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fb0733f6-e543-4263-bae1-c711cd52ecba req-b433aa30-eacd-447e-b760-b871dde2326f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46448c6-28d1-4533-9ff3-2e160f3b28dd", "name": "network-vif-unplugged", "status": "completed", "tag": "4e07b583-4c8d-4359-ab3b-32365dd9a3ba"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:55.595358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7180fffb-3735-4832-9ccb-95dec002574d tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:55.611363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7180fffb-3735-4832-9ccb-95dec002574d tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for user a1e2e525a1764b7784a4bc983e6b9043 and project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:55.629930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb0733f6-e543-4263-bae1-c711cd52ecba req-b433aa30-eacd-447e-b760-b871dde2326f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.631401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb0733f6-e543-4263-bae1-c711cd52ecba req-b433aa30-eacd-447e-b760-b871dde2326f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.632091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb0733f6-e543-4263-bae1-c711cd52ecba req-b433aa30-eacd-447e-b760-b871dde2326f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:55.679636 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fb0733f6-e543-4263-bae1-c711cd52ecba req-b433aa30-eacd-447e-b760-b871dde2326f service nova] Creating event network-vif-unplugged:4e07b583-4c8d-4359-ab3b-32365dd9a3ba for instance b46448c6-28d1-4533-9ff3-2e160f3b28dd on n-h2-862416-4 Oct 26 05:10:55.709743 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fb0733f6-e543-4263-bae1-c711cd52ecba req-b433aa30-eacd-447e-b760-b871dde2326f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136936 Oct 26 05:10:55.710507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1216/2433] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:55.727082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:55.728407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:55.735476 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7180fffb-3735-4832-9ccb-95dec002574d tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.229394 Oct 26 05:10:55.737361 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1218/2434] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:55 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:55.742815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:55.743450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:55.762216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.764872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.766601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.767632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:55.771698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.773247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.774211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:55.774567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.775109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:55.775990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:55.776485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:55.777632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.287314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:56.298873 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c57c1e4c-0a45-4f3a-b326-b31374338617 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.560201 Oct 26 05:10:56.300172 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1219/2435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:55 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:56.305747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-348b8440-7bc5-4a77-8751-f8dfdbc6d8c3 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f470abb7940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:56.332637 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-348b8440-7bc5-4a77-8751-f8dfdbc6d8c3 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558754498" status: 202 len: 0 microversion: 2.1 time: 0.031147 Oct 26 05:10:56.342178 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1220/2436] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558754498 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:56.348654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:56.349730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:56.374303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.376314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.376861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:56.378010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.379019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.381246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.383757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.385690 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48a9538a-1f06-4a66-b183-02b9221455d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1362 microversion: 2.1 time: 0.673927 Oct 26 05:10:56.405871 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1217/2437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:55 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1362 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:56.411844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-38299add-7a74-4ee8-bc68-c0213582dcf3 req-bf78efbe-adb9-444f-9f54-4f577c20ee61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8934c2-5330-401c-a60c-782e427a7966", "name": "network-vif-plugged", "status": "completed", "tag": "a976d88b-74aa-4aa1-b413-41ada8fb3dae"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:56.425418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-38299add-7a74-4ee8-bc68-c0213582dcf3 req-bf78efbe-adb9-444f-9f54-4f577c20ee61 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.426154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-38299add-7a74-4ee8-bc68-c0213582dcf3 req-bf78efbe-adb9-444f-9f54-4f577c20ee61 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.427016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-38299add-7a74-4ee8-bc68-c0213582dcf3 req-bf78efbe-adb9-444f-9f54-4f577c20ee61 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.439924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-38299add-7a74-4ee8-bc68-c0213582dcf3 req-bf78efbe-adb9-444f-9f54-4f577c20ee61 service nova] Creating event network-vif-plugged:a976d88b-74aa-4aa1-b413-41ada8fb3dae for instance 5c8934c2-5330-401c-a60c-782e427a7966 on n-h1-862416-4 Oct 26 05:10:56.446001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-38299add-7a74-4ee8-bc68-c0213582dcf3 req-bf78efbe-adb9-444f-9f54-4f577c20ee61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038428 Oct 26 05:10:56.447355 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1218/2438] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:56.456859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb99b796-85e7-49f5-b753-d81eb6a81780 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Action: 'create', calling method: .version_select at 0x7f4709f87af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1014277185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM0h89cJ6oMPAeiqKg+v0RRj/5MgPMi4Qou/1X1RhNk4iYLa4TP5Fi/Q9OQ2vfCnh2LnoMzMGXszZ4DkIiz6fsAh7/fPvISA3X9uAfFS9ibUwiIsb4AhckjAGmKEYbpWA=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:56.476402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.477092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.477693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.478282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lazy-loading 'fault' on Instance uuid 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:10:56.502648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-fb99b796-85e7-49f5-b753-d81eb6a81780 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:56.513157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-fb99b796-85e7-49f5-b753-d81eb6a81780 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for user a1e2e525a1764b7784a4bc983e6b9043 and project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:56.573101 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb99b796-85e7-49f5-b753-d81eb6a81780 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.124279 Oct 26 05:10:56.574215 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1219/2439] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:56.579040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:56.582044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:56.597603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.601929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.602623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.604279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.606143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.606812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.621484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6390eed87d6a41df96e727227de791bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e01a8f000f431095aa38c6c15050c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:56.624924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:56.642451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d070ebbe-4424-46e0-bbbd-e49d06228ebc tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 200 len: 1298 microversion: 2.1 time: 0.291853 Oct 26 05:10:56.643322 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1221/2440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:56 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 1298 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:56.657654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95b847b2-c59b-4701-b77d-3d4dd09df942 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Action: 'create', calling method: .version_select at 0x7f470a9a2dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1675416483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABxvhtQb8Bh9NtWVzZ+AT8uTlWjGB4hjzsqGyIApsknyATeOJVejW+ZPmlDMN2vU+BmExkM3j4TCmFKPm84Dg+kIADJv0huzyLnbYX0r/yYCj05Fm+ZYyfRrjVHf4nX9g=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:56.739678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-95b847b2-c59b-4701-b77d-3d4dd09df942 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:56.754695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-95b847b2-c59b-4701-b77d-3d4dd09df942 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for user a1e2e525a1764b7784a4bc983e6b9043 and project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:56.811344 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95b847b2-c59b-4701-b77d-3d4dd09df942 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.164726 Oct 26 05:10:56.820754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1222/2441] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:56.837436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:56.841096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:56.855852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.857059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.857900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.858830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:56.859462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:56.860089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:56.988686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:56.998318 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a63a5154-78fb-4cc7-9ba0-7b24604c3975 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.423043 Oct 26 05:10:56.999223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1220/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:56 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:57.022011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9eac5247-02ef-4238-b0bc-4eca986a4cbc tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Action: 'create', calling method: .version_select at 0x7f4709f38820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1298299742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrwOb1Gt+FhWEndS3HyN4PjOsjMfhWMy3dJEtIXrT77y8LNKBJMbllmv3sLhnwkVWLpocbXNzzu0WyW7hxCMhBETXTFoml4S85IUX/Hq3ik7IuV/UkmfPuwoYqfjmwSsw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:57.038867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9eac5247-02ef-4238-b0bc-4eca986a4cbc tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:10:57.052372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9eac5247-02ef-4238-b0bc-4eca986a4cbc tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Getting quotas for user a1e2e525a1764b7784a4bc983e6b9043 and project 91d36d14805445e89b526cfb2aa7626c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:10:57.090680 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9eac5247-02ef-4238-b0bc-4eca986a4cbc tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.089900 Oct 26 05:10:57.092030 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1221/2443] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:10:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:57.108623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84006d71-3eea-43de-ab75-e775a9b2306a tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f470afe7940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.114529 n-d-862416-4 devstack@n-api.service[120585]: WARNING oslo_db.sqlalchemy.utils [None req-84006d71-3eea-43de-ab75-e775a9b2306a tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 05:10:57.123971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:57.126901 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-84006d71-3eea-43de-ab75-e775a9b2306a tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.028291 Oct 26 05:10:57.127534 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1222/2444] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:10:57 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:10:57.146875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba7bc20e-5f87-4295-83f6-cc0f3c5abab9 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f4709e7dee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.176258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:57.187138 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e5167a1-2305-4707-af34-da35a6e37d2d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.364788 Oct 26 05:10:57.188535 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1223/2445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:56 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:57.207388 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba7bc20e-5f87-4295-83f6-cc0f3c5abab9 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1298299742" status: 202 len: 0 microversion: 2.1 time: 0.070791 Oct 26 05:10:57.209369 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1223/2446] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 26 05:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1298299742 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:57.217186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45425323-68b8-4b04-9f40-26acadcfee67 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f470a0348b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.242184 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45425323-68b8-4b04-9f40-26acadcfee67 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1675416483" status: 202 len: 0 microversion: 2.1 time: 0.029273 Oct 26 05:10:57.243550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1224/2447] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 26 05:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1675416483 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:10:57.257721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c46a74ad-e2e6-42d7-a115-ea4e845626a9 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] Calling method '.version_select at 0x7f4709f870d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.284608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c46a74ad-e2e6-42d7-a115-ea4e845626a9 tempest-KeyPairsV2TestJSON-303644228 tempest-KeyPairsV2TestJSON-303644228-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1014277185" status: 202 len: 0 microversion: 2.1 time: 0.035485 Oct 26 05:10:57.294989 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1224/2448] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 26 05:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1014277185 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:10:57.326168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.326819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:57.330503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:57.338621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.339561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.340035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.342949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.343447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.343894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.412234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.413136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:57.436466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.436975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.437480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.438647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.439120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.439557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.684617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:57.692425 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-318f450d-1e96-4ef1-847d-a15bb63eafe3 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.371511 Oct 26 05:10:57.699316 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1225/2449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:57 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:57.704357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.708016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:57.727025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.727531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.727979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.728702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.729168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.729622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.767978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 could not be found. Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 HTTP/1.1 Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:57.771470 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 could not be found. Oct 26 05:10:57.773357 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '763a0afe-e4d9-4662-8fa9-a6e13da4d9b0'} Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 could not be found. Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:57.774085 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 could not be found. Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 could not be found. Oct 26 05:10:57.775245 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.776304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:57.776304 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36176c44-c347-4c6a-9708-37a7a8eda037 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0" status: 404 len: 111 microversion: 2.1 time: 0.071250 Oct 26 05:10:57.779096 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1226/2450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:57 2022] GET /compute/v2.1/servers/763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:57.782903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763a0afe-e4d9-4662-8fa9-a6e13da4d9b0", "name": "network-vif-deleted", "tag": "0dd48839-e258-4235-8e71-67acf022ca5f"}, {"name": "network-changed", "server_uuid": "b46448c6-28d1-4533-9ff3-2e160f3b28dd", "tag": "4e07b583-4c8d-4359-ab3b-32365dd9a3ba"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:10:57.805614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.805923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.806381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.843506 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] Creating event network-vif-deleted:0dd48839-e258-4235-8e71-67acf022ca5f for instance 763a0afe-e4d9-4662-8fa9-a6e13da4d9b0 on n-h2-862416-4 Oct 26 05:10:57.845203 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] Creating event network-changed:4e07b583-4c8d-4359-ab3b-32365dd9a3ba for instance b46448c6-28d1-4533-9ff3-2e160f3b28dd on n-h2-862416-4 Oct 26 05:10:57.852596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:57.869965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f6024507-a6c5-4511-a522-0c80e000801b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1549 microversion: 2.1 time: 0.461760 Oct 26 05:10:57.876725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1225/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:57 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1549 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:57.882316 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-14717d54-258f-46ec-81b3-d6ab579a9145 req-811d6280-2732-49db-9a7c-166d7ab1f3e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.096043 Oct 26 05:10:57.883623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1227/2452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:57.894952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.895401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:57.898762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.899659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:57.906221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.906855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.907246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.907480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.908048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.908485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.908795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.908980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.909715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.911386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.912710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.913581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.942316 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a HTTP/1.1 Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:57.944603 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:57.945945 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e56e3676-5bff-4ea3-8e64-3d3cdf77f37a'} Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:57.946699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:57.947907 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:57.949092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:57.952007 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c175fb2-cb13-4f1e-9343-278bce4b349f tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 404 len: 111 microversion: 2.1 time: 0.070346 Oct 26 05:10:57.956541 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1226/2453] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:57 2022] DELETE /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:57.965533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:57.967630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: e56e3676-5bff-4ea3-8e64-3d3cdf77f37a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:57.985795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.986769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.987226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:57.988153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:57.988625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:57.989116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.011845 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a HTTP/1.1 Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:58.015435 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:58.016720 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e56e3676-5bff-4ea3-8e64-3d3cdf77f37a'} Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.017462 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. Oct 26 05:10:58.022261 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.023322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance e56e3676-5bff-4ea3-8e64-3d3cdf77f37a could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.023322 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bcb81ead-4702-4a2b-bd4a-b70ad62fd201 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a" status: 404 len: 111 microversion: 2.1 time: 0.057687 Oct 26 05:10:58.023322 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1227/2454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:57 2022] GET /compute/v2.1/servers/e56e3676-5bff-4ea3-8e64-3d3cdf77f37a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:58.025032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.025147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.031347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.032741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.032969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.033718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.034959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.035526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.036378 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-084a7368-7079-41ec-aa61-951e29f74c62 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142086 Oct 26 05:10:58.037643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1228/2455] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:10:57 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:10:58.044572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b04145d-c77b-4b4e-af98-984c9bcfa43b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a1613a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.103043 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-4b04145d-c77b-4b4e-af98-984c9bcfa43b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Image not found. Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b04145d-c77b-4b4e-af98-984c9bcfa43b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 HTTP/1.1 Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:58.105363 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '1f05f78f-6c46-461d-853a-7ce305c7b9a5'} Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.106831 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1f05f78f-6c46-461d-853a-7ce305c7b9a5 to delete Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.107820 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f05f78f-6c46-461d-853a-7ce305c7b9a5 could not be found. Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.109165 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:10:58.110562 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.111532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b04145d-c77b-4b4e-af98-984c9bcfa43b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.112514 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b04145d-c77b-4b4e-af98-984c9bcfa43b tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5" status: 404 len: 62 microversion: 2.1 time: 0.073509 Oct 26 05:10:58.113162 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1229/2456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] DELETE /compute/v2.1/images/1f05f78f-6c46-461d-853a-7ce305c7b9a5 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:58.132773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.133787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.162010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.163860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.165218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.166088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.168664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.169235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.189244 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 HTTP/1.1 Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:58.191581 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.192885 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '522771cc-3392-4767-ba87-48a030cf98b2'} Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.193637 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.199500 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.201897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.201897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51481290-e703-4f08-a9ce-946999ca5c99 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 404 len: 111 microversion: 2.1 time: 0.073727 Oct 26 05:10:58.201897 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1230/2457] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:58 2022] DELETE /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:58.205171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.207580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 522771cc-3392-4767-ba87-48a030cf98b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.219353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.219919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.220699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.221841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.222334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.222775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.239792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 HTTP/1.1 Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:58.243076 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.244721 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '522771cc-3392-4767-ba87-48a030cf98b2'} Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.249349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. Oct 26 05:10:58.250912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.252184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 522771cc-3392-4767-ba87-48a030cf98b2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.252184 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c820b21-c6d7-4b81-9735-92482b987038 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2" status: 404 len: 111 microversion: 2.1 time: 0.043485 Oct 26 05:10:58.252184 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1231/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] GET /compute/v2.1/servers/522771cc-3392-4767-ba87-48a030cf98b2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:58.254498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.255131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.262789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.263306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.263768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.264506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.264977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.267140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.586768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:58.596835 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f9a4862-cf3b-4d6f-bf61-ff5e72269466 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.577567 Oct 26 05:10:58.602816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1228/2459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:58.609507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e543e95-d430-48e0-bee1-ddaae275ae42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f4709f9cca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.639608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1e543e95-d430-48e0-bee1-ddaae275ae42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Image not found. Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e543e95-d430-48e0-bee1-ddaae275ae42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 HTTP/1.1 Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:58.642688 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '39274fb3-ae6a-4b8a-98e1-94354d1d6ee4'} Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.644209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 to delete Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.645139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 could not be found. Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.646438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:10:58.648336 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.652447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e543e95-d430-48e0-bee1-ddaae275ae42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.655232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e543e95-d430-48e0-bee1-ddaae275ae42 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4" status: 404 len: 62 microversion: 2.1 time: 0.049307 Oct 26 05:10:58.656499 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1229/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] DELETE /compute/v2.1/images/39274fb3-ae6a-4b8a-98e1-94354d1d6ee4 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:58.668215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.669762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.677978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.680334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.681063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.682180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.683095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.683893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.702558 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 HTTP/1.1 Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:58.704534 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.705958 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1009243c-75eb-4ae9-9c19-1993034b9935'} Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.706647 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.707778 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.711193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.712406 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4728b09c-a8fb-4479-9072-03c17e165424 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 404 len: 111 microversion: 2.1 time: 0.049972 Oct 26 05:10:58.713620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1230/2461] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:58 2022] DELETE /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:58.727514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.728472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 1009243c-75eb-4ae9-9c19-1993034b9935] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.740506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.743718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.744629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.746479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.747318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.748305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.754095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:10:58.777808 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 HTTP/1.1 Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:10:58.779895 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.781704 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1009243c-75eb-4ae9-9c19-1993034b9935'} Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:58.782542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. Oct 26 05:10:58.783979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:10:58.785644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 1009243c-75eb-4ae9-9c19-1993034b9935 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:58.785644 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7105b63c-c569-4591-bdf8-d22b9c2bcf3d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935" status: 404 len: 111 microversion: 2.1 time: 0.061317 Oct 26 05:10:58.785644 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1231/2462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] GET /compute/v2.1/servers/1009243c-75eb-4ae9-9c19-1993034b9935 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:58.791366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:58.791997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:58.800061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.800817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.801262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:58.802235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:58.802694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:58.804145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.047181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:59.058445 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-593b5e67-9b3d-4f7a-8520-c2bcea760da4 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1313 microversion: 2.1 time: 0.811713 Oct 26 05:10:59.081452 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1232/2463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1313 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:10:59.095530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30801374-63d2-4a9e-942d-0ff4a4355d20 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470b3455e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.146465 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-30801374-63d2-4a9e-942d-0ff4a4355d20 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Image not found. Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30801374-63d2-4a9e-942d-0ff4a4355d20 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 HTTP/1.1 Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:59.154524 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '44724cc7-431a-4629-9d5e-48f9b74b08c9'} Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:59.155912 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 44724cc7-431a-4629-9d5e-48f9b74b08c9 to delete Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.156731 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44724cc7-431a-4629-9d5e-48f9b74b08c9 could not be found. Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:59.157853 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:10:59.159158 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.162230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30801374-63d2-4a9e-942d-0ff4a4355d20 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:59.166147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30801374-63d2-4a9e-942d-0ff4a4355d20 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9" status: 404 len: 62 microversion: 2.1 time: 0.077447 Oct 26 05:10:59.166679 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1233/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:59 2022] DELETE /compute/v2.1/images/44724cc7-431a-4629-9d5e-48f9b74b08c9 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:59.180852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.182373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:59.191107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.192379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.193051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.194039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.194702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.195321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.215665 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 HTTP/1.1 Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:59.218439 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.219685 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3631f7b3-349e-43e1-8d4f-128ddb274ee8'} Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:59.220412 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.221585 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.225001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:59.227065 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a942346-a2fd-4fb6-b1b8-be46f815c68d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 404 len: 111 microversion: 2.1 time: 0.055966 Oct 26 05:10:59.228273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1234/2465] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:59 2022] DELETE /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:59.237620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.249568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: 3631f7b3-349e-43e1-8d4f-128ddb274ee8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:59.266294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.266890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.267623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.268578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.269128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.269682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.285815 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 HTTP/1.1 Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:59.289110 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.290757 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3631f7b3-349e-43e1-8d4f-128ddb274ee8'} Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:59.291485 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. Oct 26 05:10:59.292662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.295367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance 3631f7b3-349e-43e1-8d4f-128ddb274ee8 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:59.297004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2941cb5-a71f-4326-a1c4-d84c9a2047e2 tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8" status: 404 len: 111 microversion: 2.1 time: 0.064432 Oct 26 05:10:59.298178 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1235/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:59 2022] GET /compute/v2.1/servers/3631f7b3-349e-43e1-8d4f-128ddb274ee8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:59.310783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f7f3fd4-56ac-4506-a1b5-389647a3c49e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '.version_select at 0x7f470a036ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.357632 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-9f7f3fd4-56ac-4506-a1b5-389647a3c49e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Image not found. Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f7f3fd4-56ac-4506-a1b5-389647a3c49e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 HTTP/1.1 Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:59.360554 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '84d916a7-9d4f-4295-91ff-a0a50907fd62'} Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:59.361911 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 84d916a7-9d4f-4295-91ff-a0a50907fd62 to delete Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.362704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84d916a7-9d4f-4295-91ff-a0a50907fd62 could not be found. Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:59.363832 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:10:59.365433 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.369688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f7f3fd4-56ac-4506-a1b5-389647a3c49e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:59.371005 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f7f3fd4-56ac-4506-a1b5-389647a3c49e tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62" status: 404 len: 62 microversion: 2.1 time: 0.068259 Oct 26 05:10:59.372144 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1236/2467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:59 2022] DELETE /compute/v2.1/images/84d916a7-9d4f-4295-91ff-a0a50907fd62 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:10:59.392108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.393101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:59.404233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.405203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.406031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.407056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.407880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.408529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.428532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 HTTP/1.1 Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:59.451749 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.453045 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f5c7821e-445f-43cc-84e8-7e697b1dd6c3'} Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:59.454239 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.455373 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.462368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:59.463736 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8fb34ccf-944f-4b06-80b7-7ef9b446eedf tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 404 len: 111 microversion: 2.1 time: 0.085488 Oct 26 05:10:59.464995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1237/2468] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:10:59 2022] DELETE /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:59.494822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.495552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] [instance: f5c7821e-445f-43cc-84e8-7e697b1dd6c3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:59.503895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.504534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.505212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.507093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.508518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.509917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.528235 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] HTTP exception thrown: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Request method failure captured: Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 HTTP/1.1 Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWL_aQqiCYz-vivWW7fsPQWI45EqZ3fk4OfyYlSIunT3c7lK5h-AT2ecA0KaMKmvzGg1w7x2CtNAEAzVWYzefKW9dJq_GLmzQzUtaDb3-OjFCsoSdxZKoj8TVTIBnvUfrDIVFiwxL0nhc9I5In9RAIIakiGCirxWckubZt0fq-roqCrI Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:10:59.530400 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e01a8f000f431095aa38c6c15050c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 28e01a8f000f431095aa38c6c15050c8 Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesTestJSON-1047986067 Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6390eed87d6a41df96e727227de791bb Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesTestJSON-1047986067-project Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.532001 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f5c7821e-445f-43cc-84e8-7e697b1dd6c3'} Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:10:59.533409 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. Oct 26 05:10:59.534794 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:10:59.536268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] Returning 404 to user: Instance f5c7821e-445f-43cc-84e8-7e697b1dd6c3 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:10:59.536703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b89c2e5-49b5-41bb-b797-ed1cb796720d tempest-ImagesTestJSON-1047986067 tempest-ImagesTestJSON-1047986067-project] 10.222.0.16 "GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3" status: 404 len: 111 microversion: 2.1 time: 0.058033 Oct 26 05:10:59.541152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1238/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:59 2022] GET /compute/v2.1/servers/f5c7821e-445f-43cc-84e8-7e697b1dd6c3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:10:59.627746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:10:59.628560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:10:59.640836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.644637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.645229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.647600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:10:59.651405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:10:59.653048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:10:59.840324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:10:59.852310 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63a6e502-5320-4453-9cae-6bb27ac990be tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 1.068126 Oct 26 05:10:59.853533 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1232/2470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:58 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:00.090427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:00.091234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:00.102449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:00.103126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:00.107720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:00.108591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:00.109147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:00.109691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:00.328432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:00.362059 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37817698-b60d-4a35-99e5-3c89349c8f68 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.721712 Oct 26 05:11:00.387411 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1239/2471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:10:59 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:00.467234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:00.474972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a4427aa-c19c-4a45-8c68-1b9e44521aca tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1463 microversion: 2.1 time: 0.390249 Oct 26 05:11:00.479318 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1233/2472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:00 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1463 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:01.023399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-837ffd42-fa12-4ab7-9688-e98960f14d48 req-99cedada-11ca-40ef-babf-6d9115801b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:01.043998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-837ffd42-fa12-4ab7-9688-e98960f14d48 req-99cedada-11ca-40ef-babf-6d9115801b47 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.048840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-837ffd42-fa12-4ab7-9688-e98960f14d48 req-99cedada-11ca-40ef-babf-6d9115801b47 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.049656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-837ffd42-fa12-4ab7-9688-e98960f14d48 req-99cedada-11ca-40ef-babf-6d9115801b47 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.059797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:01.065183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'deleted': False, 'project_id': 'b41b4cc2324841679f420b7390b7d9b2'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:01.092754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.101470 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-837ffd42-fa12-4ab7-9688-e98960f14d48 req-99cedada-11ca-40ef-babf-6d9115801b47 service nova] Creating event network-changed:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:11:01.102444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.103096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.104139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.107558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.110612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.133048 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-837ffd42-fa12-4ab7-9688-e98960f14d48 req-99cedada-11ca-40ef-babf-6d9115801b47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.548941 Oct 26 05:11:01.138106 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1234/2473] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:11:01.161851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:01.169687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:01.192799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.193754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.197905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.198935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.199687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.201019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.219838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c2036f9-f960-485b-aa58-f950191e5e5e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.713979 Oct 26 05:11:01.223767 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1240/2474] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:11:00 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:01.249940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:01.264179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'deleted': False} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:01.274483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.280193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.280927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.281986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.282673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.283347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.501546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:11:01.659179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:01.676923 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e20e28bd-0052-4199-ab21-2d723a3340cb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.534906 Oct 26 05:11:01.679110 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1235/2475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:01 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:01.693545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:01.694797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:01.706594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.707360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.708031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.720207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.720730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.722443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:01.723671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:01.726422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:01.726879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:02.285720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:02.304210 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbead85f-fc0a-49ab-8fda-9714bcd44c3b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.619014 Oct 26 05:11:02.305379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1236/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:01 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:02.706159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:02.706806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:02.718133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:02.720653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:02.721118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:02.724788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:02.725957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:02.726199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.047126 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b45da38-0215-4d9f-9bf7-0866d41f0bfc tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15095 microversion: 2.1 time: 1.801039 Oct 26 05:11:03.053246 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1241/2477] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 26 05:11:01 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15095 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:11:03.103704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:03.123069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'deleted': False, 'project_id': 'b41b4cc2324841679f420b7390b7d9b2'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:03.136210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.139608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.140336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.142412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.142996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.144340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.226836 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71c2771c-822c-42c9-9441-d26fa1d777cf tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=454a8c023fbb41749f8046a3bd1f6fbf" status: 200 len: 15 microversion: 2.1 time: 0.127734 Oct 26 05:11:03.234093 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1242/2478] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Oct 26 05:11:03 2022] GET /compute/v2.1/servers/detail?tenant_id=454a8c023fbb41749f8046a3bd1f6fbf => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:03.252932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:03.259290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:03.262243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'tenant_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'deleted': False} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:03.280117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.280908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.282762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.283795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.284492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.285162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.293862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f614971-7dc0-4f77-a90f-68cf4aa09352 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.591677 Oct 26 05:11:03.294788 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1237/2479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:02 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:03.330789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:03.331405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:03.348367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.354075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.357926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.358699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.359267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.359587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.387715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:11:03.555020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:03.555523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:03.555970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:03.983269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:03.994812 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b0ade74-a0ce-47c2-b8f6-2af59dac771f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.670014 Oct 26 05:11:03.997411 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1238/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:03 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:04.004122 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6884b2ab-c44f-404a-b2e6-17d77599352c tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=454a8c023fbb41749f8046a3bd1f6fbf" status: 200 len: 4825 microversion: 2.1 time: 0.755119 Oct 26 05:11:04.005519 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1243/2481] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 05:11:03 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=454a8c023fbb41749f8046a3bd1f6fbf => generated 4825 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:04.036424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:04.048957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'tenant_id': 'b41b4cc2324841679f420b7390b7d9b2', 'deleted': False} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:04.081111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.081946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.086876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.087985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.094087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.096775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.168942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bf5ecaf-57ce-4623-a702-ad0b20c49b3d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b41b4cc2324841679f420b7390b7d9b2" status: 200 len: 15 microversion: 2.1 time: 0.136492 Oct 26 05:11:04.172876 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1239/2482] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 05:11:04 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b41b4cc2324841679f420b7390b7d9b2 => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:04.208954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b74c73a5-648f-4980-9f01-a1c7eef13803 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:04.222885 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b74c73a5-648f-4980-9f01-a1c7eef13803 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.017083 Oct 26 05:11:04.223847 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1244/2483] 10.222.0.16 () {58 vars in 1189 bytes} [Wed Oct 26 05:11:04 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:04.256385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:04.260215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:04.277071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.277959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.278584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.279314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.280023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.280858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.323123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:04.323750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:04.340456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.340965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.348751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.353503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.355529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.356005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.485854 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e625971b-6177-4cc7-8cec-3db0447fab67 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.235707 Oct 26 05:11:04.487365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1240/2484] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:04 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:11:04.499276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:04.512968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:04.517941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:04.532125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.534554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.535427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.536736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.539109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.539666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.766709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:11:04.943217 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b44f948-6652-4c62-af27-e3675638919c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.451132 Oct 26 05:11:04.947168 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1241/2485] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 26 05:11:04 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:11:04.959870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:04.961013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:04.966301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:04.971346 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23d5388a-32d6-46a1-bf00-832384a61941 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.653578 Oct 26 05:11:04.971936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1245/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:04 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:04.978451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.979379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.980705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:04.980842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:04.981454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:04.981991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:05.025374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:05.026268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:05.037124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:05.040306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:05.040770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:05.041569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:05.042045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:05.042504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:05.206841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7beece74-c3bb-41fc-a1a9-0f09eabd246e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.253346 Oct 26 05:11:05.208271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1242/2487] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:04 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:11:05.220795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:05.221655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:05.232306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:05.232806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:05.233244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:05.233980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:05.234434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:05.234876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:05.840692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:05.859859 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bcbd327f-bcf1-412e-bf39-c2d66d60df7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.835297 Oct 26 05:11:05.860527 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1246/2488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:05 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:05.976090 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3fd8dc81-c3e4-48e4-8c54-d090dd881d2d tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1613 microversion: 2.1 time: 0.762977 Oct 26 05:11:05.977299 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1243/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:05 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1613 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:06.005058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:06.005981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:06.007794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:06.008517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:06.021608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.021958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.022503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.022953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.023678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.024137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.024572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.025256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.025908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.032400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.033850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.039430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.641092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5376f6bb-11a2-46ab-a0d4-980fa58c09f1 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1613 microversion: 2.1 time: 0.637595 Oct 26 05:11:06.643059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1244/2490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:06 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1613 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:06.669485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:06.681222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'host': 'n-h1-862416-4', 'deleted': False} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:06.696938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.697463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.700919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.702048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.702678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.703292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.718768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:06.728838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9b8116c-531b-4a45-b04f-8ee1a6d64e8d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.735579 Oct 26 05:11:06.731891 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1247/2491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:05 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:06.889678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:06.894715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:06.902707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.903524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.904217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.905181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:06.905893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:06.906544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:06.943722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:11:07.074137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:07.077988 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4f83329-6596-411b-9282-ba6081f80337 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h1-862416-4&all_tenants=1" status: 200 len: 1644 microversion: 2.1 time: 0.412274 Oct 26 05:11:07.093802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1245/2492] 10.222.0.16 () {58 vars in 1190 bytes} [Wed Oct 26 05:11:06 2022] GET /compute/v2.1/servers?host=n-h1-862416-4&all_tenants=1 => generated 1644 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:07.099696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:07.112923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:11:07.132473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.132968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.133513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.134262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.134720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.135149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.161434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:07.179496 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8764fed5-87ca-40cf-aced-aee37faf6035 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.084514 Oct 26 05:11:07.180770 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1246/2493] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Oct 26 05:11:07 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:07.195272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:07.221826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:07.229330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.232164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.232708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.233861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.234334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.234771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.449633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:07.458689 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8cbaccbb-87aa-4870-ad6a-935883eafe66 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.573940 Oct 26 05:11:07.466053 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1248/2494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:06 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:07.538624 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59ac31b0-056d-4037-a727-1ffbdcc3a213 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.345159 Oct 26 05:11:07.541139 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1247/2495] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:07 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:11:07.549272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:07.552183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:07.567950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.568608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.569506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.570479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.570957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.572977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.758885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:07.759827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:07.775007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.775545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.778561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.779368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:07.782608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:07.785719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:07.802043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:11:07.805336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:11:07.807799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:11:07.810020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:11:07.812214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:11:07.849633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:08.000868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:08.019715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:08.021429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:08.026788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:08.027850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:08.029766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:08.038539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:08.122934 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d6cfd4d0-020d-4482-a731-677a3bb5e307 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 1066 microversion: 2.1 time: 0.577482 Oct 26 05:11:08.126978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1249/2496] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:07 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 1066 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 05:11:08.154979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:08.158124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:08.180597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:08.181616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:08.182327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:08.183901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:08.184777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:08.187451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:08.379120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:08.393651 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ca621ab-1f43-4041-b5f0-adb44bb7a7f0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.641371 Oct 26 05:11:08.401300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1248/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:07 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:08.769501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:08.789176 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c74f534b-21f5-4dd9-aead-6bbcd56f9af6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.646823 Oct 26 05:11:08.799491 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1250/2498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:08 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:08.880147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:08.881701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:08.910845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:08.916767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:08.917397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:08.918192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:08.918672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:08.919110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:09.425434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:09.426740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:09.456040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:09.459802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:09.461275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:09.462243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:09.462866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:09.463451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:09.894120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:09.901646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:09.913442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd04643f-1427-4270-a0ee-2fe2622572b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1528 microversion: 2.1 time: 0.491246 Oct 26 05:11:09.917440 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4bf8c5a7-819d-4db2-a4db-58b33257773b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 1.431101 Oct 26 05:11:09.918973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1251/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:09 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1528 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:09.923811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:09.924433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:09.929127 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1249/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:08 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:09.950510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:09.951351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:09.952009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:09.953550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:09.957039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:09.957778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:10.270651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:10.283428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c29c3e7f-7cd9-48e2-8ec6-fccc2fca09b9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.363320 Oct 26 05:11:10.289425 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1252/2501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:09 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:10.945951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:10.946750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:10.954127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:10.954743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:10.961928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:10.962431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:10.962877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:10.963599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:10.964059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:10.964492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:10.967985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:10.972118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:10.973777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:10.974623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:10.976666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:10.977654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:11.368236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:11.374347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:11.381729 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a737764-32eb-4dc1-a07c-e86a9388ff32 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.431528 Oct 26 05:11:11.383023 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1253/2502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:10 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:11.402684 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f43b2611-5cb7-437d-8d59-fea94c28eca2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1510 microversion: 2.1 time: 0.462126 Oct 26 05:11:11.404176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:11.405105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:11.406228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1250/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:10 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1510 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:11.417146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:11.418883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:11.422480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:11.423447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:11.424106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:11.424710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:11.654890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:11.665178 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f7b3c73-314e-429c-a2b9-c35ee2c7b543 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.279998 Oct 26 05:11:11.665816 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1254/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:11 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:12.412238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:12.413637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:12.433455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:12.434102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:12.435307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:12.435820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:12.436258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:12.436984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:12.437611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:12.438220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:12.448953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:12.449679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:12.450307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:12.451183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:12.453022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:12.453660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:12.703193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:12.717877 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a64bb7e2-aadb-47c0-8855-c377d61b6850 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.308171 Oct 26 05:11:12.720169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1251/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:12 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:12.729643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:12.736100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:12.749800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:12.752620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:12.755345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:12.756307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:12.758185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:12.759010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:12.774677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:12.788488 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c8158e0-9715-49d8-9eb8-80e680edd075 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1510 microversion: 2.1 time: 0.360024 Oct 26 05:11:12.789090 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1255/2506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:12 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:12.987039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:13.007470 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-de36ab3c-afde-4259-bc3b-a9664cc18d32 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.283513 Oct 26 05:11:13.008132 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1252/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:12 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:13.077888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c2e2ee8-8907-40b4-91a7-64b767336a17 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.225560 Oct 26 05:11:13.079876 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1256/2508] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 26 05:11:12 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 26 05:11:13.098948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b83f8527-7fb4-456d-b33c-da8734dcec17 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Calling method '.version_select at 0x7f4709f9cf70>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:13.158570 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b83f8527-7fb4-456d-b33c-da8734dcec17 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] HTTP exception thrown: Image not found. Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b83f8527-7fb4-456d-b33c-da8734dcec17 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Request method failure captured: Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFwYhA7D2-odR-cFVnQ24VNlaQFXiLaDzzFs6wH4EcHX3jMs0rhO79G6a1MXXedq8OQ8EBG7eHwiK70lpm0tYEq_Ijn6hyqgzCO37hdNn29uQpHr55rY8OgaIwNkeoABPOQ--DVHpOHhWacMr1WTPgczocVgV2aO2uy__XiS5vMams Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:11:13.160690 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5283d53f07d54383a588e500dbec2cef Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '-1'} Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:13.161961 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.165783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:13.167086 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b83f8527-7fb4-456d-b33c-da8734dcec17 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b83f8527-7fb4-456d-b33c-da8734dcec17 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.075786 Oct 26 05:11:13.168944 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1253/2509] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 26 05:11:13 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 26 05:11:13.173955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50284239-1997-447a-a6b4-efe072cd6ab8 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Calling method '.version_select at 0x7f470adb7820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:13.267178 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-50284239-1997-447a-a6b4-efe072cd6ab8 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] HTTP exception thrown: Image not found. Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50284239-1997-447a-a6b4-efe072cd6ab8 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Request method failure captured: Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/4f1fc51b-b927-4263-9df3-200c8ee532cj HTTP/1.1 Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFwYhA7D2-odR-cFVnQ24VNlaQFXiLaDzzFs6wH4EcHX3jMs0rhO79G6a1MXXedq8OQ8EBG7eHwiK70lpm0tYEq_Ijn6hyqgzCO37hdNn29uQpHr55rY8OgaIwNkeoABPOQ--DVHpOHhWacMr1WTPgczocVgV2aO2uy__XiS5vMams Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:11:13.270364 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5283d53f07d54383a588e500dbec2cef Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '4f1fc51b-b927-4263-9df3-200c8ee532cj'} Oct 26 05:11:13.272739 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4f1fc51b-b927-4263-9df3-200c8ee532cj to delete Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.273957 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f1fc51b-b927-4263-9df3-200c8ee532cj could not be found. Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:13.276931 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50284239-1997-447a-a6b4-efe072cd6ab8 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:13.278661 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-50284239-1997-447a-a6b4-efe072cd6ab8 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] 10.222.0.16 "DELETE /compute/v2.1/images/4f1fc51b-b927-4263-9df3-200c8ee532cj" status: 404 len: 62 microversion: 2.1 time: 0.105699 Oct 26 05:11:13.280226 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1257/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:13 2022] DELETE /compute/v2.1/images/4f1fc51b-b927-4263-9df3-200c8ee532cj => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:11:13.285082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dba31ff8-45f5-4f63-933d-03200b2221d9 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Calling method '.version_select at 0x7f4709fb9af0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:13.318155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-dba31ff8-45f5-4f63-933d-03200b2221d9 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] HTTP exception thrown: Image not found. Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dba31ff8-45f5-4f63-933d-03200b2221d9 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Request method failure captured: Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/images/f0a1e2d8-188a-4727-afc4-fc6071587bf21 HTTP/1.1 Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFwYhA7D2-odR-cFVnQ24VNlaQFXiLaDzzFs6wH4EcHX3jMs0rhO79G6a1MXXedq8OQ8EBG7eHwiK70lpm0tYEq_Ijn6hyqgzCO37hdNn29uQpHr55rY8OgaIwNkeoABPOQ--DVHpOHhWacMr1WTPgczocVgV2aO2uy__XiS5vMams Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:11:13.323409 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5283d53f07d54383a588e500dbec2cef Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f0a1e2d8-188a-4727-afc4-fc6071587bf21'} Oct 26 05:11:13.324808 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f0a1e2d8-188a-4727-afc4-fc6071587bf21 to delete Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.325582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0a1e2d8-188a-4727-afc4-fc6071587bf21 could not be found. Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:13.326700 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dba31ff8-45f5-4f63-933d-03200b2221d9 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:13.333425 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dba31ff8-45f5-4f63-933d-03200b2221d9 tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] 10.222.0.16 "DELETE /compute/v2.1/images/f0a1e2d8-188a-4727-afc4-fc6071587bf21" status: 404 len: 62 microversion: 2.1 time: 0.045276 Oct 26 05:11:13.335730 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1254/2511] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:11:13 2022] DELETE /compute/v2.1/images/f0a1e2d8-188a-4727-afc4-fc6071587bf21 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:11:13.349607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd4509fb-f37e-4ff6-8b0a-d27002ce99ac tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Calling method '.version_select at 0x7f470a827700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:13.362240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:13.390117 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-dd4509fb-f37e-4ff6-8b0a-d27002ce99ac tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] HTTP exception thrown: Image not found. Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd4509fb-f37e-4ff6-8b0a-d27002ce99ac tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Request method failure captured: Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/tempest-invalid-10590615 HTTP/1.1 Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFwYhA7D2-odR-cFVnQ24VNlaQFXiLaDzzFs6wH4EcHX3jMs0rhO79G6a1MXXedq8OQ8EBG7eHwiK70lpm0tYEq_Ijn6hyqgzCO37hdNn29uQpHr55rY8OgaIwNkeoABPOQ--DVHpOHhWacMr1WTPgczocVgV2aO2uy__XiS5vMams Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:11:13.391937 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5283d53f07d54383a588e500dbec2cef Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'tempest-invalid-10590615'} Oct 26 05:11:13.393189 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-10590615 to delete Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.393971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-10590615 could not be found. Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:13.395117 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd4509fb-f37e-4ff6-8b0a-d27002ce99ac tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:13.396224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd4509fb-f37e-4ff6-8b0a-d27002ce99ac tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-10590615" status: 404 len: 62 microversion: 2.1 time: 0.061818 Oct 26 05:11:13.398546 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1258/2512] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Oct 26 05:11:13 2022] DELETE /compute/v2.1/images/tempest-invalid-10590615 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:11:13.409104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bf93c87-f1f7-4de7-93f7-db80f37a833b tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Calling method '.version_select at 0x7f4709ffbc10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:13.448957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-6bf93c87-f1f7-4de7-93f7-db80f37a833b tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] HTTP exception thrown: Image not found. Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bf93c87-f1f7-4de7-93f7-db80f37a833b tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Request method failure captured: Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/images/47bd2318-b86d-4786-9458-0fc5c6843d9f HTTP/1.1 Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFwYhA7D2-odR-cFVnQ24VNlaQFXiLaDzzFs6wH4EcHX3jMs0rhO79G6a1MXXedq8OQ8EBG7eHwiK70lpm0tYEq_Ijn6hyqgzCO37hdNn29uQpHr55rY8OgaIwNkeoABPOQ--DVHpOHhWacMr1WTPgczocVgV2aO2uy__XiS5vMams Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:11:13.451602 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4717b7b86df5454dadc98b57b8da49d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4717b7b86df5454dadc98b57b8da49d1 Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626 Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 5283d53f07d54383a588e500dbec2cef Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1313344626-project Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '47bd2318-b86d-4786-9458-0fc5c6843d9f'} Oct 26 05:11:13.453102 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47bd2318-b86d-4786-9458-0fc5c6843d9f to delete Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.454257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47bd2318-b86d-4786-9458-0fc5c6843d9f could not be found. Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:13.455844 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bf93c87-f1f7-4de7-93f7-db80f37a833b tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:13.460029 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bf93c87-f1f7-4de7-93f7-db80f37a833b tempest-ImagesDeleteNegativeTestJSON-1313344626 tempest-ImagesDeleteNegativeTestJSON-1313344626-project] 10.222.0.16 "DELETE /compute/v2.1/images/47bd2318-b86d-4786-9458-0fc5c6843d9f" status: 404 len: 62 microversion: 2.1 time: 0.052030 Oct 26 05:11:13.462772 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1255/2513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:13 2022] DELETE /compute/v2.1/images/47bd2318-b86d-4786-9458-0fc5c6843d9f => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:11:13.691915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=20 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:13.745944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:13.746738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:13.754361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:13.755279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:13.757591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:13.758561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:13.768888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:13.769702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:13.987973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-10cf3def-d201-4854-a8a1-37aa4124faa5 req-f4efab66-3607-43ab-86a1-aeeae0cf4315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "name": "network-vif-unplugged", "status": "completed", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:14.013499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10cf3def-d201-4854-a8a1-37aa4124faa5 req-f4efab66-3607-43ab-86a1-aeeae0cf4315 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:14.015700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:14.018309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10cf3def-d201-4854-a8a1-37aa4124faa5 req-f4efab66-3607-43ab-86a1-aeeae0cf4315 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:14.024316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10cf3def-d201-4854-a8a1-37aa4124faa5 req-f4efab66-3607-43ab-86a1-aeeae0cf4315 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:14.030043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9b241a1-d434-45d8-879b-0a86daf5dcf7 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.290469 Oct 26 05:11:14.031095 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1256/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:13 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:14.035976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:14.036753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:14.039712 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-10cf3def-d201-4854-a8a1-37aa4124faa5 req-f4efab66-3607-43ab-86a1-aeeae0cf4315 service nova] Creating event network-vif-unplugged:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h1-862416-4 Oct 26 05:11:14.046285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:14.047483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:14.048211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:14.049078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:14.050405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:14.051621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:14.061231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-10cf3def-d201-4854-a8a1-37aa4124faa5 req-f4efab66-3607-43ab-86a1-aeeae0cf4315 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.370758 Oct 26 05:11:14.062197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1259/2515] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:14.069928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:14.070776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:14.091264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:14.091766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:14.092235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:14.092936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:14.093598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:14.094034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:14.255841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:14.265168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c74120a6-9992-499e-8774-18e9b3bb442d tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1510 microversion: 2.1 time: 0.232626 Oct 26 05:11:14.267414 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1257/2516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:14 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:14.396598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:14.410492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-432fd380-87d8-4e2d-babf-16635beae864 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.346956 Oct 26 05:11:14.411481 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1260/2517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:14 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:14.526667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1798015529", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:14.599392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] validate_networks() for [('6244b107-bb8d-4e09-8ea3-338c3fe120bd', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:11:15.065174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:15.067139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:15.085355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.087436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.089097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.092179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.092708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.093150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.419817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:11:15.421040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:11:15.421739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:11:15.422291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:11:15.424060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:11:15.436852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:15.449820 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3cd5def-71ed-4139-9c81-ef2d46fb588d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1714 microversion: 2.1 time: 0.392323 Oct 26 05:11:15.455079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.455569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.456004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.456760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.457215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.464213 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1261/2518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:15 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1714 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:15.471019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:15.471637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:15.479772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.500692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.501537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.502889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.503894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.508249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.509403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.539805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Getting quotas for project 0ba7acf0d091489aa05981fbee243ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:11:15.551768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Getting quotas for user cd36941b3dcf4521956760b686e76e5e and project 0ba7acf0d091489aa05981fbee243ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:11:15.590925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:11:15.596715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:11:15.697948 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ec56fdc-25bb-4d45-a9a3-adc04483d38e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.239249 Oct 26 05:11:15.699660 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1258/2519] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:11:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:11:15.708898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:15.711054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:15.721868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.722687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.723230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.724056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:15.725029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:15.725914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:15.894979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:15.906201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98df4ef3-a5c5-40cb-8db8-5b85ee2d1654 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1453 microversion: 2.1 time: 0.440845 Oct 26 05:11:15.909458 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1262/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:15 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1453 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:15.914894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe592998-bf8e-4d91-aa03-66a1c33db9ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:15.919932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe592998-bf8e-4d91-aa03-66a1c33db9ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:16.022551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe592998-bf8e-4d91-aa03-66a1c33db9ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:16.030577 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe592998-bf8e-4d91-aa03-66a1c33db9ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1223 microversion: 2.1 time: 0.119792 Oct 26 05:11:16.035092 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1263/2521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:15 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:16.047407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:16.062303 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-909e52fb-f7c4-4f12-b656-db83d083d113 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.360286 Oct 26 05:11:16.063367 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1259/2522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:15 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:16.077845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:16.078621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:16.087938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:16.089036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:16.089873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:16.092952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:16.094177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:16.095318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:16.398475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:16.405661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-880365bc-519b-4b15-9e5b-b6573db158a9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f470a0365e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-401486594", "description": "tempest-description-601107638"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:16.409279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f63b482e-8829-4046-b30e-4697eb3be4e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1453 microversion: 2.1 time: 0.343692 Oct 26 05:11:16.410442 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1260/2523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:16 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1453 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:16.488726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:16.489510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:16.500814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:16.501629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:16.505298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:16.506445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:16.507219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:16.507731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:16.781989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-880365bc-519b-4b15-9e5b-b6573db158a9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.745548 Oct 26 05:11:16.782710 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1264/2524] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:11:16 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:16.787004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:16.797259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:16.799648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:16.802251 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3375cc9-c22d-4ba2-a202-7a04cd035789 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1704 microversion: 2.1 time: 0.317595 Oct 26 05:11:16.816873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:16.817827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:16.818434 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1261/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:16 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1704 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:16.818750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:16.820158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:16.820858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:16.821614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:16.909959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lazy-loading 'flavor' on Instance uuid 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:11:16.932670 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'shelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state shelved_offloaded Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 14 Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:11:16.934485 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: {"shelve": {}} Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:11:16.936240 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'shelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state shelved_offloaded Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'shelve': {}}} Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:16.937209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state shelved_offloaded Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:16.938441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:16.939586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state shelved_offloaded Oct 26 05:11:16.939586 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:11:16.939586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'shelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state shelved_offloaded {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:16.939586 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-640dbc6e-47ad-4f6f-9293-e7c450ae64ac tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 155 microversion: 2.1 time: 0.144095 Oct 26 05:11:16.939586 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1265/2526] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:16 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 155 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:11:16.951312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c1e9621-bc7c-4bc8-8590-241df37a375a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709f855e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715092119", "description": "tempest-description-1879156563"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:17.024418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-353918818", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:17.095250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:11:17.260390 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c1e9621-bc7c-4bc8-8590-241df37a375a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.321285 Oct 26 05:11:17.261301 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1266/2527] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:11:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:17.268123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ebdbcf9-0de9-4749-814c-cf6959048231 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '.version_select at 0x7f4709f85dc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:17.284263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebdbcf9-0de9-4749-814c-cf6959048231 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.286061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebdbcf9-0de9-4749-814c-cf6959048231 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.286749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebdbcf9-0de9-4749-814c-cf6959048231 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.305889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ebdbcf9-0de9-4749-814c-cf6959048231 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1170 microversion: 2.1 time: 0.042582 Oct 26 05:11:17.307214 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1267/2528] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:11:17 2022] GET /compute/v2.1/os-migrations => generated 1170 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:17.317671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:17.318361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:17.327591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.328165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.328596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.329288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.329788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.330214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.390591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120586) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 05:11:17.467965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:11:17.468710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:11:17.469449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:11:17.470023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:11:17.470622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:11:17.483742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.492534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.493100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.495636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.498086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.499757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.532525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-899f922b-862b-4699-9980-fd2caafe8d5e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 202 len: 0 microversion: 2.1 time: 0.224128 Oct 26 05:11:17.535794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1268/2529] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:17 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:11:17.545531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Getting quotas for project 5471bab47d5b41c79aa90a93547be446. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:11:17.551663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Getting quotas for user f1c51212204f4654b320552298e77c3b and project 5471bab47d5b41c79aa90a93547be446. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:11:17.554019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:17.555106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:17.556491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:17.567421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:11:17.569919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:11:17.573429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.574282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.574727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.578897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.580173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.580868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.638124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b855c538-d286-4832-8173-42943b5eaa22 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818354 Oct 26 05:11:17.641429 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1262/2530] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:11:17.650169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:17.652331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:17.661832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.662540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.677555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.678604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.679246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.679873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.735007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:17.744640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e63debe6-4ffc-4054-a824-790cb82f7d44 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1275 microversion: 2.1 time: 0.203780 Oct 26 05:11:17.746104 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1269/2531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:17 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:17.752363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:17.753154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:17.768611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.769339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.770086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:17.771715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:17.772207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:17.773081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:18.072569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:18.089565 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7be5633a-a9eb-4187-baa3-726978da2457 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.445679 Oct 26 05:11:18.097587 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1263/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:17 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:18.117240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-843780937", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "e7452117-582b-4407-b78c-25682aebccf5"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:18.180114 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c18aec6b-efe0-422f-9075-e9b42b4385dc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1855 microversion: 2.1 time: 0.429995 Oct 26 05:11:18.180639 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1270/2533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:17 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1855 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:18.185578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:18.186200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:18.205973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:18.206743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:18.207033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:18.207883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:18.208349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:18.208866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:18.221329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:18.270133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] validate_networks() for [('e7452117-582b-4407-b78c-25682aebccf5', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:11:18.693763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:18.703468 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fa8b285-a02d-4a83-92b1-6fcf19fb4077 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1461 microversion: 2.1 time: 0.521726 Oct 26 05:11:18.705994 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1271/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:18 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1461 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:18.732707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:18.735944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:18.754285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:18.755049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:18.757767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:18.758880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:18.764188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:18.765021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.077224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:19.089933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9c83023a-9bbf-4387-aa09-21ef78e49997 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1220 microversion: 2.1 time: 0.375497 Oct 26 05:11:19.091721 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1272/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:18 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1220 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:19.098764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:19.099731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:19.130638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.131353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.134264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.136872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.150168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.150967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.488056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:11:19.488603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:11:19.489004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:11:19.490093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:11:19.490553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:11:19.507489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.507983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.508650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.509596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.510208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.510790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.544508 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd95b59e-fb87-4333-a2aa-3ed52e50479c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1855 microversion: 2.1 time: 0.450001 Oct 26 05:11:19.551785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Getting quotas for project 40bfda33e8334078bdae14fdfed8320f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:11:19.564189 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1273/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:19 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1855 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:19.573242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Getting quotas for user c296433625e849448fc3bb355334421d and project 40bfda33e8334078bdae14fdfed8320f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:11:19.593793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:19.594570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:19.614774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.616481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.619822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.620677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.621165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.621636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.629128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:11:19.634801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:11:19.763284 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7c68e82-a036-4904-9444-36cea744c58e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661300 Oct 26 05:11:19.764958 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1264/2537] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:11:19.787382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:19.788381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:19.802422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.803842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.804596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:19.805804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:19.806449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:19.807914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.091215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:20.109431 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c642261f-1308-4497-90b9-37b87ee300c7 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.541690 Oct 26 05:11:20.110081 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1274/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:19 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:20.130031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:20.131314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:20.140729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:20.154689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.155514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.156339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.157704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.158742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.161083 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbb44318-64a8-44b0-a133-077f3c10f0d0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.385582 Oct 26 05:11:20.168395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1265/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:19 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:20.171018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.180935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:20.182418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:20.190365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.190860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.191300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.192810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.193283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.194670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.407760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lazy-loading 'services' on Instance uuid b46448c6-28d1-4533-9ff3-2e160f3b28dd {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:11:20.583736 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d83c77f0-70e4-47e9-b45d-5992be977124 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments/7975ea2f-0a49-4d6c-aa46-26f6949b9fff" status: 202 len: 0 microversion: 2.1 time: 0.469980 Oct 26 05:11:20.584931 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1275/2540] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:11:20 2022] DELETE /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments/7975ea2f-0a49-4d6c-aa46-26f6949b9fff => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:11:20.590727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23a573e4-6794-4a99-8675-0e5f65289c77 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:20.591663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23a573e4-6794-4a99-8675-0e5f65289c77 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:20.599854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:20.704314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:20.714419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23a573e4-6794-4a99-8675-0e5f65289c77 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:20.715971 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0c2712f-7588-4205-b511-701ddc9fa5df tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.542918 Oct 26 05:11:20.716758 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1266/2541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:20 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:20.722512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:20.723327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:20.723970 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23a573e4-6794-4a99-8675-0e5f65289c77 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1215 microversion: 2.1 time: 0.137502 Oct 26 05:11:20.724995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1276/2542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:20 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:20.730844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.731515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.731657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:20.732356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.733211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.733836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.734664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.737759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:20.741096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:20.750889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.751239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.751820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.752760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:20.753468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:20.754085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:20.801365 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7375861e-e464-4a18-97c9-17a66ad798a1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074212 Oct 26 05:11:20.802248 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1277/2543] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:11:20 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:20.826584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:20.838035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-016823a1-4ac8-469d-beaa-d9809f4307cd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1274 microversion: 2.1 time: 0.119479 Oct 26 05:11:20.838890 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1267/2544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:20 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:21.135218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:21.136430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:21.143627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.144117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.144557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.145478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.146098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.146695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.193359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:21.194504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:21.201476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.209025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.210034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.210793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.211351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.211786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.566782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:21.580662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b3b04ac-d8ad-4777-8976-fb855d51bb8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.448718 Oct 26 05:11:21.582901 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1278/2545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:21 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:21.644015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:21.656788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-557074e4-140e-4a6c-91e8-3cf0b51bc32d req-9faac213-e1c9-4746-b17b-e08eefce7f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:21.666500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-283e5f60-f398-43dc-b6bd-64ab4a2b90f3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.477502 Oct 26 05:11:21.674602 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1268/2546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:21 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:21.679811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-557074e4-140e-4a6c-91e8-3cf0b51bc32d req-9faac213-e1c9-4746-b17b-e08eefce7f2b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.683344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-557074e4-140e-4a6c-91e8-3cf0b51bc32d req-9faac213-e1c9-4746-b17b-e08eefce7f2b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.684006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-557074e4-140e-4a6c-91e8-3cf0b51bc32d req-9faac213-e1c9-4746-b17b-e08eefce7f2b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.706585 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-557074e4-140e-4a6c-91e8-3cf0b51bc32d req-9faac213-e1c9-4746-b17b-e08eefce7f2b service nova] Creating event network-changed:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:11:21.720708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-557074e4-140e-4a6c-91e8-3cf0b51bc32d req-9faac213-e1c9-4746-b17b-e08eefce7f2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067421 Oct 26 05:11:21.724631 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1279/2547] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:11:21.749104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:21.760287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:21.796350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:21.798159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:21.798427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.800555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.805359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.807470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.809899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.810514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.816672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.818105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.821054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:21.822108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:21.822735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:21.823668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.232649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:22.251095 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-499af16c-c5ca-4d10-b264-f8115068929a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1267 microversion: 2.1 time: 0.489538 Oct 26 05:11:22.251939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1280/2548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:21 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1267 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:22.257548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:22.263822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:22.278636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.279354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.280257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.280802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.281600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.289412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.355933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0855c499-ebcc-46aa-8965-aee5a637f3d8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102658 Oct 26 05:11:22.360684 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1281/2549] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:11:22 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:22.365572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:22.370514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:22.383807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.388876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.389457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.390533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.391088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.395642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.454224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:22.465237 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a94980a6-0ca5-4b4a-bdf2-9a29508a9091 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.723118 Oct 26 05:11:22.466587 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1269/2550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:21 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:22.606115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:22.606881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:22.614532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.615408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.616135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.617203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.617895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.618584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.798732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:22.812397 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-945a63c7-2bcc-410e-98e0-b3e54582337a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.453610 Oct 26 05:11:22.814942 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1282/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:22 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:22.825612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:22.826505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:22.834427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.835466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.836094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:22.838293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:22.839675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:22.841458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.060866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:23.080410 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9792fa5c-fa11-464f-8f9a-72bd4f076268 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.477997 Oct 26 05:11:23.085161 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1270/2552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:22 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:23.096991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ca789f8e-cfee-487b-89ac-79746a8df4fe req-75ab2657-daae-4f1a-ba35-ebd07a7d9d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:23.140293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ca789f8e-cfee-487b-89ac-79746a8df4fe req-75ab2657-daae-4f1a-ba35-ebd07a7d9d5e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.141930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ca789f8e-cfee-487b-89ac-79746a8df4fe req-75ab2657-daae-4f1a-ba35-ebd07a7d9d5e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.142713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ca789f8e-cfee-487b-89ac-79746a8df4fe req-75ab2657-daae-4f1a-ba35-ebd07a7d9d5e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.167129 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ca789f8e-cfee-487b-89ac-79746a8df4fe req-75ab2657-daae-4f1a-ba35-ebd07a7d9d5e service nova] Creating event network-changed:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h2-862416-4 Oct 26 05:11:23.173942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ca789f8e-cfee-487b-89ac-79746a8df4fe req-75ab2657-daae-4f1a-ba35-ebd07a7d9d5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087217 Oct 26 05:11:23.175581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1271/2553] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:23.286984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:23.289274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:23.304492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.305543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.306558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.307913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.308222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:23.310774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.313541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.317839 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abb138ab-4acd-41bc-9af6-5ac7e8d07df7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.500794 Oct 26 05:11:23.330446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1283/2554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:22 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:23.369651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:23.372738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:23.381285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.382079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.382676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.383533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.384889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.385629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.422083 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-323a70a1-c192-4830-b040-3296eb00caa0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057406 Oct 26 05:11:23.427530 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1284/2555] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:11:23 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:11:23.449504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:23.460547 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-38e379e9-9720-40b6-bba3-0738afc6638f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1273 microversion: 2.1 time: 0.182534 Oct 26 05:11:23.461742 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1272/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:23 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:23.489027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:23.490033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:23.497869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.498989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.499446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.503567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.504089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.504551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.743403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7e8f8ddc-0774-49ef-bfa0-e6c0a1d49802 req-469b705c-4f7f-4ed1-975a-1d78a87fde8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:23.753908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e8f8ddc-0774-49ef-bfa0-e6c0a1d49802 req-469b705c-4f7f-4ed1-975a-1d78a87fde8c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.754397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e8f8ddc-0774-49ef-bfa0-e6c0a1d49802 req-469b705c-4f7f-4ed1-975a-1d78a87fde8c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.754836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e8f8ddc-0774-49ef-bfa0-e6c0a1d49802 req-469b705c-4f7f-4ed1-975a-1d78a87fde8c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.767244 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7e8f8ddc-0774-49ef-bfa0-e6c0a1d49802 req-469b705c-4f7f-4ed1-975a-1d78a87fde8c service nova] Creating event network-changed:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:11:23.772245 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7e8f8ddc-0774-49ef-bfa0-e6c0a1d49802 req-469b705c-4f7f-4ed1-975a-1d78a87fde8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Oct 26 05:11:23.773408 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1273/2557] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:23.838276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:23.839098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:23.846076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.846687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.847366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:23.848193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:23.848743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:23.849270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.127360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:24.135426 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9eff9f99-5004-480b-893a-7cbcac8d57b0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.651203 Oct 26 05:11:24.141804 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1285/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:23 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:24.149536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:24.150950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:24.151588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:24.159129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.159865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.160469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.160742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32f8a684-d8a7-4ab1-879e-5738970e5f26 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.326530 Oct 26 05:11:24.161574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.162211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.163546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.171014 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1274/2559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:23 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:24.358676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:24.359313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:24.368270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.369114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.369819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.370860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.371485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.372329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.407494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:24.419022 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d13c00c4-f6f1-44c3-8947-d02d03f80f55 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.275812 Oct 26 05:11:24.422425 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1286/2560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:24 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:24.439479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:24.440137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:24.447991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.448487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.448936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.449669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.450125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.450551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.486726 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b288b694-e1fa-40bd-a626-cd04d04a07cf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055511 Oct 26 05:11:24.488598 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1287/2561] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:11:24 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:11:24.494365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:24.495370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:24.502485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.503241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.503835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.504699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:24.505495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:24.505917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:24.565097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:24.578818 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d90cc407-c643-466b-b721-8fb97eb288ee tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1470 microversion: 2.1 time: 0.224783 Oct 26 05:11:24.593389 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1275/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:24 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:24.664463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:24.667573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:24.681800 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7aabf899-79bc-487e-9ec2-b3194d288c50 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.191773 Oct 26 05:11:24.682615 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1288/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:24 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:25.159052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:25.159859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:25.167837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.168336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.168793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.169534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.169994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.170432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.187433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:25.188081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:25.195319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.195817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.196254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.196971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.197495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.197949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.389911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:25.396463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:25.404753 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2eef38de-1547-478d-a0c0-903d65ee90a0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.249603 Oct 26 05:11:25.405367 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1276/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:25 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:25.405572 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-959e2ac2-c8c4-45d8-9c06-520cd9bb3233 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.222922 Oct 26 05:11:25.406387 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1289/2565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:25 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:25.449368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:25.450062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:25.456493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.456982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.457457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.458158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.458621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.459049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.506033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:25.508682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:25.520766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.524620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.525187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.526055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.528649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.529181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.564067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9e5cbac-7793-4c5f-ae94-98d482f78cb9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068679 Oct 26 05:11:25.564723 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1290/2566] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:11:25 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:25.604761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:25.605803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:25.612190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.612686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.613132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.613888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.614544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.614977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.615298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:25.624397 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d277ddc9-6f44-4aae-8afc-6c550c8e8c8f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.179609 Oct 26 05:11:25.625155 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1277/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:25 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:25.710822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:25.712149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:25.721483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.724287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.724840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.730341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:25.731019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:25.732274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:25.969663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:25.980211 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19679662-ece1-4db5-8423-a801c00f55df tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1476 microversion: 2.1 time: 0.379749 Oct 26 05:11:26.000202 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1291/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:25 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:26.006867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:26.007701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:26.015733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.016939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.017578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.018658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.019547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.020269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.058641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:11:26.158955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:26.180367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0ef658d-614f-4733-8b1f-3f9859c5c824 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.475344 Oct 26 05:11:26.181213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-226940c7-d7f9-4405-99ae-60231a4b0f85 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 204 len: 0 microversion: 2.1 time: 0.178388 Oct 26 05:11:26.185445 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1292/2569] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:11:26 2022] DELETE /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:11:26.190842 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1278/2570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:25 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:26.192324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:26.193199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:26.202719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.203471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.204976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.205902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.206472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.206976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.428921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:26.429894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:26.430568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:26.438314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.439185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.440007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.440944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.441661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.442561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.458036 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c2661cdb-54ae-4a68-b007-c11721de2b8d tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.270432 Oct 26 05:11:26.459211 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1293/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:26 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:26.464800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:26.465447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:26.474460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.474954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.476206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.477172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.477723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.478154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.770373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:26.779103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:26.779625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d752e213-8ec2-47e8-9e58-d443a2666703 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.355361 Oct 26 05:11:26.780464 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1279/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:26 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:26.785297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:26.787462 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a843840-e995-4490-b75e-9812c0f20888 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.326426 Oct 26 05:11:26.788081 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1294/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:26 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:26.789211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:26.793137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:26.793778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:26.796671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.797163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.797658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.798354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.799776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.800389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.801701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.802117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.802557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.804008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:26.804757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:26.805196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:26.836653 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-951bd682-b46d-4d31-8b8c-bbfdc83deb9f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054973 Oct 26 05:11:26.842638 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1280/2574] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:11:26 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:26.994575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:27.008075 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e92700e7-c0c8-4fe3-b500-5f6b6cc420ed tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.217542 Oct 26 05:11:27.008258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:27.008849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:27.017161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.017741 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1295/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:26 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:27.017864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.018201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.018897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.019363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.019778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.187171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-794b73c4-0bbf-4f0c-a7d8-6e4b290552aa req-3ee16fb2-e07b-4555-8a05-258cff83d914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c757ce8f-1ab1-43b1-af99-ed0a9906061c", "tag": "d9bc1b0e-4950-4818-b099-c95c34e796e4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:27.205410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-794b73c4-0bbf-4f0c-a7d8-6e4b290552aa req-3ee16fb2-e07b-4555-8a05-258cff83d914 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.206046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-794b73c4-0bbf-4f0c-a7d8-6e4b290552aa req-3ee16fb2-e07b-4555-8a05-258cff83d914 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.207041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-794b73c4-0bbf-4f0c-a7d8-6e4b290552aa req-3ee16fb2-e07b-4555-8a05-258cff83d914 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.241758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:27.244406 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-794b73c4-0bbf-4f0c-a7d8-6e4b290552aa req-3ee16fb2-e07b-4555-8a05-258cff83d914 service nova] Creating event network-changed:d9bc1b0e-4950-4818-b099-c95c34e796e4 for instance c757ce8f-1ab1-43b1-af99-ed0a9906061c on n-h2-862416-4 Oct 26 05:11:27.250325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c070a58-8701-4465-b8fc-75efd52485aa tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1476 microversion: 2.1 time: 0.248295 Oct 26 05:11:27.251240 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1281/2576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:27 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:27.268737 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-794b73c4-0bbf-4f0c-a7d8-6e4b290552aa req-3ee16fb2-e07b-4555-8a05-258cff83d914 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085498 Oct 26 05:11:27.271012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1296/2577] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:11:27.279198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:27.280426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:27.287491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.288386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.288838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.289843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.290717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.291832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.489876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:27.492196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:27.502160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.503249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.504818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.505700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.506852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.508267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.658993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:27.672862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4fcb48f2-0690-4e86-935c-1d35baa199c7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.420570 Oct 26 05:11:27.687026 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1282/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:27 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:27.805709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:27.806529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:27.823639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.824136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.824573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.825288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.828664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.829118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.884569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:27.892702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26041ffa-4801-4907-8bab-33ac410636dc tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.412991 Oct 26 05:11:27.896551 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1297/2579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:27 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:27.907811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:27.911601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:27.924835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.925456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.925820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:27.926536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:27.927019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:27.927442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.179250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:28.183321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:28.190411 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24d420ec-9ee0-4156-9004-ae133220dfb5 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.390202 Oct 26 05:11:28.191010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1283/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:27 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:28.192175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-068b67e4-9231-4dc9-a504-af8cbfa47dc2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.292656 Oct 26 05:11:28.192772 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1298/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:27 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:28.196437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:28.197052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:28.203123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.203612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.204054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.204744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.205201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.205656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.275030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:28.275676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:28.283019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.283750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.284356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.285280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.290170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.291463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.361489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:28.379796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b63a725-9ced-4bb2-88fd-11209f2b6bf0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.187490 Oct 26 05:11:28.380928 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1284/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:28 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:28.462464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:28.471150 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7bba06af-c3e8-4652-a394-b5c5f20cd259 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1476 microversion: 2.1 time: 0.200070 Oct 26 05:11:28.471917 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1299/2583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:28 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:28.674834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4a03bf66-cfe3-40fc-a6cd-ccd83b7b4208 req-5b1d1102-c42b-4af7-9aea-fa0d5c98eb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "name": "network-vif-plugged", "status": "completed", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:28.691335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4a03bf66-cfe3-40fc-a6cd-ccd83b7b4208 req-5b1d1102-c42b-4af7-9aea-fa0d5c98eb82 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.701956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:28.703261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:28.707610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4a03bf66-cfe3-40fc-a6cd-ccd83b7b4208 req-5b1d1102-c42b-4af7-9aea-fa0d5c98eb82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.708510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4a03bf66-cfe3-40fc-a6cd-ccd83b7b4208 req-5b1d1102-c42b-4af7-9aea-fa0d5c98eb82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.717285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.718046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.719721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.723538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.724456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.729670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.741416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:28.743958 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4a03bf66-cfe3-40fc-a6cd-ccd83b7b4208 req-5b1d1102-c42b-4af7-9aea-fa0d5c98eb82 service nova] Creating event network-vif-plugged:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:11:28.753112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4a03bf66-cfe3-40fc-a6cd-ccd83b7b4208 req-5b1d1102-c42b-4af7-9aea-fa0d5c98eb82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082120 Oct 26 05:11:28.754103 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1285/2584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:28.908968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:28.919743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:28.920844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:28.923608 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a22c2524-7906-44ec-aa28-f0485e86252a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.228040 Oct 26 05:11:28.924753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1300/2585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:28 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:28.929140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.929669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.930272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:28.931152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:28.931758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:28.932681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.073223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:29.081113 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c538a39-40eb-479e-9944-c8499917a23e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.167142 Oct 26 05:11:29.082025 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1286/2586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:28 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:29.216940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:29.217558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:29.217725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:29.218414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:29.223937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.224439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.224886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.226653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.227125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.227358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.227559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.227850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.228439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.229443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.229908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.230339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.451755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:29.452314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:29.460501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ca11a887-aeb9-43b0-b9c6-38fba21fc9e8 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.246548 Oct 26 05:11:29.460692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a56ec5d-d7a6-4399-afa1-37a255b8c52c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.247673 Oct 26 05:11:29.465345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1287/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:29 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:29.465489 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1301/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:29 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:29.465944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:29.466550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:29.472462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.472891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.473363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.474238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.474704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.475168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.497276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:29.498238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:29.504692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.505183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.505647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.506629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.507083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.507703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.527904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=14 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:29.601085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=18 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:29.674577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:29.684783 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0ae1ab7-d2c9-41f6-a571-d5154c061972 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.222316 Oct 26 05:11:29.685635 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1288/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:29 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:29.715150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:29.770451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f0489bd-3b5f-4ce7-a698-3fcffcc5381d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1476 microversion: 2.1 time: 0.278062 Oct 26 05:11:29.775244 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1302/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:29 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:29.956053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:29.956834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:29.970312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.971613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.972404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:29.979702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:29.982067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:29.982910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.109354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:30.111631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:30.119042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.125932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.126418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.130118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.130616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.131047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.284608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:30.299703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3594ea0-1309-4215-b33b-ec96c53253ec tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.348095 Oct 26 05:11:30.316345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1289/2591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:29 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:30.359949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:30.367813 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ada6eb5-cbe0-43d1-b51f-74828b5ae635 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.264070 Oct 26 05:11:30.382916 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1303/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:30 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:30.483576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:30.484194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:30.484460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:30.484816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:30.491611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.492281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.492726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.494634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.495593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.495819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.496275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.498906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.499749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.503018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.505783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.508147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.517116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:30.722965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:30.779298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:30.792749 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f211c894-9592-4a19-8926-683f292f9d78 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.312481 Oct 26 05:11:30.803038 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1304/2593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:30 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:30.803297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:30.811391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:30.811391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:30.816834 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dcf346d7-078a-4465-81f6-bfa59f982635 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.337359 Oct 26 05:11:30.823388 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1290/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:30 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:30.840719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbe1b84-a304-484a-85d3-c4a14ae7f738", "name": "network-vif-unplugged", "status": "completed", "tag": "d5f6930c-ad93-40a8-9436-52d09e288111"}, {"server_uuid": "8b22c173-3089-46c5-91c6-2bac95ac7cf7", "name": "network-vif-plugged", "status": "completed", "tag": "1f98965e-9ae0-4cce-b52a-48dd51766116"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:30.844401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.844959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.845556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.849575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.850770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.851355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.863071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.864959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.865713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.900699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] Creating event network-vif-unplugged:d5f6930c-ad93-40a8-9436-52d09e288111 for instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 on n-h2-862416-4 Oct 26 05:11:30.905245 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] Creating event network-vif-plugged:1f98965e-9ae0-4cce-b52a-48dd51766116 for instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 on n-h1-862416-4 Oct 26 05:11:30.947439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5c9f92fb-a88a-47c6-b078-89171e6c216c req-dafeb796-af07-400d-bba7-e608193bebe7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.122107 Oct 26 05:11:30.948503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1291/2595] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:30.954304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:30.961473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:30.982666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.983179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.983625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:30.984499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:30.984953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:30.998521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.168634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:31.176532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-456db1e5-926b-40ec-a985-fd6f6025a315 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.381724 Oct 26 05:11:31.186314 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1305/2596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:30 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:31.242374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:31.255382 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae6c0bc9-6a84-4f62-9f36-e523b04c2dba tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1476 microversion: 2.1 time: 0.305592 Oct 26 05:11:31.255968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1292/2597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:30 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:31.341409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:31.342198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:31.360956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.366678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.367477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.371624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.372668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.373446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.407515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:31.408051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:31.416707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.417205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.417673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.429102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.430136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.430254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.677195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:31.690339 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58dcb336-332b-405f-bf1d-59646f5cacf2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.286675 Oct 26 05:11:31.693549 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1293/2598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:31 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:31.696961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:31.718623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9dba058-79df-4476-8dd8-6e89fb0df324 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.387049 Oct 26 05:11:31.735654 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1306/2599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:31 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:31.822193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:31.823027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:31.845997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:31.847054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:31.853133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.853829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.855888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.856722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.857330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.858039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.858690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.859269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.859900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:31.865245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:31.866814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:31.867752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.124624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:32.139516 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da783ef6-b6ae-4334-bdf1-48db53759253 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.297737 Oct 26 05:11:32.140393 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1307/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:31 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:32.174609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:32.184498 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2f1dad39-074a-4b5d-a5a2-cb2a01a2b470 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.367187 Oct 26 05:11:32.186479 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1294/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:31 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:32.200536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:32.201339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:32.211270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.213016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.213846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.215397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.216787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.218181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.283232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:32.284373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:32.304920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.307757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.307757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.312200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.322454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.323281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.635907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:32.657921 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d7637eca-f30b-4c03-8fa8-620b05fea46c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.461266 Oct 26 05:11:32.666544 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1308/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:32 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:32.679861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:32.689345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3005f3d0-c2f7-4f67-af3d-537c994c9e23 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1476 microversion: 2.1 time: 0.413728 Oct 26 05:11:32.690427 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1295/2603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:32 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1476 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:32.719308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:32.720333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:32.734215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.735396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.744543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:32.745746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:32.749831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.750932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.753381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.754035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.756555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.763260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.764050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:32.769012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:32.769778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:32.771778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.172724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:33.185330 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4abf4ad7-f32c-4f1d-b09c-ba2554adee1e tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.471982 Oct 26 05:11:33.222098 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1309/2604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:32 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:33.225893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:33.227345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d29be082-f0e7-491b-82eb-6de07814ab28 req-a973898a-8225-4a5e-9159-46d49a602b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "name": "network-vif-plugged", "status": "completed", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:33.245482 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d737c11a-5ac9-4b5e-a64c-5e28b605f95d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.506423 Oct 26 05:11:33.258562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1296/2605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:32 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:33.260536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d29be082-f0e7-491b-82eb-6de07814ab28 req-a973898a-8225-4a5e-9159-46d49a602b2c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.261380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d29be082-f0e7-491b-82eb-6de07814ab28 req-a973898a-8225-4a5e-9159-46d49a602b2c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.262300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d29be082-f0e7-491b-82eb-6de07814ab28 req-a973898a-8225-4a5e-9159-46d49a602b2c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.273018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:33.273680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:33.280446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d29be082-f0e7-491b-82eb-6de07814ab28 req-a973898a-8225-4a5e-9159-46d49a602b2c service nova] Creating event network-vif-plugged:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:11:33.286492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d29be082-f0e7-491b-82eb-6de07814ab28 req-a973898a-8225-4a5e-9159-46d49a602b2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063128 Oct 26 05:11:33.287073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.287797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.288000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.288574 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1310/2606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:33.288814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.290918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.291747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.297886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:33.300943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:33.316051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.316962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.317726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.318690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.322278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.323091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.626112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:33.638460 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91993fe6-e65b-480a-a13a-a50609eb4569 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.374587 Oct 26 05:11:33.639282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1297/2607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:33 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:33.694822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:33.695573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:33.714956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.715734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.716665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.718103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.720075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.723264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.743493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:33.754660 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b68ea0b0-6296-4d6e-aa9c-7f70448f01e6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.462855 Oct 26 05:11:33.760813 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1311/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:33 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:33.766508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:33.767352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:33.774419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.775162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.775763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:33.777991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:33.778740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:33.779802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:34.143179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:34.159094 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3fce4ec3-81ce-48b1-868c-a5d5bea46099 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1462 microversion: 2.1 time: 0.396290 Oct 26 05:11:34.160460 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1312/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:33 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1462 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:34.171090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:34.190040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:34.191695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:34.198159 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-828a77ff-baab-446e-963c-cd60fb0dc2bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.508301 Oct 26 05:11:34.199073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1298/2610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:33 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:34.208891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:34.210425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:34.211333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:34.212240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:34.212861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:34.213656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:34.239461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:34.240137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:34.258308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:34.259637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:34.261996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:34.263167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:34.263653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:34.264101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:34.541331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:34.555213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d639425-dbe7-4c41-a19d-078f2cef4425 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1462 microversion: 2.1 time: 0.372099 Oct 26 05:11:34.558222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1313/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:34 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1462 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:34.573330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:34.573976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:34.582878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:34.583383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:34.583846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:34.585126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:34.585916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:34.586352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.065462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:35.080198 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6200a48-09e0-482a-9adf-b79f41ef6886 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.843626 Oct 26 05:11:35.082812 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1299/2612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:34 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:35.091356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:35.095294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:35.106157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.107104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.107940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.109214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.110041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.110915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.229383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:35.245487 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b8cd1656-ac55-48a4-ab94-59bfa46c2df4 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.685758 Oct 26 05:11:35.247479 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1314/2613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:34 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:35.254249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:35.255140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:35.281408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.282153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.286158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.287397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.288727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.289704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.548833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:35.560963 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d0b149c-e730-480f-9d73-97b0e6b1a3fd tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.311841 Oct 26 05:11:35.561956 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1315/2614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:35 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:35.571429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:35.586129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:35.599455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.601292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.601756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.602497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.603009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.603407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.799912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:35.809648 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e839043e-4cce-4b5f-9ab7-de4f2b26fcdf tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.242685 Oct 26 05:11:35.810511 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1316/2615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:35 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:35.835470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:35.836205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:35.857974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.858569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.859076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:35.860125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:35.860659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:35.861162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.115204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:36.137108 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22ad88eb-eef7-409b-b305-e5ce66e920d5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.306476 Oct 26 05:11:36.154220 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1317/2616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:35 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:36.165177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:36.176763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:36.186031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.186857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.187363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.188330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.188788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.189496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.427033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:36.441707 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c282e5ce-a7f6-4b66-bf9c-e0a9d2baf64b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.286152 Oct 26 05:11:36.442638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1318/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:36 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:36.447815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:36.448592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:36.455483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.456761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.457464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.458304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.459063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.459853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.670050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:36.681594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26238952-98ca-4f1a-ae76-7b0854ec8e4b tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.237823 Oct 26 05:11:36.693703 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1319/2618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:36 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:36.699721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:36.700335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:36.711000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.711541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.711996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.712719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.713556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.714023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.859283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:36.867876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-059f59b8-71bf-45f0-876a-517b7140c9de tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.172693 Oct 26 05:11:36.869350 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1320/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:36 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:36.873334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:36.873958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:36.880173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.880638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.885287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:36.885287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:36.885287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:36.885287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.104919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:37.107310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:37.114956 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fce2c84f-f15e-43d2-ac5d-0cbce51d6f53 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.245049 Oct 26 05:11:37.129038 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1321/2620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:36 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:37.134536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:37.135171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:37.139054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:37.142755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.143325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.143771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.144489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.144962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.145429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.323499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:37.331522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cdaf8ee-13c3-4ecf-945f-0c75e7625534 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.201326 Oct 26 05:11:37.332106 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1322/2621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:37 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:37.337709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:37.338325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:37.344334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.344825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.345279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.345997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.346513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.347070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.533745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:37.545423 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-090bdc86-6fd6-4aa8-9ce7-7c8b61a6e967 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.212241 Oct 26 05:11:37.546985 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1323/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:37 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:37.552106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:37.553098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:37.560634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.561681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.562290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.563777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.564746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.565563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.723376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:37.733634 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-198d3d1f-6daa-4b44-ba8a-f8995a0a545d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.185237 Oct 26 05:11:37.734531 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1324/2623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:37 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:37.739858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:37.740210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:37.747659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.748165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.748611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.749369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.749942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.750586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.926913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:37.936655 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ae6a961-aa53-4583-bf77-b1bf991c67ef tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.200769 Oct 26 05:11:37.937712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1325/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:37 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:37.943264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:37.945105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:37.951615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.952130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.952797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:37.953686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:37.954221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:37.954726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.102390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:38.110126 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4207dd58-52a0-49ab-b8f5-5d73e938ac9c tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.171370 Oct 26 05:11:38.110701 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1326/2625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:37 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:38.115509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-341589979"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:38.118838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:38.125281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.125801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.126249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.126980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.127440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.127859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.323474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:11:38.324560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:11:38.325048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:11:38.325502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:11:38.325924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:11:38.398098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:38.406638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:38.408322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.414506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.414930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.416142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.416685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.417123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.450430 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3152b5cf-e22f-4ffd-8f11-e2d9d67c0ff6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 1066 microversion: 2.1 time: 3.366052 Oct 26 05:11:38.461516 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1300/2626] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:35 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 1066 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 05:11:38.469571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:38.470295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:38.481434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.482235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.482693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.483183 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93d780ef-c539-460f-905a-ee13b8dbdf1f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.370834 Oct 26 05:11:38.483671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.484472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.485035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.486690 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1327/2627] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:38 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 26 05:11:38.496517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:38.496707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:38.496810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:38.505894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.507138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.507607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.508971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.509100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.509861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.743805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:38.745909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:38.752221 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77af5893-1ea9-4847-8d77-b348aa3ef369 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.263890 Oct 26 05:11:38.755987 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1328/2628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:38 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:38.756147 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f148090a-794a-46e7-a62d-216003bcd055 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.291062 Oct 26 05:11:38.756147 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1301/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:38 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:38.757811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:38.758431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:38.761039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:38.764419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.764915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.765134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:38.765383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.766090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.766679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.767120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.772478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.773648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.774282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.774994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:38.775457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:38.775887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:38.988720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:38.991578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:38.998168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64e2d41a-a12e-4baf-9ef1-c956380eb8f5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.242481 Oct 26 05:11:38.998965 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1302/2630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:38 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:39.003910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:39.004515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:39.010935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.011696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.012195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.012908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.013388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.013820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.014380 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a3ae0b3d-eeb6-47d0-bf33-2b0c366c31d1 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.245140 Oct 26 05:11:39.024981 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1329/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:38 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:39.134975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:39.135741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:39.143006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.143505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.143954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.144671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.145135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.145596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.163052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:39.171295 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f24f265-c055-4496-bb92-a95a55d449d0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.171171 Oct 26 05:11:39.185507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1303/2632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:38 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:39.288671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:39.297042 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b92b9592-0acf-4e27-bc0c-7a803d125347 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.166827 Oct 26 05:11:39.297953 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1330/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:39 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:39.779277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:39.780009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:39.782618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:39.783243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:39.786492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.786922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.787357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.788574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.789100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.789576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.790297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.791113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.791617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.792403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:39.793231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:39.793683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:39.989014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:39.997449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:40.005564 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39d29637-0415-4e4e-92b3-2d7deff7a54b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.230070 Oct 26 05:11:40.006253 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5af918b-e227-4db0-b26a-8cd29a4b8680 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.230880 Oct 26 05:11:40.006388 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1304/2634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:39 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:40.019884 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1331/2635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:39 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:40.031199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:40.031821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:40.040045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:40.040600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:40.042897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.044024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.044641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.046076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.046919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.047438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.047621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.047918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.048445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.048653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.049192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.049653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.255846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:40.261142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:40.265023 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-33d1630e-802e-45eb-bb94-1c0757282e4d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.229762 Oct 26 05:11:40.265931 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1332/2636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:40 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:40.270779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:40.271505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:40.277990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.278564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.279311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.280221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.280851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.281483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.290978 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e364f2e6-9063-4bbc-a246-30addc90d42a tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.273152 Oct 26 05:11:40.305542 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1305/2637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:40 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:40.320611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:40.321221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:40.327634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.328130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.328574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.329687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:40.330144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:40.330570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:40.470321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:40.479797 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ee03472-596d-4961-9f25-fbaeb588e460 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.212464 Oct 26 05:11:40.480385 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1333/2638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:40 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:40.508924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:40.516876 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da12b000-909e-4291-8657-e20930942b41 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.200173 Oct 26 05:11:40.517483 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1306/2639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:40 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:41.031943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:41.032678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:41.039970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.040673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.041472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.042270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.042806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.043305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.043586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:41.044204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:41.052080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.052582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.053027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.054235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.054622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.055051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.264240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:41.266954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:41.273506 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f31aee30-3713-4fd5-953a-a283617d1d65 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.245502 Oct 26 05:11:41.275180 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4999a59c-a7be-4070-b9a3-0ab307e61f81 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.235706 Oct 26 05:11:41.289569 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1307/2640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:41 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:41.289767 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1334/2641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:41 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:41.294803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:41.295413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:41.301741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.302231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.302670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.303927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.305005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.305475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.314936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:41.316024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:41.323279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.323768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.324204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.324897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.325555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.326138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.536696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:41.541027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:41.551135 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a5a4d86-7924-44d7-9004-4b43d5414284 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.260382 Oct 26 05:11:41.551906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1308/2642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:41 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:41.556116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3fb8157b-e372-4b70-bdfc-6783340b1905 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.244853 Oct 26 05:11:41.556695 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1335/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:41 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:41.561376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:41.561984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:41.567972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.568471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.569006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.569874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.570333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.570762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.576261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:41.576861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:41.586204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.586708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.587149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.587865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:41.588324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:41.588751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:41.974763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:41.989056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3ed522e-0c2a-4c5f-9116-95c82a5296f2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.430442 Oct 26 05:11:42.004044 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1336/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:41 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:42.059612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:42.072633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e57bcaa5-30a0-4971-9b7e-7eda7367dffb tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.504187 Oct 26 05:11:42.074771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1309/2645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:41 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:42.300400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:42.301037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:42.301647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:42.302634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:42.316660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.317407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.318029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.318253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.318954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.319485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.320629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.320748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.321129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.321561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.321924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.322185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.352398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:42.562494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:42.567009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:42.575700 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f9ab50a-e2bf-4b27-91ea-cfe5afe88275 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.278048 Oct 26 05:11:42.585352 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1337/2646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:42 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:42.585352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:42.586662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:42.593888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.594542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.595184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.595967 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-111cbf0b-3813-4c46-a45c-2bcaed03f54c tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.300339 Oct 26 05:11:42.596749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.597535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.597913 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1310/2647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:42 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:42.598048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.605096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:42.606037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:42.613039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.613859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.614467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.615347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:42.617515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:42.618293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:42.814619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:42.818466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:42.823693 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab639be4-7e72-4374-93b4-e079cb940585 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.245068 Oct 26 05:11:42.824280 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1338/2648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:42 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:42.827191 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-68ffc620-0835-425b-b654-751cd507595f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.227960 Oct 26 05:11:42.827751 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1311/2649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:42 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:43.035208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:43.035845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:43.042518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.043015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.043462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.044161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.044628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.045059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.096634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:43.097262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:43.104787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.106475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.107157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.107868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.108493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.108936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.223277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:43.231693 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8a310ba-e38b-4275-8c32-033d410e9220 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.200478 Oct 26 05:11:43.239458 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1339/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:43 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:43.269222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:43.277966 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1345ee1-eaf6-493a-a29b-9e1ad5b69f8b tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.185357 Oct 26 05:11:43.278750 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1312/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:43 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:43.600001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:43.600666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:43.607830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.608326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.608764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.609495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.609960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.610388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.620564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:43.621429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:43.627450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.628136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.628582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.629276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.629761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.630193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.805216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:43.817026 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cbdb3350-c074-442f-b03e-762a7bd47ea8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.220802 Oct 26 05:11:43.818342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1340/2652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:43 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:43.843729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:43.847206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:43.848325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:43.854699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d53cfd42-88ce-405d-968c-a16d0322340b tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.238714 Oct 26 05:11:43.855957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.856527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.857040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.857851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.858382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.858886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.869522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1313/2653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:43 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:43.876243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:43.876862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:43.884879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.885987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.886519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:43.887206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:43.887702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:43.888155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.080020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:44.088939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:44.094657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-91ab50b8-d892-4e71-aaa4-4a7fcc5b559d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.251736 Oct 26 05:11:44.095243 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1341/2654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:43 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:44.099046 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f9e83107-0606-4ede-9d4d-5931d76762d8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.228217 Oct 26 05:11:44.100161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b408fbbf-3338-4b0c-aa25-2074efa7d61c req-6355319e-c28b-4a9a-9a24-91241cd836bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-plugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:44.106709 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1314/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:43 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:44.110502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b408fbbf-3338-4b0c-aa25-2074efa7d61c req-6355319e-c28b-4a9a-9a24-91241cd836bd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.119343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b408fbbf-3338-4b0c-aa25-2074efa7d61c req-6355319e-c28b-4a9a-9a24-91241cd836bd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.121993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b408fbbf-3338-4b0c-aa25-2074efa7d61c req-6355319e-c28b-4a9a-9a24-91241cd836bd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.155476 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b408fbbf-3338-4b0c-aa25-2074efa7d61c req-6355319e-c28b-4a9a-9a24-91241cd836bd service nova] Creating event network-vif-plugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:11:44.161835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b408fbbf-3338-4b0c-aa25-2074efa7d61c req-6355319e-c28b-4a9a-9a24-91241cd836bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065337 Oct 26 05:11:44.162979 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1342/2656] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:44.264415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:44.274666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:44.292773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.305611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:44.306139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.306459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:44.308184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.310845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.314014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.314945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.315225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.315667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.316117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.316920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.317616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.318127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.563950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:44.573011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed46f8d1-a1d2-4aa9-a2b9-4133042ae4f4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.273907 Oct 26 05:11:44.580058 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1343/2657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:44 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:44.586245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:44.594318 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e2044c8-df19-4318-b101-b451e4d3f5e7 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1666 microversion: 2.1 time: 0.343381 Oct 26 05:11:44.597379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1315/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:44 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1666 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:44.842153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:44.843767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:44.854004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.854754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.855406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.856296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.856942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.857597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.884354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:44.884978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:44.895783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.896276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.896718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:44.897519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:44.897970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:44.902410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.133601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:45.153928 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-147ab135-19b5-4511-aca5-c0c915c0ac4e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.316902 Oct 26 05:11:45.169337 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1344/2659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:44 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:45.170596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:45.171081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:45.171081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:45.172990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ea8a9b7-869d-4c55-a442-97e80dbbb06d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.293095 Oct 26 05:11:45.174164 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1316/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:44 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:45.177657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.178169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.180023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:45.180811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:45.186050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.186840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.187520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.187973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.188366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.189008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.189631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.190486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.191191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.191760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.548262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:45.556543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:45.564878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:45.568737 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60e45b17-9399-4431-9503-b9a025d8da97 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.393341 Oct 26 05:11:45.570333 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1317/2661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:45 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:45.572165 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57dfcdd3-2c62-4ccd-bba6-ddcfc03c7c0e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.415919 Oct 26 05:11:45.573799 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1345/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:45 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:45.576444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8285edb2-f5e5-4d83-bc58-efe87fe5fe23 req-d00a60e5-4dbc-401a-a574-17424bc904fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbe1b84-a304-484a-85d3-c4a14ae7f738", "name": "network-vif-deleted", "tag": "d5f6930c-ad93-40a8-9436-52d09e288111"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:45.589240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8285edb2-f5e5-4d83-bc58-efe87fe5fe23 req-d00a60e5-4dbc-401a-a574-17424bc904fa service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.590640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8285edb2-f5e5-4d83-bc58-efe87fe5fe23 req-d00a60e5-4dbc-401a-a574-17424bc904fa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.591299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8285edb2-f5e5-4d83-bc58-efe87fe5fe23 req-d00a60e5-4dbc-401a-a574-17424bc904fa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.602489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:45.603108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:45.607225 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8285edb2-f5e5-4d83-bc58-efe87fe5fe23 req-d00a60e5-4dbc-401a-a574-17424bc904fa service nova] Creating event network-vif-deleted:d5f6930c-ad93-40a8-9436-52d09e288111 for instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 on n-h2-862416-4 Oct 26 05:11:45.610060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.610556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.611157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.611997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.613714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.613714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.616661 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8285edb2-f5e5-4d83-bc58-efe87fe5fe23 req-d00a60e5-4dbc-401a-a574-17424bc904fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044947 Oct 26 05:11:45.617573 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1318/2663] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:45.628491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:45.630304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:45.640453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.641263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.641975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.643033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:45.643728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:45.644391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:45.731154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:45.745516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eaec2700-d915-42ac-b4b4-fc7c53317305 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1598 microversion: 2.1 time: 0.122066 Oct 26 05:11:45.763443 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1319/2664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:45 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1598 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:45.831960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:45.840649 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85030c32-6972-4cbd-9528-5cdfbf09943e tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.244992 Oct 26 05:11:45.841145 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1346/2665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:45 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:46.183126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:46.183738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:46.190083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.190572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.191194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.192060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.192676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.193263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.209246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:46.211256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:46.220309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.220745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.221189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.225907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.226393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.226821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.434737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:46.439010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:46.450226 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8da454b8-5976-4360-909e-4039fe618f7d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.270996 Oct 26 05:11:46.451068 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1320/2666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:46 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:46.453691 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b889e083-b7d3-4a5d-8b29-cddd6ab77319 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.251110 Oct 26 05:11:46.454430 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1347/2667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:46 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:46.595136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:46.596097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:46.610085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:46.610943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:46.618154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.620071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.620874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.621856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.622279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.623189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.623817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.624722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.625404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.626053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.626695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.629815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.869895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:46.873857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:46.877889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d126ee24-0054-461d-ad77-4f08f51c200c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.273932 Oct 26 05:11:46.878472 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1348/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:46 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:46.884066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0dde7973-ee3b-4dcf-98d0-bcad698b4867 req-dca1f529-75db-44bf-81fd-c6f47bd4890b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "name": "network-vif-plugged", "status": "completed", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:46.892267 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fbca96da-15ac-4783-96a0-18942e8e3a65 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.300162 Oct 26 05:11:46.893662 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1321/2669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:46 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:46.894153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dde7973-ee3b-4dcf-98d0-bcad698b4867 req-dca1f529-75db-44bf-81fd-c6f47bd4890b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.894832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dde7973-ee3b-4dcf-98d0-bcad698b4867 req-dca1f529-75db-44bf-81fd-c6f47bd4890b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.895554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dde7973-ee3b-4dcf-98d0-bcad698b4867 req-dca1f529-75db-44bf-81fd-c6f47bd4890b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.899810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:46.900434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:46.907361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.907928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.908435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.909605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.909989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0dde7973-ee3b-4dcf-98d0-bcad698b4867 req-dca1f529-75db-44bf-81fd-c6f47bd4890b service nova] Creating event network-vif-plugged:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h2-862416-4 Oct 26 05:11:46.910143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.910551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.916190 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0dde7973-ee3b-4dcf-98d0-bcad698b4867 req-dca1f529-75db-44bf-81fd-c6f47bd4890b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036129 Oct 26 05:11:46.916998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1349/2670] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:46.922278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:46.923000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:46.930109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.930608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.931051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.931755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:46.932214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:46.932830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:46.981913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:46.990441 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-904fc690-a945-48ea-b215-8d271c5e9c65 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1598 microversion: 2.1 time: 0.095447 Oct 26 05:11:46.991888 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1322/2671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:46 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1598 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:47.086908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:47.094840 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd0a2de4-71e0-4cf8-b0f3-fbb8bd403049 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1323 microversion: 2.1 time: 0.176501 Oct 26 05:11:47.096044 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1350/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:46 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:47.478809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:47.480156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:47.481041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:47.481885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:47.488014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.488527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.488971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.490265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.490843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.491650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.491650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.493124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.493933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.495110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.496049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.496906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.754499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:47.759027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:47.767193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a82585af-389a-4617-a90a-c78819856cfd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.296813 Oct 26 05:11:47.771484 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1323/2673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:47 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:47.785003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e03a3277-e031-495c-90ac-942dacf610f1 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1316 microversion: 2.1 time: 0.310420 Oct 26 05:11:47.786188 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1351/2674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:47 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:47.905461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:47.906112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:47.914658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.915334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.916193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.917279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.917968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.919276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.919930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:47.920663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:47.927005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.927491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.927952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:47.929524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:47.929995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:47.930426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:48.229448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:48.239048 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3e426c56-38cb-4f47-b8bd-4ac14e2d7225 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.337451 Oct 26 05:11:48.244258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1324/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:47 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:48.254172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:48.255715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:48.283597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:48.285941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:48.286713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:48.290095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:48.290569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:48.291666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:48.292579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:48.304689 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73f087d7-d7aa-4f1f-bd37-01963d3cc523 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.390181 Oct 26 05:11:48.311829 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1352/2676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:47 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:48.324857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:48.330578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:48.343898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:48.346215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:48.347218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:48.349587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:48.351386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:48.352082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.015277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea42164668b4720b9613f7be63ec59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64091bf1c8d14f1ebf7c9be4eb68753e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:49.026538 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bb422c31-83f5-49f7-bb81-9aeb34c2e8a2 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 200 len: 1310 microversion: 2.1 time: 0.780706 Oct 26 05:11:49.041688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1325/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:48 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 1310 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:49.047198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:49.048066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:49.058999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.060464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.063379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.064453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.065186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.065898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.135506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:49.143925 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cdaf52d-63c7-42e6-9df6-8b5aef7d1252 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1517 microversion: 2.1 time: 0.830462 Oct 26 05:11:49.147987 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1353/2678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:48 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1517 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:49.171148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:49.171797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:49.184778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.185294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.185758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.186478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.186967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.187380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.502203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:49.515473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c27f2bb9-e184-4a6a-bd1a-9588c3bf7c5e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.472344 Oct 26 05:11:49.517984 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1326/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:49 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:49.523273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:49.528790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:49.543057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.544071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.544218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.545751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.545952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.546384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.551436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:49.561813 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16cadd1e-8981-4c2d-a723-c12a61074a49 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1466 microversion: 2.1 time: 0.412741 Oct 26 05:11:49.573737 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1354/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:49 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1466 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:49.578832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:49.579646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:49.586935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.590049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.590663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.591536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.592155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.592741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.597552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:49.602264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lazy-loading 'flavor' on Instance uuid 0881d8c2-64ff-4b98-90ce-4fed3d77577f {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:11:49.707703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c1dd92a-4207-4cb3-a8b5-75fb32769db5 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action" status: 200 len: 32 microversion: 2.1 time: 0.188235 Oct 26 05:11:49.714842 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1327/2681] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:49 2022] POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:11:49.716404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:49.717117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:49.724450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.725025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.725905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.726657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.727119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.727548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.763921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:49.773122 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1f1e591-c62d-4f55-b34f-b40249e530cc tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.197917 Oct 26 05:11:49.777237 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1355/2682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:49 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:49.782545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-401505904", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1d3f1995-4a9c-473d-83e2-e714a42436e5"}], "block_device_mapping_v2": [{"uuid": "237e709b-9298-4718-9fe5-9f28b38784c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:49.917853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:49.926462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] validate_networks() for [('1d3f1995-4a9c-473d-83e2-e714a42436e5', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:11:49.926990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da9f5d49-6c84-488e-b22d-c99910003e69 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.216994 Oct 26 05:11:49.929880 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1328/2683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:49 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:49.934704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-515447384", "metadata": {"image_type": "test"}}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:49.937413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:49.961702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.962316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.962772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:49.963694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:49.964156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:49.964587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:50.043621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Getting quotas for project 5471bab47d5b41c79aa90a93547be446. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:11:50.057358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Getting quotas for user f1c51212204f4654b320552298e77c3b and project 5471bab47d5b41c79aa90a93547be446. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:11:50.315504 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a9790b0-9ee2-4cdc-8477-62fa7f3e4706 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "POST /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44/action" status: 202 len: 0 microversion: 2.1 time: 0.384362 Oct 26 05:11:50.316785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1329/2684] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:49 2022] POST /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:11:50.323671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:50.325136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:50.331731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:50.332405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:50.333030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:50.333940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:50.335173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:50.336386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:50.675925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:11:50.676759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:11:50.677742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:11:50.679063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:11:50.679844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:11:50.729232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:50.733079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:50.744129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:50.748477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:50.753605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:50.754788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:50.847105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:50.855825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:11:50.883601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Getting quotas for user dbd1775d9dd04820aec1aa2efde776e1 and project 8ef7259043394cb8a05b8c57782d0475. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:11:50.895566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-821b5d46-2400-4275-bf1c-e8f3a03060d1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.562469 Oct 26 05:11:50.898124 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1330/2685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:50 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:50.927113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:50.930504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] [instance: fbbe1b84-a304-484a-85d3-c4a14ae7f738] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:50.983968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:50.993904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:50.994871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:50.998702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.003488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.006802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:51.011891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:11:51.017813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='237e709b-9298-4718-9fe5-9f28b38784c8',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:11:51.088695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:51.117878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] HTTP exception thrown: Instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 could not be found. Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Request method failure captured: Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 HTTP/1.1 Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMEXZGScs94OPyXp7d4crlU2ach8H7CrPypvH-COgfh_wLJnrYXhdSf1TkWhS93qKPuoOLIDCaTXmJHh5yChbcF6GL555CZNLR7sn_T4tOprNvEJs_7IMuspw8UJKvUTqIryAilo3qaf2zQk8bP2rV9vC4nEk8-y4REFGxENCchvq1Y Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 64091bf1c8d14f1ebf7c9be4eb68753e Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestFqdnHostnames-1888212114 Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:11:51.120828 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_64091bf1c8d14f1ebf7c9be4eb68753e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64091bf1c8d14f1ebf7c9be4eb68753e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/64091bf1c8d14f1ebf7c9be4eb68753e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/64091bf1c8d14f1ebf7c9be4eb68753e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestFqdnHostnames-1888212114 Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 64091bf1c8d14f1ebf7c9be4eb68753e Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1888212114 Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestFqdnHostnames-1888212114-project Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2ea42164668b4720b9613f7be63ec59e Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestFqdnHostnames-1888212114-project Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 could not be found. Oct 26 05:11:51.124549 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'fbbe1b84-a304-484a-85d3-c4a14ae7f738'} Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 could not be found. Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:51.126682 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 could not be found. Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 could not be found. Oct 26 05:11:51.129511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:51.133755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Returning 404 to user: Instance fbbe1b84-a304-484a-85d3-c4a14ae7f738 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:51.136892 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eed0ede3-0a82-46c2-97c9-de85d3fef7bd tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738" status: 404 len: 111 microversion: 2.1 time: 0.235578 Oct 26 05:11:51.144550 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1331/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:50 2022] GET /compute/v2.1/servers/fbbe1b84-a304-484a-85d3-c4a14ae7f738 => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:11:51.158447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc659a14-4598-412d-ae81-cc655e580a21 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a001550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:51.311401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07abadf9-f9db-44ee-b290-1fbfc82dde1c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532713 Oct 26 05:11:51.312065 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1356/2687] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:11:51.316982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:51.317623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:51.326038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.326520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.327169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:51.327869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.328489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.328916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:51.511400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:51.521011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05be34eb-11fa-4052-8e85-b46fc1e978f6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.207568 Oct 26 05:11:51.522183 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1357/2688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:51 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:51.527356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:51.528085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:51.534609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.535285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.535933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:51.536839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.537509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.538643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:51.794054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:51.810192 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca2fd9e6-596b-4bbf-9444-6a78036cb699 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1519 microversion: 2.1 time: 0.286771 Oct 26 05:11:51.811072 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1358/2689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:51 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:51.832308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:51.832991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:51.854662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.855170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.855611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:51.856323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:51.856789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:51.857251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.023097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:52.032966 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d2e4243-3263-4460-8b7e-0ddb1208076f tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.209601 Oct 26 05:11:52.033788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1359/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:51 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:52.040500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b942b6cf-cbbf-4285-8368-4a8337fe9d0c req-d2a0dde0-6efa-4a58-b3e8-71cbb54cb147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c757ce8f-1ab1-43b1-af99-ed0a9906061c", "name": "network-vif-plugged", "status": "completed", "tag": "d9bc1b0e-4950-4818-b099-c95c34e796e4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:52.054506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b942b6cf-cbbf-4285-8368-4a8337fe9d0c req-d2a0dde0-6efa-4a58-b3e8-71cbb54cb147 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.057197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b942b6cf-cbbf-4285-8368-4a8337fe9d0c req-d2a0dde0-6efa-4a58-b3e8-71cbb54cb147 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.057888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b942b6cf-cbbf-4285-8368-4a8337fe9d0c req-d2a0dde0-6efa-4a58-b3e8-71cbb54cb147 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.079107 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b942b6cf-cbbf-4285-8368-4a8337fe9d0c req-d2a0dde0-6efa-4a58-b3e8-71cbb54cb147 service nova] Creating event network-vif-plugged:d9bc1b0e-4950-4818-b099-c95c34e796e4 for instance c757ce8f-1ab1-43b1-af99-ed0a9906061c on n-h2-862416-4 Oct 26 05:11:52.087562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b942b6cf-cbbf-4285-8368-4a8337fe9d0c req-d2a0dde0-6efa-4a58-b3e8-71cbb54cb147 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052430 Oct 26 05:11:52.089707 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1360/2691] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:52.099352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37b67f8f-1d96-41e6-af52-8061bfd10427 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] Calling method '.version_select at 0x7f4709f09280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:52.101234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc659a14-4598-412d-ae81-cc655e580a21 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.954822 Oct 26 05:11:52.103636 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1332/2692] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:11:51 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:52.123133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:52.126757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:52.136703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.137506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.138125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.139015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.140507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.141266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.143759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37b67f8f-1d96-41e6-af52-8061bfd10427 tempest-ServersTestFqdnHostnames-1888212114 tempest-ServersTestFqdnHostnames-1888212114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792616239" status: 202 len: 0 microversion: 2.1 time: 0.051930 Oct 26 05:11:52.147538 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1361/2693] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792616239 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:11:52.169352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:52.174644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:52.189468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.191178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.191737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.193614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.194696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.197794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.260803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:52.276281 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b5adb0eb-f5ef-403e-bf24-06e149e5d5f8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1102 microversion: 2.1 time: 0.171309 Oct 26 05:11:52.291856 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1333/2694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:52 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1102 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:52.472852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:52.482071 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d27ce13-6040-4642-aa24-ba3c4d45b706 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.335726 Oct 26 05:11:52.482660 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1362/2695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:52 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:52.551728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:52.552974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:52.563604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.564571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.565241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.566366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.567091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.568081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.840952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:52.842864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:52.854827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.855750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.856623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.857883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:52.858553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:52.859190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:52.954175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:52.983765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4ec8b7a-3097-4a8c-8d2e-7f999ec5264f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1315 microversion: 2.1 time: 0.438269 Oct 26 05:11:53.004270 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1334/2696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:52 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:53.065378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:53.066071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:53.078423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.081488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.082009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.083023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.084066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.089825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.134414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:53.146164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8fa59a50-8c38-405e-8f4e-c9cc07fd6709 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.311493 Oct 26 05:11:53.146756 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1363/2697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:52 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:53.158065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d54fc1f-05e1-44ea-80ff-38b9a94484ad tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f41e50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:53.248475 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d54fc1f-05e1-44ea-80ff-38b9a94484ad tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.099229 Oct 26 05:11:53.249273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1364/2698] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:11:53 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:53.263930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:53.264491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:53.282956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:11:53.288708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.290576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.291894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.293096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.293783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.294479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.484942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:53.494046 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6098e4a2-e041-4a8c-adbd-6a4d875decc6 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.436291 Oct 26 05:11:53.515273 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1335/2699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:53 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:53.529399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:53.530032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:53.544067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.545014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.545769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.547049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.547615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.548220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.730744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:53.739764 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2bb22eac-dd6c-4b87-bb54-3bd6759d7f8a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1168 microversion: 2.1 time: 0.222000 Oct 26 05:11:53.744853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1336/2700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:53 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1168 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:53.769843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:53.770540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:53.792439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.793094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.793671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.794486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.795055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.795588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.877526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:53.890830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d46ca7b-4e35-42b8-b560-7fc165a19d72 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.639051 Oct 26 05:11:53.891732 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1365/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:53 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:53.923385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:53.925128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:53.935544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.938213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.938892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:53.940300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:53.943399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:53.949932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:54.448834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:54.471495 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-275ba5e1-dc2b-4558-8a66-c6cd2b287b6d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.712410 Oct 26 05:11:54.472093 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1337/2702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:53 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:54.484500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:54.485538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:54.498274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:54.506081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:54.507471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:54.508459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:54.509141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:54.509836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:54.616770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:54.625282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cfe4baa-71be-4881-a1e3-2a0974fd02b4 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.705821 Oct 26 05:11:54.649686 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1366/2703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:53 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:11:54.660512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e86d5df8-93bc-428f-a9c8-5e68c9804aed tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f78700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:54.737818 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e86d5df8-93bc-428f-a9c8-5e68c9804aed tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.086566 Oct 26 05:11:54.738406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1367/2704] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:11:54 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:54.747672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:54.751877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:54.762625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:54.767212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:54.769088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:54.771215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:54.771881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:54.774866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:54.933072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:54.945354 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d2b43b7-55cd-43a6-b0ab-22269d615560 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1502 microversion: 2.1 time: 0.470537 Oct 26 05:11:54.969009 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1338/2705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:54 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1502 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:54.985527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1095041-32cd-4fa8-9edd-faf1e13732c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:54.996237 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d1095041-32cd-4fa8-9edd-faf1e13732c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance a09528b2-4b5c-4bde-ba1a-08976c74acb5 has no mapping to a cell. Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1095041-32cd-4fa8-9edd-faf1e13732c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/a09528b2-4b5c-4bde-ba1a-08976c74acb5/action HTTP/1.1 Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 15 Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:11:55.012858 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: {"os-stop": {}} Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:11:55.014360 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a09528b2-4b5c-4bde-ba1a-08976c74acb5 has no mapping to a cell. Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a09528b2-4b5c-4bde-ba1a-08976c74acb5', 'body': {'os-stop': {}}} Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a09528b2-4b5c-4bde-ba1a-08976c74acb5 has no mapping to a cell. Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:55.015184 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a09528b2-4b5c-4bde-ba1a-08976c74acb5 has no mapping to a cell. Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a09528b2-4b5c-4bde-ba1a-08976c74acb5 has no mapping to a cell. Oct 26 05:11:55.016403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:11:55.019727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1095041-32cd-4fa8-9edd-faf1e13732c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance a09528b2-4b5c-4bde-ba1a-08976c74acb5 has no mapping to a cell. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:11:55.019727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1095041-32cd-4fa8-9edd-faf1e13732c0 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/a09528b2-4b5c-4bde-ba1a-08976c74acb5/action" status: 404 len: 117 microversion: 2.1 time: 0.044382 Oct 26 05:11:55.019727 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1339/2706] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:54 2022] POST /compute/v2.1/servers/a09528b2-4b5c-4bde-ba1a-08976c74acb5/action => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:11:55.021271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:55.021937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:55.045790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.046852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.047360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.048113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.048580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.049014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.423741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:55.437664 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c40e5d79-6c59-4e40-af5f-319d9ea56edf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1210 microversion: 2.1 time: 0.420692 Oct 26 05:11:55.438306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1340/2707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:55 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1210 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:55.463449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-401486594"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:55.466389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:55.472395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:55.477569 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dbfc688c-07c1-42c1-9219-9dbdd1c97344 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.737876 Oct 26 05:11:55.478153 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1368/2708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:54 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:55.487328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:55.490443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:55.494085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.494573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.495015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.495768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.496197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.496628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.501141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.501917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.502523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.503568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.504185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.504772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.795928 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Adding security group 8deade92-5aa3-4cf6-a41c-dfc8ba4111d1 to port d9bc1b0e-4950-4818-b099-c95c34e796e4 Oct 26 05:11:55.882956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:55.891177 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d68544ae-37cb-4212-8735-41b2e14c1c3b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.407486 Oct 26 05:11:55.894948 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1369/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:55 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:55.904820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:55.907848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:55.920696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.923813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.924611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:55.926199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:55.927654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:55.929238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:56.842872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:56.859013 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6b999092-d05b-4853-9b4a-a4748a71da0d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.962575 Oct 26 05:11:56.860372 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1370/2710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:55 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:56.874727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-93ed39ed-6c5f-488d-859d-dd1d7c7b40cd req-4cf7dead-bade-4f1d-8d40-4ef02e6c9436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1f397d6-655f-419e-bf0c-ee1e69cc8321", "tag": "07b2594b-ca56-427c-b400-a762819750c6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:56.905403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-93ed39ed-6c5f-488d-859d-dd1d7c7b40cd req-4cf7dead-bade-4f1d-8d40-4ef02e6c9436 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:56.905911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-93ed39ed-6c5f-488d-859d-dd1d7c7b40cd req-4cf7dead-bade-4f1d-8d40-4ef02e6c9436 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:56.906358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-93ed39ed-6c5f-488d-859d-dd1d7c7b40cd req-4cf7dead-bade-4f1d-8d40-4ef02e6c9436 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:56.938822 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-93ed39ed-6c5f-488d-859d-dd1d7c7b40cd req-4cf7dead-bade-4f1d-8d40-4ef02e6c9436 service nova] Creating event network-changed:07b2594b-ca56-427c-b400-a762819750c6 for instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 on n-h1-862416-4 Oct 26 05:11:56.946120 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-93ed39ed-6c5f-488d-859d-dd1d7c7b40cd req-4cf7dead-bade-4f1d-8d40-4ef02e6c9436 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082947 Oct 26 05:11:56.948454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1371/2711] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:56.969678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e4738ed-af6a-4c8a-a93f-73efd60f4661 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f41af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:57.051467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e4738ed-af6a-4c8a-a93f-73efd60f4661 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.099578 Oct 26 05:11:57.052087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1372/2712] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:11:56 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:57.069024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:57.070084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:57.099980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:57.111938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:57.112402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:57.113146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:57.113642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:57.114074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:57.298105 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-081e6f2f-d076-4e31-bad5-ff75a8210a63 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c/action" status: 202 len: 0 microversion: 2.1 time: 1.847525 Oct 26 05:11:57.298729 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1341/2713] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:55 2022] POST /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c/action => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:11:57.307662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:57.308281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:57.335820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:57.336325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:57.336766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:57.337746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:57.338418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:57.344077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:58.205432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:58.220914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60993b26-72b0-4cbb-9192-3ca94cefee39 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 1.158289 Oct 26 05:11:58.232133 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1373/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:57 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:58.252757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:58.273902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:58.297091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:58.302554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:58.310001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:58.315923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:58.316624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:58.317333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:58.318689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:58.332123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5124260-e6c0-4d6c-8229-69d359f146aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1210 microversion: 2.1 time: 1.029280 Oct 26 05:11:58.332738 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1342/2715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:57 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1210 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:58.342315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7e2a8977-aa05-408e-8c78-acb03fd0fb46 req-7369310c-79b5-4c65-ae4d-42cb0bda6bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "name": "network-vif-plugged", "status": "completed", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:58.368998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e2a8977-aa05-408e-8c78-acb03fd0fb46 req-7369310c-79b5-4c65-ae4d-42cb0bda6bfc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:58.369812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e2a8977-aa05-408e-8c78-acb03fd0fb46 req-7369310c-79b5-4c65-ae4d-42cb0bda6bfc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:58.371739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e2a8977-aa05-408e-8c78-acb03fd0fb46 req-7369310c-79b5-4c65-ae4d-42cb0bda6bfc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:58.424499 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7e2a8977-aa05-408e-8c78-acb03fd0fb46 req-7369310c-79b5-4c65-ae4d-42cb0bda6bfc service nova] Creating event network-vif-plugged:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:11:58.431105 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7e2a8977-aa05-408e-8c78-acb03fd0fb46 req-7369310c-79b5-4c65-ae4d-42cb0bda6bfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096989 Oct 26 05:11:58.433628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1343/2716] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:58.453953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715092119"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:58.454846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:58.469963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:58.472132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:58.472749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:58.473940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:58.477214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:58.477978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:58.951925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:58.965446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-522eba18-b685-44d2-8de9-69546437c2e0 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.722902 Oct 26 05:11:58.966742 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1374/2717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:58 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:58.983421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-bad668d9-7e4d-4406-9c66-b4660b6dbccf req-a11dadf0-fdf7-480c-ade7-663036fb32f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c757ce8f-1ab1-43b1-af99-ed0a9906061c", "tag": "d9bc1b0e-4950-4818-b099-c95c34e796e4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:11:59.009230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bad668d9-7e4d-4406-9c66-b4660b6dbccf req-a11dadf0-fdf7-480c-ade7-663036fb32f3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:59.010894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bad668d9-7e4d-4406-9c66-b4660b6dbccf req-a11dadf0-fdf7-480c-ade7-663036fb32f3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:59.011505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bad668d9-7e4d-4406-9c66-b4660b6dbccf req-a11dadf0-fdf7-480c-ade7-663036fb32f3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:59.042512 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-bad668d9-7e4d-4406-9c66-b4660b6dbccf req-a11dadf0-fdf7-480c-ade7-663036fb32f3 service nova] Creating event network-changed:d9bc1b0e-4950-4818-b099-c95c34e796e4 for instance c757ce8f-1ab1-43b1-af99-ed0a9906061c on n-h2-862416-4 Oct 26 05:11:59.051890 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-bad668d9-7e4d-4406-9c66-b4660b6dbccf req-a11dadf0-fdf7-480c-ade7-663036fb32f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083451 Oct 26 05:11:59.055073 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1375/2718] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:11:59.076511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:11:59.077749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:11:59.091620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:59.092010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:59.092826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:59.093930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:11:59.094715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:11:59.095467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:11:59.293409 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Adding security group 73860dbe-dd02-4c74-a093-451a1f16878e to port d9bc1b0e-4950-4818-b099-c95c34e796e4 Oct 26 05:11:59.684940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:11:59.700931 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4f37ca7-ea46-49fb-8e21-d3b94410c317 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.643311 Oct 26 05:11:59.708569 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1376/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:11:59 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:11:59.719726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-21259645-789e-4e16-b061-8a33a3ae26e0 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709eead30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:00.814644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:00.909560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:01.336011 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dafdcaba-8710-49a7-80e1-49cc1ba73ea6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c/action" status: 202 len: 0 microversion: 2.1 time: 2.900213 Oct 26 05:12:01.338628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1344/2720] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:11:58 2022] POST /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c/action => generated 0 bytes in 2904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:01.345625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f770aa5-67c1-40c2-a4d4-a87eda6edd46 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:01.346165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f770aa5-67c1-40c2-a4d4-a87eda6edd46 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: e34b4489-4313-477a-8380-a1e0b333a82b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:01.360403 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1f770aa5-67c1-40c2-a4d4-a87eda6edd46 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance e34b4489-4313-477a-8380-a1e0b333a82b could not be found. Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f770aa5-67c1-40c2-a4d4-a87eda6edd46 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/e34b4489-4313-477a-8380-a1e0b333a82b/action HTTP/1.1 Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 15 Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:01.362543 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: {"suspend": {}} Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:01.364005 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e34b4489-4313-477a-8380-a1e0b333a82b could not be found. Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e34b4489-4313-477a-8380-a1e0b333a82b', 'body': {'suspend': {}}} Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34b4489-4313-477a-8380-a1e0b333a82b could not be found. Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:01.364946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34b4489-4313-477a-8380-a1e0b333a82b could not be found. Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34b4489-4313-477a-8380-a1e0b333a82b could not be found. Oct 26 05:12:01.366283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:01.368223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f770aa5-67c1-40c2-a4d4-a87eda6edd46 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance e34b4489-4313-477a-8380-a1e0b333a82b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:01.370281 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f770aa5-67c1-40c2-a4d4-a87eda6edd46 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/e34b4489-4313-477a-8380-a1e0b333a82b/action" status: 404 len: 111 microversion: 2.1 time: 0.028696 Oct 26 05:12:01.377665 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1345/2721] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:01 2022] POST /compute/v2.1/servers/e34b4489-4313-477a-8380-a1e0b333a82b/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:01.389072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:01.390050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:01.407934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:01.408692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:01.409293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:01.410185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:01.413404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:01.414179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:01.897806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:01.913597 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e540f81e-b55a-4401-b1f2-f471a2d0d293 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1210 microversion: 2.1 time: 0.533937 Oct 26 05:12:01.931695 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1346/2722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:01 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1210 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:01.952757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:01.961638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:01.972561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:01.974078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:01.981817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:01.982440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:01.983234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:01.983719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:01.984143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:02.592681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:02.607377 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9780ec0-c49b-4ca0-b3d5-6468aa12423c tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.671643 Oct 26 05:12:02.609592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1347/2723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:01 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:02.619673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:02.624897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:02.638826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:02.639601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:02.642099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:02.643080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:02.644396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:02.645005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:02.885580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:02.898485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9c64fbc2-1d8d-4d55-b533-3279489a2d27 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.284659 Oct 26 05:12:02.899808 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1348/2724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:02 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:02.905914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-25e51aae-ed45-43e4-ae7c-22064c488027 req-2e019f5d-d76c-4651-bf2d-708c1ae9427d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c757ce8f-1ab1-43b1-af99-ed0a9906061c", "tag": "d9bc1b0e-4950-4818-b099-c95c34e796e4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:02.917660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25e51aae-ed45-43e4-ae7c-22064c488027 req-2e019f5d-d76c-4651-bf2d-708c1ae9427d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:02.918441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25e51aae-ed45-43e4-ae7c-22064c488027 req-2e019f5d-d76c-4651-bf2d-708c1ae9427d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:02.919087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25e51aae-ed45-43e4-ae7c-22064c488027 req-2e019f5d-d76c-4651-bf2d-708c1ae9427d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:02.933329 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-25e51aae-ed45-43e4-ae7c-22064c488027 req-2e019f5d-d76c-4651-bf2d-708c1ae9427d service nova] Creating event network-changed:d9bc1b0e-4950-4818-b099-c95c34e796e4 for instance c757ce8f-1ab1-43b1-af99-ed0a9906061c on n-h2-862416-4 Oct 26 05:12:02.941592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-25e51aae-ed45-43e4-ae7c-22064c488027 req-2e019f5d-d76c-4651-bf2d-708c1ae9427d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040132 Oct 26 05:12:02.943188 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1349/2725] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:02.950335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:02.951315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:02.960260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:02.961247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:02.962014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:02.963460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:02.964289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:02.977865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:03.534370 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9fe6e87-1c9f-4d6c-aedc-700c1a1e307f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.589440 Oct 26 05:12:03.535740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1350/2726] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 26 05:12:02 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c/os-security-groups => generated 1157 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:03.545136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:03.545967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:03.557812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:03.559399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:03.560769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:03.561832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:03.562601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:03.563198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:04.112044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:04.121390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a418568-f72d-445a-9497-b23fb1ee6256 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.584378 Oct 26 05:12:04.129772 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1351/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:03 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:04.144898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:04.145887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:04.160920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:04.165292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:04.167489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:04.177414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:04.178919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:04.181940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:04.411228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:04.422805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20b37766-322e-44e6-a06c-bd900664cf6d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.290912 Oct 26 05:12:04.424792 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1352/2728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:04 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:04.439835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54802829-be39-4728-b5aa-281c8c6b2014 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f470a001ee0>, body: {"security_group": {"name": " tempest-securitygroup -684002648 ", "description": "tempest-description-210152545"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:04.813800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54802829-be39-4728-b5aa-281c8c6b2014 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.387424 Oct 26 05:12:04.814824 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1353/2729] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:04 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:04.820746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:04.821713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:04.836295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:04.837027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:04.837771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:04.838861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:04.839544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:04.840204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:05.135702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:05.139675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:05.150459 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49051c7f-d2af-4e01-a66c-ff94acd2fc59 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1471 microversion: 2.1 time: 0.334369 Oct 26 05:12:05.155767 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1354/2730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:04 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:05.175019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:05.183424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:05.198225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:05.199162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:05.201630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:05.203365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:05.207961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:05.208647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.069255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:06.083501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60ff0069-8ef6-43e7-b5c7-fd365a55217d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.912388 Oct 26 05:12:06.085169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1355/2731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:05 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:06.090261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:06.091158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:06.099732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.101170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.110626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.112126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.112623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.113121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.209123 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-21259645-789e-4e16-b061-8a33a3ae26e0 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 6.498847 Oct 26 05:12:06.210229 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1377/2732] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:11:59 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 6500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:06.216715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b91c2a5f-8d8d-4603-af94-f1917ae5c736 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709ebb5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:06.310551 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b91c2a5f-8d8d-4603-af94-f1917ae5c736 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401" status: 200 len: 222 microversion: 2.1 time: 0.096817 Oct 26 05:12:06.320380 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1378/2733] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:12:06 2022] GET /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401 => generated 222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:06.325354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:06.325971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:06.330569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:06.342662 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7fde14aa-0f0b-4292-94a9-7ca4e22c98b7 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.256021 Oct 26 05:12:06.343852 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1356/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:06 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:06.351224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:06.355393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.355904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.356352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.357068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.357580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.358001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.358672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:06.375738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.376452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.376993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.380050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.380654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.381158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.628981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:06.636911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7d110f7-244d-4684-a0e7-027c469d554b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.315383 Oct 26 05:12:06.637541 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1379/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:06 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:06.650146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:06.654858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:06.659313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:06.663603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.664110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.664692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.665617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.666234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.667538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.673224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f72480c-e398-46eb-8d44-9e04e8cfee3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.326899 Oct 26 05:12:06.674634 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1357/2736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:06 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:06.680734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ede8c2f2-9344-45ed-bc13-143af3ac706b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470e9f2b80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:06.685103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:06.933765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:06.943396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2be2ecd0-f64f-49d8-b874-dd5624ee5c21 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1477 microversion: 2.1 time: 0.300770 Oct 26 05:12:06.948760 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1380/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:06 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:06.964027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:06.965604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:06.979457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.981785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.982917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:06.985019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:06.988169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:06.988879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:07.000846 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ede8c2f2-9344-45ed-bc13-143af3ac706b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401" status: 202 len: 0 microversion: 2.1 time: 0.322929 Oct 26 05:12:07.002276 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1358/2738] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:12:06 2022] DELETE /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:07.021555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lazy-loading 'flavor' on Instance uuid 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:12:07.030893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a8c1c10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:07.076650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:12:07.077648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 not found {{(pid=120585) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:12:07.087020 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.087020 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401 HTTP/1.1 Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:07.093192 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] Oct 26 05:12:07.094666 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'ef4cd84f-b1b3-43ef-bf45-af20d3a20401'} Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:07.095525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:12:07.096850 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.099720 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] Oct 26 05:12:07.102534 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:07.105937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:12:07.105937 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-73a7427b-30ca-4b25-8bee-e430e182e83f'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:07.111479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-508b944c-ca0e-44c3-9577-98c672f4e3e5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401" status: 404 len: 194 microversion: 2.1 time: 0.096215 Oct 26 05:12:07.114432 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1359/2739] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:12:07 2022] GET /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:07.125259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:07.127721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:07.128729 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-172c1262-678b-4188-adde-b1490bfcd6d9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 202 len: 0 microversion: 2.1 time: 0.177963 Oct 26 05:12:07.133085 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1381/2740] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:06 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:07.139493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:07.140000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:07.140748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:07.142721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3598caa2-fdc0-4c8e-b1e6-34b1c3016cbf tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709f19af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-782892761", "description": "tempest-description-108734302"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:07.143278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:07.144399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:07.145737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:07.513504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:07.525757 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69f2bde8-15bf-4df3-9663-d8ddfda8ab73 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.409391 Oct 26 05:12:07.526449 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1360/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:07 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:07.545556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:07.546449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:07.552976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:07.555858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:07.556313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:07.557044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:07.557538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:07.557969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:07.572842 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3598caa2-fdc0-4c8e-b1e6-34b1c3016cbf tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.437937 Oct 26 05:12:07.581345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1382/2742] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:07 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:07.586834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de3820fe-c690-468d-ac61-c6f2f0b2157d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f09dc0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:07.676849 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de3820fe-c690-468d-ac61-c6f2f0b2157d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.094419 Oct 26 05:12:07.685584 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1383/2743] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:07 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:07.690766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bf08b867-d1a3-48f2-a682-5a92a53bc770 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709ebb3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1007685835", "description": "tempest-description-1773811729"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:07.810316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:07.850929 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d884ca6b-d701-49a8-a3a1-a35c54007044 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1514 microversion: 2.1 time: 0.319537 Oct 26 05:12:07.852855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1361/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:07 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:07.875922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:07.876836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:07.905751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:07.910340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:07.911044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:07.912055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:07.912724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:07.913365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.110089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bf08b867-d1a3-48f2-a682-5a92a53bc770 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.423077 Oct 26 05:12:08.120025 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1384/2745] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:08.125481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:08.126683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:08.156363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.159780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.160496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.163213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.165976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.166912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.367909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:08.376773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47eff01f-00af-4dd2-bd36-df9a06886cb4 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.520657 Oct 26 05:12:08.382149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1362/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:07 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:08.402466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:08.403817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:08.426997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.427504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.427961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.433730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.434260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.434717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.485796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:08.495861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d44486e6-9195-4b79-91b5-9236c204c3a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.374269 Oct 26 05:12:08.498845 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1385/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:08 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:08.516731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8417a6d-33de-448a-9751-c324782fbebd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709f09dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1921693939", "description": "tempest-description-2038941646"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:08.767986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:08.785811 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b9a503b-bc98-4836-b23f-7cf53140514d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1477 microversion: 2.1 time: 0.400334 Oct 26 05:12:08.787730 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1363/2748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:08 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:08.821285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f3868bae-1b79-467a-8e5d-ea5328f65de4 req-73906f67-6617-4bef-a735-7db994219934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b22c173-3089-46c5-91c6-2bac95ac7cf7", "name": "network-vif-unplugged", "status": "completed", "tag": "1f98965e-9ae0-4cce-b52a-48dd51766116"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:08.845768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f3868bae-1b79-467a-8e5d-ea5328f65de4 req-73906f67-6617-4bef-a735-7db994219934 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.847031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f3868bae-1b79-467a-8e5d-ea5328f65de4 req-73906f67-6617-4bef-a735-7db994219934 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.848039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f3868bae-1b79-467a-8e5d-ea5328f65de4 req-73906f67-6617-4bef-a735-7db994219934 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.875201 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f3868bae-1b79-467a-8e5d-ea5328f65de4 req-73906f67-6617-4bef-a735-7db994219934 service nova] Creating event network-vif-unplugged:1f98965e-9ae0-4cce-b52a-48dd51766116 for instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 on n-h1-862416-4 Oct 26 05:12:08.884276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f3868bae-1b79-467a-8e5d-ea5328f65de4 req-73906f67-6617-4bef-a735-7db994219934 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077764 Oct 26 05:12:08.886323 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1364/2749] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:08.894650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-381851419"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:08.900142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:08.908704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.909297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.909805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:08.910655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:08.911659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:08.912187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:09.022931 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8417a6d-33de-448a-9751-c324782fbebd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.521626 Oct 26 05:12:09.031886 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1386/2750] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:09.038198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:09.039452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:09.054636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:09.055458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:09.056269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:09.058310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:09.059222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:09.060286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:09.237475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:09.248319 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9a2f7ff-0d50-4c17-91ec-2aa6cf7d019d tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.214875 Oct 26 05:12:09.265290 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1387/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:09 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:09.279181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68c705b9-f00d-4d7b-8a0a-3d040395980a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f093a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:09.298307 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e2b41d5b-ccdc-482c-a11f-e5ffc8764621 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.408444 Oct 26 05:12:09.299985 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1365/2752] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:08 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 26 05:12:09.306880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:09.308088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:09.322642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:09.323541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:09.324200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:09.325334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:09.326016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:09.327021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:09.392363 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68c705b9-f00d-4d7b-8a0a-3d040395980a tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.132343 Oct 26 05:12:09.401211 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1388/2753] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:09 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:09.415342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84463508-8c2e-41fa-bce4-074d56f8e93d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f41700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:09.740228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:09.757658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21b70c72-2f74-43c2-8dfb-808c437f31c5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1497 microversion: 2.1 time: 0.451655 Oct 26 05:12:09.761486 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1366/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:09 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:09.779526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:09.781787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:09.794834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:09.795581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:09.796087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:09.799400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:09.801401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:09.802331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.099559 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84463508-8c2e-41fa-bce4-074d56f8e93d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.689105 Oct 26 05:12:10.101122 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1389/2755] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:12:09 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:10.122393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:10.122861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:10.144466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.145472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.146183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.147430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.154634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.155383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.187233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:10.197909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lazy-loading 'flavor' on Instance uuid 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:12:10.214281 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-884d4b32-9d61-4531-85cd-95d5bd40a926 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.451377 Oct 26 05:12:10.219991 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1367/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:09 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:10.237561 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'suspend' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state suspended Oct 26 05:12:10.250519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 15 Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:12:10.251073 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: {"suspend": {}} Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:12:10.252434 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'suspend' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state suspended Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'suspend': {}}} Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 26 05:12:10.253278 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state suspended Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:10.254645 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:10.256215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:10.256215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:10.256215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state suspended Oct 26 05:12:10.256215 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:10.258796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:10.261076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'suspend' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state suspended {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:10.267191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00b3461b-c9b6-418f-9ebd-049b316e1dd2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 148 microversion: 2.1 time: 0.150910 Oct 26 05:12:10.268719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.269750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.270598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.271937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.272620 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1390/2757] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:10 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 148 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:12:10.273016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.273649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.288864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1e1be11c-a598-4606-8b34-c695ae3f5475 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f9f5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:10.618612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:10.630893 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8abac0dc-8be8-4082-90c1-9c623b82ce0d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1477 microversion: 2.1 time: 0.406912 Oct 26 05:12:10.632335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1368/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:10 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1477 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:10.651164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:10.651800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:10.664900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.665446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.665906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.666891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.667357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.667794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.967775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1e1be11c-a598-4606-8b34-c695ae3f5475 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1" status: 202 len: 0 microversion: 2.1 time: 0.693478 Oct 26 05:12:10.972876 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1391/2759] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:12:10 2022] DELETE /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1 => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:10.979131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:10.981927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:10.998009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:10.998509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:10.998956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:10.999666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.000124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.000548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.110220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:11.118939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66990b87-1fe0-40ba-8a9f-3c208023d744 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.485517 Oct 26 05:12:11.138410 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1369/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:10 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:11.147213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15c98f8c-01d3-49d5-8d6d-d5cf38e55e52 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a8bb700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:11.207777 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fdf18d46-dbee-4a2d-8262-b4a8f750fc73 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 202 len: 0 microversion: 2.1 time: 0.232949 Oct 26 05:12:11.214313 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1392/2761] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:10 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:11.226301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d45818e4-6769-4296-a805-00a8b32cf34a req-2d04d461-bb95-4433-866d-c48c773c2ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b22c173-3089-46c5-91c6-2bac95ac7cf7", "name": "network-vif-plugged", "status": "completed", "tag": "1f98965e-9ae0-4cce-b52a-48dd51766116"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:11.256445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d45818e4-6769-4296-a805-00a8b32cf34a req-2d04d461-bb95-4433-866d-c48c773c2ae8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.258921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d45818e4-6769-4296-a805-00a8b32cf34a req-2d04d461-bb95-4433-866d-c48c773c2ae8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.269806 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15c98f8c-01d3-49d5-8d6d-d5cf38e55e52 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.130118 Oct 26 05:12:11.278485 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1370/2762] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:11 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:11.278669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d45818e4-6769-4296-a805-00a8b32cf34a req-2d04d461-bb95-4433-866d-c48c773c2ae8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.290140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f871f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:11.324689 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d45818e4-6769-4296-a805-00a8b32cf34a req-2d04d461-bb95-4433-866d-c48c773c2ae8 service nova] Creating event network-vif-plugged:1f98965e-9ae0-4cce-b52a-48dd51766116 for instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 on n-h1-862416-4 Oct 26 05:12:11.343733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d45818e4-6769-4296-a805-00a8b32cf34a req-2d04d461-bb95-4433-866d-c48c773c2ae8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127642 Oct 26 05:12:11.346867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1393/2763] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:11.355757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:12:11.356490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 not found {{(pid=120585) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:12:11.357155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.357155 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1 HTTP/1.1 Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:11.359646 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] Oct 26 05:12:11.361147 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c679bd6d-261e-4c29-b4ce-2dbf83e628d1'} Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:11.362717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:12:11.377044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.388813 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-c254e20a-674f-48db-8eab-7984f22f40d9'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e270b271-1185-420b-8c35-87d2b5104636 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1" status: 404 len: 194 microversion: 2.1 time: 0.088644 Oct 26 05:12:11.394341 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1371/2764] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:12:11 2022] GET /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:11.397864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:11.397864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:11.398862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:11.405553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:11.421125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.421125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.421125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.422570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.423328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.425809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.426727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.427124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.427630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.428735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.436298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.436871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.786925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:11.798054 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4511356b-8824-4e92-bcce-99a8a8d82c97 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.430660 Oct 26 05:12:11.801571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1372/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:11 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:11.812079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d65fa2bf-0892-4677-9ebe-c4518c9e81d9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a9378b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:11.862931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:11.876460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e1ec952b-7acc-4896-821d-cbe7dee338a8 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1503 microversion: 2.1 time: 0.527252 Oct 26 05:12:11.891305 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1394/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:11 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:11.905844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:11.910998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:11.922900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.923731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.926162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:11.927077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:11.927698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:11.930825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:12.390319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:12.407209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c74a58f8-9b90-4465-9664-e4c75bd1c084 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1477 microversion: 2.1 time: 0.514431 Oct 26 05:12:12.407806 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1395/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:11 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1477 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:12.454513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:12.472419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:12.505900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:12.514107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:12.518803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:12.519648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:12.527106 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d65fa2bf-0892-4677-9ebe-c4518c9e81d9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68" status: 202 len: 0 microversion: 2.1 time: 0.723706 Oct 26 05:12:12.528702 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1373/2768] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:12:11 2022] DELETE /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:12.534121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e02314c7-d49d-4999-8845-0b5b0099ef87 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a8c19d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:12.537595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:12.538885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:12.631238 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e02314c7-d49d-4999-8845-0b5b0099ef87 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 0.101348 Oct 26 05:12:12.632409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1374/2769] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:12 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:12.651012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a1adb80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:12.748261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:12:12.748873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 not found {{(pid=120585) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:12:12.749465 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.749465 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68 HTTP/1.1 Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:12.751317 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] Oct 26 05:12:12.752843 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd25f29c8-4e97-418c-ab2d-92f6ffef0f68'} Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:12.753723 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:12:12.754910 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.757873 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-a21210b8-4b46-4c56-9ec4-eb4aece77feb'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-207b728a-4b22-417b-9570-b998c18d0afd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68" status: 404 len: 194 microversion: 2.1 time: 0.111118 Oct 26 05:12:12.760938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1375/2770] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:12:12 2022] GET /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:12.763551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-157cbdd3-13f4-436d-a227-b76b73d01cea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a1add30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:13.243997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:13.253143 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc1b1f7a-9c08-4be4-9bc9-5af0e63be5e1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.815389 Oct 26 05:12:13.260728 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1396/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:12 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:13.267059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:13.271909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:13.292301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:13.292919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:13.294086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:13.296942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:13.297685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:13.299607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:13.528608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-157cbdd3-13f4-436d-a227-b76b73d01cea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1" status: 202 len: 0 microversion: 2.1 time: 0.770835 Oct 26 05:12:13.529192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1376/2772] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:12:12 2022] DELETE /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:13.534124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:13.534744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:13.548868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:13.565574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:13.566443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:13.567220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:13.567695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:13.568112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:13.867852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:13.881631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0822519e-b515-446d-8618-f952fe290b7f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.619230 Oct 26 05:12:13.887356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1397/2773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:13 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:13.906599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:13.909756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:13.926824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:13.927949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:13.929896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:13.932237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:13.932914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:13.934288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:14.102111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:14.127538 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2756aa36-c5f0-48be-98f1-c4156e5251f2 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1503 microversion: 2.1 time: 0.588362 Oct 26 05:12:14.129474 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1377/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:13 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:14.145994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a0015e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:14.279028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:12:14.279892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 not found {{(pid=120585) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:12:14.280749 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.280749 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1 HTTP/1.1 Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:14.283094 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] Oct 26 05:12:14.285536 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4808ac47-fda9-43b7-a276-501e9b35f1c1'} Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:14.289220 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:12:14.290949 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.292549 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-bdeed77f-f7c7-4bbb-bb23-6361036b8f9a'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d159f68d-7095-4612-8d29-1500d634a818 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1" status: 404 len: 194 microversion: 2.1 time: 0.156764 Oct 26 05:12:14.295847 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1378/2775] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:12:14 2022] GET /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1 => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:14.314387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d602e1c-c819-4e83-85ff-64ea035740a7 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a8daca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:14.442944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:14.458914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88879eeb-d8e8-4911-839e-151f61ce07b7 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1477 microversion: 2.1 time: 0.570163 Oct 26 05:12:14.463397 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1398/2776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:13 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1477 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:14.468705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-91ecb4be-7284-44cd-a61e-da6ca75d4478 req-bf330067-f6bd-40c4-80ae-27129cf25871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-unplugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:14.490020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-91ecb4be-7284-44cd-a61e-da6ca75d4478 req-bf330067-f6bd-40c4-80ae-27129cf25871 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:14.491323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-91ecb4be-7284-44cd-a61e-da6ca75d4478 req-bf330067-f6bd-40c4-80ae-27129cf25871 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:14.491954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-91ecb4be-7284-44cd-a61e-da6ca75d4478 req-bf330067-f6bd-40c4-80ae-27129cf25871 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:14.516201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-91ecb4be-7284-44cd-a61e-da6ca75d4478 req-bf330067-f6bd-40c4-80ae-27129cf25871 service nova] Creating event network-vif-unplugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:12:14.542535 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-91ecb4be-7284-44cd-a61e-da6ca75d4478 req-bf330067-f6bd-40c4-80ae-27129cf25871 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077070 Oct 26 05:12:14.543358 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1399/2777] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:14.554107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:14.555962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:14.574121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:14.574813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:14.580059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:14.580939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:14.584339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:14.585404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:14.918088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:14.934819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bef40654-b98e-4693-9ba9-bf2b9ec34df3 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.390100 Oct 26 05:12:14.935743 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1400/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:14 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:14.944419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b027a69b-069b-489c-bea4-98188d17f8b5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709fbf160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:15.253888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b027a69b-069b-489c-bea4-98188d17f8b5 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.316836 Oct 26 05:12:15.266064 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1401/2779] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:12:14 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:15.275184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:15.275805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:15.291596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:15.292362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:15.292960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:15.298294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:15.298800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:15.299281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:15.612079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:15.630619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a2084ec2-6d94-45e5-b626-a4b933b9757f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.374313 Oct 26 05:12:15.631978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1402/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:15 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:15.642161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:15.643962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:15.667434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:15.668448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:15.669175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:15.670720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:15.671518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:15.672375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:15.918143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:15.921446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:15.930988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-312227d5-b064-449f-a091-bc6e13e7b76c tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.297705 Oct 26 05:12:15.945998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1403/2781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:15 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:15.961515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f53a8645-83c0-4d02-af7b-5fb09ec85efb tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709f78550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-932133513", "description": "tempest-description-447251756"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:16.294090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f53a8645-83c0-4d02-af7b-5fb09ec85efb tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.346361 Oct 26 05:12:16.295271 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1404/2782] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:16.300736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:16.301882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:16.318714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:16.320250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:16.321074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:16.322254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:16.323089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:16.324173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:16.650677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:16.661424 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d99adfe-4bdd-4ac2-b7e3-00265f11d170 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1462 microversion: 2.1 time: 0.364602 Oct 26 05:12:16.690863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1405/2783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:16 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1462 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:16.696808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:16.719483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:16.726669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:16.727831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:16.730234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:16.733042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:16.733776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:16.738308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:16.964225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:16.976126 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d5b0d363-3b95-43a3-9bc6-88af650e67ce tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.283790 Oct 26 05:12:16.977004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1406/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:16 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:16.982235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:16.983068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:16.989806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:16.990966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:16.992405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:16.993378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:16.994011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:16.994605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:17.188733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:17.199957 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b54a601-ac4f-4fda-be9c-0902554c4a44 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.221552 Oct 26 05:12:17.201264 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1407/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:16 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:17.208251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01322e85-fe11-4d0f-9dc6-e64fce2a3ea7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709eea040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1773466269", "description": "tempest-description-1281470997"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:17.471754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01322e85-fe11-4d0f-9dc6-e64fce2a3ea7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.269144 Oct 26 05:12:17.473683 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1408/2786] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:17 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:17.473683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:17.473683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:17.523240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:17.524236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:17.526674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:17.527706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:17.528329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:17.532371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:17.801373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:17.812599 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31c21957-5366-45bc-a3c1-9265e2c3e12b tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.337802 Oct 26 05:12:17.813771 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1409/2787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:17 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:17.819656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:17.822410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:17.835325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:17.836909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:17.837618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:17.838580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:17.839253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:17.839906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:18.002812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ad3fe9c-1a2c-4e32-a500-131adc4b7bb2 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.187594 Oct 26 05:12:18.011850 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1410/2788] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:17 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:18.025225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-18043820-a78a-45a2-ab8a-3ec9b9540123 req-e4cc1a95-7695-4e78-80a1-6d140a51cba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-plugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:18.039692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-18043820-a78a-45a2-ab8a-3ec9b9540123 req-e4cc1a95-7695-4e78-80a1-6d140a51cba1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:18.040186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-18043820-a78a-45a2-ab8a-3ec9b9540123 req-e4cc1a95-7695-4e78-80a1-6d140a51cba1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:18.041193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-18043820-a78a-45a2-ab8a-3ec9b9540123 req-e4cc1a95-7695-4e78-80a1-6d140a51cba1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:18.055295 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-18043820-a78a-45a2-ab8a-3ec9b9540123 req-e4cc1a95-7695-4e78-80a1-6d140a51cba1 service nova] Creating event network-vif-plugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:12:18.060275 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-18043820-a78a-45a2-ab8a-3ec9b9540123 req-e4cc1a95-7695-4e78-80a1-6d140a51cba1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047089 Oct 26 05:12:18.061736 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1411/2789] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:18.320425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1023659446", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:18.676546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d602e1c-c819-4e83-85ff-64ea035740a7 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1421 microversion: 2.1 time: 4.380639 Oct 26 05:12:18.678038 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1379/2790] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:14 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1421 bytes in 4383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:18.689238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-338ae752-dfeb-4bbc-8a6b-6941dc8a903b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:18.692102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-338ae752-dfeb-4bbc-8a6b-6941dc8a903b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: e90e486f-7fc8-4e8c-a1ab-61882de4ba79] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:18.699793 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-338ae752-dfeb-4bbc-8a6b-6941dc8a903b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance e90e486f-7fc8-4e8c-a1ab-61882de4ba79 could not be found. Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-338ae752-dfeb-4bbc-8a6b-6941dc8a903b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/e90e486f-7fc8-4e8c-a1ab-61882de4ba79/action HTTP/1.1 Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 15 Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:18.701533 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: {"unpause": {}} Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:18.704472 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e90e486f-7fc8-4e8c-a1ab-61882de4ba79 could not be found. Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e90e486f-7fc8-4e8c-a1ab-61882de4ba79', 'body': {'unpause': {}}} Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e90e486f-7fc8-4e8c-a1ab-61882de4ba79 could not be found. Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:18.705916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e90e486f-7fc8-4e8c-a1ab-61882de4ba79 could not be found. Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e90e486f-7fc8-4e8c-a1ab-61882de4ba79 could not be found. Oct 26 05:12:18.707449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:18.712939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-338ae752-dfeb-4bbc-8a6b-6941dc8a903b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance e90e486f-7fc8-4e8c-a1ab-61882de4ba79 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:18.713999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-338ae752-dfeb-4bbc-8a6b-6941dc8a903b tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/e90e486f-7fc8-4e8c-a1ab-61882de4ba79/action" status: 404 len: 111 microversion: 2.1 time: 0.033608 Oct 26 05:12:18.715322 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1380/2791] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:18 2022] POST /compute/v2.1/servers/e90e486f-7fc8-4e8c-a1ab-61882de4ba79/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:18.722072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-785078555", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "e7452117-582b-4407-b78c-25682aebccf5"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:18.804471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:12:18.830108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] validate_networks() for [('e7452117-582b-4407-b78c-25682aebccf5', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:12:19.631107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:12:19.636931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:12:19.638735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:12:19.640536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:12:19.641683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:12:19.651989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.652484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.653210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.653703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.654181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.654943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.677470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:12:19.689986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:12:19.690504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:12:19.690866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:12:19.691460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:12:19.692042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:12:19.696457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:12:19.703026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.703741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.704356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.705346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.706144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.706754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.712974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:12:19.715434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:12:19.731142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Getting quotas for project 40bfda33e8334078bdae14fdfed8320f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:12:19.740437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Getting quotas for user c296433625e849448fc3bb355334421d and project 40bfda33e8334078bdae14fdfed8320f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:12:19.758374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:12:19.769829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:12:19.777357 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f94f73b-474d-4e86-8e98-f866df91b1bf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713877 Oct 26 05:12:19.778274 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1412/2792] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:12:19.782910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:19.783714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:19.791697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.792704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.793343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.794615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.795319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.795911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.863972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4003efc4-60b6-4d9a-8674-cf63d2463524 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147290 Oct 26 05:12:19.879235 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1381/2793] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:12:19.887836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:19.888511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:19.906290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.906790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.907238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.908025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.908668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.909275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.939905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:19.993695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:19.994632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:19.995235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:19.995992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lazy-loading 'fault' on Instance uuid 8b22c173-3089-46c5-91c6-2bac95ac7cf7 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:12:20.157086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:20.173443 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b19f4fde-e5fb-46f3-a8ca-27430cd6acc0 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.393502 Oct 26 05:12:20.189354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1413/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:19 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:20.195245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:20.198898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:20.216884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.219345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.220052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.221186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.223262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.225796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.375777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-62ba3456-97da-496d-b080-0a15c18ec989 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1596 microversion: 2.1 time: 0.495351 Oct 26 05:12:20.382452 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1382/2795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:19 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1596 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:20.387725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:20.390916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:20.399773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.400189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.400884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.411023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.416657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.417896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.706500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:20.731737 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ac3d718-8ee8-49d9-86ba-178d3492b49e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.550368 Oct 26 05:12:20.732579 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1414/2796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:20 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:20.771263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-61e590e0-96f2-4d12-ba8a-aa21fa787a6d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709ee3280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:20.864028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:20.874172 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1bc505b-d1d1-4fc2-9f30-b81e83d420e2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.490253 Oct 26 05:12:20.874937 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1383/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:20 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:20.879932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:20.880867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:20.895896 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-61e590e0-96f2-4d12-ba8a-aa21fa787a6d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1430 microversion: 2.1 time: 0.134351 Oct 26 05:12:20.897629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1415/2798] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:20 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1430 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:20.903433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:20.904931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:20.911241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.912793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.913708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.913978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.914359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.914786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.915619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.916459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:20.917301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.917619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:20.918216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.919265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:20.988685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:20.999429 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc6c85d8-704f-4669-98a8-b46b5180947f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1219 microversion: 2.1 time: 0.100377 Oct 26 05:12:21.013943 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1416/2799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:20 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.021227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-73de8125-57ef-416f-9999-eb05dc44940e req-61c1e4c9-0746-405f-a8a2-b3cf2ec80d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f397d6-655f-419e-bf0c-ee1e69cc8321", "name": "network-vif-plugged", "status": "completed", "tag": "07b2594b-ca56-427c-b400-a762819750c6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:21.032142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73de8125-57ef-416f-9999-eb05dc44940e req-61c1e4c9-0746-405f-a8a2-b3cf2ec80d0c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.032976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73de8125-57ef-416f-9999-eb05dc44940e req-61c1e4c9-0746-405f-a8a2-b3cf2ec80d0c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.033654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73de8125-57ef-416f-9999-eb05dc44940e req-61c1e4c9-0746-405f-a8a2-b3cf2ec80d0c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.041025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:21.048407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-73de8125-57ef-416f-9999-eb05dc44940e req-61c1e4c9-0746-405f-a8a2-b3cf2ec80d0c service nova] Creating event network-vif-plugged:07b2594b-ca56-427c-b400-a762819750c6 for instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 on n-h1-862416-4 Oct 26 05:12:21.054416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67654e2a-7645-4916-a6f1-cf3e18e406c7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1211 microversion: 2.1 time: 0.177343 Oct 26 05:12:21.054708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-73de8125-57ef-416f-9999-eb05dc44940e req-61c1e4c9-0746-405f-a8a2-b3cf2ec80d0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038501 Oct 26 05:12:21.055440 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1417/2800] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:21.064868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:21.067642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.071050 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1384/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:20 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1211 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.075928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.077092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.077249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.078122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.079070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.079754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.080584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.091905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.098304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.098998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.099603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.100525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.101138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.101742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.248776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-108e029f-b050-4d0f-b4b0-a19b34fab63e tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.187997 Oct 26 05:12:21.250701 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1418/2802] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:21 2022] POST /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:21.262090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc813b56-9073-4f4f-b679-e8b347a86c59 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f41160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.337354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc813b56-9073-4f4f-b679-e8b347a86c59 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 200 len: 1430 microversion: 2.1 time: 0.081470 Oct 26 05:12:21.338330 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1419/2803] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:21 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 1430 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.343055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.343680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.361584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.362104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.362556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.363295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.363766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.364199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.421514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:21.430953 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e7f99fdd-18e9-4c34-a4a8-514bc95039b5 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.358536 Oct 26 05:12:21.432258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1385/2804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:21 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.437187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.437826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.445175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.446111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.446823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.447895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.448350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.448789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.652112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:21.676636 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2b59f59b-8e30-4665-af4e-897d47392a8c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.335643 Oct 26 05:12:21.679163 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1420/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:21 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.695453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.696444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.709188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.718446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.721201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.723197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.723992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.726324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.729783 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94af3b00-6639-4c6e-be70-8a624c9cc3d9 tempest-ServersAdminTestJSON-1941330228 tempest-ServersAdminTestJSON-1941330228-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1613 microversion: 2.1 time: 0.290412 Oct 26 05:12:21.732201 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1386/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:21 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1613 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.744681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:21.745495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.752595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.753380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.754029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.755317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.756214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.756861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.832095 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'unpause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 15 Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:21.845986 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: {"unpause": {}} Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:21.847387 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'unpause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'unpause': {}}} Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state active. Cannot unpause while the instance is in this state. Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:21.848209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:21.849717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:21.851694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'unpause' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:21.851694 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-110a08fd-4196-4361-84ba-8d93f278c524 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 145 microversion: 2.1 time: 0.118127 Oct 26 05:12:21.852120 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1387/2807] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:21 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 145 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:12:21.859701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.860266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.870312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.870954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.871348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.872188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.872654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.873086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.909553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:12:21.938850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:21.947940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c640e52f-4ff6-4da8-b065-7e4e8b24c200 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1466 microversion: 2.1 time: 0.266784 Oct 26 05:12:21.948873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1421/2808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:21 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:21.954204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:21.955221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:21.962633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.963603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.964292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:21.965247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:21.965948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:21.966572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.038830 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-195d036f-cebe-4760-916f-1ccd90d7da2a tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 204 len: 0 microversion: 2.1 time: 0.185009 Oct 26 05:12:22.039690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1388/2809] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:21 2022] DELETE /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:12:22.045112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.046123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:22.052700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.053536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.054204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.054928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.055389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.055825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.205883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:22.224406 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b88e95bc-9c82-4b25-aca6-7da95303b390 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.274129 Oct 26 05:12:22.225722 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1422/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:21 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:22.233272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d47b9abe-0163-429e-a4a5-e598e9f6e4c4 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470b0b5040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.259850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:22.268091 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f51e353-54d5-49d3-b2d2-eb34bf87e500 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1198 microversion: 2.1 time: 0.227226 Oct 26 05:12:22.269225 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1389/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1198 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:22.275325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.275938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:22.283134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.283886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.284966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.286104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.286471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.286887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.302520 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d47b9abe-0163-429e-a4a5-e598e9f6e4c4 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/d596d51f-4bb2-4340-8449-72226e2537e8" status: 200 len: 784 microversion: 2.1 time: 0.075479 Oct 26 05:12:22.304166 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1423/2812] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/images/d596d51f-4bb2-4340-8449-72226e2537e8 => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:22.318303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.319773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:22.326807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.327390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.327905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.328675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.329206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.329746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.351487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:22.373417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:22.383362 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ba40176-b6dc-4113-bfc6-000a6b259f11 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1211 microversion: 2.1 time: 0.112555 Oct 26 05:12:22.393353 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1390/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:22.393353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.393353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:22.401915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.401915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.401915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.401915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.402570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.403166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.498418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:22.509882 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b87437c5-7e9f-4524-8664-117756d1a460 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1267 microversion: 2.1 time: 0.123471 Oct 26 05:12:22.512330 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1391/2814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:22.521424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.524180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:22.537030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.538087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.542735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.543663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.544418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.545006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.546973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:22.560755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb9c2e98-90e0-46e9-b617-3c6e66446eb2 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1469 microversion: 2.1 time: 0.245956 Oct 26 05:12:22.579337 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1424/2815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:22.584238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bf70444e-0851-4e9b-8b83-8b7aa0603967 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.621683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bf70444e-0851-4e9b-8b83-8b7aa0603967 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040917 Oct 26 05:12:22.629734 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1425/2816] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:22.637271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75db4ba4-d606-4828-a0c8-77eb58bb4fa7 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f2aa60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.646008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:22.764246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:22.778659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec13cab0-10b4-47b1-8278-098a4c130a49 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.264628 Oct 26 05:12:22.779237 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1392/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:22.784887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:22.785865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:22.797021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.797645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.798144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.799073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:22.799683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:22.800297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:22.996837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:23.006935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d00412e7-7403-4bcf-89ba-9f0433c8e118 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.225922 Oct 26 05:12:23.008213 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1393/2818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:23.013065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d13b747-0368-49f5-968b-6c9e86392c87 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:23.013698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6d13b747-0368-49f5-968b-6c9e86392c87 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 3cdf059a-16b3-405b-abe5-50aebdc3be9d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.019531 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-6d13b747-0368-49f5-968b-6c9e86392c87 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 3cdf059a-16b3-405b-abe5-50aebdc3be9d could not be found. Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d13b747-0368-49f5-968b-6c9e86392c87 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/3cdf059a-16b3-405b-abe5-50aebdc3be9d/action HTTP/1.1 Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 18 Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:23.022815 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: {"unshelve": null} Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 3cdf059a-16b3-405b-abe5-50aebdc3be9d could not be found. Oct 26 05:12:23.025031 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3cdf059a-16b3-405b-abe5-50aebdc3be9d', 'body': {'unshelve': None}} Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdf059a-16b3-405b-abe5-50aebdc3be9d could not be found. Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:23.026219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdf059a-16b3-405b-abe5-50aebdc3be9d could not be found. Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdf059a-16b3-405b-abe5-50aebdc3be9d could not be found. Oct 26 05:12:23.027814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.030105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d13b747-0368-49f5-968b-6c9e86392c87 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 3cdf059a-16b3-405b-abe5-50aebdc3be9d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:23.030973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d13b747-0368-49f5-968b-6c9e86392c87 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/3cdf059a-16b3-405b-abe5-50aebdc3be9d/action" status: 404 len: 111 microversion: 2.1 time: 0.021605 Oct 26 05:12:23.031550 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1394/2819] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:23 2022] POST /compute/v2.1/servers/3cdf059a-16b3-405b-abe5-50aebdc3be9d/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:23.040886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.042318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.053559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.054209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.054640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.055423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.056075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.056499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.218547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:23.229566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4adcd4a-e463-4a06-8c75-18bcf4e1d6e9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.192841 Oct 26 05:12:23.230549 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1395/2820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:23.261635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.262620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.268952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.269539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.270245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.271160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.272005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.272665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.287824 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75db4ba4-d606-4828-a0c8-77eb58bb4fa7 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "DELETE /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 204 len: 0 microversion: 2.1 time: 0.654744 Oct 26 05:12:23.289172 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1426/2821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:22 2022] DELETE /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:12:23.298028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.298683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.319596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.320337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.321336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.323912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.324992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.326813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.519800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:23.536932 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-352a92e7-21d1-4d65-b42d-29fd8d7340c9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.274127 Oct 26 05:12:23.549335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1396/2822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:23.549335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8b82e27-160f-46d0-8911-b77d45144f39 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a001ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.549752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:23.560059 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-819ff5b7-d308-4c2c-811f-29a9223d828f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1382 microversion: 2.1 time: 0.265378 Oct 26 05:12:23.560822 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1427/2823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1382 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:23.565599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.566233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.573546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.573987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.574428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.575344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.576095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.576685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.577716 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e8b82e27-160f-46d0-8911-b77d45144f39 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] HTTP exception thrown: Image not found. Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8b82e27-160f-46d0-8911-b77d45144f39 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Request method failure captured: Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e HTTP/1.1 Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMF0iDspzDX_VLhJPIuvURpyEaRyTrQUxw5d8-rX6Y6EwpjH3415NPwzGLUJ_ePd7OXApT3nGag-uXA19anpGgT07urZC4P5IEKzee5XrYTY3Nj3Uqxb06VT8NQsLR7vOLhAFZ6zZl6YZoURirny3ythD425A12wOs0-5Gd3HOEnXDY Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5471bab47d5b41c79aa90a93547be446 Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:23.580339 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5471bab47d5b41c79aa90a93547be446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5471bab47d5b41c79aa90a93547be446 Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerTestJSON-534054076-project Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f1c51212204f4654b320552298e77c3b Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerTestJSON-534054076-project Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: exception: Image not found. Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '779e291f-6040-45b9-8cba-d09158376c8e'} Oct 26 05:12:23.581980 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:12:23.582832 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 779e291f-6040-45b9-8cba-d09158376c8e Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:12:23.585131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 779e291f-6040-45b9-8cba-d09158376c8e could not be found. Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:12:23.587242 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8b82e27-160f-46d0-8911-b77d45144f39 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Returning 404 to user: Image not found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:23.589451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8b82e27-160f-46d0-8911-b77d45144f39 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 404 len: 62 microversion: 2.1 time: 0.041846 Oct 26 05:12:23.593131 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1397/2824] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:12:23.594739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.595370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.597491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:23.605250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.606327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.611340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.612328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.613119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.613770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.665851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:23.673853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3e50e6a8-04a4-48d3-98e7-441738c6a8f9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1211 microversion: 2.1 time: 0.111858 Oct 26 05:12:23.674739 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1428/2825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:23.683080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:23.683974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.690959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.691701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.692341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.693271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.694078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.694711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.716066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:23.723444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Cannot 'unshelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:23.726514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b1983b1-6471-4256-af19-12579bcdf806 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1267 microversion: 2.1 time: 0.137319 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action HTTP/1.1 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 18 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:12:23.726911 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: {"unshelve": null} Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:12:23.728325 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'unshelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'unshelve': None}} Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 in vm_state active. Cannot unshelve while the instance is in this state. Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:23.729178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:23.730974 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:23.732131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active Oct 26 05:12:23.732131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:23.732131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 409 to user: Cannot 'unshelve' instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 while it is in vm_state active {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:23.732131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5328508e-62bd-4873-84f9-eda7a4b79f75 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action" status: 409 len: 146 microversion: 2.1 time: 0.050443 Oct 26 05:12:23.732131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1429/2826] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:23 2022] POST /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053/action => generated 146 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:12:23.742510 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1398/2827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:23.753989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1590454579"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:23.756586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.763861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.764382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.764830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.765857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.766127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.766590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.797162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:23.941392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:23.942010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:23.950271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.950846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.951476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:23.952298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:23.952879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:23.953371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.169734 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0536ba20-ad97-4448-9c5a-651ef48efe33 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "POST /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44/action" status: 202 len: 0 microversion: 2.1 time: 0.417336 Oct 26 05:12:24.170421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1399/2828] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:23 2022] POST /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:12:24.179975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:24.180763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:24.193507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.195021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.197663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.198372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.198851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.199290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.219205 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d812ae7-6534-4352-895b-90047814cb8f tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1533 microversion: 2.1 time: 0.487884 Oct 26 05:12:24.219797 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1430/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:23 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1533 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:24.233616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:24.234325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:24.249740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.250321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.251909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.253255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.256133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.257401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.629498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:24.639016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bfe646a2-2742-4bea-8671-e2b33dc42772 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1469 microversion: 2.1 time: 0.467136 Oct 26 05:12:24.643780 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1400/2830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:24 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:24.648609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:24.654436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:24.665894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.666418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.666873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.667886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.668355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.668798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.700593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:24.737800 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d57aeaaf-747a-41e8-8c1b-7892dea04d8e tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.499066 Oct 26 05:12:24.737800 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1431/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:24 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:24.747946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65f833aa-c795-402a-9aeb-b1dfa4a56547 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709ee34c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:24.864920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65f833aa-c795-402a-9aeb-b1dfa4a56547 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.135280 Oct 26 05:12:24.865386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1432/2832] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:24 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:24.897607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:24.900585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:24.913834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:24.916762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.918784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.919302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.921298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.922128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.922682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4ed2144-253a-4ded-9a2d-71118318014c tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1523 microversion: 2.1 time: 0.277816 Oct 26 05:12:24.923267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1401/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:24 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:24.923409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.929522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:24.930398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:24.939058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.939857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.940526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:24.941486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:24.942139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:24.942763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.019681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:25.033935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39a74794-f293-4ce0-b1d0-3c03d2b3eccd tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1267 microversion: 2.1 time: 0.109062 Oct 26 05:12:25.052540 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1402/2834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:24 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:25.056296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:25.056918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:25.075152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.075963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.076494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.077528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.078637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.079132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.190994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:25.202183 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e1291780-52d0-41ba-a419-aec0e196e1f7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1273 microversion: 2.1 time: 0.156909 Oct 26 05:12:25.213335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1403/2835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:25 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:25.213335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:25.213335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:25.235081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.235438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.235792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.236521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.236981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.237436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.315500 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b8645f6-9342-4597-8ccd-d0ea7fbd5cfc tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1533 microversion: 2.1 time: 0.429133 Oct 26 05:12:25.316081 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1433/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:24 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1533 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:25.327363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9f98ad2b-b86e-48e2-81a0-a214b28bd0a0 req-f6a3f5ec-a6e4-4d14-a45b-5b1648be15ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "name": "network-vif-unplugged", "status": "completed", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:25.361346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9f98ad2b-b86e-48e2-81a0-a214b28bd0a0 req-f6a3f5ec-a6e4-4d14-a45b-5b1648be15ce service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.364464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9f98ad2b-b86e-48e2-81a0-a214b28bd0a0 req-f6a3f5ec-a6e4-4d14-a45b-5b1648be15ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.365393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9f98ad2b-b86e-48e2-81a0-a214b28bd0a0 req-f6a3f5ec-a6e4-4d14-a45b-5b1648be15ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.383617 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9f98ad2b-b86e-48e2-81a0-a214b28bd0a0 req-f6a3f5ec-a6e4-4d14-a45b-5b1648be15ce service nova] Creating event network-vif-unplugged:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:12:25.398387 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9f98ad2b-b86e-48e2-81a0-a214b28bd0a0 req-f6a3f5ec-a6e4-4d14-a45b-5b1648be15ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078338 Oct 26 05:12:25.406840 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1434/2837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:25.420581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:25.429052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.432446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.433077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.434141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.434866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.435541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.487172 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-14abca79-5c30-43c5-8b40-622161796751 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.078639 Oct 26 05:12:25.490451 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1435/2838] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:12:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:25.505692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": false, "disk_over_commit": false}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:25.508624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:25.515568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.516075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.517765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.519114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.519893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.521283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.543781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:25.554962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a530564-9636-4c82-bb9d-9ff242c0cdf9 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.350622 Oct 26 05:12:25.555848 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1404/2839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:25 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:25.563971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lazy-loading 'flavor' on Instance uuid c1f397d6-655f-419e-bf0c-ee1e69cc8321 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:12:25.579877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Going to try to live migrate instance to n-h2-862416-4 {{(pid=120586) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:12:25.580504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c6ad32d-efab-43ad-812c-40714eb511fb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063162393_updated"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:25.585203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c6ad32d-efab-43ad-812c-40714eb511fb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 63b44a46-b727-4ca2-9938-97e047abc670] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:25.597325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0c6ad32d-efab-43ad-812c-40714eb511fb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 63b44a46-b727-4ca2-9938-97e047abc670 could not be found. Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c6ad32d-efab-43ad-812c-40714eb511fb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/servers/63b44a46-b727-4ca2-9938-97e047abc670 HTTP/1.1 Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 81 Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:25.601236 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063162393_updated"}} Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:25.604834 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 63b44a46-b727-4ca2-9938-97e047abc670 could not be found. Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '63b44a46-b727-4ca2-9938-97e047abc670', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2063162393_updated'}}} Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b44a46-b727-4ca2-9938-97e047abc670 could not be found. Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:25.605988 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b44a46-b727-4ca2-9938-97e047abc670 could not be found. Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:25.607458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:25.611865 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:25.611865 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:25.611865 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b44a46-b727-4ca2-9938-97e047abc670 could not be found. Oct 26 05:12:25.611865 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:25.611865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c6ad32d-efab-43ad-812c-40714eb511fb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 63b44a46-b727-4ca2-9938-97e047abc670 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:25.612885 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c6ad32d-efab-43ad-812c-40714eb511fb tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "PUT /compute/v2.1/servers/63b44a46-b727-4ca2-9938-97e047abc670" status: 404 len: 111 microversion: 2.1 time: 0.037774 Oct 26 05:12:25.617454 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1405/2840] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:12:25 2022] PUT /compute/v2.1/servers/63b44a46-b727-4ca2-9938-97e047abc670 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:25.625968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:25.628842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:25.642924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.648074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.648742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.649645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.650240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.651911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.869280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:25.896276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19cbd26e-20ab-4f50-b02a-557731410830 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.273737 Oct 26 05:12:25.900806 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1406/2841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:25 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:12:25.905697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:25.906313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:25.932940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.933970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.935616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:25.937301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:25.938964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:25.939418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:26.093004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:26.136347 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a6c52e90-71dd-4578-b116-54f18dd084e5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 200 len: 1427 microversion: 2.1 time: 0.234314 Oct 26 05:12:26.166744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1407/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:25 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 1427 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:26.188664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-924abcd1-1b4e-4cc1-a146-472c7c963c7e tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a1ade50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:26.316469 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-924abcd1-1b4e-4cc1-a146-472c7c963c7e tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.135193 Oct 26 05:12:26.326085 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1408/2843] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:26 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:26.349823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:26.354945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:26.391107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:26.393719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:26.394217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:26.394983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:26.395445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:26.403911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:26.771803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:26.784016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21c7d711-2936-4dd2-9620-8adcd25ac4aa tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.455784 Oct 26 05:12:26.784634 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1409/2844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:26 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:26.824062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:26.824941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:26.838981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:26.841015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:26.841646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:26.842528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:26.843137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:26.843721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:27.008380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:27.020498 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b2aa039c-4978-4a26-b73b-4a2baa9bf3bd tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1503 microversion: 2.1 time: 0.205341 Oct 26 05:12:27.024038 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1410/2845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:26 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:27.030346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:27.031719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:27.039019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:27.040218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:27.041040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:27.042417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:27.043020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:27.044655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:27.480183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:27.494623 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-133c3189-e4d4-489d-a526-a713c059d356 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.469144 Oct 26 05:12:27.495770 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1411/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:27 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:27.597378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e9f4e0ed-8a92-4af7-84e5-539ce79cdcd7 req-a542ecc2-3c9c-4e39-af35-4cc6b67afede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8934c2-5330-401c-a60c-782e427a7966", "name": "network-vif-deleted", "tag": "a976d88b-74aa-4aa1-b413-41ada8fb3dae"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:27.612045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e9f4e0ed-8a92-4af7-84e5-539ce79cdcd7 req-a542ecc2-3c9c-4e39-af35-4cc6b67afede service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:27.613254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e9f4e0ed-8a92-4af7-84e5-539ce79cdcd7 req-a542ecc2-3c9c-4e39-af35-4cc6b67afede service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:27.613955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e9f4e0ed-8a92-4af7-84e5-539ce79cdcd7 req-a542ecc2-3c9c-4e39-af35-4cc6b67afede service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:27.630259 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e9f4e0ed-8a92-4af7-84e5-539ce79cdcd7 req-a542ecc2-3c9c-4e39-af35-4cc6b67afede service nova] Creating event network-vif-deleted:a976d88b-74aa-4aa1-b413-41ada8fb3dae for instance 5c8934c2-5330-401c-a60c-782e427a7966 on n-h1-862416-4 Oct 26 05:12:27.639369 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e9f4e0ed-8a92-4af7-84e5-539ce79cdcd7 req-a542ecc2-3c9c-4e39-af35-4cc6b67afede service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141889 Oct 26 05:12:27.640457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1412/2847] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:27.650297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:27.651925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:27.658685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:27.659610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:27.660277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:27.661209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:27.661955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:27.663148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:27.954775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:27.964286 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3bbbfa7-8308-4b3c-bc95-90301afff01e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.321753 Oct 26 05:12:27.980818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1413/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:27 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:27.986276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-944c37b6-bcf3-44aa-a84b-fdec97bf3a4f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-944c37b6-bcf3-44aa-a84b-fdec97bf3a4f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: request: PUT /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 HTTP/1.1 Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 280 Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:27.990770 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:12:27.992219 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:12:27.992932 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:12:27.993623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:12:27.994878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:12:27.995710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 26 05:12:27.995710 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:27.998803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-944c37b6-bcf3-44aa-a84b-fdec97bf3a4f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:27.999780 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-944c37b6-bcf3-44aa-a84b-fdec97bf3a4f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "PUT /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 400 len: 619 microversion: 2.1 time: 0.017653 Oct 26 05:12:28.000416 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1414/2849] 10.222.0.16 () {60 vars in 1257 bytes} [Wed Oct 26 05:12:27 2022] PUT /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:12:28.005720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d301413-2770-4777-936b-5892bc4e3c01 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'create', calling method: .version_select at 0x7f470ea58310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-142872832", "description": "tempest-description-1065983454"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:28.011107 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a7b240ea-42c4-43d4-95b0-9bd035df5e4c tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321/action" status: 202 len: 0 microversion: 2.1 time: 2.512190 Oct 26 05:12:28.012323 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1436/2850] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:25 2022] POST /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321/action => generated 0 bytes in 2514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:28.032579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:28.039455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 5c8934c2-5330-401c-a60c-782e427a7966] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:28.064166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.067354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.067888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.071757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.072978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.074527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.125741 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] HTTP exception thrown: Instance 5c8934c2-5330-401c-a60c-782e427a7966 could not be found. Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Request method failure captured: Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 HTTP/1.1 Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEqLDV3xPskGT5azwtZfWxwWrkVcuaCaz620i8p9reVyuW7MDkN-Ukjj_bf8rR19qi403nFv1kwVq1C977uwG4PwWjhaFukna8P7LCx4ZSIwOwUWgKzzzd4iZPzFwvTGpx1AN7KeAUs_I6DNdMrVrxKW1MP5Qajrx9qW08sCIEPYoc Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 454a8c023fbb41749f8046a3bd1f6fbf Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:12:28.136573 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 454a8c023fbb41749f8046a3bd1f6fbf Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdminTestJSON-405455832-project Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 0984efbdfee347d8b72d1a5f089fdd6f Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdminTestJSON-405455832-project Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 5c8934c2-5330-401c-a60c-782e427a7966 could not be found. Oct 26 05:12:28.138127 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '5c8934c2-5330-401c-a60c-782e427a7966'} Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8934c2-5330-401c-a60c-782e427a7966 could not be found. Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:28.138947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8934c2-5330-401c-a60c-782e427a7966 could not be found. Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8934c2-5330-401c-a60c-782e427a7966 could not be found. Oct 26 05:12:28.140159 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:28.143815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Returning 404 to user: Instance 5c8934c2-5330-401c-a60c-782e427a7966 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:28.145600 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a5c4112-24dd-45ef-b2cf-82ed3f8b5df9 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966" status: 404 len: 111 microversion: 2.1 time: 0.132246 Oct 26 05:12:28.147572 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1437/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:28 2022] GET /compute/v2.1/servers/5c8934c2-5330-401c-a60c-782e427a7966 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:28.154887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f572297-2a69-44ec-b16e-447ef7539709 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709e6e0d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:28.255116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f572297-2a69-44ec-b16e-447ef7539709 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.105767 Oct 26 05:12:28.255934 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1438/2852] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:28 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:28.263440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:28.264311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:28.271730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.272913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.273798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.274737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.275442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.276212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.315142 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d301413-2770-4777-936b-5892bc4e3c01 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.313156 Oct 26 05:12:28.317349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1415/2853] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:12:28 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:28.321652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:28.324090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:28.330322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.331320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.332022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.332923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.333590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.334292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.924901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:28.938425 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e951689a-19a7-4958-b8b8-b534d42c5cef tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.679743 Oct 26 05:12:28.939589 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1439/2854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:28 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:28.946277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:28.949944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:28.953621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:28.963475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa8c094f-c23c-4a3f-827b-79aeae13445a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.646363 Oct 26 05:12:28.965367 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1416/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:28 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:28.970960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.971720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.972318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.973212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.973853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.974442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.988443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-142872832"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:28.989003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:28.997601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:28.998081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:28.998735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:28.999736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.000356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.000951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.004634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:12:29.128255 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2f4603c-bf7f-4c43-aa80-6e417040886d tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 204 len: 0 microversion: 2.1 time: 0.185968 Oct 26 05:12:29.130058 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1440/2856] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:28 2022] DELETE /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:12:29.137608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:29.138633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:29.147904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.148865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.149535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.150497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.151378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.152078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.204061 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Adding security group fb3252e1-eedb-49ec-957c-16d3db2e89a3 to port 10822a10-e2b6-4523-a741-69670cc77e9a Oct 26 05:12:29.431046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:29.460678 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e7d47d8-61c6-4f0c-899a-9514398ab62a tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.328985 Oct 26 05:12:29.461877 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1441/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:29 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:29.467585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:29.468606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:29.476614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.477338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.477941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.479048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.479672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.480290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.707887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:29.719815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:29.737172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:29.745418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a6879d5-2255-497c-97af-432a1b8d7406 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.282295 Oct 26 05:12:29.749776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:29.752740 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1442/2858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:29 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:29.760456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:29.761079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:29.778213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.779968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.780561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.781699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.782758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.784146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.815008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf620a98-e2e2-4af7-9d78-0bcc423fee08 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action" status: 202 len: 0 microversion: 2.1 time: 0.840351 Oct 26 05:12:29.816470 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1417/2859] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:28 2022] POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:29.823761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:29.825022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:29.841851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.843561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.844298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:29.845271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:29.846119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:29.846772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.118009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:30.120333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:30.129057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e2fbf0d-85b6-4c1c-aa89-f5b4364add0b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.374969 Oct 26 05:12:30.134626 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1443/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:29 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:30.154561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30b44112-4f17-47af-b13b-2201443f1e2d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709e6ef70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:30.196676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:30.205008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09a9741b-c43a-4850-b243-6d0f93051740 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1470 microversion: 2.1 time: 0.387196 Oct 26 05:12:30.211072 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1418/2861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:29 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1470 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:30.215758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a4edf8-969f-4a82-be7a-6c76cfa8d8a7", "tag": "01edd8bb-c764-4022-b525-16ef70eb6862"}, {"name": "network-changed", "server_uuid": "558a1c7e-d245-4c4d-9d76-6a1f8313557e", "tag": "00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:30.244281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.245074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.245723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.247332 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30b44112-4f17-47af-b13b-2201443f1e2d tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.096529 Oct 26 05:12:30.250959 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1444/2862] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:30 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:30.258254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a2fa0ab-181e-4e28-906a-0702a4d04915 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a2fa0ab-181e-4e28-906a-0702a4d04915 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 HTTP/1.1 Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 24 Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:12:30.267263 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": ""}} Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:12:30.268719 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053', 'body': {'server': {'name': ''}}} Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi '' Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:30.269584 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:12:30.271018 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:12:30.274298 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:30.276630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a2fa0ab-181e-4e28-906a-0702a4d04915 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:30.277809 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a2fa0ab-181e-4e28-906a-0702a4d04915 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "PUT /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 400 len: 108 microversion: 2.1 time: 0.024753 Oct 26 05:12:30.279055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1445/2863] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:12:30 2022] PUT /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:12:30.288656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-142872832"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:30.290162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:30.294959 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] Creating event network-changed:01edd8bb-c764-4022-b525-16ef70eb6862 for instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 on n-h1-862416-4 Oct 26 05:12:30.299004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.302523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.302523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.302990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.303694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.304218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.306224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] Creating event network-changed:00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d for instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e on n-h1-862416-4 Oct 26 05:12:30.321746 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b22c6cb8-f128-450d-b4ff-f09dc8064344 req-68a97a9d-1991-4131-b597-013d0ba95050 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109332 Oct 26 05:12:30.332323 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1419/2864] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:30.342595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-14123e2b-67ec-4207-8444-1266192a6ea2 req-978c678b-ace1-44df-ae2e-3ec531c24680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:30.370496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-14123e2b-67ec-4207-8444-1266192a6ea2 req-978c678b-ace1-44df-ae2e-3ec531c24680 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.370993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-14123e2b-67ec-4207-8444-1266192a6ea2 req-978c678b-ace1-44df-ae2e-3ec531c24680 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.371435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-14123e2b-67ec-4207-8444-1266192a6ea2 req-978c678b-ace1-44df-ae2e-3ec531c24680 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.401248 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-14123e2b-67ec-4207-8444-1266192a6ea2 req-978c678b-ace1-44df-ae2e-3ec531c24680 service nova] Creating event network-changed:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:12:30.414929 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-14123e2b-67ec-4207-8444-1266192a6ea2 req-978c678b-ace1-44df-ae2e-3ec531c24680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081039 Oct 26 05:12:30.415903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1420/2865] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:30.421932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:30.422650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:30.438838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.439337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.439996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.440876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.447930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.448564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.451959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:30.532550 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.network.security_group_api [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Removing security group fb3252e1-eedb-49ec-957c-16d3db2e89a3 from port 10822a10-e2b6-4523-a741-69670cc77e9a Oct 26 05:12:30.877785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:30.899041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89dcb9b1-65dd-43c3-9e50-57e4e7db5788 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.481652 Oct 26 05:12:30.901416 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1421/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:30 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:30.906365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:30.928995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:30.936475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.940171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.945163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:30.946029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:30.946510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:30.946952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.241460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:31.259677 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b40fe6a5-13a2-4837-94fc-05b371f08e71 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1506 microversion: 2.1 time: 0.352744 Oct 26 05:12:31.262603 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1422/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:30 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:31.274633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:31.278252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:31.307975 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a15bee9-7b19-47f7-b62f-386c576231b1 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action" status: 202 len: 0 microversion: 2.1 time: 1.027530 Oct 26 05:12:31.308679 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1446/2868] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:30 2022] POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:31.315366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:31.315986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:31.318694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:31.320313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:31.320988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.324455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:31.326330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:31.327017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.327203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:31.341853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:31.342380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.343134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:31.343604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:31.344029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.736922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:31.747088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e458181a-9b70-4682-b70a-7821b700ed5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.436910 Oct 26 05:12:31.750508 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1447/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:31 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:31.757998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:31.759126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:31.785535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:31.786511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:31.787252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.788834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:31.791558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:31.792940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:31.819251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:31.832808 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-640271c6-d8dd-4dfb-adbc-ba0b064ffcd0 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.564603 Oct 26 05:12:31.833785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1423/2870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:31 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:31.846474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf333558-a729-42c7-942b-505bd1beb71f tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a976670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:31.963989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf333558-a729-42c7-942b-505bd1beb71f tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.127232 Oct 26 05:12:31.965409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1424/2871] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:31 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:31.984201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27d7c79c-7899-49e4-8228-7fa86b2a02d4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'create', calling method: .version_select at 0x7f470a1ad0d0>, body: {"pool": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:32.267074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:32.275595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-555f4f9e-cb01-40b2-9078-c57d612c646b tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1470 microversion: 2.1 time: 0.523492 Oct 26 05:12:32.286107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1448/2872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:31 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:32.302804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:32.307864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:32.317380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:32.321231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:32.321797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:32.322558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:32.323047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:32.323490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:33.228871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:33.243691 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22155975-0bbb-4b76-809c-9174f7feec39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.957324 Oct 26 05:12:33.258195 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1449/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:32 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:33.273662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0324b03a-96a5-4009-a811-a277c2e5c1fa req-e6d036ae-1ad9-495d-998a-89008f7d3926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:33.306999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0324b03a-96a5-4009-a811-a277c2e5c1fa req-e6d036ae-1ad9-495d-998a-89008f7d3926 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:33.307675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0324b03a-96a5-4009-a811-a277c2e5c1fa req-e6d036ae-1ad9-495d-998a-89008f7d3926 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:33.310285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0324b03a-96a5-4009-a811-a277c2e5c1fa req-e6d036ae-1ad9-495d-998a-89008f7d3926 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:33.333591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0324b03a-96a5-4009-a811-a277c2e5c1fa req-e6d036ae-1ad9-495d-998a-89008f7d3926 service nova] Creating event network-changed:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:12:33.351683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0324b03a-96a5-4009-a811-a277c2e5c1fa req-e6d036ae-1ad9-495d-998a-89008f7d3926 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089124 Oct 26 05:12:33.355023 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1450/2874] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:33.375955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:33.376598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:33.395140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:33.399526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:33.400768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:33.406642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:33.407370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:33.408152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:33.892555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:33.902834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7fda90b-db01-463c-b6de-caac74ba6515 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.538230 Oct 26 05:12:33.906204 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1451/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:33 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:33.917097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:33.920009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:33.930810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:33.931508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:33.932101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:33.934657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:33.935620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:33.936305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.266446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:34.275353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-daef3767-704e-4209-9ca0-9d20989dd867 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.367870 Oct 26 05:12:34.279879 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1452/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:33 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:34.309358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93b67e47-4f11-4fa1-832a-a852e7d9e712 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709e9b670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:34.386295 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93b67e47-4f11-4fa1-832a-a852e7d9e712 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.091886 Oct 26 05:12:34.387537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1453/2877] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:34 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:34.394113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7aafbdb0-d497-4cde-a04c-5590cea713ad req-add3e82b-fee5-4620-a592-b0834e3a147f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e024cf59-b4a7-4ca4-8ce2-877e72485ff1", "name": "network-vif-deleted", "tag": "49af1a4d-b60d-4257-be62-01b84d2a9387"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:34.436617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7aafbdb0-d497-4cde-a04c-5590cea713ad req-add3e82b-fee5-4620-a592-b0834e3a147f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.437883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7aafbdb0-d497-4cde-a04c-5590cea713ad req-add3e82b-fee5-4620-a592-b0834e3a147f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.439102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7aafbdb0-d497-4cde-a04c-5590cea713ad req-add3e82b-fee5-4620-a592-b0834e3a147f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.479807 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7aafbdb0-d497-4cde-a04c-5590cea713ad req-add3e82b-fee5-4620-a592-b0834e3a147f service nova] Creating event network-vif-deleted:49af1a4d-b60d-4257-be62-01b84d2a9387 for instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 on n-h1-862416-4 Oct 26 05:12:34.494317 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7aafbdb0-d497-4cde-a04c-5590cea713ad req-add3e82b-fee5-4620-a592-b0834e3a147f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105208 Oct 26 05:12:34.498802 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1454/2878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:34.505003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:34.505733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:34.529864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.530742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.531378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.532343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.535710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.539452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.578597 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27d7c79c-7899-49e4-8228-7fa86b2a02d4 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.611287 Oct 26 05:12:34.581785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1425/2879] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 26 05:12:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:34.587537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-45f7f90e-6540-43a2-ae62-3a96a2011308 req-d5f52d62-3232-45a9-a576-d67a22eae6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "name": "network-vif-plugged", "status": "completed", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:34.620840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-45f7f90e-6540-43a2-ae62-3a96a2011308 req-d5f52d62-3232-45a9-a576-d67a22eae6f1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.621692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-45f7f90e-6540-43a2-ae62-3a96a2011308 req-d5f52d62-3232-45a9-a576-d67a22eae6f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.622364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-45f7f90e-6540-43a2-ae62-3a96a2011308 req-d5f52d62-3232-45a9-a576-d67a22eae6f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.634362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:34.642934 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-45f7f90e-6540-43a2-ae62-3a96a2011308 req-d5f52d62-3232-45a9-a576-d67a22eae6f1 service nova] Creating event network-vif-plugged:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:12:34.643287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84b1033f-6cfd-491a-9490-0e52cc7cba41 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 200 len: 1428 microversion: 2.1 time: 0.142094 Oct 26 05:12:34.644172 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1455/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:34 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 1428 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:34.650891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:34.651504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:34.656372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-45f7f90e-6540-43a2-ae62-3a96a2011308 req-d5f52d62-3232-45a9-a576-d67a22eae6f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073163 Oct 26 05:12:34.659304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1426/2881] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:34.671649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:34.675541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:34.682421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.682946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.683417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.684245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.684747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.685217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.690995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.692856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.694633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:34.696286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:34.697585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:34.699181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:35.332373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:35.349080 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50ea9a39-2cfc-4ae7-affb-bbb7c2b5f171 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.686762 Oct 26 05:12:35.349241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:35.353789 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1427/2882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:34 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:35.360079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95974548-3d76-4bd8-8819-00d6d71a7d57 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.713059 Oct 26 05:12:35.362272 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1456/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:34 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:35.368515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.252"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:35.374553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:35.375435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:35.378594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:35.387054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:35.401477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:35.402148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:35.402905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:35.403429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:35.403719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:35.403861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:35.404499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:35.405183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:35.406368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:35.407075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:35.407753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:35.453631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "refresh_cache-0881d8c2-64ff-4b98-90ce-4fed3d77577f" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:12:35.454532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquired lock "refresh_cache-0881d8c2-64ff-4b98-90ce-4fed3d77577f" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:12:35.479901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:36.136946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:36.150157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cce356b4-8559-4b5f-bfb1-11341dabf36d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.786535 Oct 26 05:12:36.150766 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1457/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:35 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:36.176775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:36.177758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:36.227852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:36.234942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:36.237942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:36.242224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:36.247025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:36.247491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:37.186743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:37.202005 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93eda3eb-6ae1-48de-9a85-f926ce44bdfc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 1.037766 Oct 26 05:12:37.202624 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1458/2885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:36 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:37.222421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a262afd-d175-4096-8934-e9f3fabd482e tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709e86b80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:37.324065 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a262afd-d175-4096-8934-e9f3fabd482e tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.120355 Oct 26 05:12:37.324767 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1459/2886] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:37 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:37.346039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:37.347621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: e024cf59-b4a7-4ca4-8ce2-877e72485ff1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:37.366692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:37.367645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:37.369845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:37.370757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:37.371388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:37.373946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:37.406770 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] HTTP exception thrown: Instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 could not be found. Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Request method failure captured: Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 HTTP/1.1 Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMEqLDV3xPskGT5azwtZfWxwWrkVcuaCaz620i8p9reVyuW7MDkN-Ukjj_bf8rR19qi403nFv1kwVq1C977uwG4PwWjhaFukna8P7LCx4ZSIwOwUWgKzzzd4iZPzFwvTGpx1AN7KeAUs_I6DNdMrVrxKW1MP5Qajrx9qW08sCIEPYoc Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 454a8c023fbb41749f8046a3bd1f6fbf Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:12:37.414417 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 454a8c023fbb41749f8046a3bd1f6fbf Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdminTestJSON-405455832-project Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 0984efbdfee347d8b72d1a5f089fdd6f Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdminTestJSON-405455832-project Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 could not be found. Oct 26 05:12:37.415844 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e024cf59-b4a7-4ca4-8ce2-877e72485ff1'} Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 could not be found. Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:37.416634 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 could not be found. Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 could not be found. Oct 26 05:12:37.419935 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:12:37.422041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Returning 404 to user: Instance e024cf59-b4a7-4ca4-8ce2-877e72485ff1 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:37.425663 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-406ed25d-ecee-4aad-91e6-4b279ecf8da3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1" status: 404 len: 111 microversion: 2.1 time: 0.089768 Oct 26 05:12:37.430812 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1460/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:37 2022] GET /compute/v2.1/servers/e024cf59-b4a7-4ca4-8ce2-877e72485ff1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:37.466514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:37.467432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:37.478712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:37.479372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:37.480387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:37.484886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:37.485765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:37.486999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:38.027851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:38.043830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2406b200-050f-447b-8f0b-3ef4ba470dc2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.611484 Oct 26 05:12:38.058653 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1461/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:37 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:38.070158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:38.070788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:38.093033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:38.093583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:38.097853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:38.099143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:38.099649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:38.106953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:38.506142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:38.518436 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a043ed01-f4f5-4c06-aae6-177abaa2420d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.458475 Oct 26 05:12:38.520745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1462/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:38 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:38.531049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:38.533921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:38.549112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:38.549625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:38.554447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:38.555372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:38.556146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:38.556737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:38.625834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Building network info cache for instance {{(pid=120585) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:12:38.999107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:39.019522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98595faf-431a-46a3-8732-78eb9cf97b80 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.497422 Oct 26 05:12:39.029406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1463/2890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:38 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:39.038504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:39.038504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:39.057365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:39.059028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:39.061356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:39.063130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:39.064915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:39.064915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:39.120249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:12:39.242718 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fecb709f-0b73-4d41-a2f3-f216828f524e tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 204 len: 0 microversion: 2.1 time: 0.214254 Oct 26 05:12:39.246786 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1464/2891] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:39 2022] DELETE /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:12:39.264086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-eecb427f-8221-45ee-a4b6-c8f7c4eba2f2 req-2707a4a1-f73a-40df-ad8d-aefb28097afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a4edf8-969f-4a82-be7a-6c76cfa8d8a7", "name": "network-vif-plugged", "status": "completed", "tag": "01edd8bb-c764-4022-b525-16ef70eb6862"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:39.296219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-eecb427f-8221-45ee-a4b6-c8f7c4eba2f2 req-2707a4a1-f73a-40df-ad8d-aefb28097afa service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:39.297010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-eecb427f-8221-45ee-a4b6-c8f7c4eba2f2 req-2707a4a1-f73a-40df-ad8d-aefb28097afa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:39.297548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-eecb427f-8221-45ee-a4b6-c8f7c4eba2f2 req-2707a4a1-f73a-40df-ad8d-aefb28097afa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:39.317978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:39.322998 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-eecb427f-8221-45ee-a4b6-c8f7c4eba2f2 req-2707a4a1-f73a-40df-ad8d-aefb28097afa service nova] Creating event network-vif-plugged:01edd8bb-c764-4022-b525-16ef70eb6862 for instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 on n-h1-862416-4 Oct 26 05:12:39.340152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-eecb427f-8221-45ee-a4b6-c8f7c4eba2f2 req-2707a4a1-f73a-40df-ad8d-aefb28097afa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090508 Oct 26 05:12:39.340152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1465/2892] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:39.364049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:39.364774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:39.399181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:39.399688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:39.400140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:39.400851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:39.401324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:39.407855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:40.331541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:40.344100 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-226f1bdc-8874-4bad-931b-d2aca81c1f04 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 1.002928 Oct 26 05:12:40.345973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1466/2893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:39 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:40.355610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-202f1869-4573-4591-b040-d838571a2413 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709e79040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:40.472775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-202f1869-4573-4591-b040-d838571a2413 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.124793 Oct 26 05:12:40.473732 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1467/2894] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:40 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:40.479866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-812672149"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:40.487921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:40.504891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:40.509140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:40.509910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:40.510860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:40.511537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:40.512177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:40.566995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Updating instance_info_cache with network_info: [{"id": "10822a10-e2b6-4523-a741-69670cc77e9a", "address": "fa:16:3e:f2:ad:97", "network": {"id": "6244b107-bb8d-4e09-8ea3-338c3fe120bd", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-471165983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0ba7acf0d091489aa05981fbee243ef5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap10822a10-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120585) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:12:40.590549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Releasing lock "refresh_cache-0881d8c2-64ff-4b98-90ce-4fed3d77577f" {{(pid=120585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:12:40.591441 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7ce59f80-6e99-4ff9-a036-ff683c770c98 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action" status: 202 len: 0 microversion: 2.1 time: 5.234711 Oct 26 05:12:40.592066 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1428/2895] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:35 2022] POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action => generated 0 bytes in 5237 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:12:40.607387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c4bb2fa1-6480-42e4-a84e-2d3e73c8fd1f req-23bdb128-d38c-42d1-82f3-6c423f79e73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:40.622455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4bb2fa1-6480-42e4-a84e-2d3e73c8fd1f req-23bdb128-d38c-42d1-82f3-6c423f79e73d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:40.623201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4bb2fa1-6480-42e4-a84e-2d3e73c8fd1f req-23bdb128-d38c-42d1-82f3-6c423f79e73d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:40.623808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c4bb2fa1-6480-42e4-a84e-2d3e73c8fd1f req-23bdb128-d38c-42d1-82f3-6c423f79e73d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:40.667599 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c4bb2fa1-6480-42e4-a84e-2d3e73c8fd1f req-23bdb128-d38c-42d1-82f3-6c423f79e73d service nova] Creating event network-changed:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:12:40.701624 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c4bb2fa1-6480-42e4-a84e-2d3e73c8fd1f req-23bdb128-d38c-42d1-82f3-6c423f79e73d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107963 Oct 26 05:12:40.702524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1429/2896] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:40.737100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:40.738267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:40.758710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:40.759469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:40.760132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:40.761094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:40.766657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:40.767428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:40.987432 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3af7f421-f029-461b-8017-31293ea2e5ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.510750 Oct 26 05:12:40.994025 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1468/2897] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:40 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 26 05:12:41.004359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:41.006981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:41.028988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:41.034633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:41.035647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:41.039703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:41.045546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:41.047722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:41.426682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:41.454489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-690a4c12-3cec-46b2-8fcc-6f596f5d0e96 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.750546 Oct 26 05:12:41.479440 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1430/2898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:40 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:41.498112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:41.498832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:41.522407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:41.522913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:41.523363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:41.524103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:41.533905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:41.534645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:41.997799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984efbdfee347d8b72d1a5f089fdd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a8c023fbb41749f8046a3bd1f6fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:42.005889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6022b2f9-8a63-42fd-8bbc-f3b89a784ea5 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 200 len: 1468 microversion: 2.1 time: 1.012973 Oct 26 05:12:42.013597 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1469/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:40 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 1468 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:42.017612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.252"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:42.093451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:42.114602 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44283c3a-c8d8-482b-8fa7-7523029bcaec tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1315 microversion: 2.1 time: 0.633682 Oct 26 05:12:42.118620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1431/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:41 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:42.155439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:42.155996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:42.167726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:42.168209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:42.173927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:42.179192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:42.179685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:42.180125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:42.231046 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 HTTP/1.1 Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:42.234101 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:42.235804 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd2afc5cb-8479-4969-bb3a-c2afb38d9999'} Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:42.236810 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:42.239833 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:42.242968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:42.244789 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-934c1b6f-e028-4cef-b5d7-582e88ba20c6 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 404 len: 111 microversion: 2.1 time: 0.102169 Oct 26 05:12:42.246460 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1432/2901] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:42 2022] DELETE /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:42.253809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:42.255430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:42.269807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:42.270609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:42.271307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:42.277344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:42.278199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:42.278884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:42.307961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:42.323114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:42.323615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:42.324054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:42.324809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:42.325272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:42.325747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.012577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:43.021182 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5f3d3d5-1080-4b2c-944a-bba8bdae9501 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.773187 Oct 26 05:12:43.024449 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1433/2902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:42 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:43.040121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-60e96ceb-0be4-41fe-86c6-4471225e79c6 req-3d7052c2-ca2e-418e-a11f-16e16a5d0a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-unplugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:43.066163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-60e96ceb-0be4-41fe-86c6-4471225e79c6 req-3d7052c2-ca2e-418e-a11f-16e16a5d0a5a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.068079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-60e96ceb-0be4-41fe-86c6-4471225e79c6 req-3d7052c2-ca2e-418e-a11f-16e16a5d0a5a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.069567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-60e96ceb-0be4-41fe-86c6-4471225e79c6 req-3d7052c2-ca2e-418e-a11f-16e16a5d0a5a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.093223 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-60e96ceb-0be4-41fe-86c6-4471225e79c6 req-3d7052c2-ca2e-418e-a11f-16e16a5d0a5a service nova] Creating event network-vif-unplugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:12:43.101973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-60e96ceb-0be4-41fe-86c6-4471225e79c6 req-3d7052c2-ca2e-418e-a11f-16e16a5d0a5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074316 Oct 26 05:12:43.107734 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1434/2903] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:43.113251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:43.114297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:43.121711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.122549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.123221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.124195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.124878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.125569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.131009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "refresh_cache-0881d8c2-64ff-4b98-90ce-4fed3d77577f" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 05:12:43.131839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquired lock "refresh_cache-0881d8c2-64ff-4b98-90ce-4fed3d77577f" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 05:12:43.481900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:43.493718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7673dfca-8959-4d4c-bf81-9577cd67165c tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.384348 Oct 26 05:12:43.509470 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1435/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:43 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:43.514689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ee59627-d740-4b30-8969-829e2d104984 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470e9629d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:43.566494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ee59627-d740-4b30-8969-829e2d104984 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.055607 Oct 26 05:12:43.567389 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1436/2905] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:43 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:43.580786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-999a779a-0a23-40e5-95e9-c1a5e3520540 req-8024c7e8-39f3-4cd1-a02b-c99d8494bf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b22c173-3089-46c5-91c6-2bac95ac7cf7", "name": "network-vif-deleted", "tag": "1f98965e-9ae0-4cce-b52a-48dd51766116"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:43.591990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-999a779a-0a23-40e5-95e9-c1a5e3520540 req-8024c7e8-39f3-4cd1-a02b-c99d8494bf1a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.592789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-999a779a-0a23-40e5-95e9-c1a5e3520540 req-8024c7e8-39f3-4cd1-a02b-c99d8494bf1a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.593528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-999a779a-0a23-40e5-95e9-c1a5e3520540 req-8024c7e8-39f3-4cd1-a02b-c99d8494bf1a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.606717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-999a779a-0a23-40e5-95e9-c1a5e3520540 req-8024c7e8-39f3-4cd1-a02b-c99d8494bf1a service nova] Creating event network-vif-deleted:1f98965e-9ae0-4cce-b52a-48dd51766116 for instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 on n-h1-862416-4 Oct 26 05:12:43.612122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-999a779a-0a23-40e5-95e9-c1a5e3520540 req-8024c7e8-39f3-4cd1-a02b-c99d8494bf1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Oct 26 05:12:43.613775 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1437/2906] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:43.619415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:43.619700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: d2afc5cb-8479-4969-bb3a-c2afb38d9999] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:43.628252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.628785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.629216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.629971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.630445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.630882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.645933 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 HTTP/1.1 Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:43.648437 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:43.649862 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd2afc5cb-8479-4969-bb3a-c2afb38d9999'} Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:43.650636 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. Oct 26 05:12:43.652946 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.656306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance d2afc5cb-8479-4969-bb3a-c2afb38d9999 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:43.656306 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31bdb497-8dec-4270-8263-d67abc226d10 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999" status: 404 len: 111 microversion: 2.1 time: 0.035307 Oct 26 05:12:43.656306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1438/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:43 2022] GET /compute/v2.1/servers/d2afc5cb-8479-4969-bb3a-c2afb38d9999 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:43.658403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:43.659027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:43.666083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.666635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.667084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.673417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.673417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.673417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.925428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:43.937040 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31972b5f-f49e-48ca-9d55-95860f282a1d tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.282245 Oct 26 05:12:43.950788 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1439/2908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:43 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:43.962119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:43.962741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] [instance: 8b22c173-3089-46c5-91c6-2bac95ac7cf7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:43.969884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.970842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.971513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.972222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:43.972845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:43.973272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:43.988850 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] HTTP exception thrown: Instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 could not be found. Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Request method failure captured: Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 HTTP/1.1 Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMEqLDV3xPskGT5azwtZfWxwWrkVcuaCaz620i8p9reVyuW7MDkN-Ukjj_bf8rR19qi403nFv1kwVq1C977uwG4PwWjhaFukna8P7LCx4ZSIwOwUWgKzzzd4iZPzFwvTGpx1AN7KeAUs_I6DNdMrVrxKW1MP5Qajrx9qW08sCIEPYoc Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 454a8c023fbb41749f8046a3bd1f6fbf Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:43.992273 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/454a8c023fbb41749f8046a3bd1f6fbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 454a8c023fbb41749f8046a3bd1f6fbf Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminTestJSON-405455832 Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminTestJSON-405455832-project Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 0984efbdfee347d8b72d1a5f089fdd6f Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminTestJSON-405455832-project Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 could not be found. Oct 26 05:12:43.994269 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8b22c173-3089-46c5-91c6-2bac95ac7cf7'} Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 could not be found. Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:43.995082 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 could not be found. Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 could not be found. Oct 26 05:12:43.996312 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:44.002333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] Returning 404 to user: Instance 8b22c173-3089-46c5-91c6-2bac95ac7cf7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:44.003393 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad00f450-7e17-4fc0-9e7a-db318f1ffca3 tempest-ServersAdminTestJSON-405455832 tempest-ServersAdminTestJSON-405455832-project] 10.222.0.16 "GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7" status: 404 len: 111 microversion: 2.1 time: 0.051254 Oct 26 05:12:44.004192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1440/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:43 2022] GET /compute/v2.1/servers/8b22c173-3089-46c5-91c6-2bac95ac7cf7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:44.011844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:44.012810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:44.021019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:44.021876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:44.022659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:44.023554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:44.024068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:44.024707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:44.231898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Building network info cache for instance {{(pid=120586) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 26 05:12:44.285218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:44.303559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5541062-b1a5-40cc-884c-b0fc1a335514 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1502 microversion: 2.1 time: 0.297719 Oct 26 05:12:44.310415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1441/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:44 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:44.315792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:44.318858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:44.338468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:44.343140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:44.343864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:44.350727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:44.352822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:44.353528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:44.419522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:12:44.524398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:44.583305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5a845d62-e1e2-4c3f-859a-54ce4fd03fda tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 204 len: 0 microversion: 2.1 time: 0.271293 Oct 26 05:12:44.588054 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1442/2911] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:44 2022] DELETE /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:12:44.602173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:44.604715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:44.620355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:44.625412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:44.626192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:44.627803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:44.629177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:44.633459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.078757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:45.093691 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ffc75ae-8d52-43d6-bf07-2fbfa6078e83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1686 microversion: 2.1 time: 0.499847 Oct 26 05:12:45.096091 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1443/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:44 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1686 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:45.112069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ec99c918-81df-421d-a95b-05e4968fb9b2 req-0f4603b2-e23a-43d1-ac78-73ddcf1f97e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:45.152464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ec99c918-81df-421d-a95b-05e4968fb9b2 req-0f4603b2-e23a-43d1-ac78-73ddcf1f97e9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.153752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ec99c918-81df-421d-a95b-05e4968fb9b2 req-0f4603b2-e23a-43d1-ac78-73ddcf1f97e9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.156282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ec99c918-81df-421d-a95b-05e4968fb9b2 req-0f4603b2-e23a-43d1-ac78-73ddcf1f97e9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.195349 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ec99c918-81df-421d-a95b-05e4968fb9b2 req-0f4603b2-e23a-43d1-ac78-73ddcf1f97e9 service nova] Creating event network-changed:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:12:45.206632 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ec99c918-81df-421d-a95b-05e4968fb9b2 req-0f4603b2-e23a-43d1-ac78-73ddcf1f97e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107865 Oct 26 05:12:45.209253 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1444/2913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:45.222317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:45.223385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:45.242024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.242809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.243736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.249128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.250597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.252287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.332069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:12:45.496844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c61615e-f3ab-48a0-9572-0a3c42601fb1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 204 len: 0 microversion: 2.1 time: 0.285471 Oct 26 05:12:45.502718 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1445/2914] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:45 2022] DELETE /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:12:45.518383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:45.519189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:45.526009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.526498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.526937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.527644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.528096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.528665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.736737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Updating instance_info_cache with network_info: [{"id": "10822a10-e2b6-4523-a741-69670cc77e9a", "address": "fa:16:3e:f2:ad:97", "network": {"id": "6244b107-bb8d-4e09-8ea3-338c3fe120bd", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-471165983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0ba7acf0d091489aa05981fbee243ef5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap10822a10-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:12:45.762468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Releasing lock "refresh_cache-0881d8c2-64ff-4b98-90ce-4fed3d77577f" {{(pid=120586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 05:12:45.763926 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80328c5f-2ee7-4344-adc4-6266f1ab153a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action" status: 202 len: 0 microversion: 2.1 time: 3.750180 Oct 26 05:12:45.765112 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1470/2915] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:42 2022] POST /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f/action => generated 0 bytes in 3752 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 26 05:12:45.773381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5790bfc1-705e-488e-a786-0eb5890b4d1e tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709e793a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:45.833147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:45.846694 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7815bdd5-bc99-4f8d-b19c-91b03e4364c2 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.337122 Oct 26 05:12:45.847622 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1446/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:45 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:45.852723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:45.859300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:45.868364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.868859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.870649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.871456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.871591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5790bfc1-705e-488e-a786-0eb5890b4d1e tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1427 microversion: 2.1 time: 0.104950 Oct 26 05:12:45.871965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.872100 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1471/2917] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:45 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:45.872403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.879840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:45.880417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:45.889355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.890168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.890890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:45.891812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:45.892771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:45.893740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:46.259643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc7ca84bead495f89d0931005853a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0144f42b64642aa5baef6a8077c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:46.268095 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be52f285-d4e8-4ec1-870b-e2f4f918f985 tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 200 len: 1512 microversion: 2.1 time: 0.419365 Oct 26 05:12:46.277456 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1447/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:45 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:46.282456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1ae302f0-0893-47a5-8743-dbeab8f7bcc3 req-111a62ae-deed-483c-929d-35da881bfbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558a1c7e-d245-4c4d-9d76-6a1f8313557e", "name": "network-vif-plugged", "status": "completed", "tag": "00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:46.299630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:46.301731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:46.303679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1ae302f0-0893-47a5-8743-dbeab8f7bcc3 req-111a62ae-deed-483c-929d-35da881bfbeb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:46.304167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1ae302f0-0893-47a5-8743-dbeab8f7bcc3 req-111a62ae-deed-483c-929d-35da881bfbeb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:46.304738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1ae302f0-0893-47a5-8743-dbeab8f7bcc3 req-111a62ae-deed-483c-929d-35da881bfbeb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:46.317975 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d49634dd-5bfb-411f-897c-e799b0e6e96c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.444637 Oct 26 05:12:46.325207 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1ae302f0-0893-47a5-8743-dbeab8f7bcc3 req-111a62ae-deed-483c-929d-35da881bfbeb service nova] Creating event network-vif-plugged:00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d for instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e on n-h1-862416-4 Oct 26 05:12:46.333778 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1472/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:45 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:46.342864 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1ae302f0-0893-47a5-8743-dbeab8f7bcc3 req-111a62ae-deed-483c-929d-35da881bfbeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063876 Oct 26 05:12:46.346077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:46.346968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1448/2920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:46.348183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:46.353287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d76292d8-bab7-419e-b236-a5da391f6e95 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '.version_select at 0x7f470a1add30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:46.359334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:46.361032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:46.362220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:46.363312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:46.366291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:46.367046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:47.017739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:47.028283 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41db0299-98dd-4a21-a4a0-a73aa60b45ed tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 200 len: 1508 microversion: 2.1 time: 0.689044 Oct 26 05:12:47.036834 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1473/2921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:46 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 1508 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:47.049140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:47.052919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:47.073877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:47.074478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:47.074833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:47.075610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:47.076054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:47.076442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:48.432541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:48.465920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c358989-c618-43f3-990e-875891e68efd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 1.414818 Oct 26 05:12:48.471485 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1474/2922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:47 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:48.494202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:48.497454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:48.525715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:48.528064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:48.530881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:48.533090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:48.536976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:48.538630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:49.381600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:49.398687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-798e1900-61fe-4190-853c-a2e7726f7e24 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1315 microversion: 2.1 time: 0.916211 Oct 26 05:12:49.400336 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1475/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:48 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:49.414048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15dcf495-ed56-4c40-a7ed-db53ce756932 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709f09a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:49.949239 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d76292d8-bab7-419e-b236-a5da391f6e95 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5fe06bfe-ce3d-450a-a6d1-f2da1ef2da8a" status: 202 len: 0 microversion: 2.1 time: 3.600781 Oct 26 05:12:49.950297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1449/2924] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:12:46 2022] DELETE /compute/v2.1/os-floating-ips/5fe06bfe-ce3d-450a-a6d1-f2da1ef2da8a => generated 0 bytes in 3602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:49.960945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:49.961750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] [instance: 4aac488d-2e5c-47f1-9363-e4b9fbe6e053] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:49.992237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:49.992738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:49.993235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:49.994010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:49.994471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:49.994900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.028144 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] HTTP exception thrown: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 could not be found. Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Request method failure captured: Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 HTTP/1.1 Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMC_8w7zDCJ3Fh7ko8ARA32qCI-E4nkADLz4x9M5wnS-3Z5Q_Kh3gKfIHNM4wXlc1t1xVAP6RxOD0yjPFj5QKTDtWLWexliIfy7PMhua4FRx3WXWizL7FN8xuOyJQvXS_InUTTKZmCrYFRHV5CEeLBiHvWFjyCbF_RMYYrwlmd7Htuo Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:50.029875 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84d0144f42b64642aa5baef6a8077c30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 84d0144f42b64642aa5baef6a8077c30 Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657535892 Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2dc7ca84bead495f89d0931005853a11 Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1657535892-project Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 could not be found. Oct 26 05:12:50.031858 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4aac488d-2e5c-47f1-9363-e4b9fbe6e053'} Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 could not be found. Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:50.034168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 could not be found. Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 could not be found. Oct 26 05:12:50.035432 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.044587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] Returning 404 to user: Instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:50.045791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-848267a4-dd7d-44cc-804f-5c7774d7028f tempest-ServersNegativeTestJSON-1657535892 tempest-ServersNegativeTestJSON-1657535892-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053" status: 404 len: 111 microversion: 2.1 time: 0.094502 Oct 26 05:12:50.046629 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1450/2925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:49 2022] GET /compute/v2.1/servers/4aac488d-2e5c-47f1-9363-e4b9fbe6e053 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:50.054793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:50.058246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:50.079901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:50.080805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:50.081493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.082420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:50.083092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:50.083717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.676869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:50.694617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4003967b-5a4d-46ae-9d46-6703e2ea87bd tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.646323 Oct 26 05:12:50.706803 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1451/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:50 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:50.706803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:50.706803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:50.720160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:50.720894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:50.721292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.722033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:50.722699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:50.731081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.763453 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 HTTP/1.1 Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:12:50.765000 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:12:50.766420 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '35a4edf8-969f-4a82-be7a-6c76cfa8d8a7'} Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:12:50.767237 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:12:50.769434 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:12:50.772159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:12:50.772159 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fdbffbe-cfce-4118-9c76-46ddda0393c9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 404 len: 111 microversion: 2.1 time: 0.069990 Oct 26 05:12:50.780026 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1452/2927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:50 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:12:50.785062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8f61f39c-ea0e-431b-8b8e-5bb796ac8df5 req-2d6cd148-c1d7-4046-b91e-1b2cbaac61a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac488d-2e5c-47f1-9363-e4b9fbe6e053", "name": "network-vif-deleted", "tag": "41f4f380-1a1f-4b43-a487-e8eae38814c8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:50.796876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8f61f39c-ea0e-431b-8b8e-5bb796ac8df5 req-2d6cd148-c1d7-4046-b91e-1b2cbaac61a9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:50.797709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8f61f39c-ea0e-431b-8b8e-5bb796ac8df5 req-2d6cd148-c1d7-4046-b91e-1b2cbaac61a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:50.798426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8f61f39c-ea0e-431b-8b8e-5bb796ac8df5 req-2d6cd148-c1d7-4046-b91e-1b2cbaac61a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.814641 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8f61f39c-ea0e-431b-8b8e-5bb796ac8df5 req-2d6cd148-c1d7-4046-b91e-1b2cbaac61a9 service nova] Creating event network-vif-deleted:41f4f380-1a1f-4b43-a487-e8eae38814c8 for instance 4aac488d-2e5c-47f1-9363-e4b9fbe6e053 on n-h2-862416-4 Oct 26 05:12:50.821148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8f61f39c-ea0e-431b-8b8e-5bb796ac8df5 req-2d6cd148-c1d7-4046-b91e-1b2cbaac61a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038737 Oct 26 05:12:50.822271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1453/2928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:50.829251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1ce67e00-c5c8-4661-8fad-0920df49f8f2 req-9b43a19f-93c4-4172-ab29-58c3bf65fac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-plugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:50.841397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1ce67e00-c5c8-4661-8fad-0920df49f8f2 req-9b43a19f-93c4-4172-ab29-58c3bf65fac3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:50.842657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1ce67e00-c5c8-4661-8fad-0920df49f8f2 req-9b43a19f-93c4-4172-ab29-58c3bf65fac3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:50.842657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1ce67e00-c5c8-4661-8fad-0920df49f8f2 req-9b43a19f-93c4-4172-ab29-58c3bf65fac3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:50.855185 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1ce67e00-c5c8-4661-8fad-0920df49f8f2 req-9b43a19f-93c4-4172-ab29-58c3bf65fac3 service nova] Creating event network-vif-plugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:12:50.860718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1ce67e00-c5c8-4661-8fad-0920df49f8f2 req-9b43a19f-93c4-4172-ab29-58c3bf65fac3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036778 Oct 26 05:12:50.861654 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1454/2929] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:51.148535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1456093487", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:55.557818 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15dcf495-ed56-4c40-a7ed-db53ce756932 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1436 microversion: 2.1 time: 6.155714 Oct 26 05:12:55.562423 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1476/2930] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:49 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1436 bytes in 6161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:55.570481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:12:55.591462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:55.596915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:55.618811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:55.621499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:55.622418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:55.623201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:55.630087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:55.630582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:55.631142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.018217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:56.034906 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5fa70c18-a8a7-4350-a8e4-9665609c4ab6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.470866 Oct 26 05:12:56.038221 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1477/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:55 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:56.051553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6132d9f6-7c39-4e54-b763-2979c92aab7f req-3b1133bd-09fe-4b37-8bca-459f8222008b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f397d6-655f-419e-bf0c-ee1e69cc8321", "name": "network-vif-unplugged", "status": "completed", "tag": "07b2594b-ca56-427c-b400-a762819750c6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:56.075819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6132d9f6-7c39-4e54-b763-2979c92aab7f req-3b1133bd-09fe-4b37-8bca-459f8222008b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.076541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6132d9f6-7c39-4e54-b763-2979c92aab7f req-3b1133bd-09fe-4b37-8bca-459f8222008b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.077087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6132d9f6-7c39-4e54-b763-2979c92aab7f req-3b1133bd-09fe-4b37-8bca-459f8222008b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.110147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6132d9f6-7c39-4e54-b763-2979c92aab7f req-3b1133bd-09fe-4b37-8bca-459f8222008b service nova] Creating event network-vif-unplugged:07b2594b-ca56-427c-b400-a762819750c6 for instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 on n-h1-862416-4 Oct 26 05:12:56.113723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:12:56.116180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:12:56.117003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:12:56.117743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:12:56.118231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6132d9f6-7c39-4e54-b763-2979c92aab7f req-3b1133bd-09fe-4b37-8bca-459f8222008b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077966 Oct 26 05:12:56.118375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:12:56.119860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1478/2932] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:56.127682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7e0dd9e-66d5-4e07-8cc1-46568628cb78 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '.version_select at 0x7f4709ee3e50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:56.159494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.166530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.167267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.169079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.174278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.174953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.218779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:12:56.225713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:12:56.258955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:12:56.262394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:12:56.366905 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e65e514a-7672-4c4d-a331-32b8aa2e63f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.503948 Oct 26 05:12:56.370802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1455/2933] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 5508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:12:56.378979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:56.387797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:56.404214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.407111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.409242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.410848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.417454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.418416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.745609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:56.765256 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa79d811-f1e8-4d04-82f8-6479349f32aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1503 microversion: 2.1 time: 0.389009 Oct 26 05:12:56.772948 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7e0dd9e-66d5-4e07-8cc1-46568628cb78 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/fb3252e1-eedb-49ec-957c-16d3db2e89a3" status: 202 len: 0 microversion: 2.1 time: 0.651256 Oct 26 05:12:56.776585 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1479/2935] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:12:56 2022] DELETE /compute/v2.1/os-security-groups/fb3252e1-eedb-49ec-957c-16d3db2e89a3 => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:56.783976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-356015545", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:56.786539 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1456/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:56 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:56.816046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:56.824636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:56.852718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.853509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.858205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.859198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:56.859891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:56.860933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:56.977876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:12:57.469221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:57.479148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e561baa-4186-40fe-b855-a4ef6b885851 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.691264 Oct 26 05:12:57.482161 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1457/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:56 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:57.513556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5352993a-fa87-488c-a8e7-8ea4c6e01e24 req-a2f613f0-4ce0-4273-9cc8-6b28ff7053ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a4edf8-969f-4a82-be7a-6c76cfa8d8a7", "name": "network-vif-deleted", "tag": "01edd8bb-c764-4022-b525-16ef70eb6862"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:57.544449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5352993a-fa87-488c-a8e7-8ea4c6e01e24 req-a2f613f0-4ce0-4273-9cc8-6b28ff7053ec service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:57.544913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5352993a-fa87-488c-a8e7-8ea4c6e01e24 req-a2f613f0-4ce0-4273-9cc8-6b28ff7053ec service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:57.545372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5352993a-fa87-488c-a8e7-8ea4c6e01e24 req-a2f613f0-4ce0-4273-9cc8-6b28ff7053ec service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:57.572645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5352993a-fa87-488c-a8e7-8ea4c6e01e24 req-a2f613f0-4ce0-4273-9cc8-6b28ff7053ec service nova] Creating event network-vif-deleted:01edd8bb-c764-4022-b525-16ef70eb6862 for instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 on n-h1-862416-4 Oct 26 05:12:57.580831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5352993a-fa87-488c-a8e7-8ea4c6e01e24 req-a2f613f0-4ce0-4273-9cc8-6b28ff7053ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085468 Oct 26 05:12:57.585493 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1458/2937] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:57.595600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ecfd55f8-c462-4334-9161-832029e792ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470eb01820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:57.687935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ecfd55f8-c462-4334-9161-832029e792ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 200 len: 1436 microversion: 2.1 time: 0.100591 Oct 26 05:12:57.688792 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1459/2938] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:12:57 2022] GET /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 1436 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:57.715518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:57.716301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:57.723864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:57.724371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:57.724818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:57.734208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:57.734710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:57.735166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:57.889261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:57.904373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-773dda56-900b-4f60-b1a6-78cf5fc10dce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1213 microversion: 2.1 time: 0.204690 Oct 26 05:12:57.913704 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1460/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:57 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:57.918824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:57.919329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:57.935829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:57.938176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:57.938824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:57.941353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:57.942015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:57.942646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:57.996660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:12:58.017793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:12:58.018379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:12:58.018688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:12:58.019105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:12:58.019757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:12:58.032553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.033055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.036516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.037934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.042664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.044086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.063883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:12:58.070317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:12:58.085504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:12:58.088226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:12:58.141402 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a29f4a5-5c0d-4c85-bf05-d30135a6586a tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 204 len: 0 microversion: 2.1 time: 0.226164 Oct 26 05:12:58.147711 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1461/2940] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:12:57 2022] DELETE /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:12:58.168933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-619fdce4-360f-47bb-a7c6-9d18b8974226 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391163 Oct 26 05:12:58.170076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-932133513"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:58.170978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:58.171823 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1480/2941] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:12:58.184877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.186685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:58.187456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.188330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:58.189018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.191714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.192426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.193104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.203544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.205914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.206611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.210741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.211511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.212198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.493935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Adding security group 68dd6786-e18e-45d8-9880-62a862e72e05 to port 00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d Oct 26 05:12:58.558342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:58.573757 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5477ad2-35d7-46c3-bbe7-88bfebffcf9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.399190 Oct 26 05:12:58.582982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1481/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:58 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:58.612620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:58.613229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:58.634529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.635290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.635908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.636797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:58.637955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:58.639003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:58.965060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:58.975916 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c2c108c-8dc3-49bb-af11-267e477f96b2 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1466 microversion: 2.1 time: 0.388633 Oct 26 05:12:58.993706 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1482/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:58 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1466 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:59.005657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-be0ec313-2711-4d0e-b5dd-84b46125c9ad req-d776337c-9174-4d5e-8481-7651a45d2efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1f397d6-655f-419e-bf0c-ee1e69cc8321", "tag": "07b2594b-ca56-427c-b400-a762819750c6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:12:59.016514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-be0ec313-2711-4d0e-b5dd-84b46125c9ad req-d776337c-9174-4d5e-8481-7651a45d2efb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.017259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-be0ec313-2711-4d0e-b5dd-84b46125c9ad req-d776337c-9174-4d5e-8481-7651a45d2efb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.017928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-be0ec313-2711-4d0e-b5dd-84b46125c9ad req-d776337c-9174-4d5e-8481-7651a45d2efb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.030670 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-be0ec313-2711-4d0e-b5dd-84b46125c9ad req-d776337c-9174-4d5e-8481-7651a45d2efb service nova] Creating event network-changed:07b2594b-ca56-427c-b400-a762819750c6 for instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 on n-h1-862416-4 Oct 26 05:12:59.037867 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-be0ec313-2711-4d0e-b5dd-84b46125c9ad req-d776337c-9174-4d5e-8481-7651a45d2efb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041381 Oct 26 05:12:59.039925 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1483/2944] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:12:59.047526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:59.048507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:59.058286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.059600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.060302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.061814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.062530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.063127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.416305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b94b9edd-4a7d-4946-8611-b7cbe282e876 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e/action" status: 202 len: 0 microversion: 2.1 time: 1.265712 Oct 26 05:12:59.417403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1462/2945] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:12:58 2022] POST /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e/action => generated 0 bytes in 1268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:12:59.423271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:59.424170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:59.449063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.449851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.450597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.452297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.453122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.453823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.520260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:59.550659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0f240ef-f934-45da-b971-ffcad1be7de6 tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1509 microversion: 2.1 time: 0.508598 Oct 26 05:12:59.551276 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1484/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:59 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1509 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:59.570299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:59.575530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:59.586846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:59.590523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:12:59.594526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.596234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.598297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.598614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17aa8a36-9f1b-4bb4-bb50-5791c5288649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1210 microversion: 2.1 time: 0.179559 Oct 26 05:12:59.599724 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1463/2947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:59 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:59.600888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.601411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.602532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.605768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:12:59.606545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:12:59.614614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.616832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.617509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.618419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:12:59.619053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:12:59.619629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:12:59.800092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:12:59.826970 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf0c3cb5-645c-4e21-a166-83fd184f0bce tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1269 microversion: 2.1 time: 0.225276 Oct 26 05:12:59.827584 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1464/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:59 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:12:59.866721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d71cdcf9-a2ee-4e37-9539-0d8dcfdcef15 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f470a8c1e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:00.123180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:00.153552 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22ab43f0-8262-4e9f-ae25-7838ae647356 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.577789 Oct 26 05:13:00.160087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1485/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:59 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:00.185496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64b1c81d-2951-40f2-b97f-7dab4674da25 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709ee3040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:00.539185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-64b1c81d-2951-40f2-b97f-7dab4674da25 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use.", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:00.540997 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-64b1c81d-2951-40f2-b97f-7dab4674da25 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.540997 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64b1c81d-2951-40f2-b97f-7dab4674da25 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05 HTTP/1.1 Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:00.544588 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: exception: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] Oct 26 05:13:00.546837 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '68dd6786-e18e-45d8-9880-62a862e72e05'} Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:00.547910 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.550138 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:00.551611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:00.553982 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:00.553982 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:00.553982 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:00.553982 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.553982 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] Oct 26 05:13:00.553982 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:00.556431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64b1c81d-2951-40f2-b97f-7dab4674da25 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 400 to user: Security Group 68dd6786-e18e-45d8-9880-62a862e72e05 in use. Oct 26 05:13:00.556431 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-7ca995d7-1db2-4e9b-ab72-5d180aa02677'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:00.557692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64b1c81d-2951-40f2-b97f-7dab4674da25 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05" status: 400 len: 185 microversion: 2.1 time: 0.392814 Oct 26 05:13:00.558761 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1486/2950] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:00 2022] DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05 => generated 185 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:13:00.575689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:00.577788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:00.596264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:00.597804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:00.599931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:00.601841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:00.604906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:00.606356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:00.615426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:01.454718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:01.467066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a8b92801-7848-4b4b-9f2f-4a633daa4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.906958 Oct 26 05:13:01.470970 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1487/2951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:00 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:01.494191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:01.505632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:01.543140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:01.546195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:01.549016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:01.555252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:01.555767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:01.565702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:01.755916 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d71cdcf9-a2ee-4e37-9539-0d8dcfdcef15 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "DELETE /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985" status: 204 len: 0 microversion: 2.1 time: 1.915851 Oct 26 05:13:01.757899 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1465/2952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:12:59 2022] DELETE /compute/v2.1/images/9034bb97-5e12-4e42-a7ae-37d2e8619985 => generated 0 bytes in 1919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:01.770633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:01.772665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:01.782323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:01.783318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:01.784067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:01.785002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:01.785761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:01.786361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:01.847701 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8e6f169-4979-4d91-a1af-774dac07d860 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e/action" status: 202 len: 0 microversion: 2.1 time: 0.374551 Oct 26 05:13:01.852250 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1488/2953] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:13:01 2022] POST /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:01.865304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:01.868529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:01.914932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:01.916645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:01.920589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:01.924005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:01.926114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:01.926977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.220912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:02.249087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1aa36389-534d-4dc8-a828-f84eed8919e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1272 microversion: 2.1 time: 0.386460 Oct 26 05:13:02.257758 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1489/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:01 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1272 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:02.313987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:02.321030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:02.349406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.352191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.357561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.358617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.359308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.359855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.392621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd36941b3dcf4521956760b686e76e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba7acf0d091489aa05981fbee243ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:02.406037 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61548d4b-6be3-4a55-878d-9d91b6554ddc tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 200 len: 1509 microversion: 2.1 time: 0.646633 Oct 26 05:13:02.412361 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1466/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:01 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 1509 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:02.425079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:02.433247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:02.455109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.455701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.456227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.457021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.457587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.458248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.606571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:02.619294 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b3abe26-096d-4ce6-a34f-83d74f6aa3ac tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1275 microversion: 2.1 time: 0.341936 Oct 26 05:13:02.620629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1490/2956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:02 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1275 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:02.645582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-216451de-dc8b-44f4-b897-3ab6c2e206b1 req-66c67ee9-cf0d-4823-a03e-ee321f46f287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558a1c7e-d245-4c4d-9d76-6a1f8313557e", "tag": "00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:02.678917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-216451de-dc8b-44f4-b897-3ab6c2e206b1 req-66c67ee9-cf0d-4823-a03e-ee321f46f287 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.679729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-216451de-dc8b-44f4-b897-3ab6c2e206b1 req-66c67ee9-cf0d-4823-a03e-ee321f46f287 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.680329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-216451de-dc8b-44f4-b897-3ab6c2e206b1 req-66c67ee9-cf0d-4823-a03e-ee321f46f287 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.705496 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-216451de-dc8b-44f4-b897-3ab6c2e206b1 req-66c67ee9-cf0d-4823-a03e-ee321f46f287 service nova] Creating event network-changed:00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d for instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e on n-h1-862416-4 Oct 26 05:13:02.713782 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-216451de-dc8b-44f4-b897-3ab6c2e206b1 req-66c67ee9-cf0d-4823-a03e-ee321f46f287 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091183 Oct 26 05:13:02.715215 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1491/2957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:02.722463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-73bf7347-6ae7-479b-8008-92531b000ed7 req-87448e42-6acc-49b9-ae29-779a0d36cb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "name": "network-vif-unplugged", "status": "completed", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:02.742145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73bf7347-6ae7-479b-8008-92531b000ed7 req-87448e42-6acc-49b9-ae29-779a0d36cb86 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.743237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73bf7347-6ae7-479b-8008-92531b000ed7 req-87448e42-6acc-49b9-ae29-779a0d36cb86 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.744091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73bf7347-6ae7-479b-8008-92531b000ed7 req-87448e42-6acc-49b9-ae29-779a0d36cb86 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.780801 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-73bf7347-6ae7-479b-8008-92531b000ed7 req-87448e42-6acc-49b9-ae29-779a0d36cb86 service nova] Creating event network-vif-unplugged:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:13:02.796736 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-73bf7347-6ae7-479b-8008-92531b000ed7 req-87448e42-6acc-49b9-ae29-779a0d36cb86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078565 Oct 26 05:13:02.807897 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1492/2958] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:02.819555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1c93638-2344-4011-b161-5170690b8cee tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '.version_select at 0x7f4709eeae50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:02.822127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:02.844304 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-56864503-da69-4505-b73d-b9e492c22c83 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.429140 Oct 26 05:13:02.870453 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1467/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:02 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:02.880058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:02.881743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:02.893482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.894405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.895206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.896609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.898324 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b1c93638-2344-4011-b161-5170690b8cee tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] HTTP exception thrown: Image not found. Oct 26 05:13:02.898843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.899524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1c93638-2344-4011-b161-5170690b8cee tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Request method failure captured: Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e HTTP/1.1 Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMF0iDspzDX_VLhJPIuvURpyEaRyTrQUxw5d8-rX6Y6EwpjH3415NPwzGLUJ_ePd7OXApT3nGag-uXA19anpGgT07urZC4P5IEKzee5XrYTY3Nj3Uqxb06VT8NQsLR7vOLhAFZ6zZl6YZoURirny3ythD425A12wOs0-5Gd3HOEnXDY Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 5471bab47d5b41c79aa90a93547be446 Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:02.901697 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5471bab47d5b41c79aa90a93547be446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 5471bab47d5b41c79aa90a93547be446 Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ImagesOneServerTestJSON-534054076-project Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: f1c51212204f4654b320552298e77c3b Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ImagesOneServerTestJSON-534054076-project Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: exception: Image not found. Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '779e291f-6040-45b9-8cba-d09158376c8e'} Oct 26 05:13:02.903549 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 779e291f-6040-45b9-8cba-d09158376c8e to delete Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:02.904904 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 779e291f-6040-45b9-8cba-d09158376c8e could not be found. Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:02.907812 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1c93638-2344-4011-b161-5170690b8cee tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Returning 404 to user: Image not found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:02.911060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1c93638-2344-4011-b161-5170690b8cee tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "DELETE /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e" status: 404 len: 62 microversion: 2.1 time: 0.095701 Oct 26 05:13:02.916717 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1493/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:02 2022] DELETE /compute/v2.1/images/779e291f-6040-45b9-8cba-d09158376c8e => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:13:02.934770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:02.940490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:02.968786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.973608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.976320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:02.979266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:02.979950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:02.980452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:03.419413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:03.436876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30b592e4-9aec-46e2-8946-8a468481aaf5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.517571 Oct 26 05:13:03.438278 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1494/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:02 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:03.450729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:03.452051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:03.463027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:03.464562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:03.465752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:03.467078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:03.467986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:03.468726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:03.516885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:03.533506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60a4f8d9-bb2c-4af8-b1de-b911f29a6133 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1573 microversion: 2.1 time: 0.660940 Oct 26 05:13:03.534088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:03.558941 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1468/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:02 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1573 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:03.572010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:03.573873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:03.590402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:03.594303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:03.595036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:03.595984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:03.596733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:03.597345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.065694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:04.078839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f6c2d23b-bf82-41bf-aab4-ed57c1d41ee8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1272 microversion: 2.1 time: 0.518504 Oct 26 05:13:04.082998 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1469/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:03 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1272 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:04.091570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:04.092512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] [instance: 0881d8c2-64ff-4b98-90ce-4fed3d77577f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:04.112003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.115871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.116877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.120240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.121498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.122127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.147400 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] HTTP exception thrown: Instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f could not be found. Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Request method failure captured: Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f HTTP/1.1 Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFyHFF7yShDf5Ep6pFHA4-lYsRDAsT6Y4DAHfxJcVZBpRGf_E_lfSqlMgkkoO7zZ3GAYr7PeOADJtnUq4d1DwmXL_DfBrjVm0a6y5iqeF4j0JkFc4bd0x2usp1UsLJ9mkQokEnWpBQbypv8IX-4qqrHama7IoBKbEGZ-53YkayC6gg Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 0ba7acf0d091489aa05981fbee243ef5 Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1169790726 Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:04.155674 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ba7acf0d091489aa05981fbee243ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ba7acf0d091489aa05981fbee243ef5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ba7acf0d091489aa05981fbee243ef5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ba7acf0d091489aa05981fbee243ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1169790726 Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 0ba7acf0d091489aa05981fbee243ef5 Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1169790726 Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueTestJSONUnderV235-1169790726-project Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: cd36941b3dcf4521956760b686e76e5e Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1169790726-project Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f could not be found. Oct 26 05:13:04.157215 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0881d8c2-64ff-4b98-90ce-4fed3d77577f'} Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f could not be found. Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:04.158214 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f could not be found. Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f could not be found. Oct 26 05:13:04.159527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:04.160696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] Returning 404 to user: Instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:04.160696 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af8632c5-663c-45c8-ac7c-ee85d027618f tempest-ServerRescueTestJSONUnderV235-1169790726 tempest-ServerRescueTestJSONUnderV235-1169790726-project] 10.222.0.16 "GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f" status: 404 len: 111 microversion: 2.1 time: 0.075366 Oct 26 05:13:04.169658 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1470/2964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:04 2022] GET /compute/v2.1/servers/0881d8c2-64ff-4b98-90ce-4fed3d77577f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:04.175324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:04.176005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:04.186632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.187133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.187582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.188356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.188824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.189914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.452060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0cea4d0d-56a5-4b72-b1c7-448b64c743ba tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 204 len: 0 microversion: 2.1 time: 1.010604 Oct 26 05:13:04.453301 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1495/2965] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:03 2022] DELETE /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:04.466262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:04.467339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:04.474753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.477140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.477851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.478833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.480201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.480863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.534894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:04.563604 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c2231f3-f5c4-49c4-91b4-aa955689cf2d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1275 microversion: 2.1 time: 0.391562 Oct 26 05:13:04.570105 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1471/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:04 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1275 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:04.608884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:04.609588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:04.631589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.633371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.633861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:04.635551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:04.640587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:04.640587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.213746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:05.228303 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae638e2d-0563-4a51-8ae1-3e776b395ede tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1472 microversion: 2.1 time: 0.655779 Oct 26 05:13:05.228906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1472/2967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:04 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1472 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:05.242500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:05.243146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:05.254687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.255203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.259038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.259902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.260394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.260839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.315841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:05.328180 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-06f5cc79-7578-422e-8585-5bc6cf2f0932 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1392 microversion: 2.1 time: 0.869884 Oct 26 05:13:05.349879 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1496/2968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:04 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1392 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:05.349879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:05.349879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:05.358581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.360318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.360590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.363996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.364585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.365045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.603419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:05.612151 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1009f0b6-c999-45b7-a302-8eca8e6fe7d3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1681 microversion: 2.1 time: 0.382112 Oct 26 05:13:05.617853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1473/2969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:05 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1681 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:05.630819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-47ea6b53-88c4-4ac6-8709-d52abeeda714 req-63367e04-f4b1-4ad8-b401-7ba50db618f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0881d8c2-64ff-4b98-90ce-4fed3d77577f", "name": "network-vif-deleted", "tag": "10822a10-e2b6-4523-a741-69670cc77e9a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:05.654138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-47ea6b53-88c4-4ac6-8709-d52abeeda714 req-63367e04-f4b1-4ad8-b401-7ba50db618f6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.654720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-47ea6b53-88c4-4ac6-8709-d52abeeda714 req-63367e04-f4b1-4ad8-b401-7ba50db618f6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.655265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-47ea6b53-88c4-4ac6-8709-d52abeeda714 req-63367e04-f4b1-4ad8-b401-7ba50db618f6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.691789 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-47ea6b53-88c4-4ac6-8709-d52abeeda714 req-63367e04-f4b1-4ad8-b401-7ba50db618f6 service nova] Creating event network-vif-deleted:10822a10-e2b6-4523-a741-69670cc77e9a for instance 0881d8c2-64ff-4b98-90ce-4fed3d77577f on n-h2-862416-4 Oct 26 05:13:05.703218 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-47ea6b53-88c4-4ac6-8709-d52abeeda714 req-63367e04-f4b1-4ad8-b401-7ba50db618f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080581 Oct 26 05:13:05.703849 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1474/2970] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:05.708923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:05.709935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:05.731514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.732027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.732695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.733737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.734946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.735641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.867258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:05.887187 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5404082d-2ebd-4e3c-8341-c19c0580106d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1571 microversion: 2.1 time: 0.549991 Oct 26 05:13:05.903807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1497/2971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:05 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1571 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:05.913296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:05.916232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:05.932340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.934377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.937403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:05.939993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:05.941964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:05.944980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:06.210848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:06.236659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:06.478822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:06.491856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e4293ce-59e7-414e-bc7b-7812115b9d19 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1314 microversion: 2.1 time: 0.786677 Oct 26 05:13:06.498164 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1475/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:05 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:06.504030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1773466269"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:06.513699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:06.521505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:06.525558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:06.526203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:06.528173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:06.532618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:06.533297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:06.772847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:06.782074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b440bb24-f3cc-4d10-b9f5-c154e2542c88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 0.880972 Oct 26 05:13:06.786257 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1498/2973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:05 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:06.799043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:06.799916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:06.814901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:06.815656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:06.816265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:06.817356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:06.818083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:06.822512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:08.055282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:08.080244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:08.262774 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Adding security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 to port 00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d Oct 26 05:13:08.588579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c51212204f4654b320552298e77c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5471bab47d5b41c79aa90a93547be446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:08.602641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa5d73e6-4111-482d-8735-13142b112977 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 200 len: 1472 microversion: 2.1 time: 1.815082 Oct 26 05:13:08.608593 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1499/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:06 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 1472 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:08.624367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:08.625670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:08.639206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:08.647255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:08.648335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:08.651700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:08.652804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:08.655830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:09.563381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:09.587322 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c62b8f30-00da-44e7-9c79-45d6fae3684c tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1382 microversion: 2.1 time: 0.971602 Oct 26 05:13:09.588420 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1500/2975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:08 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1382 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:09.595375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:09.597617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:09.612268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:09.613099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:09.613808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:09.614752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:09.615739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:09.616525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:10.292782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:10.311892 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-50dcda5e-3311-4f67-94d6-21efd15ab877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.720852 Oct 26 05:13:10.313218 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1501/2976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:09 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:10.318054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-119b9bf4-d466-4ae4-a0dd-374eb4b55499 req-ff3d0b33-0c83-4e26-b165-c954e69dc2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560a06b2-fb56-433f-8399-aa01b41b7fc2", "tag": "2c442610-8b4b-49ff-8b8d-96fdae17b21b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:10.346899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-119b9bf4-d466-4ae4-a0dd-374eb4b55499 req-ff3d0b33-0c83-4e26-b165-c954e69dc2c7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:10.347651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-119b9bf4-d466-4ae4-a0dd-374eb4b55499 req-ff3d0b33-0c83-4e26-b165-c954e69dc2c7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:10.348246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-119b9bf4-d466-4ae4-a0dd-374eb4b55499 req-ff3d0b33-0c83-4e26-b165-c954e69dc2c7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:10.372210 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-119b9bf4-d466-4ae4-a0dd-374eb4b55499 req-ff3d0b33-0c83-4e26-b165-c954e69dc2c7 service nova] Creating event network-changed:2c442610-8b4b-49ff-8b8d-96fdae17b21b for instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 on n-h1-862416-4 Oct 26 05:13:10.379100 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-119b9bf4-d466-4ae4-a0dd-374eb4b55499 req-ff3d0b33-0c83-4e26-b165-c954e69dc2c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064291 Oct 26 05:13:10.380200 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1502/2977] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:10.386392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:10.387341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:10.394176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:10.394914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:10.395635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:10.396744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:10.397383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:10.398058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:10.693231 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7271cb69-2ff6-4e0b-b173-77114db7290b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e/action" status: 202 len: 0 microversion: 2.1 time: 4.193860 Oct 26 05:13:10.694967 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1476/2978] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:13:06 2022] POST /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e/action => generated 0 bytes in 4195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:10.699403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:10.699988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:10.724266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:10.726067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:10.726716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:10.727632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:10.734622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:10.735389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:11.480924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:11.489427 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-123a4f8a-5faf-493d-bf0d-c0e693b68047 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 0.793889 Oct 26 05:13:11.494123 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1477/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:10 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:11.501467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66aaadd7-5344-487f-b5cb-5d3c1e2d0d64 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '.version_select at 0x7f470a937550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:11.504965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66aaadd7-5344-487f-b5cb-5d3c1e2d0d64 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:11.505526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66aaadd7-5344-487f-b5cb-5d3c1e2d0d64 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:11.505976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66aaadd7-5344-487f-b5cb-5d3c1e2d0d64 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:11.532562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66aaadd7-5344-487f-b5cb-5d3c1e2d0d64 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1555 microversion: 2.1 time: 0.037327 Oct 26 05:13:11.548597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1478/2980] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:13:11 2022] GET /compute/v2.1/os-migrations => generated 1555 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:11.554346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:11.555249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] [instance: 4966c893-463f-4a9d-b85c-c3d317a1aa44] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:11.562241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:11.563103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:11.563767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:11.564703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:11.565438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:11.566095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:11.581125 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] HTTP exception thrown: Instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 could not be found. Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Request method failure captured: Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 HTTP/1.1 Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMF0iDspzDX_VLhJPIuvURpyEaRyTrQUxw5d8-rX6Y6EwpjH3415NPwzGLUJ_ePd7OXApT3nGag-uXA19anpGgT07urZC4P5IEKzee5XrYTY3Nj3Uqxb06VT8NQsLR7vOLhAFZ6zZl6YZoURirny3ythD425A12wOs0-5Gd3HOEnXDY Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5471bab47d5b41c79aa90a93547be446 Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:11.583360 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5471bab47d5b41c79aa90a93547be446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5471bab47d5b41c79aa90a93547be446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5471bab47d5b41c79aa90a93547be446 Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-534054076 Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ImagesOneServerTestJSON-534054076-project Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f1c51212204f4654b320552298e77c3b Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ImagesOneServerTestJSON-534054076-project Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 could not be found. Oct 26 05:13:11.584856 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4966c893-463f-4a9d-b85c-c3d317a1aa44'} Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 could not be found. Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:11.585890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 could not be found. Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 could not be found. Oct 26 05:13:11.587133 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:11.589761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] Returning 404 to user: Instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:11.590863 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29a8ff04-8012-479e-80f7-80333dec63b9 tempest-ImagesOneServerTestJSON-534054076 tempest-ImagesOneServerTestJSON-534054076-project] 10.222.0.16 "GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44" status: 404 len: 111 microversion: 2.1 time: 0.041209 Oct 26 05:13:11.591973 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1479/2981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:11 2022] GET /compute/v2.1/servers/4966c893-463f-4a9d-b85c-c3d317a1aa44 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:11.611072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a8fa7484-0b6f-415f-a158-d1f07d5d7e50 req-f443d983-d0f3-415f-905d-c99dee8671ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4966c893-463f-4a9d-b85c-c3d317a1aa44", "name": "network-vif-deleted", "tag": "36d5f183-7f3f-4d3e-95fb-3a6ec18b4209"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:11.619297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:11.629091 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a2355157-a89a-4fae-9f21-715e6200b66d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1314 microversion: 2.1 time: 1.247339 Oct 26 05:13:11.635847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8fa7484-0b6f-415f-a158-d1f07d5d7e50 req-f443d983-d0f3-415f-905d-c99dee8671ab service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:11.637920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1503/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:10 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1314 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:11.638512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8fa7484-0b6f-415f-a158-d1f07d5d7e50 req-f443d983-d0f3-415f-905d-c99dee8671ab service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:11.640243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8fa7484-0b6f-415f-a158-d1f07d5d7e50 req-f443d983-d0f3-415f-905d-c99dee8671ab service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:11.644168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87576fcd-0824-45fe-9134-e526d091b3fc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f09790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:11.661604 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a8fa7484-0b6f-415f-a158-d1f07d5d7e50 req-f443d983-d0f3-415f-905d-c99dee8671ab service nova] Creating event network-vif-deleted:36d5f183-7f3f-4d3e-95fb-3a6ec18b4209 for instance 4966c893-463f-4a9d-b85c-c3d317a1aa44 on n-h2-862416-4 Oct 26 05:13:11.675651 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a8fa7484-0b6f-415f-a158-d1f07d5d7e50 req-f443d983-d0f3-415f-905d-c99dee8671ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082191 Oct 26 05:13:11.681962 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1480/2983] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:11.697116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:11.699451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:11.719183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:11.719695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:11.720211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:11.720964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:11.721461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:11.721964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.291256 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba2451a3-3a2e-4342-bc16-de769cf2ca72 tempest-LiveMigrationTest-871001720 tempest-LiveMigrationTest-871001720-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1533 microversion: 2.1 time: 0.607519 Oct 26 05:13:12.292258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1481/2984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:11 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1533 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:12.310856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:12.313461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:12.350553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:12.352269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:12.354891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-87576fcd-0824-45fe-9134-e526d091b3fc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use.", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:12.355950 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-87576fcd-0824-45fe-9134-e526d091b3fc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.355950 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87576fcd-0824-45fe-9134-e526d091b3fc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02 HTTP/1.1 Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:12.359664 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: exception: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] Oct 26 05:13:12.361253 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '0023da00-ece2-49b4-bc2f-c7c85cdf0b02'} Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:12.362133 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.363322 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:12.366488 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:12.368658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:12.368658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:12.368658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:12.368658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.368658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] Oct 26 05:13:12.368658 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:12.371049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87576fcd-0824-45fe-9134-e526d091b3fc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 400 to user: Security Group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 in use. Oct 26 05:13:12.371049 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-adc028db-7182-4db0-a18e-bcb4e6b3a5a7'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:12.372288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-87576fcd-0824-45fe-9134-e526d091b3fc tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02" status: 400 len: 185 microversion: 2.1 time: 0.732466 Oct 26 05:13:12.374040 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1504/2985] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:11 2022] DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02 => generated 185 bytes in 735 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:13:12.378125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.382117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:12.383511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:12.386845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.392295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:12.394273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:12.423179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:12.424343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:12.428233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.445655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:12.449505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:12.451648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.546716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:12.563309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:12.768272 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6334c953-04b2-4a74-8fef-f3bb2289e26f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 204 len: 0 microversion: 2.1 time: 0.392472 Oct 26 05:13:12.769881 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1505/2986] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:12 2022] DELETE /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:12.788225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:12.789408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:12.808166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:12.809553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:12.811316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.813727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:12.814318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:12.815614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:12.914729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:13.068003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bda42580-b901-4bb7-bb58-b33794f3c949 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 204 len: 0 microversion: 2.1 time: 0.291994 Oct 26 05:13:13.069610 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1506/2987] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:12 2022] DELETE /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:13.076052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:13.077289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:13.091394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:13.092752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:13.093596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:13.096112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:13.097127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:13.097804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:13.343147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:13.376806 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d149e2d-3c10-44cb-870d-4b6a960aeaa1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 1.081480 Oct 26 05:13:13.380305 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1482/2988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:12 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:13.393748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:13.394382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:13.406666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:13.407178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:13.407882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:13.409464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:13.410191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:13.410843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:13.717261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:13.731393 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31821364-f045-4fe5-8802-f2ec7af7cb77 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 0.654382 Oct 26 05:13:13.732074 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1507/2989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:13 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:13.736863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:13.745659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:13.756855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:13.765431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:13.766084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:13.766822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:13.767291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:13.767737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:13.999119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:14.011412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f57d501d-6fa1-47da-b0de-35f791cd112c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1314 microversion: 2.1 time: 0.626746 Oct 26 05:13:14.015525 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1483/2990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:13 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:14.034579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:14.039974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:14.058075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:14.058774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:14.059797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:14.060810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:14.061411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:14.065291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:14.719924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:14.743476 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1388 microversion: 2.1 time: 1.009201 Oct 26 05:13:14.745475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1508/2991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:13 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1388 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:14.747677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:14.750884 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45638a69-2469-490f-a42d-fe9453fe4fda tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003357 Oct 26 05:13:14.751692 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1509/2992] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 26 05:13:14 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 05:13:14.796737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01534544-bfd6-4966-ae95-7dd5271c956f", "tag": "ad3ac6ca-a0ca-4241-8d8b-4b347431b29d"}, {"name": "network-changed", "server_uuid": "558a1c7e-d245-4c4d-9d76-6a1f8313557e", "tag": "00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:14.827558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:14.828771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:14.829621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:14.853228 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] Creating event network-changed:ad3ac6ca-a0ca-4241-8d8b-4b347431b29d for instance 01534544-bfd6-4966-ae95-7dd5271c956f on n-h2-862416-4 Oct 26 05:13:14.859631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] Creating event network-changed:00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d for instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e on n-h1-862416-4 Oct 26 05:13:14.873651 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d79bff30-3875-40ef-990e-77b25498ebd4 req-6591a038-5ef6-48db-ac14-577ca89c9d3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085258 Oct 26 05:13:14.875658 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1510/2993] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:14.885073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9d60858b-d5d1-47b4-8203-5cfd5b76f370 req-1574602f-6b47-46c0-afa8-823bfb3765fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-unplugged", "status": "completed", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:14.899485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9d60858b-d5d1-47b4-8203-5cfd5b76f370 req-1574602f-6b47-46c0-afa8-823bfb3765fe service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:14.900362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9d60858b-d5d1-47b4-8203-5cfd5b76f370 req-1574602f-6b47-46c0-afa8-823bfb3765fe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:14.901027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9d60858b-d5d1-47b4-8203-5cfd5b76f370 req-1574602f-6b47-46c0-afa8-823bfb3765fe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:14.958423 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9d60858b-d5d1-47b4-8203-5cfd5b76f370 req-1574602f-6b47-46c0-afa8-823bfb3765fe service nova] Creating event network-vif-unplugged:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:13:14.970557 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9d60858b-d5d1-47b4-8203-5cfd5b76f370 req-1574602f-6b47-46c0-afa8-823bfb3765fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091879 Oct 26 05:13:14.971881 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1511/2994] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:14.980439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:14.982993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:14.992411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:14.993825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:14.995330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:14.996112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:14.998309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:14.999209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:14.999806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:15.020325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec562c8e-6265-46ea-bd5d-abd99f496091 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1646 microversion: 2.1 time: 1.000947 Oct 26 05:13:15.023825 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1484/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:14 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1646 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:15.355643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Calling method '.version_select at 0x7f470a1b23a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:15.369369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:15.369861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:15.370501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:15.371410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:15.372033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:15.372472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:15.383463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:15.399373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3ec09f7-e7e9-4d22-9e24-babac099d8a5 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.374192 Oct 26 05:13:15.414606 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1485/2996] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 26 05:13:15 2022] GET /compute/v2.1/limits => generated 511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:15.448507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:15.449010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:15.472455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:15.473016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:15.475950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:15.484120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:15.487680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:15.491710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:15.659988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:15.669679 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bee9a839-e984-493e-924a-e7c111cffc96 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 0.696258 Oct 26 05:13:15.670263 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1512/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:14 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:15.676010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1320086837", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:15.789086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:13:16.241448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:16.250222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac1e9831-d413-4a8f-a6d2-3951d9b1c664 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1314 microversion: 2.1 time: 0.834229 Oct 26 05:13:16.256954 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1486/2998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:15 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:16.268751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:16.281517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:16.289781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:16.290289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:16.290747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:16.291998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:16.293536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:16.293989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:16.764271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Getting quotas for project 84167595e54b4109b116c3f498c95d78. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:16.773619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Getting quotas for user ca9fd07ccbde4758acf0cbaaee91c807 and project 84167595e54b4109b116c3f498c95d78. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:16.777600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:16.799733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Request method failure captured: Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 1752 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMHqFiDjnfAgcZe9lTpFnKB2BJ3yp38dSBwYrdd1By5p5d-_DuFyTknyMXZzyMx0Nod52eUlZxougkXAgNRO72lb3HHEfTpGzclzUu_sfSRvVv0jD8Ve-FHWx4OwcyUydg2ME9pdeibPF8hkFTswcA42SBu8ZeeqRGsqjrj8dVAG7A0 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 84167595e54b4109b116c3f498c95d78 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-187274387 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84167595e54b4109b116c3f498c95d78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84167595e54b4109b116c3f498c95d78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84167595e54b4109b116c3f498c95d78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84167595e54b4109b116c3f498c95d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-187274387 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 84167595e54b4109b116c3f498c95d78 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-187274387 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-187274387-project Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: ca9fd07ccbde4758acf0cbaaee91c807 Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-187274387-project Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1320086837", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:13:16.806393 n-d-862416-4 devstack@n-api.service[120586]: exception: Maximum number of metadata items exceeds 128 Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1320086837', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:13:16.809199 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 26 05:13:16.812823 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:16.814939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:16.817582 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e83752f1-68c0-4adb-b7d2-d231da0f3da6 tempest-AbsoluteLimitsNegativeTestJSON-187274387 tempest-AbsoluteLimitsNegativeTestJSON-187274387-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.144407 Oct 26 05:13:16.819342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1513/2999] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Oct 26 05:13:15 2022] POST /compute/v2.1/servers => generated 87 bytes in 1147 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:13:16.841130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:16.841910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:16.868102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:16.870848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:16.872294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:16.876755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:16.878186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:16.881050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:16.911742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:16.937467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a241ac42-0ef9-4733-95e4-a50e15a279c1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.679630 Oct 26 05:13:16.944699 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1487/3000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:16 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:16.950132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:16.958485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:16.982939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:16.984501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:16.987110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:16.987775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:16.991933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:16.995455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:16.996091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:17.095101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:17.095833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:17.096915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:17.097731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lazy-loading 'fault' on Instance uuid 558a1c7e-d245-4c4d-9d76-6a1f8313557e {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:13:17.308623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:17.333748 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b364b39b-b308-41c3-adf6-cf9a9d3c4de7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 200 len: 1472 microversion: 2.1 time: 0.387022 Oct 26 05:13:17.374648 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1488/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:16 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 1472 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:17.392830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e6020172-d1d4-45ed-a272-e9391135ba68 req-af4e3c70-abd4-4bab-adf4-688ac9aeb080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558a1c7e-d245-4c4d-9d76-6a1f8313557e", "name": "network-vif-deleted", "tag": "00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:17.427466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e6020172-d1d4-45ed-a272-e9391135ba68 req-af4e3c70-abd4-4bab-adf4-688ac9aeb080 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:17.428727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e6020172-d1d4-45ed-a272-e9391135ba68 req-af4e3c70-abd4-4bab-adf4-688ac9aeb080 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:17.432063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e6020172-d1d4-45ed-a272-e9391135ba68 req-af4e3c70-abd4-4bab-adf4-688ac9aeb080 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:17.485463 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e6020172-d1d4-45ed-a272-e9391135ba68 req-af4e3c70-abd4-4bab-adf4-688ac9aeb080 service nova] Creating event network-vif-deleted:00c3bb2b-8b47-43d4-aa8e-2ab4d0c8d08d for instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e on n-h1-862416-4 Oct 26 05:13:17.497899 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e6020172-d1d4-45ed-a272-e9391135ba68 req-af4e3c70-abd4-4bab-adf4-688ac9aeb080 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119649 Oct 26 05:13:17.499140 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1489/3002] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:17.517899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:17.518859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:17.529172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:17.530078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:17.534149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:17.535607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:17.536094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:17.536532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:17.580143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:17.589741 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c282da8a-d1e7-4ca5-9105-ad428883ace3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1388 microversion: 2.1 time: 0.768989 Oct 26 05:13:17.590302 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1514/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:16 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1388 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:17.619382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:17.622388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:17.631537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:17.635632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:17.636103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:17.636849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:17.637466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:17.637782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.314854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:18.328054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:18.338373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10707f54-78d9-4428-b01d-235eb52c3bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 0.837384 Oct 26 05:13:18.339266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1490/3004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:17 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:18.343742 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ce9b910-9dd2-41ce-9299-763f317cb8c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.749251 Oct 26 05:13:18.349525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-73ed8eaa-3c8e-4563-b52b-4ce372d05313 req-8762a2d4-0316-477e-9e4f-79ce14b1b501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560a06b2-fb56-433f-8399-aa01b41b7fc2", "name": "network-vif-plugged", "status": "completed", "tag": "2c442610-8b4b-49ff-8b8d-96fdae17b21b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:18.349744 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1515/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:17 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:18.372020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-73ed8eaa-3c8e-4563-b52b-4ce372d05313 req-8762a2d4-0316-477e-9e4f-79ce14b1b501 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.372872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-73ed8eaa-3c8e-4563-b52b-4ce372d05313 req-8762a2d4-0316-477e-9e4f-79ce14b1b501 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.373499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-73ed8eaa-3c8e-4563-b52b-4ce372d05313 req-8762a2d4-0316-477e-9e4f-79ce14b1b501 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.390109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:18.392060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:18.398494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-73ed8eaa-3c8e-4563-b52b-4ce372d05313 req-8762a2d4-0316-477e-9e4f-79ce14b1b501 service nova] Creating event network-vif-plugged:2c442610-8b4b-49ff-8b8d-96fdae17b21b for instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 on n-h1-862416-4 Oct 26 05:13:18.411917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.414362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.414827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.415612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.416026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.417899 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-73ed8eaa-3c8e-4563-b52b-4ce372d05313 req-8762a2d4-0316-477e-9e4f-79ce14b1b501 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076216 Oct 26 05:13:18.423445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.424427 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1491/3006] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:18.435858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fedc11af-7ade-41b2-90da-e9372eedf6e0 req-99e49063-c183-4bb0-9a97-2957a6d364b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f397d6-655f-419e-bf0c-ee1e69cc8321", "name": "network-vif-deleted", "tag": "07b2594b-ca56-427c-b400-a762819750c6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:18.457338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fedc11af-7ade-41b2-90da-e9372eedf6e0 req-99e49063-c183-4bb0-9a97-2957a6d364b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.458295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fedc11af-7ade-41b2-90da-e9372eedf6e0 req-99e49063-c183-4bb0-9a97-2957a6d364b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.458978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fedc11af-7ade-41b2-90da-e9372eedf6e0 req-99e49063-c183-4bb0-9a97-2957a6d364b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.472644 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fedc11af-7ade-41b2-90da-e9372eedf6e0 req-99e49063-c183-4bb0-9a97-2957a6d364b6 service nova] Creating event network-vif-deleted:07b2594b-ca56-427c-b400-a762819750c6 for instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 on n-h2-862416-4 Oct 26 05:13:18.479635 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fedc11af-7ade-41b2-90da-e9372eedf6e0 req-99e49063-c183-4bb0-9a97-2957a6d364b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053515 Oct 26 05:13:18.481088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1492/3007] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:18.489340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:18.490310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:18.499119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.499899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.500573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.501832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.502517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.503891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.520702 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e HTTP/1.1 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '558a1c7e-d245-4c4d-9d76-6a1f8313557e'} Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:18.522965 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:18.527995 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:18.530002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:18.531111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da4c9afb-8bee-463f-acbd-3ab4fbe835aa tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 404 len: 111 microversion: 2.1 time: 0.048626 Oct 26 05:13:18.532953 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1493/3008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:18 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:18.539145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:18.540056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:18.547260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.548110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.548774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.549769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:18.550446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:18.551111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:18.935265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:18.945091 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c4c950ee-5fcc-4a24-816e-4d2653b13e15 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1314 microversion: 2.1 time: 0.576039 Oct 26 05:13:18.954905 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1516/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:18 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:18.981353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-13355151-04f9-4e8a-80f9-ace7144bb40e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709eea280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:18.983594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:18.997848 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce8688d8-c6df-4bbc-8937-6b10343851c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.463318 Oct 26 05:13:18.998666 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1494/3010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:18 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:19.020539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:19.021218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:19.034182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.037857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.041109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:19.041941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.042426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.044784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:19.188938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:19.205102 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28da1a0d-5cb5-490c-8975-af38eefc1dd1 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1183 microversion: 2.1 time: 0.192460 Oct 26 05:13:19.205802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1495/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:19 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:19.213941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:19.216640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:19.236716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.242269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.243064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:19.245642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.246422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.248660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:19.414559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ac4ea4a-8545-4548-ab46-23d6829153ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.206104 Oct 26 05:13:19.418654 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1496/3012] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:13:19 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:19.526684 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-13355151-04f9-4e8a-80f9-ace7144bb40e tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05" status: 202 len: 0 microversion: 2.1 time: 0.570431 Oct 26 05:13:19.527598 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1517/3013] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:18 2022] DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:19.532823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:19.534252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:19.548416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.548936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.554105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:19.555094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.555591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.556036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:19.874867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1386036332", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:19.984098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:19.984803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:19.985504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:19.986104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:19.986741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:19.997690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:19.998494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:19.999132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:20.000093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:20.000758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:20.001424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:20.021805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Getting quotas for project 123cc71a44084278a9da1ead2d46118f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:20.029197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Getting quotas for user 30a3704834514180b2f696e39949589b and project 123cc71a44084278a9da1ead2d46118f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:20.059477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:13:20.064766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:20.157690 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57212995-5681-44d7-a340-c224d92e8ae1 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.733405 Oct 26 05:13:20.158488 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1497/3014] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:13:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:13:20.178695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:20.182207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:20.202570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:20.203344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:20.203976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:20.204872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:20.206738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:20.207377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:20.663876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:20.674548 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ad15dd2-ac33-404d-9bf9-838addf348bf tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1670 microversion: 2.1 time: 0.507863 Oct 26 05:13:20.705648 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1498/3015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:20 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:20.732696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cdfba7b5-fe6d-40ba-aa07-5802f4e8db9d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a875940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:20.831505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:20.855844 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09ef09b7-91c8-4cad-b4ea-762fe7f2320f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 1.315393 Oct 26 05:13:20.856871 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1518/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:19 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:20.876212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:20.877470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:20.893989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:20.896116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:20.900012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:20.900994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:20.901767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:20.915067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.322487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:21.334788 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a4fe7b1-71f4-4729-af33-996a663f0168 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1502 microversion: 2.1 time: 0.476452 Oct 26 05:13:21.337019 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1519/3017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:20 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:21.354188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:21.355461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:21.366666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.367186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.367641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.368405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.368822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.369259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.757217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:21.767990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:21.769502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:21.782020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a2e4438-be0f-495c-82bf-c24e82d75ff9 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1" status: 200 len: 1330 microversion: 2.47 time: 0.442283 Oct 26 05:13:21.782954 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1520/3018] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:21 2022] GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 => generated 1330 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:21.794539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cdfba7b5-fe6d-40ba-aa07-5802f4e8db9d tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02" status: 202 len: 0 microversion: 2.1 time: 1.087397 Oct 26 05:13:21.805680 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1499/3019] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:20 2022] DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:21.817289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-89516678-a711-46ba-9948-dce56dfdf9d7 req-1f3e0d92-f9f7-4515-b96c-ddd2c6ff008a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01534544-bfd6-4966-ae95-7dd5271c956f", "name": "network-vif-plugged", "status": "completed", "tag": "ad3ac6ca-a0ca-4241-8d8b-4b347431b29d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:21.823925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:21.830083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:21.847383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.848064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.857263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.860515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-89516678-a711-46ba-9948-dce56dfdf9d7 req-1f3e0d92-f9f7-4515-b96c-ddd2c6ff008a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.860753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.861531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.862079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.863898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-89516678-a711-46ba-9948-dce56dfdf9d7 req-1f3e0d92-f9f7-4515-b96c-ddd2c6ff008a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.865019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-89516678-a711-46ba-9948-dce56dfdf9d7 req-1f3e0d92-f9f7-4515-b96c-ddd2c6ff008a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.906908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-89516678-a711-46ba-9948-dce56dfdf9d7 req-1f3e0d92-f9f7-4515-b96c-ddd2c6ff008a service nova] Creating event network-vif-plugged:ad3ac6ca-a0ca-4241-8d8b-4b347431b29d for instance 01534544-bfd6-4966-ae95-7dd5271c956f on n-h2-862416-4 Oct 26 05:13:21.927545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-89516678-a711-46ba-9948-dce56dfdf9d7 req-1f3e0d92-f9f7-4515-b96c-ddd2c6ff008a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117785 Oct 26 05:13:21.934101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1500/3020] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:21.951373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:21.952873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:21.964758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.974393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.975288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:21.976912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:21.977541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:21.978082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:22.093579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:22.109094 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9198f28c-f799-451f-b57c-74d914c4df94 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1183 microversion: 2.1 time: 0.322490 Oct 26 05:13:22.121339 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1521/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:21 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:22.121339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5aaf2b2f-d6b9-422f-a639-415e66f558da tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'create', calling method: .version_select at 0x7f4709fbf9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1914710063", "description": "tempest-description-2056085234"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:22.609322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:22.622017 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c421b544-3157-4952-bf45-db57488eb11d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.686502 Oct 26 05:13:22.637748 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1501/3022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:21 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:22.648224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:22.660942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:22.669068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:22.669916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:22.670560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:22.671432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:22.672068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:22.682159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.173957 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5aaf2b2f-d6b9-422f-a639-415e66f558da tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.062701 Oct 26 05:13:23.174598 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1522/3023] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:13:22 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:23.181225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-703967575", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:23.332088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:23.336398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:23.337356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:23.341304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:23.348301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:23.383054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:23.391720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2a47027c-c0a7-49a8-822c-54e5ffaf93d9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1317 microversion: 2.1 time: 0.751999 Oct 26 05:13:23.397601 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1502/3024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:22 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:23.398444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:23.398956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:23.399414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.400174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:23.400645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:23.407942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.418285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:23.421721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:23.430994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:23.431642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:23.432454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.433564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:23.434131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:23.435304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.489844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Getting quotas for project 123cc71a44084278a9da1ead2d46118f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:23.499918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Getting quotas for user 30a3704834514180b2f696e39949589b and project 123cc71a44084278a9da1ead2d46118f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:23.525996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:13:23.529006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:23.539777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3750cc20-6ed8-4fe1-a952-d3671a2192d7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 200 len: 322 microversion: 2.1 time: 0.140177 Oct 26 05:13:23.547096 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1503/3025] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:13:23 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:23.581189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:23.582694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:23.597849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:23.598556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:23.599107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.601095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:23.602044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:23.603046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:23.707635 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bfce5c45-6a5d-4f77-929b-086bc006c544 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.531275 Oct 26 05:13:23.708309 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1523/3026] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:13:23.723251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bda93e5f-6893-417b-954a-c7b17c3158d7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Action: 'update', calling method: .version_select at 0x7f4709fbfdc0>, body: {"security_group": {"name": "tempest-sg-hth-1075481219", "description": "tempest-description-hth-1300978534"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:23.933810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:23.949263 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5101d758-fad0-447b-8b18-a60a46e8cab8 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1183 microversion: 2.1 time: 0.391756 Oct 26 05:13:23.966305 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1504/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:23 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1183 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:23.976878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:23.989167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:24.077809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:24.079781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:24.087262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:24.093261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:24.098766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:24.102807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:24.688804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:24.718128 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e0c9560-7957-4934-92ac-b7db16a6e08c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.748840 Oct 26 05:13:24.745403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1505/3028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:23 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:24.762808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09d1293a-c92e-4ad7-a9ab-78b3f5e4af32 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:24.775202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09d1293a-c92e-4ad7-a9ab-78b3f5e4af32 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:24.861823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d1293a-c92e-4ad7-a9ab-78b3f5e4af32 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:24.862877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d1293a-c92e-4ad7-a9ab-78b3f5e4af32 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:24.868376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d1293a-c92e-4ad7-a9ab-78b3f5e4af32 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:24.890614 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bda93e5f-6893-417b-954a-c7b17c3158d7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/b19f86aa-1b6a-4d98-ad47-19224fc87314" status: 200 len: 218 microversion: 2.1 time: 1.180782 Oct 26 05:13:24.892520 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1524/3029] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Oct 26 05:13:23 2022] PUT /compute/v2.1/os-security-groups/b19f86aa-1b6a-4d98-ad47-19224fc87314 => generated 218 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:24.899046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:24.908191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:24.926234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:24.926733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:24.927175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:24.932207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:24.932810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:24.933224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:25.023641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:25.027905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:25.052631 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09d1293a-c92e-4ad7-a9ab-78b3f5e4af32 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "PUT /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 991 microversion: 2.47 time: 0.305935 Oct 26 05:13:25.070580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1506/3030] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Oct 26 05:13:24 2022] PUT /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 991 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:13:25.082295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:25.083164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:25.094639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:25.095226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:25.095909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:25.096802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:25.097524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:25.098120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:25.672552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:25.684045 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-255675c9-0b9f-47ea-8601-cf50321e026d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1465 microversion: 2.1 time: 0.790316 Oct 26 05:13:25.691309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:25.701214 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1525/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:24 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1465 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:25.717024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48ebbb02-0587-47f1-b2e2-c2328a3cf280 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f851f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:25.726755 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e7b08547-812b-48a6-ac52-5b7f0ffe50a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.654431 Oct 26 05:13:25.727575 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1507/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:25 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:25.736411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:25.737179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:25.758559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:25.759337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:25.759956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:25.760855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:25.761587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:25.762443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:25.979491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:25.988906 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3fb1276f-0c60-4f8f-8de5-1bc3bbc3a502 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1183 microversion: 2.1 time: 0.260172 Oct 26 05:13:25.998782 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1508/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:25 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:26.018115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:26.018766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:26.024523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48ebbb02-0587-47f1-b2e2-c2328a3cf280 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/b19f86aa-1b6a-4d98-ad47-19224fc87314" status: 200 len: 218 microversion: 2.1 time: 0.321055 Oct 26 05:13:26.029446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1526/3034] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:13:25 2022] GET /compute/v2.1/os-security-groups/b19f86aa-1b6a-4d98-ad47-19224fc87314 => generated 218 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:26.043097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.043944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.049408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97793dfa-fbc6-4faa-b030-737724b87c5d"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:26.052629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.053533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.054027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.054482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.062701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:26.097818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.098559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.099109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.100868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.101888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.102886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.336717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:26.348868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:26.351172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:26.352363 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93b5ed1c-d1d7-4ab7-aec4-880dcba4a1f7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1329 microversion: 2.47 time: 0.352289 Oct 26 05:13:26.357036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1509/3035] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:25 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1329 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:26.640547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:26.641500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:26.650558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.654748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.659355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.660697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.661457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.662141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.720249 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c220917-9c65-4ec4-87cf-9dce99fae702 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681755 Oct 26 05:13:26.725363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1527/3036] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:13:26 2022] POST /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:26.733758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:26.734496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:26.753553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.758150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.758620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:26.759557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:26.760252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:26.760956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:27.170957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:27.189389 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b1d0a01-1a3c-4186-938c-bb3c156aa8a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.465141 Oct 26 05:13:27.201345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1528/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:26 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:27.207322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-44ac8924-d316-4a98-b4e2-431e29e27449 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f234c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:27.742295 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e25ce45d-bf11-4b83-adef-035f986ce4f0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1616 microversion: 2.1 time: 1.377089 Oct 26 05:13:27.744342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1510/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:26 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1616 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:27.770327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:27.772939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:27.794562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:27.796639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:27.797345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:27.800088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:27.800883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:27.803908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:27.885197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:27.887484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:27.888065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:27.889081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lazy-loading 'fault' on Instance uuid c1f397d6-655f-419e-bf0c-ee1e69cc8321 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:13:27.989598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:28.013735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2cd1b08e-0c9a-4d61-bb66-fc5351a59fe3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 200 len: 1188 microversion: 2.1 time: 0.258392 Oct 26 05:13:28.029764 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-44ac8924-d316-4a98-b4e2-431e29e27449 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b19f86aa-1b6a-4d98-ad47-19224fc87314" status: 202 len: 0 microversion: 2.1 time: 0.836827 Oct 26 05:13:28.031937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1529/3039] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:27 2022] DELETE /compute/v2.1/os-security-groups/b19f86aa-1b6a-4d98-ad47-19224fc87314 => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:28.037662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.037895 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1511/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:27 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 1188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:28.038668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:28.048219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.053372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.056697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:28.057688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.059848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.064006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.070042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.071231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.071876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.072675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.073160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.075606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.076851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.077360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.267749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:28.279962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:28.282031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:28.291287 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4308982-be1f-4258-802b-470bf3777ed6 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1335 microversion: 2.47 time: 0.244781 Oct 26 05:13:28.293287 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1512/3041] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:28 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1335 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:28.299107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:28.308667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99bf26e1-9fd4-4403-b97b-1f578750a4af tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.274933 Oct 26 05:13:28.314065 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1530/3042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:28 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:28.325199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.338126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:28.349299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb3fcc2b-3491-4fe2-a55f-fbd842652219 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: .version_select at 0x7f4709e6d550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1248231551", "policies": ["affinity"]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:28.379136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.379655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.386610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.387765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.389509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.390235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.415875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-eb3fcc2b-3491-4fe2-a55f-fbd842652219 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:28.421006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.429670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-eb3fcc2b-3491-4fe2-a55f-fbd842652219 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e HTTP/1.1 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '558a1c7e-d245-4c4d-9d76-6a1f8313557e'} Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:28.431939 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.436902 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.438932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:28.440021 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0073f8e2-49a1-4ecf-89e8-975cdb10bdc8 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 404 len: 111 microversion: 2.1 time: 0.124784 Oct 26 05:13:28.440819 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1531/3043] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:28 2022] DELETE /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:28.450067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.454195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: 558a1c7e-d245-4c4d-9d76-6a1f8313557e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:28.477851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.478644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.479246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.480181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:28.480803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:28.481587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:28.519163 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e HTTP/1.1 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '558a1c7e-d245-4c4d-9d76-6a1f8313557e'} Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.522366 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. Oct 26 05:13:28.527005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.538269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Instance 558a1c7e-d245-4c4d-9d76-6a1f8313557e could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:28.539877 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f87c02e5-27c1-4303-813c-c2cdcd1391fe tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e" status: 404 len: 111 microversion: 2.1 time: 0.094311 Oct 26 05:13:28.540849 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1532/3044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:28 2022] GET /compute/v2.1/servers/558a1c7e-d245-4c4d-9d76-6a1f8313557e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:28.542777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-eb3fcc2b-3491-4fe2-a55f-fbd842652219 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:28.549168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709f23af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.564102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-eb3fcc2b-3491-4fe2-a55f-fbd842652219 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:28.588052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:28.588342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:28.589391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:13:28.589926 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.589926 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] Oct 26 05:13:28.590160 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb3fcc2b-3491-4fe2-a55f-fbd842652219 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.293966 Oct 26 05:13:28.601922 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1513/3045] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 26 05:13:28 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:28.607691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-722338086", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "51e64d69-11bc-4d31-bfc7-b6ed610b422e"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02 HTTP/1.1 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '0023da00-ece2-49b4-bc2f-c7c85cdf0b02'} Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:28.609648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] Oct 26 05:13:28.613690 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.619276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group 0023da00-ece2-49b4-bc2f-c7c85cdf0b02 does not exist Oct 26 05:13:28.619276 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-bd605202-812a-4231-9272-2f34d2a90663'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:28.622630 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a58efbb3-a2c5-4707-a728-fcac088df9ef tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02" status: 404 len: 194 microversion: 2.1 time: 0.077209 Oct 26 05:13:28.626560 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1533/3046] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:28 2022] DELETE /compute/v2.1/os-security-groups/0023da00-ece2-49b4-bc2f-c7c85cdf0b02 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:28.634970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709e9ba60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.700145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] validate_networks() for [('51e64d69-11bc-4d31-bfc7-b6ed610b422e', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:13:28.735378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:28.736027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group 68dd6786-e18e-45d8-9880-62a862e72e05 not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:13:28.736606 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.736606 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05 HTTP/1.1 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '68dd6786-e18e-45d8-9880-62a862e72e05'} Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:28.739415 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group 68dd6786-e18e-45d8-9880-62a862e72e05 does not exist Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-aae4d3e7-041b-4499-9acd-60128af42df4'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82f29a67-5595-43f0-9af6-2dea5f2a7ac7 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05" status: 404 len: 194 microversion: 2.1 time: 0.109923 Oct 26 05:13:28.747940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1534/3047] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:28 2022] DELETE /compute/v2.1/os-security-groups/68dd6786-e18e-45d8-9880-62a862e72e05 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:13:28.757352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709ef4670>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:28.832328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:28.832706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:13:28.833278 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.833278 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1 HTTP/1.1 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '4808ac47-fda9-43b7-a276-501e9b35f1c1'} Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:28.836316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group 4808ac47-fda9-43b7-a276-501e9b35f1c1 does not exist Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-4023f93a-c072-4006-916e-2a5d3f2b6b04'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-424cb7a7-6961-4ec1-a344-66d46a58b5e9 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1" status: 404 len: 194 microversion: 2.1 time: 0.091421 Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1535/3048] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:28 2022] DELETE /compute/v2.1/os-security-groups/4808ac47-fda9-43b7-a276-501e9b35f1c1 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:13:28.845863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-680807693", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b761d15b-bebf-4351-ad4c-fea51b5de71d"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:28.942214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:13:29.537137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:29.539085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:29.539883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:29.541139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:29.542547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:29.586104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:29.588656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:29.590772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:29.593462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:29.594945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:29.598020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:29.656754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:29.679970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:29.708721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Going to run 2 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:13:29.711739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:29.828261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:29.839545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:29.922582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:29.929827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:29.931109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:29.931889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:29.932476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:29.933080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:29.934412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:29.944871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:29.946034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:29.947015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:29.947910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:29.948549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:29.949351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:29.959771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=d2aecf79-7575-4b25-95c2-58a59a2d7d35,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:29.978239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:29.985202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for user 4c2aa94263344a7eb33bcc7c6594229a and project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:30.003219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:13:30.006681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:30.064661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:30.081930 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-38197a80-a0ff-4e85-bedc-0fd073e8c053 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478108 Oct 26 05:13:30.090361 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1514/3049] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:13:30.096346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a875d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:30.102338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:30.115921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:30.124306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:30.125121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 not found {{(pid=120585) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:13:30.126072 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.126072 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68 HTTP/1.1 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd25f29c8-4e97-418c-ab2d-92f6ffef0f68'} Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:30.128737 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] Oct 26 05:13:30.133699 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.139142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group d25f29c8-4e97-418c-ab2d-92f6ffef0f68 does not exist Oct 26 05:13:30.139142 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-41fe6d35-0748-4cc5-81cf-0fd0a56ad451'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:30.140316 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa3b6335-f276-4180-83e6-3a81b26b8225 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68" status: 404 len: 194 microversion: 2.1 time: 0.048795 Oct 26 05:13:30.141192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1515/3050] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:30 2022] DELETE /compute/v2.1/os-security-groups/d25f29c8-4e97-418c-ab2d-92f6ffef0f68 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:30.218766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:30.236789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:30.353288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb815277-3b6a-4da3-8b11-89897daecea4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.513915 Oct 26 05:13:30.354680 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1536/3051] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:13:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1516 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:13:30.366898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:30.367939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c1f397d6-655f-419e-bf0c-ee1e69cc8321] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:30.382591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:30.383302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:30.383913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:30.384946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:30.385936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:30.387162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:30.405280 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] HTTP exception thrown: Instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 could not be found. Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Request method failure captured: Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 HTTP/1.1 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMApVsH4yMAzNlWrbXtsGyC6cVt19dYW3mIRpweksv3Ngi8Z44_eljb5r-9tp3XUsipUeg6SvZcv19v-4Lu3Upupc_qY22JVnZmHpTYNGUBdeHXNCI_J4fhxikgkkyepNGri9qX3ptfDcDOHO_7E90CSBmkFLDtMlrs7N99N3KCbE-M Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-LiveMigrationTest-440887043 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dbd1775d9dd04820aec1aa2efde776e1 Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 could not be found. Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c1f397d6-655f-419e-bf0c-ee1e69cc8321'} Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 could not be found. Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 could not be found. Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:30.407789 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 could not be found. Oct 26 05:13:30.413247 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:30.418030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Returning 404 to user: Instance c1f397d6-655f-419e-bf0c-ee1e69cc8321 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:30.419343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-20136086-ad10-4a52-b032-c24c5bf1b87f tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321" status: 404 len: 111 microversion: 2.1 time: 0.063215 Oct 26 05:13:30.420107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1537/3052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:30 2022] GET /compute/v2.1/servers/c1f397d6-655f-419e-bf0c-ee1e69cc8321 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:30.441458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:30.442395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:30.458380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:30.458889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:30.463833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:30.464807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:30.465690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:30.466763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:30.689227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:30.701302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:30.705128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:30.707626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d13f144-4c27-4040-83c1-263106f9a652 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1335 microversion: 2.47 time: 0.286276 Oct 26 05:13:30.708946 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1538/3053] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:30 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1335 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:30.718833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af073724-9dfd-48cb-a5f2-0f15508c34c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:30.719957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af073724-9dfd-48cb-a5f2-0f15508c34c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:30.748914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1329947018", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bac81520-1baa-4c42-8100-ebc9048d81f4"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:30.916804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] validate_networks() for [('bac81520-1baa-4c42-8100-ebc9048d81f4', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:13:30.932747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-af073724-9dfd-48cb-a5f2-0f15508c34c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:30.946004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af073724-9dfd-48cb-a5f2-0f15508c34c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1214 microversion: 2.1 time: 0.233462 Oct 26 05:13:30.947363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1539/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:30 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:30.957943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709e9b0d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:31.101966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:31.102744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:13:31.103773 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.103773 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1 HTTP/1.1 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c679bd6d-261e-4c29-b4ce-2dbf83e628d1'} Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:31.106833 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group c679bd6d-261e-4c29-b4ce-2dbf83e628d1 does not exist Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-9fe4651b-0e13-4f79-b463-1179ffbd31ba'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a277279f-20b5-4d5d-9182-59a601888b82 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1" status: 404 len: 194 microversion: 2.1 time: 0.158726 Oct 26 05:13:31.110896 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1540/3055] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:30 2022] DELETE /compute/v2.1/os-security-groups/c679bd6d-261e-4c29-b4ce-2dbf83e628d1 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:31.124541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:31.129291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:31.160023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Searching by: {'deleted': False, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:13:31.215190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:31.218893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:31.221698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:31.239164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:31.241492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:31.243346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:31.324746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:13:31.398680 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.285555 Oct 26 05:13:31.399703 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1541/3056] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:13:31 2022] GET /compute/v2.1/servers => generated 1002 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:31.401880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:31.403990 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-413cefe3-1664-4651-81d9-b991eb655b0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003043 Oct 26 05:13:31.412837 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1542/3057] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 26 05:13:31 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 05:13:31.420119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f4709e9b0d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:31.569152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:13:31.570043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Neutron security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:13:31.570775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.570775 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401 HTTP/1.1 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'ef4cd84f-b1b3-43ef-bf45-af20d3a20401'} Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:13:31.573630 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] Oct 26 05:13:31.577567 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:31.582171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Security group ef4cd84f-b1b3-43ef-bf45-af20d3a20401 does not exist Oct 26 05:13:31.582171 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-8cff792b-efbc-46d6-8e4b-a94a5ddcc4f6'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:31.583424 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a8852c6-4fc5-4397-80aa-c32e5d5082ea tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401" status: 404 len: 194 microversion: 2.1 time: 0.168947 Oct 26 05:13:31.588869 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1543/3058] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:31 2022] DELETE /compute/v2.1/os-security-groups/ef4cd84f-b1b3-43ef-bf45-af20d3a20401 => generated 194 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:31.603030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48bba649-69aa-4f27-bf09-3f04bc891bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:31.604019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-48bba649-69aa-4f27-bf09-3f04bc891bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:32.254971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-48bba649-69aa-4f27-bf09-3f04bc891bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:32.264247 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48bba649-69aa-4f27-bf09-3f04bc891bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1218 microversion: 2.1 time: 0.673625 Oct 26 05:13:32.265099 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1544/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:31 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1218 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:32.266528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48bba649-69aa-4f27-bf09-3f04bc891bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:32.267794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48bba649-69aa-4f27-bf09-3f04bc891bb7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001625 Oct 26 05:13:32.276020 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1545/3060] 10.222.0.16 () {54 vars in 1035 bytes} [Wed Oct 26 05:13:32 2022] GET /compute/v2/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 26 05:13:32.284030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:32.284790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:32.300475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.301254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:32.301795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:32.301974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.302595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.302725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:32.304027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:32.304393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:32.304792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.305499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.306979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.320537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.321297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.323008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.324420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.325230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.325973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.354130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Getting quotas for project 70a976fe749244c58556050fb4c7a70b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:32.360536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Getting quotas for user 9dc40bd8c6f54e0ba9a74a5844816c11 and project 70a976fe749244c58556050fb4c7a70b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:32.375720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:13:32.378063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:32.438744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:32.466858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82574938-de86-483f-8ec2-95aa2c512f86 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.324356 Oct 26 05:13:32.475116 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1516/3061] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:13:32.481182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:32.482056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:32.492683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.493634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.494674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.496921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.498275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.499633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.694985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:32.706788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:32.708423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:32.709801 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1356 microversion: 2.47 time: 0.233207 Oct 26 05:13:32.741156 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d05a24b-89f4-4e38-a546-87107d80ea27 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 204 len: 0 microversion: 2.1 time: 0.463206 Oct 26 05:13:32.747518 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1546/3062] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:32 2022] DELETE /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:32.748964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1517/3063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:32 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:32.758112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:32.760830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:32.765261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:32.766186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-213cd2a3-44c3-4a0c-848d-b19d42196c05 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.015775 Oct 26 05:13:32.773143 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1518/3064] 10.222.0.16 () {54 vars in 1041 bytes} [Wed Oct 26 05:13:32 2022] GET /compute/v2.1/ => generated 388 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:32.784908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.785493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.786382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.790650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:32.791214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:32.792625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:32.797867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4621438-323f-4c56-b504-70bc4b3dc310 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:32.798476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4621438-323f-4c56-b504-70bc4b3dc310 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:32.992592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4621438-323f-4c56-b504-70bc4b3dc310 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:33.003078 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4621438-323f-4c56-b504-70bc4b3dc310 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1218 microversion: 2.1 time: 0.228389 Oct 26 05:13:33.009035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:33.018771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0b96b93-245b-4925-a2aa-16a3f9497084 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1274 microversion: 2.1 time: 0.269797 Oct 26 05:13:33.019689 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1519/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:32 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:33.029330 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1547/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:32 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:33.035170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:33.043932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:33.045550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:33.046060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:33.068532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.069042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.069663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.070221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.070634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.072128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.072702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.073422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.074335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.074901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.075533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.077514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.266612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:33.267040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:33.267522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:33.267937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:33.268342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:33.460306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:33.467914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.469029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.470222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.471113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.471784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.472377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.507223 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "POST /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda/action" status: 202 len: 1078 microversion: 2.47 time: 0.485063 Oct 26 05:13:33.508737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1520/3067] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:13:33 2022] POST /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda/action => generated 1078 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 05:13:33.509921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:33.511364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b273db7a-9320-4a2a-8220-6bd5add36d24 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001481 Oct 26 05:13:33.511951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1521/3068] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 26 05:13:33 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 05:13:33.562625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:33.563941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:33.591228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.596763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.597548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.603473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.606708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.609975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.628566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:33.649608 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3afd5b3-6518-4716-990d-d9cdfc82a4d6 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1645 microversion: 2.1 time: 0.612147 Oct 26 05:13:33.650257 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1548/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:33 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1645 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:33.676131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:33.680687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:33.699329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.700152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.702339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.703245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:33.706557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:33.707294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:33.929791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:33.939998 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fffd39c-6980-4752-a4ff-cf52f37208c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1214 microversion: 2.1 time: 0.426898 Oct 26 05:13:33.940960 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1522/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:33 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1214 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:33.970533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:34.018606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:34.026785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:34.029585 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a3235e86-a547-4e5a-848d-a4a0c52b0f16 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.365363 Oct 26 05:13:34.042253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:34.043148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:34.043291 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1549/3071] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:33 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:34.057112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:34.064326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:34.071888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.078032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.078748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.083971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.087794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.088452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.107770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.109857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.111890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.112951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.114890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.118430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.241188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:34.254712 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c705632b-acba-4b3b-af0b-b68155d98e35 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1222 microversion: 2.1 time: 0.216190 Oct 26 05:13:34.259179 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1523/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:34 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:34.347800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:34.357273 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-edb15de0-0b4c-42bf-aa52-9067c788f3e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1272 microversion: 2.1 time: 0.312088 Oct 26 05:13:34.365761 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1550/3073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:34 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:34.680891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:34.682304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:34.699454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.700388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.701743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.703023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.705909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.707826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.966951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:34.968636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:34.983713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.984229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.984684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:34.985435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:34.998755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:34.999270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:35.320422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:35.330387 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb345791-0ad5-48d5-af5f-aec192f3d957 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1270 microversion: 2.1 time: 0.367646 Oct 26 05:13:35.346127 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1551/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:34 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1270 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:35.354112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:35.354744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:35.383334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:35.383852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:35.393641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:35.394656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:35.395225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:35.400426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:35.512250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:35.671505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:35.683782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:35.685254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:35.702879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00a36b6f-1b09-48ee-bbec-3a2a9755545e tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.352722 Oct 26 05:13:35.703796 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1552/3075] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:35 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:35.708588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:35.709296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:35.742871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:35.743676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:35.748051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:35.758649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:35.759541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:35.760215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:36.009882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:36.019308 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84f3186d-5b98-416e-b076-48becba031ee tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1270 microversion: 2.1 time: 0.314426 Oct 26 05:13:36.026082 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1553/3076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:35 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1270 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:36.033941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:36.038235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:36.059652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:36.061554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:36.062251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:36.070605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:36.071510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:36.072184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:36.106318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:36.114982 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ba9d4a2-5869-432e-8de2-695d6880b0d1 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1645 microversion: 2.1 time: 1.438730 Oct 26 05:13:36.133824 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1524/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:34 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1645 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:36.375242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:36.376477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:36.386793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:36.388047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:36.389468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:36.391672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:36.392376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:36.402301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:36.660721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:36.678749 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bb451d9-8d80-4dfe-bada-cb3f44814086 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1288 microversion: 2.1 time: 0.306551 Oct 26 05:13:36.698544 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1525/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:36 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1288 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:36.733556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:36.734471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:36.748136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:36.751020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:36.765665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:36.770973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:36.772279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:36.775424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.164284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.179240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.180956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.184366 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c8be762-5c56-4e95-ae84-8e9e79bad89d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.455079 Oct 26 05:13:37.188254 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1526/3079] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:36 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:13:37.201826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7f1cf7f0-5d53-4c86-a9e4-edc68ee2913b req-6b216a68-11be-40f4-b233-bbd426f87df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c757ce8f-1ab1-43b1-af99-ed0a9906061c", "name": "network-vif-deleted", "tag": "d9bc1b0e-4950-4818-b099-c95c34e796e4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:37.233384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7f1cf7f0-5d53-4c86-a9e4-edc68ee2913b req-6b216a68-11be-40f4-b233-bbd426f87df5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.244456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7f1cf7f0-5d53-4c86-a9e4-edc68ee2913b req-6b216a68-11be-40f4-b233-bbd426f87df5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.245971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7f1cf7f0-5d53-4c86-a9e4-edc68ee2913b req-6b216a68-11be-40f4-b233-bbd426f87df5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.273532 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7f1cf7f0-5d53-4c86-a9e4-edc68ee2913b req-6b216a68-11be-40f4-b233-bbd426f87df5 service nova] Creating event network-vif-deleted:d9bc1b0e-4950-4818-b099-c95c34e796e4 for instance c757ce8f-1ab1-43b1-af99-ed0a9906061c on n-h2-862416-4 Oct 26 05:13:37.283957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7f1cf7f0-5d53-4c86-a9e4-edc68ee2913b req-6b216a68-11be-40f4-b233-bbd426f87df5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092097 Oct 26 05:13:37.284887 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1527/3080] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:37.301723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:37.302776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:37.323360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.325201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.327044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.329988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.335362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.336171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.341789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:37.364180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.377230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d36665eb-16ac-4d2a-adf3-223460d0a379 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 1.349701 Oct 26 05:13:37.381435 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1554/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:36 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:37.395661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:37.400396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:37.426391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.429037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.429702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.430605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.435558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.437448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.542682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.545285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.548506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.552577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lazy-loading 'fault' on Instance uuid c757ce8f-1ab1-43b1-af99-ed0a9906061c {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:13:37.618565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.627956 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17803cdc-893f-4552-81af-83a48e0f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1276 microversion: 2.1 time: 0.337435 Oct 26 05:13:37.628538 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1528/3082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:37 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1276 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:37.690423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c296433625e849448fc3bb355334421d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfda33e8334078bdae14fdfed8320f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.703069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:37.703297 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4564acd2-36c3-46ed-8805-318cbf92704b tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 200 len: 1305 microversion: 2.1 time: 0.320090 Oct 26 05:13:37.703775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:37.704333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1555/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:37 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 1305 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:37.732214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.733765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.735796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.737393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:37.738097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:37.739915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:37.933960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:37.944413 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8bdd1a89-6dc7-4724-ac06-04794f91f045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1276 microversion: 2.1 time: 0.244600 Oct 26 05:13:37.948964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1529/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:37 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:38.219461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:38.221245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:38.247863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.248412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.248865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.249652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.250146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.250606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.403442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:38.404065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:38.421410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.422239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.422896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.424379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.425069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.426059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.480783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:38.495409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:38.497715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:38.499412 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abd42f71-898a-43d7-9ca7-dccddbc64512 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.284938 Oct 26 05:13:38.500596 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1556/3085] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:38 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:38.658126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:38.659847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:38.684121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.685203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.686785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.688845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.692955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.697859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.824021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:38.843041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c452dee0-f807-403d-ab16-e931cecfaaf1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.443414 Oct 26 05:13:38.845750 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1530/3086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:38 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:38.851361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:38.851983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] [instance: c757ce8f-1ab1-43b1-af99-ed0a9906061c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:38.896054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.897066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.897712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.898629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:38.899258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:38.899859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:38.936706 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] HTTP exception thrown: Instance c757ce8f-1ab1-43b1-af99-ed0a9906061c could not be found. Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Request method failure captured: Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c HTTP/1.1 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFzngRc0wPsyqZIMrXW9yUzBMhE50FaQ-ZFf75AGOGnb3Nc3e-sFISQ7KxQPGWCKx2RYs6CgKk7tTED7z3yCOxLg70FQn20zwtMwqZ_7cT4jb_83jE2v5jqiXG2KJnEMMmYy2rp_LH3I755pY_k8slACmdFgv_9xc6w4AKD74Ucq0k Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40bfda33e8334078bdae14fdfed8320f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 40bfda33e8334078bdae14fdfed8320f Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-698421021 Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c296433625e849448fc3bb355334421d Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupsTestJSON-698421021-project Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c757ce8f-1ab1-43b1-af99-ed0a9906061c could not be found. Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c757ce8f-1ab1-43b1-af99-ed0a9906061c'} Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c757ce8f-1ab1-43b1-af99-ed0a9906061c could not be found. Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c757ce8f-1ab1-43b1-af99-ed0a9906061c could not be found. Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:38.938717 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c757ce8f-1ab1-43b1-af99-ed0a9906061c could not be found. Oct 26 05:13:38.943942 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:38.945170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Returning 404 to user: Instance c757ce8f-1ab1-43b1-af99-ed0a9906061c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:38.947911 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22bf7714-a3f1-4e9b-a5c4-d99450cc3322 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c" status: 404 len: 111 microversion: 2.1 time: 0.101030 Oct 26 05:13:38.950114 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1531/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:38 2022] GET /compute/v2.1/servers/c757ce8f-1ab1-43b1-af99-ed0a9906061c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:38.961117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed06ede8-a5dd-4c20-8e9a-4e6674f26883 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a1b2f70>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:39.358548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:39.388177 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-119b512e-ff5a-449c-b239-96b6c7fc452c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.736827 Oct 26 05:13:39.413422 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1557/3088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:38 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:39.413422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:39.420891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:39.457572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:39.457875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:39.458335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:39.459215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:39.459818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:39.460260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.055326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:40.076869 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24566189-b760-40db-b751-9a35fff3d907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1276 microversion: 2.1 time: 0.677839 Oct 26 05:13:40.097362 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1558/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:39 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1276 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:40.103192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:40.108903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:40.130841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:40.132475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:40.133107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.134036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:40.136459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:40.137121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.327729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:40.338777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:40.342165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:40.346747 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2b00804-7cf6-4057-b2af-acb19c381e3f tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.248085 Oct 26 05:13:40.369508 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1559/3090] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:40 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:40.377087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:40.378028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:40.392864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:40.393701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:40.394312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.398363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:40.399105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:40.399729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.503772 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed06ede8-a5dd-4c20-8e9a-4e6674f26883 tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/73860dbe-dd02-4c74-a093-451a1f16878e" status: 202 len: 0 microversion: 2.1 time: 1.548168 Oct 26 05:13:40.505837 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1532/3091] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:38 2022] DELETE /compute/v2.1/os-security-groups/73860dbe-dd02-4c74-a093-451a1f16878e => generated 0 bytes in 1551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:40.511475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:40.512290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:40.519782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:40.520511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:40.521237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.522226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:40.523016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:40.523705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:40.706775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:40.714959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6b6e57bd-ccb4-4815-9de4-b2296253c610 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.344269 Oct 26 05:13:40.716221 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1560/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:40 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:41.022531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15cb1a17-6686-44f3-a44c-8597e94229b4 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Action: 'create', calling method: .version_select at 0x7f4709e37430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1394825025", "metadata": {"Type": "work"}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:41.149713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:41.179225 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9582d658-a985-4dd3-8afa-4d6ac797dff6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.667480 Oct 26 05:13:41.187305 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1533/3093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:40 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:41.207538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5139b1c-5ffd-4551-8da7-cc0089f1137f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] Calling method '.version_select at 0x7f470a875e50>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:41.249597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:41.840271 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15cb1a17-6686-44f3-a44c-8597e94229b4 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.122578 Oct 26 05:13:41.842024 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1561/3094] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 26 05:13:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1125 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 26 05:13:41.850692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:41.854002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:41.897603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:41.900101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:41.902366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:41.904331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:41.907173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:41.908349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.005707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:42.102034 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5139b1c-5ffd-4551-8da7-cc0089f1137f tempest-SecurityGroupsTestJSON-698421021 tempest-SecurityGroupsTestJSON-698421021-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8deade92-5aa3-4cf6-a41c-dfc8ba4111d1" status: 202 len: 0 microversion: 2.1 time: 0.911346 Oct 26 05:13:42.103465 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1534/3095] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:13:41 2022] DELETE /compute/v2.1/os-security-groups/8deade92-5aa3-4cf6-a41c-dfc8ba4111d1 => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:42.116619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a25ea683-bd0a-4851-85f4-25a9b2510e00 req-0d016e88-09d2-4e83-9e43-376e8f5c64da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0a1d8a-ad5e-4660-a523-115cc3f1f953", "tag": "c90dafd6-dcb4-4e3f-984e-b68fa8508d27"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:42.159658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a25ea683-bd0a-4851-85f4-25a9b2510e00 req-0d016e88-09d2-4e83-9e43-376e8f5c64da service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.160148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a25ea683-bd0a-4851-85f4-25a9b2510e00 req-0d016e88-09d2-4e83-9e43-376e8f5c64da service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.160582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a25ea683-bd0a-4851-85f4-25a9b2510e00 req-0d016e88-09d2-4e83-9e43-376e8f5c64da service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.188743 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a25ea683-bd0a-4851-85f4-25a9b2510e00 req-0d016e88-09d2-4e83-9e43-376e8f5c64da service nova] Creating event network-changed:c90dafd6-dcb4-4e3f-984e-b68fa8508d27 for instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 on n-h2-862416-4 Oct 26 05:13:42.206525 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a25ea683-bd0a-4851-85f4-25a9b2510e00 req-0d016e88-09d2-4e83-9e43-376e8f5c64da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101484 Oct 26 05:13:42.207398 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1535/3096] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:42.213915 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b31cd06c-1e1a-4b0b-94fd-2992f7da04aa tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 204 len: 0 microversion: 2.1 time: 0.369887 Oct 26 05:13:42.214524 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1562/3097] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:41 2022] DELETE /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:42.217904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-314674af-0bee-4b06-bc64-2e9a4793bb5f req-86dd06a6-114c-4bd1-9077-1fc5d1ae25a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e83a75-8a2f-49d2-b779-f606722d5153", "tag": "752e6978-f7ec-4e01-9171-f52413dafacd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:42.230552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:42.231229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:42.239743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-314674af-0bee-4b06-bc64-2e9a4793bb5f req-86dd06a6-114c-4bd1-9077-1fc5d1ae25a2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.241030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-314674af-0bee-4b06-bc64-2e9a4793bb5f req-86dd06a6-114c-4bd1-9077-1fc5d1ae25a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.241732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-314674af-0bee-4b06-bc64-2e9a4793bb5f req-86dd06a6-114c-4bd1-9077-1fc5d1ae25a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.244426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.249602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.250477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.251844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.253610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.257655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.264630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-314674af-0bee-4b06-bc64-2e9a4793bb5f req-86dd06a6-114c-4bd1-9077-1fc5d1ae25a2 service nova] Creating event network-changed:752e6978-f7ec-4e01-9171-f52413dafacd for instance f5e83a75-8a2f-49d2-b779-f606722d5153 on n-h1-862416-4 Oct 26 05:13:42.270973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-314674af-0bee-4b06-bc64-2e9a4793bb5f req-86dd06a6-114c-4bd1-9077-1fc5d1ae25a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061987 Oct 26 05:13:42.281725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1536/3098] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:42.287901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:42.288907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:42.303838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.306563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:42.308007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.309425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.311864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.312555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.313826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.368660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:42.534531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:42.544668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:42.555034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:42.556680 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ff7ca6b-acdd-481a-985c-1dd83a5d44f5 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.273447 Oct 26 05:13:42.569395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1537/3099] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:42 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:42.574960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:42.575856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:42.582370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.583449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.590107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.591199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.591905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.592554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.695294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:42.705908 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1dbc1c0e-4b67-4afe-b2f8-22d01ed71243 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.489956 Oct 26 05:13:42.708551 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1563/3100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:42 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:42.721117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5940584-a8b8-44a8-8ae7-3ad99b14b7f3 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f470a85c0d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:42.798486 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5940584-a8b8-44a8-8ae7-3ad99b14b7f3 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 200 len: 353 microversion: 2.1 time: 0.086497 Oct 26 05:13:42.799642 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1564/3101] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:42 2022] GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:42.805765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:42.806692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:42.814851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.815633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.816328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.817303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:42.818046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:42.818783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:42.998617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=30 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:43.048541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.057291 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ecd8286a-35f2-4a15-bf5f-86c2319cab05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.486200 Oct 26 05:13:43.059088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1538/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:42 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:43.068987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:43.077427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:43.091709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:43.092228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:43.092678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:43.093433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:43.093896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:43.094327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:43.203977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.216180 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b5bcda1-7b1d-41a1-b44e-f2d1e232c6d3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.415175 Oct 26 05:13:43.229766 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1565/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:42 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:43.325842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.336714 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72c7edad-ebe2-4474-acb0-74c278160d7a tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1664 microversion: 2.1 time: 0.276568 Oct 26 05:13:43.337424 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1539/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:43 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1664 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:43.587853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:43.588405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:43.597702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:43.599021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:43.599464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:43.601067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:43.601751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:43.602181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:43.672096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.680903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.682625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.684216 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2328d619-89dd-49a4-b9f2-195ef1fb026b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.101557 Oct 26 05:13:43.684951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1566/3105] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:43 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:43.737122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:43.737772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:43.746928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:43.748842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:43.749670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:43.750703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:43.752725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:43.753640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:43.816664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fc986ad-9c77-478c-a770-d1c24422b486 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f470a79b3a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:43.907603 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5fc986ad-9c77-478c-a770-d1c24422b486 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 200 len: 354 microversion: 2.1 time: 0.097472 Oct 26 05:13:43.909882 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1567/3106] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:43 2022] GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:43.923328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ecc0540-640d-4d43-a78c-fc99c7543c11 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f4709e37a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:43.928342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:43.937735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eff955dc-bcf7-4df8-a4f8-440c780dd815 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.206112 Oct 26 05:13:43.955047 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1540/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:43 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:43.974540 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ecc0540-640d-4d43-a78c-fc99c7543c11 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 200 len: 354 microversion: 2.1 time: 0.055251 Oct 26 05:13:43.975782 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1568/3108] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:43 2022] GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:13:43.989275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bd9d09c-331d-4166-8950-d70aa8fd304f tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f470a79e940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.057658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bd9d09c-331d-4166-8950-d70aa8fd304f tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 202 len: 0 microversion: 2.1 time: 0.072069 Oct 26 05:13:44.061044 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1541/3109] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:13:43 2022] DELETE /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:44.066784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-697cf014-8519-49a0-85a9-b6e42294ee94 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f470a899ca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.086133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.086816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:44.097829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.098371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.100640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.103540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.104372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.105121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.136808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-697cf014-8519-49a0-85a9-b6e42294ee94 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 200 len: 353 microversion: 2.1 time: 0.073539 Oct 26 05:13:44.145656 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1569/3110] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:44 2022] GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:44.243927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.244845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:44.251302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.251989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.252588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.253479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.254094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.254703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.273392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:44.282939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-351c77d2-9f15-4040-be93-81f7b2e924b7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.202057 Oct 26 05:13:44.284162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1542/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:44 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:44.362318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.364219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:44.372824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.373575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.374793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.376064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.376679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.377262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.406787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:44.416984 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa10c12e-ff88-4cce-8fdd-4a567052e9bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.177579 Oct 26 05:13:44.417600 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1570/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:44 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:44.544942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:44.554202 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8bd13ec-c8ab-4486-97a6-f1a5d618cd65 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1664 microversion: 2.1 time: 0.196478 Oct 26 05:13:44.557724 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1543/3113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:44 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1664 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:44.633079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a7a7748b-21f6-46d4-902f-357755d87173 req-510175bf-f46f-4faa-9879-37b3228966f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2aecf79-7575-4b25-95c2-58a59a2d7d35", "tag": "7acab832-94d5-4e97-92d1-3e6916283146"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:44.644398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a7a7748b-21f6-46d4-902f-357755d87173 req-510175bf-f46f-4faa-9879-37b3228966f0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.644883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a7a7748b-21f6-46d4-902f-357755d87173 req-510175bf-f46f-4faa-9879-37b3228966f0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.645543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a7a7748b-21f6-46d4-902f-357755d87173 req-510175bf-f46f-4faa-9879-37b3228966f0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.660990 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a7a7748b-21f6-46d4-902f-357755d87173 req-510175bf-f46f-4faa-9879-37b3228966f0 service nova] Creating event network-changed:7acab832-94d5-4e97-92d1-3e6916283146 for instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 on n-h1-862416-4 Oct 26 05:13:44.666730 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a7a7748b-21f6-46d4-902f-357755d87173 req-510175bf-f46f-4faa-9879-37b3228966f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037811 Oct 26 05:13:44.667480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1571/3114] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:13:44.713615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.714353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:44.721434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.722228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.722691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.723413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.723869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.724424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.810627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:44.823595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:44.825269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:44.826628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b94d7259-1751-474a-988f-b931040bcd62 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.117054 Oct 26 05:13:44.830174 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1544/3115] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:44 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:44.966344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:44.967430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:44.975025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.981153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.982279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:44.988869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:44.990844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:44.992109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:45.155725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85507318-7ad9-4a32-a011-23624472e3e7 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f4709bfe5e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:45.231157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:45.244659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:45.249834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f81a2677-cae3-412c-835c-8c43fb5c4bae tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.287611 Oct 26 05:13:45.256885 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1572/3116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:44 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:45.271026 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85507318-7ad9-4a32-a011-23624472e3e7 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 200 len: 353 microversion: 2.1 time: 0.120748 Oct 26 05:13:45.272712 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1545/3117] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:45 2022] GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:45.309404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:45.310360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:45.325903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:45.326826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:45.327771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:45.329521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:45.331079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:45.332599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:45.444736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:45.445426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:45.452808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:45.453947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:45.454395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:45.455331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:45.456087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:45.457424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.149838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:46.178405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d966dc75-644b-4764-a782-62034d51b3f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.873933 Oct 26 05:13:46.179447 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1573/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:45 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:46.204965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:46.212112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:46.236473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.237003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.241009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.242776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.243370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.243815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.271182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:46.289478 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2a96f6f-ff40-4112-be4c-633cd5343b20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.848377 Oct 26 05:13:46.307093 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1546/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:45 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:46.314105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:46.315258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:46.323777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.324768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.325466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.327254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.327972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.328647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.437253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:46.449291 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0da8b3e1-12eb-404b-893f-e117bec52a63 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1597 microversion: 2.1 time: 0.267095 Oct 26 05:13:46.453130 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1574/3120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:46 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1597 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:46.458087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17826539-43d2-4d8c-968e-e64d7f8e84e0 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Calling method '.version_select at 0x7f470a8233a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:46.475471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:46.488126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:46.491479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:46.498626 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28e65425-bcde-423e-93d7-57ba2ec27256 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.189598 Oct 26 05:13:46.499012 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-17826539-43d2-4d8c-968e-e64d7f8e84e0 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] HTTP exception thrown: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17826539-43d2-4d8c-968e-e64d7f8e84e0 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Request method failure captured: Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 HTTP/1.1 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMIEaMDi-XmRFfc7P0Y3VVxRYeVTE5hdJFJLh7vT0I79_Kr7DRfrvVIquQLJnN7MA1IFh6x4hvV0vzDsYWSkAYHeyFBwRIi6A8fpSJExh7pOZuhQS_1hN6xqcocDzLgyaFWkNKcFSIUJod2jQrY0G8L_9tk35b1AC6D55LWpJp33_y0 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3dc037dc4bb64d779fc0cc18202cd4f3 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesGetTestJSON-1499158208 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dc037dc4bb64d779fc0cc18202cd4f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dc037dc4bb64d779fc0cc18202cd4f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dc037dc4bb64d779fc0cc18202cd4f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dc037dc4bb64d779fc0cc18202cd4f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesGetTestJSON-1499158208 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3dc037dc4bb64d779fc0cc18202cd4f3 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesGetTestJSON-1499158208 Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesGetTestJSON-1499158208-project Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 867ad8803909487d8c0a0c4eb86dc52c Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesGetTestJSON-1499158208-project Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: exception: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9fd6e2df-2a34-4647-931c-3a20282df6b1'} Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. (HTTP 404) (Request-ID: req-a2f214a6-4421-4546-9756-d3d54474d6a8) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:13:46.502497 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. Oct 26 05:13:46.506704 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:13:46.510721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17826539-43d2-4d8c-968e-e64d7f8e84e0 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] Returning 404 to user: Volume 9fd6e2df-2a34-4647-931c-3a20282df6b1 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:46.511917 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-17826539-43d2-4d8c-968e-e64d7f8e84e0 tempest-VolumesGetTestJSON-1499158208 tempest-VolumesGetTestJSON-1499158208-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1" status: 404 len: 109 microversion: 2.1 time: 0.057473 Oct 26 05:13:46.512699 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1575/3121] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:46 2022] GET /compute/v2.1/os-volumes/9fd6e2df-2a34-4647-931c-3a20282df6b1 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:46.513017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1547/3122] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:46 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:46.518520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:46.520852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:46.531999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.533531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.534188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.535145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.535910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.536539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.695295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-939bd6ba-b75e-4d6c-b06c-4eb5a2235e67 req-a4b01e5d-f875-4803-ace9-5ff80afd000d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d681fe-d1fc-45af-9272-6470713e3c1d", "tag": "de9c87dd-eab7-4e05-b333-119c6fc97fd8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:46.717551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-939bd6ba-b75e-4d6c-b06c-4eb5a2235e67 req-a4b01e5d-f875-4803-ace9-5ff80afd000d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:46.718066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-939bd6ba-b75e-4d6c-b06c-4eb5a2235e67 req-a4b01e5d-f875-4803-ace9-5ff80afd000d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:46.718714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-939bd6ba-b75e-4d6c-b06c-4eb5a2235e67 req-a4b01e5d-f875-4803-ace9-5ff80afd000d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:46.740986 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-939bd6ba-b75e-4d6c-b06c-4eb5a2235e67 req-a4b01e5d-f875-4803-ace9-5ff80afd000d service nova] Creating event network-changed:de9c87dd-eab7-4e05-b333-119c6fc97fd8 for instance 99d681fe-d1fc-45af-9272-6470713e3c1d on n-h1-862416-4 Oct 26 05:13:46.746634 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-939bd6ba-b75e-4d6c-b06c-4eb5a2235e67 req-a4b01e5d-f875-4803-ace9-5ff80afd000d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055320 Oct 26 05:13:46.752125 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1548/3123] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:13:47.168197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:47.186870 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80d8f782-a239-46f6-874a-4a00fd7eebfd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.670855 Oct 26 05:13:47.187788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1576/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:46 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:47.206551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:47.207268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:47.237129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.237669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.238117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.238845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.239306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.239739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.331190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:47.332100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:47.345351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.362174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.362655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.363403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.363880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.375415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.614279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:47.622863 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b87115d7-1d0e-4e1d-a8dc-9adcc1a8eb2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.421182 Oct 26 05:13:47.626796 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1549/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:47 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:47.635045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:47.639825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:47.649072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.649640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.650087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.656403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.656929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.657398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.737702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.739765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.740846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.746063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lazy-loading 'fault' on Instance uuid b46448c6-28d1-4533-9ff3-2e160f3b28dd {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:13:47.879279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:47.897363 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ff9e0d1-d2d0-42b4-96f6-125db110d7ee tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 200 len: 1322 microversion: 2.1 time: 0.269400 Oct 26 05:13:47.901042 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1550/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:47 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:47.907970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:47.916490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:47.936228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.937396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.938078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:47.939800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:47.942938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:47.943657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.004627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:48.014918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:48.178690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:48.211824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc16710c-508c-4e89-b531-3ba2da533003 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 204 len: 0 microversion: 2.1 time: 0.306280 Oct 26 05:13:48.212765 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1551/3127] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:47 2022] DELETE /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:48.214715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.225720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:48.226475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:48.231620 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef859baf-0429-4abd-85f0-7ca9b746afb0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.913491 Oct 26 05:13:48.233254 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1577/3128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:47 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:48.245639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.245639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.245639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.245639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.245639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.247935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.263744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:48.264745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:48.277370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.280426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.281131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.282695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.284543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.285861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.374007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.383809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.385251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.386616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-04521e48-39d1-42df-9e8a-7e2c2b864655 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.172697 Oct 26 05:13:48.387181 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1552/3129] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:48 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:48.392299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:48.393153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:48.399936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.400883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.401702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.402599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.406386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.407058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.586560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.596141 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2fe41a8f-4621-4985-b7e1-5010d7cbcd89 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.346823 Oct 26 05:13:48.616850 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1578/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:48 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:48.650140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:48.650765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:48.668084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.670351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.670812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.679597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.680108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.680574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.730124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.746542 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94146587-5026-4cee-a064-3711d898c5d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1554 microversion: 2.1 time: 0.358048 Oct 26 05:13:48.755189 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1553/3131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:48 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1554 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:48.867821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:48.879768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e428af6b-5f6e-4f32-9bab-81395d2a3ef1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.234206 Oct 26 05:13:48.880935 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1579/3132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:48 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:48.925158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:48.925808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: b46448c6-28d1-4533-9ff3-2e160f3b28dd] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:48.934688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-93887e91-34ff-45b6-b5c5-9305410418bf req-161b1667-f5cd-4f87-a609-1740c3fae311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46448c6-28d1-4533-9ff3-2e160f3b28dd", "name": "network-vif-deleted", "tag": "4e07b583-4c8d-4359-ab3b-32365dd9a3ba"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:48.956012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:48.965591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.966393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.971677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.972646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.976013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.976625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:48.982815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-93887e91-34ff-45b6-b5c5-9305410418bf req-161b1667-f5cd-4f87-a609-1740c3fae311 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:48.984186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-93887e91-34ff-45b6-b5c5-9305410418bf req-161b1667-f5cd-4f87-a609-1740c3fae311 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:48.986372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-93887e91-34ff-45b6-b5c5-9305410418bf req-161b1667-f5cd-4f87-a609-1740c3fae311 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:49.018143 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] HTTP exception thrown: Instance b46448c6-28d1-4533-9ff3-2e160f3b28dd could not be found. Oct 26 05:13:49.019742 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-93887e91-34ff-45b6-b5c5-9305410418bf req-161b1667-f5cd-4f87-a609-1740c3fae311 service nova] Creating event network-vif-deleted:4e07b583-4c8d-4359-ab3b-32365dd9a3ba for instance b46448c6-28d1-4533-9ff3-2e160f3b28dd on n-h1-862416-4 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Request method failure captured: Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd HTTP/1.1 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMApVsH4yMAzNlWrbXtsGyC6cVt19dYW3mIRpweksv3Ngi8Z44_eljb5r-9tp3XUsipUeg6SvZcv19v-4Lu3Upupc_qY22JVnZmHpTYNGUBdeHXNCI_J4fhxikgkkyepNGri9qX3ptfDcDOHO_7E90CSBmkFLDtMlrs7N99N3KCbE-M Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-LiveMigrationTest-440887043 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dbd1775d9dd04820aec1aa2efde776e1 Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance b46448c6-28d1-4533-9ff3-2e160f3b28dd could not be found. Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'b46448c6-28d1-4533-9ff3-2e160f3b28dd'} Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46448c6-28d1-4533-9ff3-2e160f3b28dd could not be found. Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46448c6-28d1-4533-9ff3-2e160f3b28dd could not be found. Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:49.020751 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46448c6-28d1-4533-9ff3-2e160f3b28dd could not be found. Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:49.026461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Returning 404 to user: Instance b46448c6-28d1-4533-9ff3-2e160f3b28dd could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:49.030633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79ac1cce-f1f7-4eb3-9622-6a57afb0e048 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd" status: 404 len: 111 microversion: 2.1 time: 0.103012 Oct 26 05:13:49.030633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1554/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:48 2022] GET /compute/v2.1/servers/b46448c6-28d1-4533-9ff3-2e160f3b28dd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:49.038945 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-93887e91-34ff-45b6-b5c5-9305410418bf req-161b1667-f5cd-4f87-a609-1740c3fae311 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107833 Oct 26 05:13:49.045571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b1cf8f7-667e-40de-a904-dd2c1bae4aa9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '.version_select at 0x7f470a79e550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:49.048652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1580/3134] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:13:49.089184 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b1cf8f7-667e-40de-a904-dd2c1bae4aa9 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769107788" status: 202 len: 0 microversion: 2.1 time: 0.055927 Oct 26 05:13:49.090522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1555/3135] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:13:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769107788 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:49.262039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:49.263589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:49.273216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:49.278332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:49.288590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:49.289582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:49.290300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:49.290945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:49.417561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:49.418426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:49.430109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:49.432027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:49.433955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:49.435709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:49.436587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:49.440119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.032062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.034437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.058136 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dc5d9d0-3dc4-4209-8c1c-c93ed879a341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.800750 Oct 26 05:13:50.067077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.067729 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1581/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:49 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:50.077792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.081588 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2be6c631-b79d-4470-a6a9-7ed4d501cc0d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.668479 Oct 26 05:13:50.084419 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1556/3137] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:49 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:50.092437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:50.096136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:50.107295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:50.116754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:50.119472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.121277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.123566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.128568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.130500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.133114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.135267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.142793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.143767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.146946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.151143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.152838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.581588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.591397 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f87adce-3782-4ec9-969a-b0da131ef181 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.520251 Oct 26 05:13:50.594571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1582/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:50 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:50.607486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:50.608334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:50.644513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.645078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.645563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.646296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.646765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.647280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.659313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.680979 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e87dda4-9dd6-44db-ba8e-7f01862cfb73 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1554 microversion: 2.1 time: 0.590269 Oct 26 05:13:50.683564 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1557/3139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:50 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1554 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:50.893920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:50.894541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:50.906442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.907448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.908458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.909268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:50.909975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:50.910495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:50.941434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:50.960630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:50.972349 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ea1fdf2d-a118-4abb-8c47-c8bd48e6293f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.374386 Oct 26 05:13:50.973254 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1583/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:50 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:51.077654 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-022ff0b6-732d-4f30-8dbd-052b32b638d3 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 204 len: 0 microversion: 2.1 time: 0.187191 Oct 26 05:13:51.078715 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1558/3141] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:50 2022] DELETE /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:51.087210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:51.087919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:51.106757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.107437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.108789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.110091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.113058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.113837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.114658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:51.115442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:51.141838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.143692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.144139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.144861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.145343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.145771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.553400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:51.566503 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1ab2eff-8fb9-49c4-a84f-e41e5f92a690 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1485 microversion: 2.1 time: 0.483629 Oct 26 05:13:51.571105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1584/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:51 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1485 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:51.585273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:51.587398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:51.600879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.603720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.604311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.606024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.607746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.609418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.632466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:51.645436 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b239aa3c-475e-42f7-ac67-7cbf3965384c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.547680 Oct 26 05:13:51.665722 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1559/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:51 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:51.676659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:51.677608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:51.694659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.695476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.696089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.696994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.699335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.699963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.836827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:51.845795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:51.848544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:51.850688 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9d78d62-0b0a-40ab-92d8-18195280c5cd tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.278263 Oct 26 05:13:51.851502 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1585/3144] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:51 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:51.856740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:51.857917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:51.866912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.867815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.868500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:51.869547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:51.870248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:51.870898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.179766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:52.191184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:52.192981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c2679e5-760f-47cf-8c46-4f82ea6745dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.525703 Oct 26 05:13:52.195120 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1560/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:51 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:52.201961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-04b0ae9c-7230-4364-b973-e73c4e2d8cb4 req-72cddd99-338c-4f81-bb67-335cd9f98e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e83a75-8a2f-49d2-b779-f606722d5153", "name": "network-vif-plugged", "status": "completed", "tag": "752e6978-f7ec-4e01-9171-f52413dafacd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:52.203513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3c4d01e-8753-4ce1-b0f4-77d095d79c5b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1554 microversion: 2.1 time: 0.350262 Oct 26 05:13:52.208333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1586/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:51 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1554 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:52.214671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:52.216362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:52.233751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-04b0ae9c-7230-4364-b973-e73c4e2d8cb4 req-72cddd99-338c-4f81-bb67-335cd9f98e28 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.234497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-04b0ae9c-7230-4364-b973-e73c4e2d8cb4 req-72cddd99-338c-4f81-bb67-335cd9f98e28 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.235101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-04b0ae9c-7230-4364-b973-e73c4e2d8cb4 req-72cddd99-338c-4f81-bb67-335cd9f98e28 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.244302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.244915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.245464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.246393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.247373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.249966 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-04b0ae9c-7230-4364-b973-e73c4e2d8cb4 req-72cddd99-338c-4f81-bb67-335cd9f98e28 service nova] Creating event network-vif-plugged:752e6978-f7ec-4e01-9171-f52413dafacd for instance f5e83a75-8a2f-49d2-b779-f606722d5153 on n-h1-862416-4 Oct 26 05:13:52.250551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.256625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-04b0ae9c-7230-4364-b973-e73c4e2d8cb4 req-72cddd99-338c-4f81-bb67-335cd9f98e28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059214 Oct 26 05:13:52.257657 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1561/3147] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:52.488321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:52.496535 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf29d627-68ac-4271-8cc5-5980c72bf420 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.286758 Oct 26 05:13:52.509699 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1587/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:52 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:52.551425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4dc09184-0251-473c-955d-3e57e876d6da req-fe8b7aee-6350-4603-a358-eb142b4ab783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968f8909-14e6-45b2-982a-2ca35d66232b", "name": "network-vif-deleted", "tag": "c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:52.575667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4dc09184-0251-473c-955d-3e57e876d6da req-fe8b7aee-6350-4603-a358-eb142b4ab783 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.579035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4dc09184-0251-473c-955d-3e57e876d6da req-fe8b7aee-6350-4603-a358-eb142b4ab783 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.581444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4dc09184-0251-473c-955d-3e57e876d6da req-fe8b7aee-6350-4603-a358-eb142b4ab783 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.597735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4dc09184-0251-473c-955d-3e57e876d6da req-fe8b7aee-6350-4603-a358-eb142b4ab783 service nova] Creating event network-vif-deleted:c2ba5fa5-63fb-4d40-b907-0d568d1c7cd8 for instance 968f8909-14e6-45b2-982a-2ca35d66232b on n-h2-862416-4 Oct 26 05:13:52.600983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:52.601638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:52.606098 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4dc09184-0251-473c-955d-3e57e876d6da req-fe8b7aee-6350-4603-a358-eb142b4ab783 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058629 Oct 26 05:13:52.607530 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1562/3149] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:52.611742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.612443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.614267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.615406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.616274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.616884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.675650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:52.676444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:52.691389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.692945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.693684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.695868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.698148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.698787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.724185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:52.743549 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bead3838-e31f-4d9c-9b9c-af5f5914d9c2 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 200 len: 1281 microversion: 2.1 time: 0.151935 Oct 26 05:13:52.747009 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1588/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:52 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:52.770874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69a4e15b-5ebe-4acf-adba-6ef0f40e3285 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470a85c160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:52.909815 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69a4e15b-5ebe-4acf-adba-6ef0f40e3285 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7f122244-02f4-4bc0-acff-de74b4d12af7" status: 200 len: 351 microversion: 2.1 time: 0.160450 Oct 26 05:13:52.910205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:52.910948 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1589/3151] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:52 2022] GET /compute/v2.1/os-volumes/7f122244-02f4-4bc0-acff-de74b4d12af7 => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:52.923777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:52.924473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:52.932411 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94b537eb-daee-4d83-9177-7ead4ac12dcf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.263724 Oct 26 05:13:52.933209 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1563/3152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:52 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:52.938288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.940939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.941683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:52.944142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:52.949958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:52.951010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.064507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:53.084284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:53.094236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:53.095523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42fb590e-9c0c-47d0-867a-531a7dba04f2 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.177072 Oct 26 05:13:53.096129 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1590/3153] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:52 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:53.229969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-2e8e6d09-cfdd-481c-8afd-bfe5eff2dd60 req-fd4467f5-ac9a-4653-ad2d-9e6642cbed57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560a06b2-fb56-433f-8399-aa01b41b7fc2", "name": "network-vif-deleted", "tag": "2c442610-8b4b-49ff-8b8d-96fdae17b21b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:53.236027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:53.239238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:53.254135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.254783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2e8e6d09-cfdd-481c-8afd-bfe5eff2dd60 req-fd4467f5-ac9a-4653-ad2d-9e6642cbed57 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.255691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.256997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2e8e6d09-cfdd-481c-8afd-bfe5eff2dd60 req-fd4467f5-ac9a-4653-ad2d-9e6642cbed57 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.257588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.258696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2e8e6d09-cfdd-481c-8afd-bfe5eff2dd60 req-fd4467f5-ac9a-4653-ad2d-9e6642cbed57 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.259756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.260712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.261440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.277597 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-2e8e6d09-cfdd-481c-8afd-bfe5eff2dd60 req-fd4467f5-ac9a-4653-ad2d-9e6642cbed57 service nova] Creating event network-vif-deleted:2c442610-8b4b-49ff-8b8d-96fdae17b21b for instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 on n-h1-862416-4 Oct 26 05:13:53.283354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-2e8e6d09-cfdd-481c-8afd-bfe5eff2dd60 req-fd4467f5-ac9a-4653-ad2d-9e6642cbed57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059067 Oct 26 05:13:53.284857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1591/3154] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:53.291889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:53.292612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:53.312193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.313638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.314430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.316314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.317137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.319318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.570553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:53.574753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:53.588886 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66bdd4fa-876e-497c-bede-800260307219 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1512 microversion: 2.1 time: 0.302449 Oct 26 05:13:53.595273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1592/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:53 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:53.618234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:53.619762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:53.639100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.646398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.647770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.648709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.649485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.650115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.683800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:53.698391 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39b199a3-393b-4167-97da-95d73f97fad7 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.479968 Oct 26 05:13:53.699055 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1564/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:53 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:53.780542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:53.781526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: 968f8909-14e6-45b2-982a-2ca35d66232b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:53.791578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.795483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.796189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.797140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.797841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.799689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.826317 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] HTTP exception thrown: Instance 968f8909-14e6-45b2-982a-2ca35d66232b could not be found. Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Request method failure captured: Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b HTTP/1.1 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMApVsH4yMAzNlWrbXtsGyC6cVt19dYW3mIRpweksv3Ngi8Z44_eljb5r-9tp3XUsipUeg6SvZcv19v-4Lu3Upupc_qY22JVnZmHpTYNGUBdeHXNCI_J4fhxikgkkyepNGri9qX3ptfDcDOHO_7E90CSBmkFLDtMlrs7N99N3KCbE-M Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-LiveMigrationTest-440887043 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dbd1775d9dd04820aec1aa2efde776e1 Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 968f8909-14e6-45b2-982a-2ca35d66232b could not be found. Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '968f8909-14e6-45b2-982a-2ca35d66232b'} Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968f8909-14e6-45b2-982a-2ca35d66232b could not be found. Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968f8909-14e6-45b2-982a-2ca35d66232b could not be found. Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:53.828208 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968f8909-14e6-45b2-982a-2ca35d66232b could not be found. Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Returning 404 to user: Instance 968f8909-14e6-45b2-982a-2ca35d66232b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2a48ae0-8fd0-4bfc-99b8-f82fd6991856 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b" status: 404 len: 111 microversion: 2.1 time: 0.061512 Oct 26 05:13:53.832381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1565/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:53 2022] GET /compute/v2.1/servers/968f8909-14e6-45b2-982a-2ca35d66232b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:13:53.841887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:53.842644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:53.852380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.853136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.853765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.854832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:53.856337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:53.856943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:53.891274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:13:53.952742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:53.982192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.009866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71ed8059-fceb-4086-9255-795c21156475 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1314 microversion: 2.1 time: 0.409430 Oct 26 05:13:54.010738 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1593/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:53 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:54.017041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:54.019359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:54.027156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.028174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.029849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.031108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.032331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.033457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.038325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7e891cb-0d01-4510-a330-6105da268bbf tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 204 len: 0 microversion: 2.1 time: 0.202038 Oct 26 05:13:54.038988 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1566/3159] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:13:53 2022] DELETE /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:13:54.050760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:54.051734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:54.061260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.061931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.062534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.063323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.063727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.064139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.310894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.326095 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-87b810f2-ba79-4ce2-b2ec-f50c944126a0 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1500 microversion: 2.1 time: 0.282191 Oct 26 05:13:54.326700 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1567/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:54 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1500 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:54.339455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:54.340075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:54.354030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.354545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.354989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.355715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.356190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.356605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.387727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.399266 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de460afb-e44f-4228-99db-371f1faa8aad tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.385712 Oct 26 05:13:54.401299 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1594/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:54 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:54.413437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0a1d8a-ad5e-4660-a523-115cc3f1f953", "name": "network-vif-plugged", "status": "completed", "tag": "c90dafd6-dcb4-4e3f-984e-b68fa8508d27"}, {"server_uuid": "99d681fe-d1fc-45af-9272-6470713e3c1d", "name": "network-vif-plugged", "status": "completed", "tag": "de9c87dd-eab7-4e05-b333-119c6fc97fd8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:54.436823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.437352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.440756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.487356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] Creating event network-vif-plugged:c90dafd6-dcb4-4e3f-984e-b68fa8508d27 for instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 on n-h2-862416-4 Oct 26 05:13:54.487907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] Creating event network-vif-plugged:de9c87dd-eab7-4e05-b333-119c6fc97fd8 for instance 99d681fe-d1fc-45af-9272-6470713e3c1d on n-h1-862416-4 Oct 26 05:13:54.508159 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f2257257-ea51-4fce-ae27-de254e026575 req-02848e3f-e1e7-4361-8ebf-f3f5f4e53aca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103436 Oct 26 05:13:54.509254 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1595/3162] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:54.514469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.524221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.525728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.527262 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bbe6b894-69ca-470e-a8c7-a9eb5756782c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.199122 Oct 26 05:13:54.533353 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1568/3163] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:54 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:54.628065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:54.628771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:54.642555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.645931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.647718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.648488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.651115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.651595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.725349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:54.726125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:54.736857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.738637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.739109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.744454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:54.744934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:54.745912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:54.909995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:54.924537 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b3e5ef10-a7bf-42f7-ad3e-cf5f786ca1d7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1345 microversion: 2.1 time: 0.297290 Oct 26 05:13:54.940347 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1596/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:54 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1345 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:55.108038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:55.113401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1975221353", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:55.118080 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-13fc78e9-69c9-4389-85a7-9649622932b0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1318 microversion: 2.1 time: 0.395321 Oct 26 05:13:55.123167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1569/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:54 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:55.143922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:55.144801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:55.157131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.158069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.158747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.159683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.160357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.161008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.200195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:55.200628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:55.201116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:55.207480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:55.208013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:55.219765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.220696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.221454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.223105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.223894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.225094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.249782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Getting quotas for project f5d6d046a389421fb784ea3bc741c72c. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:13:55.257718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Getting quotas for user bc24f39a8942439385df1d409065db51 and project f5d6d046a389421fb784ea3bc741c72c. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:13:55.273529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:13:55.277034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:13:55.345029 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d85e40d-14df-4df2-af9d-f29c511a364e tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.403021 Oct 26 05:13:55.354470 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1597/3166] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:13:55.357480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:55.358327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:55.366496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.367243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.368046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.368994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.369589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.370212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.463992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:55.475334 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c52c72ad-d9e1-435a-a3d1-09feb8c5233e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1502 microversion: 2.1 time: 0.336033 Oct 26 05:13:55.476315 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1570/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:55 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:55.482256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ca5238d8-70f7-4581-a0db-6934a1741656 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:55.483158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ca5238d8-70f7-4581-a0db-6934a1741656 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:55.570477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ca5238d8-70f7-4581-a0db-6934a1741656 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:55.584988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ca5238d8-70f7-4581-a0db-6934a1741656 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:55.597224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ca5238d8-70f7-4581-a0db-6934a1741656 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:55.601335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ca5238d8-70f7-4581-a0db-6934a1741656 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1278 microversion: 2.54 time: 0.123226 Oct 26 05:13:55.606611 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1571/3168] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:55 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:55.617955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:55.618900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:55.631998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.633154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.633802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.634918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.635535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.636134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.661818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:55.672783 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d841825-408b-4f95-8d47-e6fe139b4a39 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1500 microversion: 2.1 time: 0.320396 Oct 26 05:13:55.675825 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1598/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:55 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1500 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:55.693614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0dfc732c-a2c6-4847-9afc-649d3c677afc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:55.700098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfc732c-a2c6-4847-9afc-649d3c677afc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.700700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfc732c-a2c6-4847-9afc-649d3c677afc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.701181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dfc732c-a2c6-4847-9afc-649d3c677afc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.792638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0dfc732c-a2c6-4847-9afc-649d3c677afc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Going to try to stop instance {{(pid=120586) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:13:55.867425 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0dfc732c-a2c6-4847-9afc-649d3c677afc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153/action" status: 202 len: 0 microversion: 2.1 time: 0.190061 Oct 26 05:13:55.869907 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1599/3170] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:13:55 2022] POST /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:13:55.893020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:55.897608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:55.908407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.909629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.910876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:55.914719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:55.914719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:55.914719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.277211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.291415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.292865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.301336 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78293505-0c10-4ff6-a283-8a064147094b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.428298 Oct 26 05:13:56.321698 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1600/3171] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:55 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:56.339002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6cda122f-06c3-4201-9583-7306a4e06ed7 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470a79c040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:56.372908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.387607 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29177884-121a-4c37-a777-44779d0a63d2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1318 microversion: 2.1 time: 0.778893 Oct 26 05:13:56.388753 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1572/3172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:55 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:56.394880 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6cda122f-06c3-4201-9583-7306a4e06ed7 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b922f50-21d9-4816-9ebd-2d137baf4c0d" status: 200 len: 351 microversion: 2.1 time: 0.060626 Oct 26 05:13:56.395753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1601/3173] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:56 2022] GET /compute/v2.1/os-volumes/0b922f50-21d9-4816-9ebd-2d137baf4c0d => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:56.395898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:56.397204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:56.402566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:56.402566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:56.407512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.409227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.409806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.410276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.410404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.410735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.411465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.411901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.412071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.412478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.413638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.414312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.492704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.510461 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4dd8ea88-f03a-4fbc-bf9e-ab01d02e35a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1345 microversion: 2.1 time: 0.112353 Oct 26 05:13:56.511394 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1602/3174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:56 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:56.526333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:56.526996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:56.545980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.546513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.547433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.548180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.548645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.549078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.765239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.769661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:56.790342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da30d974-658b-4c3f-9b98-bcb8eb3d29c9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1467 microversion: 2.1 time: 0.277626 Oct 26 05:13:56.793017 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-41be012c-7ab1-4a1a-8bff-5d562bea74fa tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.402713 Oct 26 05:13:56.793845 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1573/3175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:56 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:56.807451 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1603/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:56 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:56.824472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-03bd4f5c-05bf-4416-9a3a-51700b88c195 req-08529d08-65bc-4e71-9785-63fa8e227a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2aecf79-7575-4b25-95c2-58a59a2d7d35", "name": "network-vif-plugged", "status": "completed", "tag": "7acab832-94d5-4e97-92d1-3e6916283146"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:56.826346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-40f4641b-4743-4141-8ea6-bf4eb51db99e req-cf222e1e-fd8c-4838-a7ec-4714af5f9f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c383a0fb-6b77-41e4-8323-9dc041ca04f3", "name": "network-vif-deleted", "tag": "3dd54acc-61f5-4fc4-8558-83cda3a2ad32"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:56.852533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-03bd4f5c-05bf-4416-9a3a-51700b88c195 req-08529d08-65bc-4e71-9785-63fa8e227a49 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.855297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40f4641b-4743-4141-8ea6-bf4eb51db99e req-cf222e1e-fd8c-4838-a7ec-4714af5f9f24 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.856093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-03bd4f5c-05bf-4416-9a3a-51700b88c195 req-08529d08-65bc-4e71-9785-63fa8e227a49 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.857034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-03bd4f5c-05bf-4416-9a3a-51700b88c195 req-08529d08-65bc-4e71-9785-63fa8e227a49 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.858296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40f4641b-4743-4141-8ea6-bf4eb51db99e req-cf222e1e-fd8c-4838-a7ec-4714af5f9f24 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.861890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40f4641b-4743-4141-8ea6-bf4eb51db99e req-cf222e1e-fd8c-4838-a7ec-4714af5f9f24 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.883873 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-40f4641b-4743-4141-8ea6-bf4eb51db99e req-cf222e1e-fd8c-4838-a7ec-4714af5f9f24 service nova] Creating event network-vif-deleted:3dd54acc-61f5-4fc4-8558-83cda3a2ad32 for instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 on n-h2-862416-4 Oct 26 05:13:56.889160 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-40f4641b-4743-4141-8ea6-bf4eb51db99e req-cf222e1e-fd8c-4838-a7ec-4714af5f9f24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082308 Oct 26 05:13:56.889837 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-03bd4f5c-05bf-4416-9a3a-51700b88c195 req-08529d08-65bc-4e71-9785-63fa8e227a49 service nova] Creating event network-vif-plugged:7acab832-94d5-4e97-92d1-3e6916283146 for instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 on n-h1-862416-4 Oct 26 05:13:56.890703 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1574/3177] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:56.896229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:56.897583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:56.901551 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-03bd4f5c-05bf-4416-9a3a-51700b88c195 req-08529d08-65bc-4e71-9785-63fa8e227a49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091571 Oct 26 05:13:56.902638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1604/3178] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:56.907822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.908484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.908926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.909683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.910056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:56.910210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.910542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.910964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:56.919364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.919875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.920325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.921043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.921544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.922166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.967020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:56.967511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:56.967948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:56.968498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lazy-loading 'fault' on Instance uuid c383a0fb-6b77-41e4-8323-9dc041ca04f3 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:13:56.997425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.017208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.018811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.019989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37037fdc-dc3f-47ac-9ad3-ebcee9844fa7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1330 microversion: 2.54 time: 0.128138 Oct 26 05:13:57.020780 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1575/3179] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:56 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:57.045441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd1775d9dd04820aec1aa2efde776e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef7259043394cb8a05b8c57782d0475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.045607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:57.046271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.052518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.053624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.054612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.055320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.055820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.056247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.060252 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ee0a737-a716-415b-aff9-3e41f0531d77 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 200 len: 1301 microversion: 2.1 time: 0.156188 Oct 26 05:13:57.061622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1605/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:56 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 1301 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:57.282762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.294889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec48f2dd-45be-4d0d-9bc3-5f5216d680ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1318 microversion: 2.1 time: 0.258693 Oct 26 05:13:57.296187 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1576/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:57 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:57.337266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:57.338190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.349383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.350849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.351777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.352873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.353533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.354545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.421495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:57.423585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.463241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.463892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.466134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.466965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.467539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.471198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.488294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.499312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.501119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.502853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-078ef809-11c2-4e63-830c-a849fa0cfafe tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.173538 Oct 26 05:13:57.503873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1606/3182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:57 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:57.536537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:57.539415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.547536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.548478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.549692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.550619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.551313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.552231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.640987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.653777 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3fc72aad-d22e-4ca5-948a-eb857263aae9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1345 microversion: 2.1 time: 0.122036 Oct 26 05:13:57.667692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.678735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-110f63fd-d439-4188-8836-be584098d56e tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1508 microversion: 2.1 time: 0.270074 Oct 26 05:13:57.678987 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1607/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:57 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:57.681935 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1577/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:57 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:57.702866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:57.703516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.711451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.717818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.718827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.720407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.721096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.721566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.818520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:57.819809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.829356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.834923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.835592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.836425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.836893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.837462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.937863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:57.953457 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d345e15-1657-4d22-9cd5-8561d462dde9 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1508 microversion: 2.1 time: 0.254572 Oct 26 05:13:57.954499 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1608/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:57 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:57.977849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:13:57.981136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:57.988289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.989122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.989764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:57.991442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:57.992079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:57.992676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.054329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.062833 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53116ab4-b175-4b67-92ca-6019ab136ed6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.248523 Oct 26 05:13:58.063567 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1578/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:57 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:58.068259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:58.069043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.075555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.076546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.077226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.078242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.078934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.079591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.094480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:13:58.095003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:13:58.095555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:13:58.096057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:13:58.096548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:13:58.149993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:58.154080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.163764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.166250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.167008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.168942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c52fda85-8e1c-4e2d-804d-8da70433af5a tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1336 microversion: 2.54 time: 0.104196 Oct 26 05:13:58.181559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.181559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.181559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.181559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.181559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.181559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.183466 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1579/3187] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:58.192853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:58.194743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] [instance: c383a0fb-6b77-41e4-8323-9dc041ca04f3] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.201747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.202546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.203198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.204126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.205077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.205748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.210310 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8761bd4-154b-4da3-aa08-c83f9b073ec0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "POST /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953/action" status: 202 len: 1110 microversion: 2.1 time: 0.235934 Oct 26 05:13:58.210310 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1609/3188] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:13:57 2022] POST /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953/action => generated 1110 bytes in 237 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 26 05:13:58.225537 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] HTTP exception thrown: Instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 could not be found. Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Request method failure captured: Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 HTTP/1.1 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMApVsH4yMAzNlWrbXtsGyC6cVt19dYW3mIRpweksv3Ngi8Z44_eljb5r-9tp3XUsipUeg6SvZcv19v-4Lu3Upupc_qY22JVnZmHpTYNGUBdeHXNCI_J4fhxikgkkyepNGri9qX3ptfDcDOHO_7E90CSBmkFLDtMlrs7N99N3KCbE-M Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ef7259043394cb8a05b8c57782d0475"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-LiveMigrationTest-440887043 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8ef7259043394cb8a05b8c57782d0475 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-LiveMigrationTest-440887043 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dbd1775d9dd04820aec1aa2efde776e1 Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-LiveMigrationTest-440887043-project Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 could not be found. Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c383a0fb-6b77-41e4-8323-9dc041ca04f3'} Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 could not be found. Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 could not be found. Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:13:58.227559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 could not be found. Oct 26 05:13:58.232538 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:13:58.233017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:58.233017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.235641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] Returning 404 to user: Instance c383a0fb-6b77-41e4-8323-9dc041ca04f3 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:13:58.235641 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4652fcaa-9636-4c93-8205-468f70ef9444 tempest-LiveMigrationTest-440887043 tempest-LiveMigrationTest-440887043-project] 10.222.0.16 "GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3" status: 404 len: 111 microversion: 2.1 time: 0.050807 Oct 26 05:13:58.238391 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1580/3189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/servers/c383a0fb-6b77-41e4-8323-9dc041ca04f3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:13:58.240857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.241538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.242217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.243039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.243739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.244348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.323314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:58.324133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.336818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.337597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.338233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.338958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.339436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.339854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.487596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.498765 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc87172d-cc05-4bb5-9247-51f1d4916713 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.272930 Oct 26 05:13:58.499630 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1610/3190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:58.530796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:58.531574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.538534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.539145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.539661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.540431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.540964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.541518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.574950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.583300 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91203fc7-d07f-4f97-84bc-de0e163efc88 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1318 microversion: 2.1 time: 0.265212 Oct 26 05:13:58.584860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1581/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:58.633730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.643132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.644936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.646553 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68afd5f2-bc19-40f8-857f-9e7b41683f61 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.119676 Oct 26 05:13:58.652968 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1611/3192] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:13:58.678396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:58.679036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:58.685415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.685908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.686356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.687078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:58.687541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:58.687971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:58.772721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:58.781501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-488545b4-ecb8-4cfc-837a-dcd14db8ca76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1345 microversion: 2.1 time: 0.107507 Oct 26 05:13:58.782174 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1582/3193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:59.003093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77ddf2a4-9351-44a6-a977-95a67ba024f8 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470a996ca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.058983 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77ddf2a4-9351-44a6-a977-95a67ba024f8 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ad999bae-72fb-4af2-91c7-c72eb754c125" status: 200 len: 351 microversion: 2.1 time: 0.059734 Oct 26 05:13:59.059633 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1612/3194] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:13:58 2022] GET /compute/v2.1/os-volumes/ad999bae-72fb-4af2-91c7-c72eb754c125 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:59.076442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-56a87656-5879-4ec5-b744-9673696bd0df tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470a79e550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.092017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.092660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:59.107534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.108492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.108949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.110301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.110781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.111228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.192839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-56a87656-5879-4ec5-b744-9673696bd0df tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.122035 Oct 26 05:13:59.193504 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1583/3195] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:59.209504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.210923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:59.217333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.217784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.218402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.219294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.219755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.220190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.317607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:59.327349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:59.329245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:59.330852 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3e36d8a3-f5fd-461c-a217-1ec39e0931e9 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1336 microversion: 2.54 time: 0.125673 Oct 26 05:13:59.331526 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1584/3196] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:13:59.336881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c82191c-4b68-49c2-871d-0d9d07e97930 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f4709c1e700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.367972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:59.383550 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5139361-e14a-43d3-b068-643718254463 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.298161 Oct 26 05:13:59.403872 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1613/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:59.439543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c82191c-4b68-49c2-871d-0d9d07e97930 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.103765 Oct 26 05:13:59.439543 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1585/3198] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:59.454051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f919672d-6fc9-4b63-b60a-fbb41062a8c9 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470acae5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.523969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.524864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:59.533249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.534166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.534936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.535892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.536559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.537634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.565533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f919672d-6fc9-4b63-b60a-fbb41062a8c9 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.114353 Oct 26 05:13:59.566545 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1614/3199] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:13:59.582409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-564a4335-b3a0-4530-8db3-0499fa9b1f6d tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470a9968b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.679929 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-564a4335-b3a0-4530-8db3-0499fa9b1f6d tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103400 Oct 26 05:13:59.680935 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1615/3200] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:13:59.686233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.687146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:59.695732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.696431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.697047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.697977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.698621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.699239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.841903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:59.853104 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24c161f7-a6cd-4f58-99cf-07deb36ccd66 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.334478 Oct 26 05:13:59.867189 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1586/3201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:13:59.878364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:13:59.879469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:13:59.888124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.888806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.889252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.890123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:13:59.890432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:13:59.890853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:13:59.911803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:13:59.991244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:13:59.998881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.000287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.000773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.001962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-812c1737-cdb1-4d27-bb99-23fc01f9216c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.133681 Oct 26 05:14:00.002701 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1587/3202] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:00.007197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21e53e88-5255-43ce-b13a-eb57dffd61e2 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f4709c0c040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.007939 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-244a43c8-956f-44c8-b491-f19571029902 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1467 microversion: 2.1 time: 0.325312 Oct 26 05:14:00.017819 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1616/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:13:59 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1467 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:00.023452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.024177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:00.031459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.031954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.032702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.033627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.034093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.034526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.081028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.085816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.086393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.087205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'fault' on Instance uuid 560a06b2-fb56-433f-8399-aa01b41b7fc2 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:00.104257 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21e53e88-5255-43ce-b13a-eb57dffd61e2 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.100580 Oct 26 05:14:00.105502 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1588/3204] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:00.110372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.116110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.117374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Searching by: {'reservation_id': 'r-ydgoxuzu', 'deleted': False, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:14:00.123387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.123875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.124317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.125055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.126193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.126680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.176463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.192171 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8b771c41-e2bd-4179-be13-f7e8e9d171aa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 200 len: 1350 microversion: 2.1 time: 0.172422 Oct 26 05:14:00.193270 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1617/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 1350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:00.207425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-358a2f28-42ad-4474-aa09-507a69ae4c66 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470a9a2040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.238736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:14:00.315829 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-358a2f28-42ad-4474-aa09-507a69ae4c66 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.120707 Oct 26 05:14:00.317671 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1618/3206] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:00.330855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df57569f-9ff4-4292-9215-0739cbb8e0dc tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f470aa8eb80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.333440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.341495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.342465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.342978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.460934 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df57569f-9ff4-4292-9215-0739cbb8e0dc tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.132251 Oct 26 05:14:00.472391 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1619/3207] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:00.478976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.479776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:00.487739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.488507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.489110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.490157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.490774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.491388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.590997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.602683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.604563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.605772 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6688d963-4410-4390-a62c-6c310045216b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1336 microversion: 2.54 time: 0.132033 Oct 26 05:14:00.608716 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1620/3208] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:00.614101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.615281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:00.622109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.623056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.623738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.624790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.625651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.626258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.655359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7c7c3ae-c86c-4d13-8562-624103caac2e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-ydgoxuzu" status: 200 len: 2927 microversion: 2.1 time: 0.549058 Oct 26 05:14:00.656070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1589/3209] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ydgoxuzu => generated 2927 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:00.660650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20aeccba-a93c-4f9b-b4a8-ffe46405e969 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] Calling method '.version_select at 0x7f4709c53c10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.778330 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20aeccba-a93c-4f9b-b4a8-ffe46405e969 tempest-VolumesTestJSON-25008948 tempest-VolumesTestJSON-25008948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.121125 Oct 26 05:14:00.778903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1590/3210] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:00.796315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d78cc116-0ca3-4408-9e63-926e3aaab929 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.844152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:00.847193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_groups [None req-d78cc116-0ca3-4408-9e63-926e3aaab929 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Querying cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) for 2 instances {{(pid=120585) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 05:14:00.847927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78cc116-0ca3-4408-9e63-926e3aaab929 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.848410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78cc116-0ca3-4408-9e63-926e3aaab929 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.848845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d78cc116-0ca3-4408-9e63-926e3aaab929 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.853979 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86fb5f6d-77c5-46c5-bca6-2f8760ddc57a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.243831 Oct 26 05:14:00.856162 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1621/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:00.870893 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d78cc116-0ca3-4408-9e63-926e3aaab929 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/b761d15b-bebf-4351-ad4c-fea51b5de71d" status: 200 len: 266 microversion: 2.1 time: 0.090733 Oct 26 05:14:00.871992 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1591/3212] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/os-server-groups/b761d15b-bebf-4351-ad4c-fea51b5de71d => generated 266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:00.882494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.885942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:00.886140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:00.887115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:00.894813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.895503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.897002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.898178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.898874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.899446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.899627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.900054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.900565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:00.901747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:00.908783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:00.910726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.249817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.262604 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18bb92d2-34af-43ce-94d7-f614b7ad0d10 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.385181 Oct 26 05:14:01.264937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1622/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:01.291267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:01.293623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:01.312934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.313420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.318971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.320045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.320535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.321588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.363117 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df23697d-4e83-40c5-bab9-ed895907737f tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1618 microversion: 2.1 time: 0.482615 Oct 26 05:14:01.366022 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1592/3214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:00 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1618 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:01.383889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:01.384514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:01.395502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:01.401734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.402249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.402703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.403429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.407832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.408376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.449156 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 HTTP/1.1 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '560a06b2-fb56-433f-8399-aa01b41b7fc2'} Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:01.464542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:01.468977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-263399fa-3880-4e85-b3b7-3434c0219373 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 404 len: 111 microversion: 2.1 time: 0.098855 Oct 26 05:14:01.470867 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1593/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:01 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:14:01.482955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:01.485856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:01.496463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.496970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.497432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.498370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.498974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.499582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.514486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.534728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.551527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.555047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b210f6ef-4f40-43bc-a611-292ff0e592d0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1365 microversion: 2.47 time: 0.287459 Oct 26 05:14:01.558682 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1623/3216] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:01 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:01.634018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:01.634947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:01.648050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.650029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.650645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.651540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.654484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.655105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.729137 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0476c0e-2371-4a09-931c-1c0eb1cc4a2a tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1618 microversion: 2.1 time: 0.256856 Oct 26 05:14:01.732760 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1594/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:01 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1618 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:01.771891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:01.772193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.779248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:01.784367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.788472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:01.789786 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-50c3a598-aa43-4963-b893-80c8f3f68c31 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1336 microversion: 2.54 time: 0.161065 Oct 26 05:14:01.790763 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1624/3218] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:01 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1336 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:01.797298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b021c87b-4cb4-4a67-b3b9-47268987647c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: .version_select at 0x7f470acae4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1272207126", "policies": ["anti-affinity"]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:01.811563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.811822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.812221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.812944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.813438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.813877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.841966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:01.857545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2/os-volume_attachments HTTP/1.1 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': '560a06b2-fb56-433f-8399-aa01b41b7fc2'} Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:01.859678 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-33fd3b09-48be-4086-8607-376e703976e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.095272 Oct 26 05:14:01.864721 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1595/3219] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:14:01 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2/os-volume_attachments => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:14:01.867653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b021c87b-4cb4-4a67-b3b9-47268987647c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:01.881984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b021c87b-4cb4-4a67-b3b9-47268987647c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:01.883788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:01.884619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:01.895121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.896160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.896656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:01.898134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:01.898655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:01.899239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:02.000592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b021c87b-4cb4-4a67-b3b9-47268987647c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:02.010910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b021c87b-4cb4-4a67-b3b9-47268987647c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_groups'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:02.045283 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b021c87b-4cb4-4a67-b3b9-47268987647c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.253325 Oct 26 05:14:02.048334 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1625/3220] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 26 05:14:01 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:02.088334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-755734928", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:02.173293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:02.247938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:02.262203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d8a26e79-b4d9-4c11-837f-76d00e394b05 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.382900 Oct 26 05:14:02.263436 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1596/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:01 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:02.274776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1770158723", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d394639b-d1b0-4e15-80a4-5f77e6651892"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:02.344318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:02.789679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:02.790776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:02.791428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:02.792035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:02.792457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:02.831193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:02.832331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:02.834916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:02.837487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:02.838833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:02.843462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:02.863914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:02.864466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:02.865095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:02.865671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:02.866296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:02.877870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:02.878055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:02.878864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:02.879584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:02.881363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:02.882731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:02.883447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:02.884195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:02.898593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Going to run 2 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:02.901237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:02.954279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:02.958167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120585) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 26 05:14:02.970590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:02.986390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:03.000269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:03.065153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:03.079631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:03.095892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:03.102145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:03.118979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=e2c7e9c1-06d6-4967-92b1-2f2f09153754,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:03.202560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:03.210613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff8b89e3-098d-4277-b0f3-11488894a4a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125124 Oct 26 05:14:03.210613 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1626/3222] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:14:03.219536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:03.220946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:03.223834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:03.229786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:03.230666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:03.231330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:03.232297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:03.233150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:03.233833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:03.276873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:03.283604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'server_group_members'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:03.342699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8bce3001-4762-4065-9535-22bf3cc1e5c6 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.078147 Oct 26 05:14:03.347132 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1597/3223] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:14:03.359821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:03.360724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:03.375981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:03.375981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:03.378522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:03.379397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:03.379733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:03.380175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:03.601044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:03.617175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d8673ab-38e0-4681-8beb-20b160ed9c11 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.406359 Oct 26 05:14:03.618074 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1627/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:03 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:03.637680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:03.638828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:03.650962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:03.653258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:03.654035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:03.659481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:03.660225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:03.660850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.261613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.265971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.283155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.285039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.286458 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2673e308-63cf-460a-bd85-3fa76ad6a35f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1336 microversion: 2.54 time: 0.662103 Oct 26 05:14:04.287664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.288764 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1628/3225] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:03 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1336 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:04.290685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.293520 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-52a6f991-240d-486c-b56f-279242921cc7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1371 microversion: 2.47 time: 0.945167 Oct 26 05:14:04.296405 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1598/3226] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:03 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1371 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:04.315395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:04.316648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:04.323461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:04.324503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:04.325506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.328728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.329348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.330165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.332301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.333008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.334053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.335189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.335644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.336373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.336837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.337476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.442675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.452666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19218eb2-b8fb-4208-b227-7e5a54c09369 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2" status: 200 len: 1218 microversion: 2.1 time: 0.162553 Oct 26 05:14:04.453249 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1629/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:04 2022] GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:04.478138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:04.483502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.484390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Searching by: {'deleted': False, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:14:04.493295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.493980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.494581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.495466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.496232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.496821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.534810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:14:04.576222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.576419 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80d75fb1-ff09-454d-be9c-5239c9f3244c tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.121561 Oct 26 05:14:04.587751 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1630/3228] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:14:04 2022] GET /compute/v2.1/servers => generated 1664 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:04.593587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:04.594282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:04.602086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.602829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.603430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.604369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.604752 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-102a5e21-4dd3-4a8d-bb62-a79db18f188f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.301855 Oct 26 05:14:04.604902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.605249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.606882 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1599/3229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:04 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:04.617700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:04.618598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:04.627213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.628673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.629257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.630270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.631888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.632506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.670851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:14:04.688720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.689524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.690210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.702221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:04.707496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'flavor' on Instance uuid 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:04.723767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:04.732464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed55dda9-0008-44ce-b4dc-c36d3bcac2ab tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1271 microversion: 2.1 time: 0.124478 Oct 26 05:14:04.746083 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1600/3230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:04 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:04.751522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'system_metadata' on Instance uuid 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:04.755141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:04.756861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:04.763723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.764598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.765455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.766800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:04.767455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:04.768053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:04.866699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'metadata' on Instance uuid 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:05.079718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.102331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93f6461c-764e-4071-87d2-dd650f8766e2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.354754 Oct 26 05:14:05.104439 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1601/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:04 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:05.317252 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.scheduler.client.report [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Deleted allocations for instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 Oct 26 05:14:05.317777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:05.318200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:05.327449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.327945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.328381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.333594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.339318 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8b2fe129-35a6-4b0a-a1bc-3840b3d5c0ee tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2" status: 204 len: 0 microversion: 2.1 time: 0.756816 Oct 26 05:14:05.339494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.341677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.346826 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1631/3232] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:14:04 2022] DELETE /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:14:05.363611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:05.364972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:05.373579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.374335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.374992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.375882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.376681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.377286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.517566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.557035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.566565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.570823 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0db1bf1-ae3a-46f9-b9cc-315ae641c3da tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1357 microversion: 2.54 time: 0.256758 Oct 26 05:14:05.572555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1602/3233] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:05 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:14:05.588896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:05.592535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:05.609454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.610226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.616505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.617728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.618500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.619192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.653462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 HTTP/1.1 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '90e01b75-9d4c-4cf2-b1cc-843f93bffbe2'} Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:05.659559 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:14:05.665715 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:05.671158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:05.672989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c9b6e07a-f79c-4b26-b053-a5de0378ecc7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2" status: 404 len: 111 microversion: 2.1 time: 0.099258 Oct 26 05:14:05.674463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.681069 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1603/3234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:05 2022] GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:14:05.697026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.698886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a5508cd-09fe-4f01-abcd-2dda3a4b79c6 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Action: 'create', calling method: .version_select at 0x7f4709c63dc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-359180275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNMsJq3iZQPj+FPIigVCegbKo4TTGl65cJloySsmiG2nOKp+xwVzpu3klXTQxa5XT5xaM8wbjUZiqMJnSHc6RuHU3RxcHRHu5msKvnJ+tKNUhcvL4UHMnDGkpmoFm/nmw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:05.725887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:05.729829 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bbe72e9-68dc-440e-b1f3-939b5846453a tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1371 microversion: 2.47 time: 0.373034 Oct 26 05:14:05.733414 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1632/3235] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:05 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:05.757225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:05.759027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:05.763578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5a5508cd-09fe-4f01-abcd-2dda3a4b79c6 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Getting quotas for project f5d6d046a389421fb784ea3bc741c72c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:05.789636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5a5508cd-09fe-4f01-abcd-2dda3a4b79c6 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Getting quotas for user bc24f39a8942439385df1d409065db51 and project f5d6d046a389421fb784ea3bc741c72c. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:05.796578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.797430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.798192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.805142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.805698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.806998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.834254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:05.890913 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5a5508cd-09fe-4f01-abcd-2dda3a4b79c6 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.202335 Oct 26 05:14:05.893809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1604/3236] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:14:05 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 211 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:14:05.921492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:05.922160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:05.936972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.937852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.943195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:05.944402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:05.945053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:05.945994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:06.095365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:06.104643 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-870ffebd-c64e-4f50-bb43-9e1868bb8fbd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1277 microversion: 2.1 time: 0.207857 Oct 26 05:14:06.125408 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1605/3237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:05 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:06.137098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-82462166", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:06.227491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:06.238040 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3f7e5c2-8e32-4cbd-8fa1-d57d14e3321c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.502605 Oct 26 05:14:06.240536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1633/3238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:05 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:06.250855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-359180275", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:06.259104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:06.263003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:06.270790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:06.271368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:06.272323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:06.273300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:06.274152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:06.274594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:06.383981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:06.385927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:06.388063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:06.388878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:06.390680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:06.521526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:06.529480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:06.530255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:06.530863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:06.531740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:06.532365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:06.533118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:06.567139 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5368aa6d-3328-4fa7-81f8-2bc84cd8d617 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "POST /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827/action" status: 202 len: 1139 microversion: 2.54 time: 0.320375 Oct 26 05:14:06.569888 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1634/3239] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Oct 26 05:14:06 2022] POST /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827/action => generated 1139 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 05:14:06.580991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:06.582647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:06.611295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:06.614431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:06.615636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:06.616665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:06.619765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:06.620534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.621503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:07.631898 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4fb7fd4e-b28f-4dca-bf8a-12f70c875806 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 1.060825 Oct 26 05:14:07.642266 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1635/3240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:06 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:07.650440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:07.651356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:07.664076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:07.664567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:07.665002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.665740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:07.666198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:07.666622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.765207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:07.781684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:07.783198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:07.787824 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7857a98a-fb2a-47e4-8113-2ef53439b311 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.143004 Oct 26 05:14:07.788453 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1636/3241] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:07 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:07.803244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:07.804282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:07.821631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:07.822794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:07.823442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:07.824007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:07.824955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:07.829386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:07.831376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:07.831834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.839501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:07.840745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:07.848158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.856076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:07.858544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:07.859002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.859967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:07.860431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:07.860869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:07.906957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:07.915700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:07.959769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:07.962564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:08.015885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.027552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.029923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.031388 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68d9229a-a2d3-4c47-aa81-4bee5aeaeed0 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1356 microversion: 2.47 time: 0.233084 Oct 26 05:14:08.033506 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1637/3242] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:07 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1356 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:08.063002 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c61d3f92-a351-4a14-89c0-9234e2d0126d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.936083 Oct 26 05:14:08.066457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1606/3243] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:08.072130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:08.081037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:08.081562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:08.086639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:08.097867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.100202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.100805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.102041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.102515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.104479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.123341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.125919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.126698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.128493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.131571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.137977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.561103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.581420 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9c7de00e-b8df-461b-af4a-da066fba3c30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1319 microversion: 2.1 time: 0.545641 Oct 26 05:14:08.585660 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1638/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:08 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:08.596653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:08.614343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.616474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Searching by: {'deleted': False, 'project_id': '123cc71a44084278a9da1ead2d46118f'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:14:08.627305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.628075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.628187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.628360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.629277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.630113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.631299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.644125 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e380667c-4e50-4870-97a6-3cf4c8215ff7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.576285 Oct 26 05:14:08.644725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1607/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:08 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:08.656674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-750bc20d-285b-4dd6-b296-95f5b5cf976a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:08.659288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-750bc20d-285b-4dd6-b296-95f5b5cf976a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:08.836343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-750bc20d-285b-4dd6-b296-95f5b5cf976a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:08.848010 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-750bc20d-285b-4dd6-b296-95f5b5cf976a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1213 microversion: 2.1 time: 0.197527 Oct 26 05:14:08.861334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:14:08.863935 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1608/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:08 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1213 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:08.881978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:08.884880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:08.920660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.921184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.921673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:08.922410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:08.926352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:08.926876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.009294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.018009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.019134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.019876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.046740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.048782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.207480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4410c001-3501-49be-a02e-bbd22019ca9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.620667 Oct 26 05:14:09.226028 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1639/3247] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 26 05:14:08 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:09.236887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:09.241263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:09.259422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.275327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.276392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.276869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.279309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.279445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.439712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.452899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.454396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.455597 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f3ebe0a-1f9b-4a14-961d-3cc79b7540dc tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.228455 Oct 26 05:14:09.456390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1640/3248] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:09 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:09.480803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:09.481347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:09.504173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.504668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.505142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.506398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.506854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.507429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.545928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:09.558642 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2adab98d-0c5e-4b4b-b9e8-0552835f7af0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.686733 Oct 26 05:14:09.559221 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1609/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:08 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:09.564088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:09.572448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:14:09.609905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:09.610143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:09.618419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.619931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.620539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.621560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.622272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.622865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.710430 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f8aac75-5719-4e17-9dc5-d410cf7db6de tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 204 len: 0 microversion: 2.47 time: 0.249848 Oct 26 05:14:09.715136 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1641/3250] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:14:09 2022] DELETE /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:14:09.722853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:09.723559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:09.736465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.737253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.737997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:09.738912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:09.739632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:09.740654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.308454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.335325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7ea1f96c-8ea8-40d6-9ab7-20e4ced4552b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1319 microversion: 2.1 time: 0.729721 Oct 26 05:14:10.336630 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1610/3251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:09 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1319 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:10.344449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:10.345215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:10.359696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.360324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.360870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.365920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.366576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.368298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.390801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:10.569285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.589052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.592914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.599114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b59b74ba-2a3a-409c-9f18-804586de32d7 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1362 microversion: 2.47 time: 0.261078 Oct 26 05:14:10.602732 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1611/3252] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:10 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:10.606824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.614244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0fa8691c-dc24-494f-813b-5830757e1ac2 req-94ec8f2c-9e4d-40b0-9636-7aba9ea238a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a60e804-2fa4-4840-8b63-cba29a9c55bc", "tag": "b8519565-855d-4738-a1cb-8c878e604e0f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:10.619604 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a0129b5-2c9b-4a26-97be-6883b6f4ced3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.904232 Oct 26 05:14:10.621364 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1642/3253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:09 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:10.645057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0fa8691c-dc24-494f-813b-5830757e1ac2 req-94ec8f2c-9e4d-40b0-9636-7aba9ea238a9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.645719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0fa8691c-dc24-494f-813b-5830757e1ac2 req-94ec8f2c-9e4d-40b0-9636-7aba9ea238a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.646492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0fa8691c-dc24-494f-813b-5830757e1ac2 req-94ec8f2c-9e4d-40b0-9636-7aba9ea238a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.653437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:10.654578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:10.668844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.670073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.671200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.673392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.675505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.676755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.682205 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0fa8691c-dc24-494f-813b-5830757e1ac2 req-94ec8f2c-9e4d-40b0-9636-7aba9ea238a9 service nova] Creating event network-changed:b8519565-855d-4738-a1cb-8c878e604e0f for instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc on n-h1-862416-4 Oct 26 05:14:10.690863 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0fa8691c-dc24-494f-813b-5830757e1ac2 req-94ec8f2c-9e4d-40b0-9636-7aba9ea238a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082048 Oct 26 05:14:10.693977 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1612/3254] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:10.710135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:10.714044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:10.728095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.730523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.731256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.733941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.737269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.738057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.846459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.859488 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f6d173e-7b57-4428-82f6-c9ed557e4b20 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1271 microversion: 2.1 time: 0.221511 Oct 26 05:14:10.860689 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1643/3255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:10 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:10.866414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:10.867416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:10.871028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:10.875906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.881611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.882305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.883210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:10.884105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:10.885164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:10.966117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.975204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.976697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:10.977941 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3427f428-1c3c-4a4c-ad3c-c468dcf0e60d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.282476 Oct 26 05:14:10.978504 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1613/3256] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:10 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:11.376919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:11.377620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:11.402031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:11.403115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:11.403736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:11.404785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:11.405565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:11.406349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:11.801449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:11.818643 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd9a0dcd-005e-4c83-82f6-e19701dde564 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.956248 Oct 26 05:14:11.819532 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1644/3257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:10 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:11.824353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:11.831740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:11.848448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:11.850324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:11.851026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:11.851964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:11.853831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:11.854496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:11.996154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.009877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.013170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.014716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d561ab9f-c1ca-43c8-8f19-aacdcf3dceba tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1362 microversion: 2.47 time: 0.194001 Oct 26 05:14:12.016256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1645/3258] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:11 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:12.023509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:12.025025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:12.033691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.034348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.034927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.035787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.036407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.037063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.167367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.179926 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9cfd965b-e55a-44bd-a1d1-1d5f0d52541d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1319 microversion: 2.1 time: 0.808637 Oct 26 05:14:12.180522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1614/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:11 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1319 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:12.186484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:12.189233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:12.197134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.197851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.198413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.199251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.199788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.200293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.561544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.575337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f51a9bc-8ef7-4a31-80dc-36fed5ac71ad tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.553411 Oct 26 05:14:12.588374 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1646/3260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:12 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:12.598031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:12.598818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:12.606066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.606568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.607108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.607825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.608294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.608780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.678401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.690666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0de5db4-e8af-4e37-b10a-7c95b1562414 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.508592 Oct 26 05:14:12.691494 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1615/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:12 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:12.755440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.770478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.772874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:12.780358 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-517e7bb7-d935-4b77-a471-b8f4d0a5dde4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.186049 Oct 26 05:14:12.804182 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1647/3262] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:12 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:12.851817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:12.852709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:12.890593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.893221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.893833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:12.897442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:12.898011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:12.898675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.049953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:13.050736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:13.071413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.077157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.078020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.079000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.080936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.082407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.168411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.169269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.170204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.170922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lazy-loading 'fault' on Instance uuid 8c1d1ef4-83b9-4b71-9f16-bc03674fedda {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:13.247140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:13.259155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b458e178-8e9b-4a25-a6a3-3f478b9ca82f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.414713 Oct 26 05:14:13.264260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:13.268729 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1616/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:12 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:13.283161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:13.289664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:13.290911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-83a47787-6851-4185-a1de-fd5eea9ca4a3 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 200 len: 1367 microversion: 2.47 time: 0.249742 Oct 26 05:14:13.304785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:13.305812 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1648/3264] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:13 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:13.306030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:13.328322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.337650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.338113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.338872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.339340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.339773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.413065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1cbdeede-3d67-4bf3-9ce6-e9b51f97ead6 req-36829d11-38a3-441f-8849-f8394922171a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818c473d-f6f2-4328-89d6-14ec2860e77f", "tag": "aaa5b3f5-7821-4969-b505-cfb871572b62"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:13.440377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1cbdeede-3d67-4bf3-9ce6-e9b51f97ead6 req-36829d11-38a3-441f-8849-f8394922171a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.447598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1cbdeede-3d67-4bf3-9ce6-e9b51f97ead6 req-36829d11-38a3-441f-8849-f8394922171a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.449214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1cbdeede-3d67-4bf3-9ce6-e9b51f97ead6 req-36829d11-38a3-441f-8849-f8394922171a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.483026 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1cbdeede-3d67-4bf3-9ce6-e9b51f97ead6 req-36829d11-38a3-441f-8849-f8394922171a service nova] Creating event network-changed:aaa5b3f5-7821-4969-b505-cfb871572b62 for instance 818c473d-f6f2-4328-89d6-14ec2860e77f on n-h2-862416-4 Oct 26 05:14:13.488953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1cbdeede-3d67-4bf3-9ce6-e9b51f97ead6 req-36829d11-38a3-441f-8849-f8394922171a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085025 Oct 26 05:14:13.490838 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1649/3265] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:13.600530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:13.601427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:13.608428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.610549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.611162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:13.612584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:13.613291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:13.613976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.131878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.155529 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-abc0bc43-dade-4f27-8106-9ff1fbcfc67e tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1319 microversion: 2.1 time: 0.884893 Oct 26 05:14:14.175368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1617/3266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:13 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1319 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:14.188720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:14.190336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:14.191872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.200290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.201879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.202845 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6717ccf-ad2c-4690-a4c6-2867572ae489 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.607125 Oct 26 05:14:14.204779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1650/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:13 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:14.206980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.207899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.208629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.210114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.217681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:14.218313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:14.235595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.236426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.237104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.238239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.238932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.239602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.447110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.465861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.467866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.471378 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-655a634c-5303-49ab-89fe-d25916805fba tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.264884 Oct 26 05:14:14.475136 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1651/3268] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:14 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:14.480052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c9346ec9-1198-4e0a-92cf-afd3705554e6 req-a4b99978-839a-478c-99e8-89c0352e71f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c7e9c1-06d6-4967-92b1-2f2f09153754", "tag": "eb9faf62-61f1-4905-80f8-f63931ef692c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:14.489701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c9346ec9-1198-4e0a-92cf-afd3705554e6 req-a4b99978-839a-478c-99e8-89c0352e71f2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.490588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c9346ec9-1198-4e0a-92cf-afd3705554e6 req-a4b99978-839a-478c-99e8-89c0352e71f2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.491194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c9346ec9-1198-4e0a-92cf-afd3705554e6 req-a4b99978-839a-478c-99e8-89c0352e71f2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.504284 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c9346ec9-1198-4e0a-92cf-afd3705554e6 req-a4b99978-839a-478c-99e8-89c0352e71f2 service nova] Creating event network-changed:eb9faf62-61f1-4905-80f8-f63931ef692c for instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 on n-h2-862416-4 Oct 26 05:14:14.524131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c9346ec9-1198-4e0a-92cf-afd3705554e6 req-a4b99978-839a-478c-99e8-89c0352e71f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047555 Oct 26 05:14:14.528515 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1652/3269] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:14.536515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:14.537615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:14.545403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.546141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.546775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.547716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.548741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.549385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.624637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.637582 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2861e439-bb8b-4982-83d5-d8863063ab4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.458668 Oct 26 05:14:14.652378 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1618/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:14 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:14.659855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:14.660816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: 8c1d1ef4-83b9-4b71-9f16-bc03674fedda] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:14.671221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.672535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.674104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.675127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.675856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.677136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.699480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] HTTP exception thrown: Instance 8c1d1ef4-83b9-4b71-9f16-bc03674fedda could not be found. Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Request method failure captured: Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda HTTP/1.1 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHuzSz1sO_-52YniiuPW_j9tJiXl66z_M-LVPhwztw7d8KGnmYu59bQjmzlniTlS2IwnlPZthJtcckJY2tSWreD7_NuQvAotdOQY42crbpS4eOhoMOKvU3PaAsLUnj2JTIktMz7U88fXstXEYfMscArNRIZEylhPAOC72lqewmiKeU Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.47 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 123cc71a44084278a9da1ead2d46118f Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerShowV247Test-519746008 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123cc71a44084278a9da1ead2d46118f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123cc71a44084278a9da1ead2d46118f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123cc71a44084278a9da1ead2d46118f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123cc71a44084278a9da1ead2d46118f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerShowV247Test-519746008 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 123cc71a44084278a9da1ead2d46118f Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerShowV247Test-519746008 Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerShowV247Test-519746008-project Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 30a3704834514180b2f696e39949589b Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerShowV247Test-519746008-project Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8c1d1ef4-83b9-4b71-9f16-bc03674fedda could not be found. Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8c1d1ef4-83b9-4b71-9f16-bc03674fedda'} Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1d1ef4-83b9-4b71-9f16-bc03674fedda could not be found. Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1d1ef4-83b9-4b71-9f16-bc03674fedda could not be found. Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:14.702622 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1d1ef4-83b9-4b71-9f16-bc03674fedda could not be found. Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:14.709179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Returning 404 to user: Instance 8c1d1ef4-83b9-4b71-9f16-bc03674fedda could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:14.710374 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-450fe944-a3da-4e81-8e91-2af023eebf9b tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda" status: 404 len: 111 microversion: 2.47 time: 0.058106 Oct 26 05:14:14.717591 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1619/3271] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:14 2022] GET /compute/v2.1/servers/8c1d1ef4-83b9-4b71-9f16-bc03674fedda => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:14:14.723967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:14.728367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:14.743107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.743107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.743107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.743461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.743815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.744885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.778089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:14:14.784441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:14.795207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-893a243b-3e14-4497-a593-75b3b5369e91 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.264704 Oct 26 05:14:14.796428 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1653/3272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:14 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:14.921420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f7ff659-4a98-448f-9f1d-b57c855bf399 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1" status: 204 len: 0 microversion: 2.47 time: 0.201483 Oct 26 05:14:14.923866 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1620/3273] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:14:14 2022] DELETE /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:14:14.932804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:14.933536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:14.942702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.943240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.943898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:14.944777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:14.945614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:14.946768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.040650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.060346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.065106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.066430 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e99f9852-4223-4386-8175-8ce441d3af23 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1" status: 200 len: 1363 microversion: 2.47 time: 0.138615 Oct 26 05:14:15.082300 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1654/3274] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:14 2022] GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:15.195530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:15.196414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:15.222011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.236581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.238072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.239002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.239545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.242096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.242702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:15.244691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:15.270826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.271888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.272337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.273247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.273926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.274527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.502751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.512524 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54747b40-938e-49cc-882e-7438741656e7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.288708 Oct 26 05:14:15.513973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1655/3275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:15 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:15.520220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1a7fe06f-a8b6-4043-b620-a4b096c9f51f req-6165eab1-1774-4908-bddb-2c97d5ad3a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a60e804-2fa4-4840-8b63-cba29a9c55bc", "name": "network-vif-plugged", "status": "completed", "tag": "b8519565-855d-4738-a1cb-8c878e604e0f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:15.535753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1a7fe06f-a8b6-4043-b620-a4b096c9f51f req-6165eab1-1774-4908-bddb-2c97d5ad3a56 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.536463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1a7fe06f-a8b6-4043-b620-a4b096c9f51f req-6165eab1-1774-4908-bddb-2c97d5ad3a56 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.536612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.538357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1a7fe06f-a8b6-4043-b620-a4b096c9f51f req-6165eab1-1774-4908-bddb-2c97d5ad3a56 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.547115 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3912e387-d855-4f95-a4c7-7154b78dfd18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1319 microversion: 2.1 time: 0.362601 Oct 26 05:14:15.561344 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1621/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:15 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:15.561344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:15.561344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:15.561762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1a7fe06f-a8b6-4043-b620-a4b096c9f51f req-6165eab1-1774-4908-bddb-2c97d5ad3a56 service nova] Creating event network-vif-plugged:b8519565-855d-4738-a1cb-8c878e604e0f for instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc on n-h1-862416-4 Oct 26 05:14:15.561872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.562292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.562924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.565127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.565900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.566504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.566635 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1a7fe06f-a8b6-4043-b620-a4b096c9f51f req-6165eab1-1774-4908-bddb-2c97d5ad3a56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051262 Oct 26 05:14:15.567158 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1656/3277] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:15.640795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.652875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.654411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.655716 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36035a0b-4b70-42da-b633-cbc9fbe796ac tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.106414 Oct 26 05:14:15.656297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1622/3278] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:15 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:15.663203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:15.664137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:15.670547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.671032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.671474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.672160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.672635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.673047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.817237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.818876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:15.819610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:15.825879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.826512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.827069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.827884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:15.828455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:15.828990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:15.829975 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-236b1e8e-0478-43f8-a3db-88e8eec9ed8d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.171340 Oct 26 05:14:15.830581 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1657/3279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:15 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:15.977718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:15.985924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-051f0cad-f44a-4cba-acbd-8df009e515a4 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.171705 Oct 26 05:14:15.986504 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1623/3280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:15 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:16.036031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c0b01b-c501-4f1c-9daa-737985a32467 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Action: 'create', calling method: .version_select at 0x7f470a823430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1690743367", "metadata": {"Type": "work"}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c0b01b-c501-4f1c-9daa-737985a32467 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Request method failure captured: Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 122 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMIn-TJ5D57cZFH2b8T5ywpdOBQ5_VhGfKu5WaPSVQydKHdFFct1bC7Jwa63zAAVSmAq9C58u9NS9eMecBytAate70XvUcjHORL5j6LhSNv6ZXoqgqJaiq6luHsEA2Po1hyHvDHRaxdi7asQCNYnibvt4WMmG0-OrO-HNNAHjVN95t0 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2bb950ea85de4e728039a3b2fd9f4f1f Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1690743367", "metadata": {"Type": "work"}}} Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1690743367', 'metadata': {'Type': 'work'}}}} Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi '#$%' Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:14:16.040698 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c0b01b-c501-4f1c-9daa-737985a32467 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80c0b01b-c501-4f1c-9daa-737985a32467 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.183121 Oct 26 05:14:16.050449 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1658/3281] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 26 05:14:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:14:16.053100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47ffc162-c419-4fb7-807c-979a35460d6f tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Action: 'create', calling method: .version_select at 0x7f4709bfed30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-309020617", "metadata": {"Type": "work"}}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47ffc162-c419-4fb7-807c-979a35460d6f tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Request method failure captured: Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 119 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIn-TJ5D57cZFH2b8T5ywpdOBQ5_VhGfKu5WaPSVQydKHdFFct1bC7Jwa63zAAVSmAq9C58u9NS9eMecBytAate70XvUcjHORL5j6LhSNv6ZXoqgqJaiq6luHsEA2Po1hyHvDHRaxdi7asQCNYnibvt4WMmG0-OrO-HNNAHjVN95t0 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2bb950ea85de4e728039a3b2fd9f4f1f Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-309020617", "metadata": {"Type": "work"}}} Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-309020617', 'metadata': {'Type': 'work'}}}} Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi '0' Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:14:16.057289 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47ffc162-c419-4fb7-807c-979a35460d6f tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:16.062818 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47ffc162-c419-4fb7-807c-979a35460d6f tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010676 Oct 26 05:14:16.066144 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1624/3282] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 26 05:14:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:14:16.069398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76e5bf00-e9af-4109-bd06-85184a63d06c tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Action: 'create', calling method: .version_select at 0x7f470aa76d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-963949197", "metadata": {"Type": "work"}}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76e5bf00-e9af-4109-bd06-85184a63d06c tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Request method failure captured: Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 118 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMIn-TJ5D57cZFH2b8T5ywpdOBQ5_VhGfKu5WaPSVQydKHdFFct1bC7Jwa63zAAVSmAq9C58u9NS9eMecBytAate70XvUcjHORL5j6LhSNv6ZXoqgqJaiq6luHsEA2Po1hyHvDHRaxdi7asQCNYnibvt4WMmG0-OrO-HNNAHjVN95t0 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2bb950ea85de4e728039a3b2fd9f4f1f Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-963949197", "metadata": {"Type": "work"}}} Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-963949197', 'metadata': {'Type': 'work'}}}} Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi '' Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:14:16.072954 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76e5bf00-e9af-4109-bd06-85184a63d06c tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:16.078241 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-76e5bf00-e9af-4109-bd06-85184a63d06c tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010000 Oct 26 05:14:16.079367 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1659/3283] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 26 05:14:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:14:16.084867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61d171e1-b3a5-40cd-9212-6c3bfaa38d61 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Calling method '.version_select at 0x7f4709bd6940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.116520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.117151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:16.120594 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-61d171e1-b3a5-40cd-9212-6c3bfaa38d61 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] HTTP exception thrown: Volume tempest-invalid-1332904108 could not be found. Oct 26 05:14:16.123429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.123946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.124387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.125079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.125632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.126053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.128824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61d171e1-b3a5-40cd-9212-6c3bfaa38d61 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Request method failure captured: Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1332904108 HTTP/1.1 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIn-TJ5D57cZFH2b8T5ywpdOBQ5_VhGfKu5WaPSVQydKHdFFct1bC7Jwa63zAAVSmAq9C58u9NS9eMecBytAate70XvUcjHORL5j6LhSNv6ZXoqgqJaiq6luHsEA2Po1hyHvDHRaxdi7asQCNYnibvt4WMmG0-OrO-HNNAHjVN95t0 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2bb950ea85de4e728039a3b2fd9f4f1f Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: exception: Volume tempest-invalid-1332904108 could not be found. Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'tempest-invalid-1332904108'} Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1332904108 could not be found. (HTTP 404) (Request-ID: req-36213d3d-4721-480f-8637-023248d3aa44) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:14:16.137283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1332904108 could not be found. Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1332904108 could not be found. Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1332904108 could not be found. Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61d171e1-b3a5-40cd-9212-6c3bfaa38d61 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Returning 404 to user: Volume tempest-invalid-1332904108 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61d171e1-b3a5-40cd-9212-6c3bfaa38d61 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1332904108" status: 404 len: 99 microversion: 2.1 time: 0.058101 Oct 26 05:14:16.141564 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1625/3284] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:14:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1332904108 => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:14:16.152369 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46371bb7-a2c0-499f-b142-458b7954ac58 tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004614 Oct 26 05:14:16.153356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1626/3285] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 26 05:14:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 26 05:14:16.162849 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f89bb47-6907-44a0-9967-d44456855abc tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004435 Oct 26 05:14:16.163368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1627/3286] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:14:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 26 05:14:16.172905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-532c1bfa-01df-4d3a-8185-167fe6c2226a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Calling method '.version_select at 0x7f4709bd6820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.204939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-532c1bfa-01df-4d3a-8185-167fe6c2226a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] HTTP exception thrown: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-532c1bfa-01df-4d3a-8185-167fe6c2226a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Request method failure captured: Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-volumes/c47a3b24-071f-476b-b027-fb6cd1cb55a7 HTTP/1.1 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIn-TJ5D57cZFH2b8T5ywpdOBQ5_VhGfKu5WaPSVQydKHdFFct1bC7Jwa63zAAVSmAq9C58u9NS9eMecBytAate70XvUcjHORL5j6LhSNv6ZXoqgqJaiq6luHsEA2Po1hyHvDHRaxdi7asQCNYnibvt4WMmG0-OrO-HNNAHjVN95t0 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2bb950ea85de4e728039a3b2fd9f4f1f Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: exception: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c47a3b24-071f-476b-b027-fb6cd1cb55a7'} Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. (HTTP 404) (Request-ID: req-c1179928-e2e6-46ae-b403-dc1fa5f0fbba) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:14:16.209589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. Oct 26 05:14:16.214495 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.217540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:16.218807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-532c1bfa-01df-4d3a-8185-167fe6c2226a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Returning 404 to user: Volume c47a3b24-071f-476b-b027-fb6cd1cb55a7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:16.219710 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-532c1bfa-01df-4d3a-8185-167fe6c2226a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/c47a3b24-071f-476b-b027-fb6cd1cb55a7" status: 404 len: 109 microversion: 2.1 time: 0.051256 Oct 26 05:14:16.220550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:16.220682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1628/3287] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:14:16 2022] DELETE /compute/v2.1/os-volumes/c47a3b24-071f-476b-b027-fb6cd1cb55a7 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:14:16.222047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:16.223210 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4eab0420-4252-47a4-a030-ae25b704a74d tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1" status: 200 len: 1363 microversion: 2.47 time: 0.112057 Oct 26 05:14:16.229651 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1660/3288] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:16 2022] GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 => generated 1363 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:14:16.231385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64534429-5251-49d6-97f2-ec1a022b803a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Calling method '.version_select at 0x7f4709c48b80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.266452 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-64534429-5251-49d6-97f2-ec1a022b803a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] HTTP exception thrown: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64534429-5251-49d6-97f2-ec1a022b803a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Request method failure captured: Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-volumes/a3037648-5ed1-45aa-9950-c8fc8e742b6f HTTP/1.1 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIn-TJ5D57cZFH2b8T5ywpdOBQ5_VhGfKu5WaPSVQydKHdFFct1bC7Jwa63zAAVSmAq9C58u9NS9eMecBytAate70XvUcjHORL5j6LhSNv6ZXoqgqJaiq6luHsEA2Po1hyHvDHRaxdi7asQCNYnibvt4WMmG0-OrO-HNNAHjVN95t0 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5a8c0fbaf9c4649a4567cbe933fc00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: c5a8c0fbaf9c4649a4567cbe933fc00e Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesNegativeTest-783485964 Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2bb950ea85de4e728039a3b2fd9f4f1f Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesNegativeTest-783485964-project Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: exception: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a3037648-5ed1-45aa-9950-c8fc8e742b6f'} Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. (HTTP 404) (Request-ID: req-0dd3c286-9294-4924-8215-0d5a8767e662) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:14:16.268465 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64534429-5251-49d6-97f2-ec1a022b803a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] Returning 404 to user: Volume a3037648-5ed1-45aa-9950-c8fc8e742b6f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64534429-5251-49d6-97f2-ec1a022b803a tempest-VolumesNegativeTest-783485964 tempest-VolumesNegativeTest-783485964-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a3037648-5ed1-45aa-9950-c8fc8e742b6f" status: 404 len: 109 microversion: 2.1 time: 0.042861 Oct 26 05:14:16.272829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1629/3289] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:14:16 2022] GET /compute/v2.1/os-volumes/a3037648-5ed1-45aa-9950-c8fc8e742b6f => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:14:16.546849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.549032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:16.559028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.559527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.559973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.560713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.561532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.562461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.572187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.573065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:16.586186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.587184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.587629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.588340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.592371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.592815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.897517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:16.914470 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4923ab6d-1fdc-4561-8e14-480812e40f90 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.378802 Oct 26 05:14:16.925695 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1661/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:16 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:16.936525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:16.937483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:16.944256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.945204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.945857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:16.946742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:16.947371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:16.947973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.104155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.108357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.114301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.116411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.117134 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc491426-c2eb-4f48-a543-9afbf9a92156 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1319 microversion: 2.1 time: 0.549262 Oct 26 05:14:17.117766 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1630/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:16 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:17.128638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:17.134610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:17.135562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d5186dc5-563d-4a03-bd6c-d8429282e168 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.208438 Oct 26 05:14:17.136287 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1662/3292] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:16 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:17.150565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.151334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.151954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.152895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.153389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.153842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:17.154353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.154861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:17.161481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.163524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.164162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.165687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.166399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.167048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.596011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.604175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.610381 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b668969a-fcb4-474a-8bd6-4fb2477e115e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.485206 Oct 26 05:14:17.615137 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f09685f-68c9-475d-980c-9c40fb554257 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.477630 Oct 26 05:14:17.616363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1663/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:17 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:17.621388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:17.622225 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1631/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:17 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:17.622505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:17.628986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.629777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.630465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.631907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.632589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.633426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.687614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.688304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.688758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.689219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lazy-loading 'fault' on Instance uuid e0086078-eb69-454b-9791-f18f501fb6d1 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:17.742857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.756777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.758687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30a3704834514180b2f696e39949589b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123cc71a44084278a9da1ead2d46118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:17.760320 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-94c90466-2847-42e5-8348-1e16dd22d264 tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1" status: 200 len: 1368 microversion: 2.47 time: 0.142859 Oct 26 05:14:17.761209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1664/3295] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:17 2022] GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 => generated 1368 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:17.885867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:17.941931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:17.942436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:17.948732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.949464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.949905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:17.950767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:17.951556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:17.951990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.066287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2057182690", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:18.126766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:18.128122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.142432 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15d2996d-e009-4202-804d-51028978011d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.204315 Oct 26 05:14:18.143072 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1665/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:17 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:18.155364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.156307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.166845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.167343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.167783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.168597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.169053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.169887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.412301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.433288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7de31b9d-1e40-49c7-b521-f09e529c9bf8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1469 microversion: 2.1 time: 0.286772 Oct 26 05:14:18.445914 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1666/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:18.458705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.459446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.463936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:18.464368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:18.464847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:18.465261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:18.465700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:18.465812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.466207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.466644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.467344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.467801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.468223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.476016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.476507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.476950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.477738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.478201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.478629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.496662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Getting quotas for project 2fb02f78470f4d21bab5069d61e3395f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:18.502049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Getting quotas for user 97ae9a317def4487817c994bb8c0bbac and project 2fb02f78470f4d21bab5069d61e3395f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:18.515207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:18.517459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:18.543058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.551637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.553866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.555116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c74855e-ca3a-432e-83e5-d3476c1781d1 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.107990 Oct 26 05:14:18.555683 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1667/3298] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:18.561627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.562442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.569615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.570178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.570678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.571438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.571954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.572449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.577738 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-596bf957-9287-4c40-a15a-a91c73092e57 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768574 Oct 26 05:14:18.578646 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1632/3299] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:18.590359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ba32ab5-d595-4af4-9a97-a28d40ec4b5e tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.591084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ba32ab5-d595-4af4-9a97-a28d40ec4b5e tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.676483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ba32ab5-d595-4af4-9a97-a28d40ec4b5e tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.687534 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ba32ab5-d595-4af4-9a97-a28d40ec4b5e tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1219 microversion: 2.1 time: 0.100775 Oct 26 05:14:18.688837 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1633/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:18.696099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.696836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.703000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:18.704402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.705081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.705922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.706934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.709264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.709961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.757092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.765709 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2eea5834-9405-4ca0-8eaa-7f49b5d6d37b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1319 microversion: 2.1 time: 0.208752 Oct 26 05:14:18.770764 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1668/3301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:18.787802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.788421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.794511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.795372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.795668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.796466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.796995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.797506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.957531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:18.966439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22b626e9-a8e7-451b-8851-1dc5d15797d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.276464 Oct 26 05:14:18.967760 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1634/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:18.973094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:18.973766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] [instance: e0086078-eb69-454b-9791-f18f501fb6d1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:18.980778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.981571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.982193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.982899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:18.983520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:18.984102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:18.990252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:19.002908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] HTTP exception thrown: Instance e0086078-eb69-454b-9791-f18f501fb6d1 could not be found. Oct 26 05:14:19.003981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=22 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Request method failure captured: Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 HTTP/1.1 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHuzSz1sO_-52YniiuPW_j9tJiXl66z_M-LVPhwztw7d8KGnmYu59bQjmzlniTlS2IwnlPZthJtcckJY2tSWreD7_NuQvAotdOQY42crbpS4eOhoMOKvU3PaAsLUnj2JTIktMz7U88fXstXEYfMscArNRIZEylhPAOC72lqewmiKeU Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.47 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 123cc71a44084278a9da1ead2d46118f Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerShowV247Test-519746008 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123cc71a44084278a9da1ead2d46118f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123cc71a44084278a9da1ead2d46118f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123cc71a44084278a9da1ead2d46118f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123cc71a44084278a9da1ead2d46118f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerShowV247Test-519746008 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 123cc71a44084278a9da1ead2d46118f Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerShowV247Test-519746008 Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerShowV247Test-519746008-project Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 30a3704834514180b2f696e39949589b Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerShowV247Test-519746008-project Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e0086078-eb69-454b-9791-f18f501fb6d1 could not be found. Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e0086078-eb69-454b-9791-f18f501fb6d1'} Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0086078-eb69-454b-9791-f18f501fb6d1 could not be found. Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0086078-eb69-454b-9791-f18f501fb6d1 could not be found. Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:19.004855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0086078-eb69-454b-9791-f18f501fb6d1 could not be found. Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] Returning 404 to user: Instance e0086078-eb69-454b-9791-f18f501fb6d1 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-560e3d17-7d72-4dce-ada0-fe586ebda76c tempest-ServerShowV247Test-519746008 tempest-ServerShowV247Test-519746008-project] 10.222.0.16 "GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1" status: 404 len: 111 microversion: 2.47 time: 0.037554 Oct 26 05:14:19.010947 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1635/3303] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/e0086078-eb69-454b-9791-f18f501fb6d1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:14:19.022041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:19.031980 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c89066d8-63c1-489a-90a4-b6c8c592987c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.260089 Oct 26 05:14:19.032565 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1669/3304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:18 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:19.171468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:19.172119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:19.182458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:19.182997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:19.183442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:19.184222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:19.184881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:19.185508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:19.340534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:19.362268 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b1fd060-52c5-4541-b9e6-526eb0b42889 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.195449 Oct 26 05:14:19.364562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1636/3305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:19 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:19.584676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:19.585226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:19.593668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:19.594290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:19.594956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:19.596639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:19.597070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:19.597919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:19.715638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:19.716803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:19.728201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:19.728702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:19.729142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:19.730041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:19.730500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:19.730928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.001808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.003399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.012088 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb31c0b2-f050-439f-9f15-fc3f156c62f0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1271 microversion: 2.1 time: 0.300695 Oct 26 05:14:20.012606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.029860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.029860 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1008764b-38fa-467f-83de-91a553b660c7 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.435747 Oct 26 05:14:20.029860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1670/3306] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:19 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:20.030195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1637/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:19 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:20.030295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:20.030295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:20.030478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:20.030478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:20.042965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.045722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.046531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.047735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.048771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.049477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.053899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.054511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.055667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.057128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.057378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.058448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.454542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.469349 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0aa06b85-b58a-4275-a763-8430a9cd6084 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.449250 Oct 26 05:14:20.473625 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1638/3308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:20 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:20.482898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:20.484573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:20.496167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.498030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.499028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.504964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.506782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.507711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.508909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.519343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a32b93da-a5bf-4d91-b60e-060f8a355931 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1319 microversion: 2.1 time: 0.500407 Oct 26 05:14:20.520691 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1671/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:20 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:20.528584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:20.529658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:20.539014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.539976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.540699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.542818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:20.543678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:20.545653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:20.939446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.952820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:20.960833 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1377da4-309a-45e8-a76c-86b696de0d17 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.437621 Oct 26 05:14:20.969096 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-77b751ff-cde8-44e2-8924-37740384fe28 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.493640 Oct 26 05:14:20.969717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1639/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:20 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:20.973728 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1672/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:20 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:21.057244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:21.058261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:21.069105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:21.070422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:21.079641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:21.081882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.083008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.084498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.085259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.085942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.087559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.088451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.088615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.089235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.089879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.090490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.091066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.210949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:21.236178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:21.238461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:21.241377 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-603b026e-d15c-49c7-a7c7-389d79d04a57 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.177069 Oct 26 05:14:21.241777 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1673/3312] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:21 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:14:21.307305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:21.317502 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0d0ddfb-5293-40a3-b600-fb4530c38dc0 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1277 microversion: 2.1 time: 0.265234 Oct 26 05:14:21.320010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1640/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:21 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:21.515273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:21.516814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:21.534473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.535057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.535569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.538298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.538858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.539641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.548172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:21.548882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:21.564347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.565187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.567207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.570850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.571326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:21.571830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:21.933228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:21.954369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:21.960574 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9aea91f4-a235-496b-b7bf-163ace7548ea tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.467399 Oct 26 05:14:21.963080 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d3e7309-1828-4cdf-aed1-bdc96b119aad tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1319 microversion: 2.1 time: 0.420249 Oct 26 05:14:21.963270 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1674/3314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:21 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:21.964622 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1641/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:21 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:21.985134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-db30fa65-0f59-4608-b83a-69a24f546018 req-66707d5e-1bf7-45f9-a9e5-27af7a856a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c473d-f6f2-4328-89d6-14ec2860e77f", "name": "network-vif-plugged", "status": "completed", "tag": "aaa5b3f5-7821-4969-b505-cfb871572b62"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:21.992675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:21.994490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:21.999088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-db30fa65-0f59-4608-b83a-69a24f546018 req-66707d5e-1bf7-45f9-a9e5-27af7a856a65 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:21.999816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-db30fa65-0f59-4608-b83a-69a24f546018 req-66707d5e-1bf7-45f9-a9e5-27af7a856a65 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.000420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-db30fa65-0f59-4608-b83a-69a24f546018 req-66707d5e-1bf7-45f9-a9e5-27af7a856a65 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.008322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.008828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.013713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.014507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.014988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.015433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.021974 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-db30fa65-0f59-4608-b83a-69a24f546018 req-66707d5e-1bf7-45f9-a9e5-27af7a856a65 service nova] Creating event network-vif-plugged:aaa5b3f5-7821-4969-b505-cfb871572b62 for instance 818c473d-f6f2-4328-89d6-14ec2860e77f on n-h2-862416-4 Oct 26 05:14:22.039179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-db30fa65-0f59-4608-b83a-69a24f546018 req-66707d5e-1bf7-45f9-a9e5-27af7a856a65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073415 Oct 26 05:14:22.040032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1675/3316] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:22.045716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:22.046644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:22.065726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.066370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.067079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.068049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.072098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.073183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.445133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:22.448206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:22.456938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a366917b-2a23-4e5a-81b7-6c9a254adf3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.415527 Oct 26 05:14:22.458242 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1676/3317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:22 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:22.462855 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2e2f1042-f131-4108-920e-a7ccf450dc6e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.475587 Oct 26 05:14:22.466210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:22.467112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:22.478680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.478948 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1642/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:21 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:22.479368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.480067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.481000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.481720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.482910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.487717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:22.489389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:22.490898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:22.498610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.499943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.500737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.503029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.503672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.504270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.592948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:22.605432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:22.607897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:22.610607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23e42a49-e573-460b-baa0-68172bc55d7b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.150390 Oct 26 05:14:22.622497 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1677/3319] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:22 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:22.686612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:22.696143 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-317ff73a-d740-4d4f-8bda-0e8841f84499 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1319 microversion: 2.1 time: 0.216013 Oct 26 05:14:22.696722 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1643/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:22 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:22.953215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-77b5606d-010f-42ae-8e6a-9b8820c7064b req-b3312e06-5c4f-4c5f-a2e7-4d595d23b27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca587e39-b569-4c22-a594-4ef3a5ab2186", "tag": "8f388013-a99e-4311-af48-6dac6d91d267"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:22.965839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-77b5606d-010f-42ae-8e6a-9b8820c7064b req-b3312e06-5c4f-4c5f-a2e7-4d595d23b27f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:22.966537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-77b5606d-010f-42ae-8e6a-9b8820c7064b req-b3312e06-5c4f-4c5f-a2e7-4d595d23b27f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:22.967057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-77b5606d-010f-42ae-8e6a-9b8820c7064b req-b3312e06-5c4f-4c5f-a2e7-4d595d23b27f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:22.979456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-77b5606d-010f-42ae-8e6a-9b8820c7064b req-b3312e06-5c4f-4c5f-a2e7-4d595d23b27f service nova] Creating event network-changed:8f388013-a99e-4311-af48-6dac6d91d267 for instance ca587e39-b569-4c22-a594-4ef3a5ab2186 on n-h1-862416-4 Oct 26 05:14:22.988085 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-77b5606d-010f-42ae-8e6a-9b8820c7064b req-b3312e06-5c4f-4c5f-a2e7-4d595d23b27f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039463 Oct 26 05:14:22.989465 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1678/3321] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:22.990699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:22.991335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:23.001835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:23.002043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.002329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.002864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:23.004467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.006079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.006755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.007784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.010557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.011223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.011754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.012614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.013151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.013743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.290444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:23.293781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:23.302885 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e9e28e9-ca0e-42e2-94fb-8f6a93647587 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1319 microversion: 2.1 time: 0.305292 Oct 26 05:14:23.317337 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a49d546d-b1ec-457b-ab18-2ff3191f46ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1313 microversion: 2.1 time: 0.320769 Oct 26 05:14:23.317337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1644/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:22 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:23.318727 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1679/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:22 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:23.480627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:23.481239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:23.489472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.491383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.492159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.493207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.493707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.494635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.682277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:23.691731 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5bb0178-0aac-437b-9aed-ec73acd7bc75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.215532 Oct 26 05:14:23.692403 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1680/3324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:23 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:23.698317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:23.698959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:23.705498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.705985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.706845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.707573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:23.708031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:23.708682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:23.781877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-220705e4-e883-41fa-abcb-e3ca4ab1e852 tempest-ComputeTenantNetworksTest-1124830930 tempest-ComputeTenantNetworksTest-1124830930-project] Calling method '.version_select at 0x7f470a722160>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:23.998877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.010803 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8760e8d3-83d6-4c67-a7ab-03c230adb726 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.316602 Oct 26 05:14:24.011625 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1681/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:23 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:24.025142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.028464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-220705e4-e883-41fa-abcb-e3ca4ab1e852 tempest-ComputeTenantNetworksTest-1124830930 tempest-ComputeTenantNetworksTest-1124830930-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.627548 Oct 26 05:14:24.029146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.029287 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1645/3326] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 26 05:14:23 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:24.033577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.034376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.039397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.040135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.040656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.041013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.041364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.041907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.042040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.042388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.042629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.043336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.043802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.044234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.167522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.177177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.179585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.181088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2291470f-3296-4423-8fc6-c01fb14a7a04 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.168657 Oct 26 05:14:24.182336 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1682/3327] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:24.187025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1599e3e-35b6-4183-8435-2dc5febc91f9 tempest-ComputeTenantNetworksTest-1124830930 tempest-ComputeTenantNetworksTest-1124830930-project] Calling method '.version_select at 0x7f470a80e160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.311882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.321873 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cedd6cde-c54e-48ac-8cc7-6f1b2e7c721c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1319 microversion: 2.1 time: 0.291760 Oct 26 05:14:24.322447 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1646/3328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:24.327468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0b60ee0b-e4ee-4970-9e55-5c68f9aa7c57 req-8e38a3a5-80bb-4388-8d51-b569ea683379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c7e9c1-06d6-4967-92b1-2f2f09153754", "name": "network-vif-plugged", "status": "completed", "tag": "eb9faf62-61f1-4905-80f8-f63931ef692c"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:24.327627 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1599e3e-35b6-4183-8435-2dc5febc91f9 tempest-ComputeTenantNetworksTest-1124830930 tempest-ComputeTenantNetworksTest-1124830930-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/918299fb-d8f7-4c41-93ee-68b203b688fc" status: 200 len: 140 microversion: 2.1 time: 0.143918 Oct 26 05:14:24.328347 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1683/3329] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/os-tenant-networks/918299fb-d8f7-4c41-93ee-68b203b688fc => generated 140 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:24.338239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.338877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.344925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0b60ee0b-e4ee-4970-9e55-5c68f9aa7c57 req-8e38a3a5-80bb-4388-8d51-b569ea683379 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.345143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.345535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0b60ee0b-e4ee-4970-9e55-5c68f9aa7c57 req-8e38a3a5-80bb-4388-8d51-b569ea683379 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.345681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.345970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.346106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0b60ee0b-e4ee-4970-9e55-5c68f9aa7c57 req-8e38a3a5-80bb-4388-8d51-b569ea683379 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.346665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.347133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.347927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.357621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0b60ee0b-e4ee-4970-9e55-5c68f9aa7c57 req-8e38a3a5-80bb-4388-8d51-b569ea683379 service nova] Creating event network-vif-plugged:eb9faf62-61f1-4905-80f8-f63931ef692c for instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 on n-h2-862416-4 Oct 26 05:14:24.363222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0b60ee0b-e4ee-4970-9e55-5c68f9aa7c57 req-8e38a3a5-80bb-4388-8d51-b569ea683379 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039294 Oct 26 05:14:24.364104 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1647/3330] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:24.370856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.371945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.379026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.383387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.384064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.385206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.385935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.386592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.670552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.679759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32f1213f-71cf-499a-b801-23456fcd4c76 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1501 microversion: 2.1 time: 0.350481 Oct 26 05:14:24.680428 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1684/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:24.710653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:24.711503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.719308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.720042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.720662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.722068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.723000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.723471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.725154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.733650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f281a94d-e301-4f3e-a86c-db2df80ed19b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1319 microversion: 2.1 time: 0.368153 Oct 26 05:14:24.738271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1648/3332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:24.746637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.747470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.754494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.755252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.756165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.757116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.757879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.758506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.850188 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb3654e0-f3b8-49e7-9d95-50f33e78b623 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f/action" status: 202 len: 0 microversion: 2.1 time: 0.144894 Oct 26 05:14:24.854706 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1685/3333] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:14:24 2022] POST /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:14:24.861857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:24.863790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:24.874178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.874917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.876020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.877140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:24.877665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:24.878192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:24.964025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:24.974225 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9b7b88c-91e0-4aed-834e-8b2eb834a1da tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.234315 Oct 26 05:14:24.976613 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1649/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:25.038399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:25.039335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:25.067734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.069510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.069649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.073479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.074026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.074474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.132864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.147774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e955d4c-686a-4af4-aeaf-1ddf68adec7a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1506 microversion: 2.1 time: 0.291416 Oct 26 05:14:25.152696 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1686/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:24 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:25.209532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:25.210276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:25.216822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.217888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.217888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.234357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.234920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.235385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.302445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.316424 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-33f31cb4-4793-49d8-a95a-e9230cc23e02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.285860 Oct 26 05:14:25.317717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1650/3336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:25 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:25.346830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:25.347409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:25.356581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.357345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.357814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.358684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.359358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.359992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.389919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.406609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.408080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.409276 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4847b4b7-14c1-42a5-9d7d-12e1680db91c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.204979 Oct 26 05:14:25.410129 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1687/3337] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:25 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:14:25.533564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.542555 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c406ff66-999b-4197-a485-548cba576ac4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1319 microversion: 2.1 time: 0.200286 Oct 26 05:14:25.543142 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1651/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:25 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:25.761562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:25.762181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:25.768746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.769229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.770082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.771493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:25.772627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:25.773232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:25.939375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:25.949115 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55deb7c9-9aed-4dc8-b90e-17444cade27d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1319 microversion: 2.1 time: 0.191166 Oct 26 05:14:25.950315 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1688/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:25 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:26.011223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.011905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.018066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.018484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.019141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.019849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.020684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.021347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.173605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.182210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.182944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.184824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-603a0fc0-8644-4068-b156-7c76885067aa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.177461 Oct 26 05:14:26.186372 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1652/3340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:26.195070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.196658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.197386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.198341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.199022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.199700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.340987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.341625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.349407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.349929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.350366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.354022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.357720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.358509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.413137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.425147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75cf6b1e-7c2f-4f91-b4cb-3d1891827e6f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1486 microversion: 2.1 time: 0.246531 Oct 26 05:14:26.426496 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1689/3341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1486 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:26.453666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.455291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.463879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.464863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.465583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.466693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.467384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.468029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.577193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.587524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.589707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.591356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85fe1b81-640e-47b8-9e4e-9c4a9a705246 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.159359 Oct 26 05:14:26.592198 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1690/3342] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:26.605607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.617897 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd82264f-8ef3-4ce3-b36e-858d389b45d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1512 microversion: 2.1 time: 0.280056 Oct 26 05:14:26.618063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.618592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.624929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.625448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.625892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.626591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.627049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.627476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.633248 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1653/3343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:26.645094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.647821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.655375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.655875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.656328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.657646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.658117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.658548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.663541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:26.666035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:14:26.777257 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da2eec10-0bbd-4bea-a967-313c2779c7e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 204 len: 0 microversion: 2.1 time: 0.169421 Oct 26 05:14:26.781154 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1691/3344] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:14:26 2022] DELETE /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:14:26.792856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.793882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.797331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:26.801877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.802614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.803456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.804470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.805135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.805596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.851574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.862373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0230bc4-94cc-4180-9ee4-cb4fddba4a5c tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1319 microversion: 2.1 time: 0.225361 Oct 26 05:14:26.864403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1654/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:26.970423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:26.972996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:26.973334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:26.974012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:26.980526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f1ae191-30bd-4770-bee8-02a3c220a6e3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1492 microversion: 2.1 time: 0.197293 Oct 26 05:14:26.981061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.981593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.981805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1692/3346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1492 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:26.982544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:26.983562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:26.984177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:26.984759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.132469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.140488 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7301a2cd-9bcb-426f-931b-1a809ca5d5d8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1469 microversion: 2.1 time: 0.172079 Oct 26 05:14:27.141348 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1655/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:26 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:27.164732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:27.170930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.182424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Searching by: {'reservation_id': 'r-r5o9jrxj', 'deleted': False, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:14:27.189461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.189949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.190383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.191094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.191553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.202608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.217894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:27.218743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:27.244289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.245003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.248066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.250146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.252571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.254085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.343043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:14:27.447096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.454611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.455104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.455921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.489076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.499516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-393f6beb-5dff-441f-aba7-235aed2c0da1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.292171 Oct 26 05:14:27.500106 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1656/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:27 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:27.508299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ee251f8f-fe00-4bdb-8fba-47832720af42 req-89e9651a-dcef-4e29-a13e-e55e98beeccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca587e39-b569-4c22-a594-4ef3a5ab2186", "name": "network-vif-plugged", "status": "completed", "tag": "8f388013-a99e-4311-af48-6dac6d91d267"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:27.523524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ee251f8f-fe00-4bdb-8fba-47832720af42 req-89e9651a-dcef-4e29-a13e-e55e98beeccc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.524028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ee251f8f-fe00-4bdb-8fba-47832720af42 req-89e9651a-dcef-4e29-a13e-e55e98beeccc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.524466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ee251f8f-fe00-4bdb-8fba-47832720af42 req-89e9651a-dcef-4e29-a13e-e55e98beeccc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.556340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ee251f8f-fe00-4bdb-8fba-47832720af42 req-89e9651a-dcef-4e29-a13e-e55e98beeccc service nova] Creating event network-vif-plugged:8f388013-a99e-4311-af48-6dac6d91d267 for instance ca587e39-b569-4c22-a594-4ef3a5ab2186 on n-h1-862416-4 Oct 26 05:14:27.568986 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ee251f8f-fe00-4bdb-8fba-47832720af42 req-89e9651a-dcef-4e29-a13e-e55e98beeccc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063818 Oct 26 05:14:27.570457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1657/3349] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:27.642638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:27.644757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:27.651930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a528d7c-ec2c-4c30-a827-072b127a3844 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-r5o9jrxj" status: 200 len: 2931 microversion: 2.1 time: 0.491327 Oct 26 05:14:27.662225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1693/3350] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 26 05:14:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-r5o9jrxj => generated 2931 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:27.662225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:27.662225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:27.669331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.670617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.671946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.673100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.673971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.674564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.699535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.702300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.704442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.708149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.710266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.710957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.848671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.874102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.876961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.878493 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb209b4c-81fb-4cee-bd25-29cdcdda4f1d tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.261918 Oct 26 05:14:27.879307 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1658/3351] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:27 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:27.885630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f68dd3c-66ea-4476-853b-dce846688e35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:27.894897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:27.904970 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f5f2cb1-e917-46a1-94cc-82792d101920 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1489 microversion: 2.1 time: 0.250896 Oct 26 05:14:27.906111 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1694/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:27 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1489 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:27.913372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_groups [None req-4f68dd3c-66ea-4476-853b-dce846688e35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Querying cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) for 2 instances {{(pid=120585) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 26 05:14:27.914158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f68dd3c-66ea-4476-853b-dce846688e35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.918055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f68dd3c-66ea-4476-853b-dce846688e35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.918316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f68dd3c-66ea-4476-853b-dce846688e35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.926258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:27.926901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:27.940803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.941340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.941773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.942803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:27.943333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:27.943766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:27.961884 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f68dd3c-66ea-4476-853b-dce846688e35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d394639b-d1b0-4e15-80a4-5f77e6651892" status: 200 len: 271 microversion: 2.1 time: 0.081106 Oct 26 05:14:27.962477 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1659/3353] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:14:27 2022] GET /compute/v2.1/os-server-groups/d394639b-d1b0-4e15-80a4-5f77e6651892 => generated 271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:27.977495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:27.983047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:27.997918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.001534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.002513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.003796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.005907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.007895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.098720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e70fa99e-92cf-4633-8a75-278ca667ea26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 200 len: 184 microversion: 2.1 time: 0.130625 Oct 26 05:14:28.101737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1660/3354] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:14:27 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 184 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:28.113805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:28.116419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:28.126375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.126957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.127863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.128848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.129733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.131994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.193612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:28.206533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d22be7d8-8d3f-49a9-a1c9-6a7e1ab64b97 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1319 microversion: 2.1 time: 0.298914 Oct 26 05:14:28.207805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1695/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:27 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:28.217836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:28.218727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:28.227013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.227788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.228404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.229113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.229663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.230133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.391995 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-feb08244-79a3-4a6a-8abe-d17994ea8b11 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 200 len: 1620 microversion: 2.1 time: 0.288494 Oct 26 05:14:28.394351 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1661/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:28 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 1620 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:28.422111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:28.423206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:28.439107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.440106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.440864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.441965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.443224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.444089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.491645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:28.506726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:28.519573 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a129dace-bac0-4fcb-85c1-53fbc76ebd60 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1492 microversion: 2.1 time: 0.310554 Oct 26 05:14:28.520636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1696/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:28 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1492 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:28.527149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:28.528129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:28.535097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.535598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.536040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.536792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.538132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.538569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.682961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=46 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:28.859568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:28.871201 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4e2b261-fd7c-46c6-a9fe-b75bee9c0bc9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.454766 Oct 26 05:14:28.875252 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1662/3358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:28 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:28.884363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:28.884978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:28.911153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.914304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.915014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.919689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.920426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.920870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.941526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a2fdf5ea-6deb-4643-8c14-501350033aae tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1620 microversion: 2.1 time: 0.419002 Oct 26 05:14:28.942123 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1697/3359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:28 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1620 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:28.954378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:28.974948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:28.995350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:28.996036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:28.996650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:28.997571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:29.001857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:29.002676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:29.467150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:29.472139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:29.485545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b12d1520-594f-4e1c-bdd8-45b2cb428869 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.535594 Oct 26 05:14:29.485982 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee0baaa0-ae41-4348-9dac-146dd766725b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.606139 Oct 26 05:14:29.489410 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1698/3360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:28 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:29.489590 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1663/3361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:28 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:29.500347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:29.500755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:29.506557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:29.514119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:29.514800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:29.515225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:29.516689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:29.517185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:29.517352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:29.518057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:29.530380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:29.530884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:29.531328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:29.538600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:29.539333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:29.540093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:29.988404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:30.002714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:30.005137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:30.007618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a37b3be-b3cd-4737-835c-3a54f49697b4 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.519639 Oct 26 05:14:30.008895 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1699/3362] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:29 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:30.014671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-732510525", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "01534544-bfd6-4966-ae95-7dd5271c956f"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:30.090590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:30.319594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:30.337398 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac3212c7-e55c-4666-8078-e08ca222cb7a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1468 microversion: 2.1 time: 0.840102 Oct 26 05:14:30.353345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1664/3363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:29 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1468 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:30.355549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:30.358623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:30.388282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.393038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.394504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.395497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.400521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.401215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.613117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:30.614486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:30.615232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:30.615821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:30.616351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:30.635347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.635879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.636366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.637124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.637621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.642580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.694303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:30.700366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:30.716818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:30.719803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:30.825352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba333801-a79b-4835-a57f-de800a1a1907 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814969 Oct 26 05:14:30.835390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1700/3364] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:30.840601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:30.842728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:30.857515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.859174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.864014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.867823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.869056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.869852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.903718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:30.908674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.909477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.910089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:30.910713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'fault' on Instance uuid 818c473d-f6f2-4328-89d6-14ec2860e77f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:30.918164 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4855c44-0c07-4368-9f64-4417a5f99e1e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.572498 Oct 26 05:14:30.920678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1665/3365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:30 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:30.933190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0fba01b9-6711-4221-986c-821233addcfb req-26d1d589-eddd-4541-b87b-dd9038895468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c473d-f6f2-4328-89d6-14ec2860e77f", "name": "network-vif-deleted", "tag": "aaa5b3f5-7821-4969-b505-cfb871572b62"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:30.967341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0fba01b9-6711-4221-986c-821233addcfb req-26d1d589-eddd-4541-b87b-dd9038895468 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:30.971491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0fba01b9-6711-4221-986c-821233addcfb req-26d1d589-eddd-4541-b87b-dd9038895468 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:30.972143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0fba01b9-6711-4221-986c-821233addcfb req-26d1d589-eddd-4541-b87b-dd9038895468 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.006118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0fba01b9-6711-4221-986c-821233addcfb req-26d1d589-eddd-4541-b87b-dd9038895468 service nova] Creating event network-vif-deleted:aaa5b3f5-7821-4969-b505-cfb871572b62 for instance 818c473d-f6f2-4328-89d6-14ec2860e77f on n-h2-862416-4 Oct 26 05:14:31.037861 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0fba01b9-6711-4221-986c-821233addcfb req-26d1d589-eddd-4541-b87b-dd9038895468 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089412 Oct 26 05:14:31.040659 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1666/3366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:31.072332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:31.087703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6b767ccf-c528-4676-b940-eea1b0236216 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 200 len: 1303 microversion: 2.1 time: 0.250724 Oct 26 05:14:31.090067 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1701/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:30 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:31.109484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:31.112093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:31.136823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.140871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.141595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.142811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.145816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.146722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.624119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1830884549", "block_migration": true, "disk_over_commit": false}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:31.628100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:31.639131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.639728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.640359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.641252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.646062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.646793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.764792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lazy-loading 'flavor' on Instance uuid ca587e39-b569-4c22-a594-4ef3a5ab2186 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:31.789833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Going to try to live migrate instance to tempest-host-1830884549 {{(pid=120585) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:14:31.806687 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] HTTP exception thrown: Compute host tempest-host-1830884549 could not be found. Oct 26 05:14:31.809407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:31.825405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5a4a233-dbcd-4ee1-9a5e-bf04b867ad3f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1515 microversion: 2.1 time: 0.732181 Oct 26 05:14:31.827600 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1702/3368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:31 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1515 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Request method failure captured: Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186/action HTTP/1.1 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 107 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIpiU13cJ0eaGQHwk4xGD3Kw0GzOtnQcCxBBBdhuGj7vulWUGMOCPxu1-oj7K4g1s7U4LE5ajJ0906XD9KKS_RqkbVXnBlfjjLde9eSxjOzpnsQHanwm9WsTwa7GIYQEqMVtqfL6oWipNSf3GCzD4gWLH-3d3s1XJEtKvXxqn6swnQ Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6dc227184acf4fe896dd25b1a1dbe3d0 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-LiveMigrationNegativeTest-874300947 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-LiveMigrationNegativeTest-874300947 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6dc227184acf4fe896dd25b1a1dbe3d0 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-874300947 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-LiveMigrationNegativeTest-874300947-project-admin Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ef8e495b229d401ab882e4ccc8e82dc4 Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-LiveMigrationNegativeTest-874300947-project-admin Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: {"os-migrateLive": {"host": "tempest-host-1830884549", "block_migration": true, "disk_over_commit": false}} Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: exception: Compute host tempest-host-1830884549 could not be found. Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'ca587e39-b569-4c22-a594-4ef3a5ab2186', 'body': {'os-migrateLive': {'host': 'tempest-host-1830884549', 'block_migration': True, 'disk_over_commit': False}}} Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 26 05:14:31.829973 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1830884549 could not be found. Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1830884549 could not be found. Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1830884549 could not be found. Oct 26 05:14:31.834430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:31.838398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Returning 400 to user: Compute host tempest-host-1830884549 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:31.839746 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a46f2001-44fa-4718-8ca3-773208197171 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186/action" status: 400 len: 100 microversion: 2.1 time: 0.793885 Oct 26 05:14:31.840621 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1667/3369] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 26 05:14:31 2022] POST /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186/action => generated 100 bytes in 796 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:14:31.845876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:31.846722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:31.853103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:31.853944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:31.858056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.859763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.860831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.862616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.863367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.863690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.864001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.864964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.866223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:31.867932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:31.868931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:31.869724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.011941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:32.026048 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8989802f-0827-4057-ab4f-fed169c6659a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1220 microversion: 2.1 time: 0.174632 Oct 26 05:14:32.026979 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1703/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:31 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1220 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:32.041169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:32.044712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:32.065859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:32.066519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:32.067103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.067970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:32.068537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:32.069065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.153181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:32.166845 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36a141a1-081c-4560-83a3-dc2499962afd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.324979 Oct 26 05:14:32.167755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1668/3371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:31 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:32.175758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:32.176940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:32.189461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:32.206069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:32.207678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.211301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:32.217276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:32.217893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.361461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:32.376268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:32.384816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:32.386790 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1cb10b9e-debf-4685-b07e-829a408b8080 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1408 microversion: 2.54 time: 0.355267 Oct 26 05:14:32.390859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1704/3372] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:32 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:32.421538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:32.423838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:32.440508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:32.441263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:32.441967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.442892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:32.444652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:32.445340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:32.473996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f HTTP/1.1 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '818c473d-f6f2-4328-89d6-14ec2860e77f'} Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:32.475916 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:14:32.480299 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:14:32.482117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:32.483165 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f502c8d7-6316-40b8-93a7-fda59fc8c998 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 404 len: 111 microversion: 2.1 time: 0.077889 Oct 26 05:14:32.494605 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1705/3373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:32 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:14:32.500676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1256561525", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "51e64d69-11bc-4d31-bfc7-b6ed610b422e"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:32.550488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:32.572991 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70d98052-f1af-453d-bc99-712a22d2fdcb tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1468 microversion: 2.1 time: 0.391104 Oct 26 05:14:32.577366 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1669/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:32 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1468 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:32.577556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] validate_networks() for [('51e64d69-11bc-4d31-bfc7-b6ed610b422e', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:32.686700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1145861428", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:32.813940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:34.014670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:34.015388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:34.015692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:34.016339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:34.016925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:34.036500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:34.038636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:34.039165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:34.040237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:34.044023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:34.044557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:34.079535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:34.086553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for user 4c2aa94263344a7eb33bcc7c6594229a and project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:34.104093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:34.106999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:34.195123 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2db6440a-6937-43a9-ab5c-e654d4466d2d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698932 Oct 26 05:14:34.203337 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1706/3375] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:34.210327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:34.212336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:34.212996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:34.213637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:34.214244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:34.214640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-166014326", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:34.245199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:34.245846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:34.246307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:34.247118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:34.247589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:34.256272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:34.335120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:34.336885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:34.355073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:34.399748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:34.402172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:34.518966 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f1f056e-77c4-420c-9394-32f48de6cc0a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834492 Oct 26 05:14:34.523161 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1670/3376] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:14:34.548428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:34.549040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:34.557403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:34.564292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:34.565526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:34.566566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:34.567037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:34.567479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.450934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:35.463360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1058e405-0d76-465d-a9ca-0b76bfc8ab44 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1533 microversion: 2.1 time: 0.938517 Oct 26 05:14:35.470451 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1671/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:34 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1533 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:35.477466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:35.483184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:35.502196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.503065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.503735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.504906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.506344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.507013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.591265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:35.591752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:35.592206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:35.593475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:35.594086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:35.616297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.617572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.618019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.620801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.621289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.623040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.672182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Getting quotas for project 2fb02f78470f4d21bab5069d61e3395f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:35.679986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Getting quotas for user 97ae9a317def4487817c994bb8c0bbac and project 2fb02f78470f4d21bab5069d61e3395f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:35.698517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:35.701329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:35.795252 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9999dd79-697e-48c2-962e-5b1e0f8578bf tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590428 Oct 26 05:14:35.799620 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1707/3378] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:35.806839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:35.823092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:35.845514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.846149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.846603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.847323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.847785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.848208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.858675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:35.870832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8da6748-b69e-4bb3-873a-4e681434231f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.398688 Oct 26 05:14:35.874323 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1672/3379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:35 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:35.882104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:35.883147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:35.931080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.933008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.934395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.935800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:35.939608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:35.941646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:35.959759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:36.137853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:36.148857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:36.154145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:36.159791 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7e82601e-cd3e-42de-9077-bd58d7a2e724 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1414 microversion: 2.54 time: 0.359005 Oct 26 05:14:36.160619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:36.161286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1708/3380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:35 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1414 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:36.168876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:36.171792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:36.178843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47cfe507-a35a-481b-bb43-3591d7675af7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1267 microversion: 2.1 time: 0.302178 Oct 26 05:14:36.191674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.192094 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1673/3381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:35 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:36.194116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.195586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:36.196314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.196776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.197209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:36.206854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e39453c9-b4b9-404b-abe8-a6de3bc71819 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:36.209247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e39453c9-b4b9-404b-abe8-a6de3bc71819 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:36.430468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:36.441825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e39453c9-b4b9-404b-abe8-a6de3bc71819 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:36.446115 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24cee650-9802-4230-a8d7-138b2225e341 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1211 microversion: 2.1 time: 0.283010 Oct 26 05:14:36.447491 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1709/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:36 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1211 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:36.454155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f5cc2904-5ce6-4792-9a1e-145382056276 req-aec4aa59-6530-4671-8d4a-3fb6ed2ee69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c79f9e-a919-4948-97a1-1bbf306f2bcf", "tag": "80c7a31e-48cf-40b2-a8ee-98b44b4b22b5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:36.455514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e39453c9-b4b9-404b-abe8-a6de3bc71819 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1218 microversion: 2.1 time: 0.261948 Oct 26 05:14:36.456278 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1674/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:36 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:36.475924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f5cc2904-5ce6-4792-9a1e-145382056276 req-aec4aa59-6530-4671-8d4a-3fb6ed2ee69e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.479022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f5cc2904-5ce6-4792-9a1e-145382056276 req-aec4aa59-6530-4671-8d4a-3fb6ed2ee69e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.479848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f5cc2904-5ce6-4792-9a1e-145382056276 req-aec4aa59-6530-4671-8d4a-3fb6ed2ee69e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:36.494823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:36.495765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:36.505144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.506060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.507594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:36.508544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.509209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.510098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:36.510310 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f5cc2904-5ce6-4792-9a1e-145382056276 req-aec4aa59-6530-4671-8d4a-3fb6ed2ee69e service nova] Creating event network-changed:80c7a31e-48cf-40b2-a8ee-98b44b4b22b5 for instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf on n-h1-862416-4 Oct 26 05:14:36.526986 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f5cc2904-5ce6-4792-9a1e-145382056276 req-aec4aa59-6530-4671-8d4a-3fb6ed2ee69e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078050 Oct 26 05:14:36.535005 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1710/3384] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:36.901005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:36.903327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:36.912523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.913651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.914328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:36.915252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:36.916034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:36.917613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.187930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.199381 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ed185b0-24bd-4189-b409-24f5aead7e61 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.710185 Oct 26 05:14:37.205404 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1675/3385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:36 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:37.217937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:37.222937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:37.226734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.229173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:37.237232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b517dc49-ba2a-49ae-83de-28e80713974b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.340934 Oct 26 05:14:37.238034 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1711/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:36 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:37.249817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.249817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.249817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.249817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.255939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.256447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.267362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:37.268104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:37.280116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.280974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.282367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.283572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.284525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.285273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.352333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.364636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.366565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.367828 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2a1a9b92-c0e6-49fd-bfa4-51dad807fb71 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1414 microversion: 2.54 time: 0.161247 Oct 26 05:14:37.368462 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1676/3387] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:37 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:37.417993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.429809 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98de39c1-dd7d-4558-b12a-afcdbac724ba tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1267 microversion: 2.1 time: 0.177620 Oct 26 05:14:37.430888 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1712/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:37 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:37.473874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:37.475785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:37.483680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.484472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.485839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.487314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.487979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.488626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.567618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fea1662-ff95-4ea5-9280-0718bf1d5c48 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: .version_select at 0x7f470a875790>, body: {"keypair": {"name": "tempest-keypair-2063902221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRQJqAY6oYq+R/NXsnlWwlI++jJi72Y92j7Wt23AVAN72MjJN6TE+sYAebr9oHyVTRhI/tWAiWek8ZMN0akBLAHVQyq2uSGk0AeQcY9/eve34/ZoJ8H9W12+gsFsGLokw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:37.588186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5fea1662-ff95-4ea5-9280-0718bf1d5c48 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:37.592447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.593712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-5fea1662-ff95-4ea5-9280-0718bf1d5c48 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:37.605201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4723b87b-c109-41cc-94e8-2b89e7a937a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1211 microversion: 2.1 time: 0.136484 Oct 26 05:14:37.606514 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1713/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:37 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1211 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:37.611599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:37.612778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:37.617838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:37.620257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.620960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.621286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.622069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.622767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.623370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.628700 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fea1662-ff95-4ea5-9280-0718bf1d5c48 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.259144 Oct 26 05:14:37.630491 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1677/3390] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:14:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:37.635918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8489acaf-a89d-442c-a70d-8ffa4d6ac33e req-161b42f1-44c0-48d1-bee3-d0d6bb83f0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0a1d8a-ad5e-4660-a523-115cc3f1f953", "name": "network-vif-unplugged", "status": "completed", "tag": "c90dafd6-dcb4-4e3f-984e-b68fa8508d27"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:37.647722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8489acaf-a89d-442c-a70d-8ffa4d6ac33e req-161b42f1-44c0-48d1-bee3-d0d6bb83f0cc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:37.648264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8489acaf-a89d-442c-a70d-8ffa4d6ac33e req-161b42f1-44c0-48d1-bee3-d0d6bb83f0cc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:37.648715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8489acaf-a89d-442c-a70d-8ffa4d6ac33e req-161b42f1-44c0-48d1-bee3-d0d6bb83f0cc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:37.664881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8489acaf-a89d-442c-a70d-8ffa4d6ac33e req-161b42f1-44c0-48d1-bee3-d0d6bb83f0cc service nova] Creating event network-vif-unplugged:c90dafd6-dcb4-4e3f-984e-b68fa8508d27 for instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 on n-h2-862416-4 Oct 26 05:14:37.681266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8489acaf-a89d-442c-a70d-8ffa4d6ac33e req-161b42f1-44c0-48d1-bee3-d0d6bb83f0cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047928 Oct 26 05:14:37.686170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1678/3391] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:37.794482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:37.805671 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d82b3d9-29cb-4748-b607-e16880612cab tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1270 microversion: 2.1 time: 0.197559 Oct 26 05:14:37.806862 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1714/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:37 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:38.231784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:38.232565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:38.246585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.247399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.248304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.249641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.250344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.250950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.263689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:38.264948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:38.279838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.280712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.281986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.284451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.285129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.287333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.639378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:38.647866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:38.670467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71862691-ae75-43e0-ae00-c68314285055 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.409726 Oct 26 05:14:38.670933 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85f7a5ac-8e0c-4883-9a46-6048cdf9d53c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.441373 Oct 26 05:14:38.685349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1679/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:38 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:38.689642 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1715/3394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:38 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:38.696511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:38.697365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:38.699198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:38.701327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:38.709190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.712033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.713377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.714439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.715140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.715799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.726544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.730204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.731878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.733196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.735375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.735826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.858707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:38.860318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:38.873753 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-40a732fb-982c-45fd-b12c-051c94f7d863 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1275 microversion: 2.1 time: 0.182172 Oct 26 05:14:38.874914 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1716/3395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:38 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:38.889763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:38.889763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:38.895595 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-87ab2c1a-46d6-421e-912e-01db4e539a06 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1414 microversion: 2.54 time: 0.210274 Oct 26 05:14:38.896239 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1680/3396] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:38 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1414 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:38.898215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:38.899015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:38.907048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:38.911433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:38.920378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.929175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.929744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.931451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.931976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.933045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.933881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.934727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.935443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:38.936377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:38.936918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:38.937349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:39.046137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:39.062917 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9150db91-cadf-4cbd-838e-39f8e8f3c10a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1267 microversion: 2.1 time: 0.170914 Oct 26 05:14:39.065218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:39.089153 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1717/3397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:38 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:39.095262 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82070d2d-5e2b-4c03-8a80-63ac8436fe89 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1288 microversion: 2.1 time: 0.195112 Oct 26 05:14:39.095854 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1681/3398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:38 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1288 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:39.702509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:39.703167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:39.703789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:39.705066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:39.715402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:39.715622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:39.716059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:39.716506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:39.716937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:39.717216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:39.718106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:39.719203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:39.719904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:39.720535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:39.722514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:39.722951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.139687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.148714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.163364 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71e94d94-2b38-4d3d-b0c6-4cbbe90f7d1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.466757 Oct 26 05:14:40.166165 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-048b59f4-c047-4910-a065-65229422857b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.468347 Oct 26 05:14:40.167273 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1682/3399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:39 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:40.174883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:40.175912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:40.185589 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1718/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:39 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:40.191681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.193621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.194652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.195609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.196762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.197463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.205271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:40.206156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:40.218731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:40.235825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.236785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.237635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.237970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.238439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.238873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.294341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.310719 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6225e8b5-5c7a-40aa-b1f2-8c6126463c53 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1275 microversion: 2.1 time: 0.141769 Oct 26 05:14:40.311975 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1683/3401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:40 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1275 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:40.320752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1733913939", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dfe50ec-535f-4512-94ac-24b3da81845a"}], "security_groups": [{"name": "tempest-securitygroup--1378871606"}], "key_name": "tempest-keypair-2063902221", "user_data": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:40.330830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.360232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.362146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.363676 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ef835c1-08ba-42cb-8717-dda7783af849 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1414 microversion: 2.54 time: 0.176426 Oct 26 05:14:40.364449 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1719/3402] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:40 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1414 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:40.370959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:40.372732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:40.380095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.381704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.383103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.384037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.384680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.385587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.509475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:40.525151 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b43f0f5d-5a23-40bd-aac0-745255432d1b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1267 microversion: 2.1 time: 0.153408 Oct 26 05:14:40.539318 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1720/3403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:40 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:40.555992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:40.556992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:40.563544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.564041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.564539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.565260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:40.565742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:40.566172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:40.621925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] validate_networks() for [('4dfe50ec-535f-4512-94ac-24b3da81845a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:41.551911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:41.574504 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e3f5d2f3-fd2a-4393-bff9-37d007c1ee25 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 1.022841 Oct 26 05:14:41.589415 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1721/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:40 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:41.589415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:41.589415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:41.596176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.597220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.598367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.599908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.600277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.600917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.737183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:41.737772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:41.739033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:41.739349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:41.739857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:41.780368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.788226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.789129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.793577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.793577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.793577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.819766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:41.828486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:41.847261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:41.851617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:41.922289 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37bf31b7-cbc0-429c-84cd-482523558927 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.608544 Oct 26 05:14:41.923624 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1684/3405] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:41.936445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:41.950973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:41.953074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d3618ed-05a7-4c00-8586-bc6e84c901d0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.374984 Oct 26 05:14:41.953279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:41.953770 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1722/3406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:41 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:41.959547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:41.964680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:41.976112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.977115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.977967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.978538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.979391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.979975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.980520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.980926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.983676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:41.984712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:41.985392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:41.986033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.311603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.321849 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc87a267-27b7-4c6e-937a-8df55379a2d1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1273 microversion: 2.1 time: 0.366753 Oct 26 05:14:42.338344 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1723/3407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:41 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:42.343039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:42.344173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:42.367504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.368169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.368744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.369757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.370560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.371108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.556352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.572320 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-070e2b21-371d-4540-8985-dd1a4c378e86 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.647244 Oct 26 05:14:42.573120 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1685/3408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:41 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:42.581955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.586837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:42.594213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:42.597336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.605396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.606975 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a1a0f36-c2da-4225-91ad-c2bb94cc36ee tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1414 microversion: 2.54 time: 0.279889 Oct 26 05:14:42.615716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.616400 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1724/3409] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:42 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1414 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:42.619580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.620331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.621368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.627429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-007fd657-e8b0-4e12-9aa8-5a93864101a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:42.631722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-007fd657-e8b0-4e12-9aa8-5a93864101a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:42.632620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.635600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.810574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-007fd657-e8b0-4e12-9aa8-5a93864101a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.812512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:42.826019 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-007fd657-e8b0-4e12-9aa8-5a93864101a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1242 microversion: 2.1 time: 0.208200 Oct 26 05:14:42.831195 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c16f8c28-210e-4c9b-b51f-9cbd246245a4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1267 microversion: 2.1 time: 0.253778 Oct 26 05:14:42.843700 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1725/3410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:42 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:42.848155 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1686/3411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:42 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:42.857802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c0d6b0ed-478e-4daf-9db4-99f1183490a6 req-98a8f098-895e-48e4-bc1a-06a9214f5622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c79f9e-a919-4948-97a1-1bbf306f2bcf", "name": "network-vif-plugged", "status": "completed", "tag": "80c7a31e-48cf-40b2-a8ee-98b44b4b22b5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:42.873902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ca8109f6-8961-4254-9b1e-942af60164c3 req-2e7fa32c-1922-476e-a2ed-0b28116f19a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faecb167-ae90-48fa-b2e7-055201f222b7", "tag": "ee82704b-b288-4a19-9444-cee93e35624b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:42.890525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0d6b0ed-478e-4daf-9db4-99f1183490a6 req-98a8f098-895e-48e4-bc1a-06a9214f5622 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.896926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0d6b0ed-478e-4daf-9db4-99f1183490a6 req-98a8f098-895e-48e4-bc1a-06a9214f5622 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.898782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0d6b0ed-478e-4daf-9db4-99f1183490a6 req-98a8f098-895e-48e4-bc1a-06a9214f5622 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.905424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ca8109f6-8961-4254-9b1e-942af60164c3 req-2e7fa32c-1922-476e-a2ed-0b28116f19a6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.907281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ca8109f6-8961-4254-9b1e-942af60164c3 req-2e7fa32c-1922-476e-a2ed-0b28116f19a6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.909553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ca8109f6-8961-4254-9b1e-942af60164c3 req-2e7fa32c-1922-476e-a2ed-0b28116f19a6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.933231 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ca8109f6-8961-4254-9b1e-942af60164c3 req-2e7fa32c-1922-476e-a2ed-0b28116f19a6 service nova] Creating event network-changed:ee82704b-b288-4a19-9444-cee93e35624b for instance faecb167-ae90-48fa-b2e7-055201f222b7 on n-h1-862416-4 Oct 26 05:14:42.939873 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ca8109f6-8961-4254-9b1e-942af60164c3 req-2e7fa32c-1922-476e-a2ed-0b28116f19a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092238 Oct 26 05:14:42.941463 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1687/3412] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:42.949223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:42.950464 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c0d6b0ed-478e-4daf-9db4-99f1183490a6 req-98a8f098-895e-48e4-bc1a-06a9214f5622 service nova] Creating event network-vif-plugged:80c7a31e-48cf-40b2-a8ee-98b44b4b22b5 for instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf on n-h1-862416-4 Oct 26 05:14:42.951459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:42.961506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.962539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.963301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.965037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:42.966041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:42.966769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:42.970222 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c0d6b0ed-478e-4daf-9db4-99f1183490a6 req-98a8f098-895e-48e4-bc1a-06a9214f5622 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120574 Oct 26 05:14:42.972222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1726/3413] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:42.995091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:43.001175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:43.033925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:43.042915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:43.043385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:43.045466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:43.057883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:43.058733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:43.407627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:43.427429 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-267b28bc-e5bc-4623-962a-88d320099c32 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.483924 Oct 26 05:14:43.428605 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1688/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:42 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:43.457885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:43.459457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:43.471185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:43.473777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:43.477694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:43.478356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:43.478851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:43.479330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:43.888929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:43.908659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-44119e67-6f4b-4e14-9108-52880232b949 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.930386 Oct 26 05:14:43.909264 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1727/3415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:42 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:43.924697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:43.928467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:43.956298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:43.956821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:43.957272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:43.960225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:43.960741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:43.966069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.012342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.025942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6d3d614-4d13-4654-90f6-32ec4fce6186 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.593408 Oct 26 05:14:44.027832 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1689/3416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:43 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:44.070450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.072287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:44.100496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.101093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.101736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.102316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.102769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.107586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.341623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.355642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.357807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.360310 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a63a0b05-9def-4ad8-9b8b-e6fd36b9f580 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1399 microversion: 2.54 time: 0.304188 Oct 26 05:14:44.374617 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1690/3417] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:44 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1399 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:44.392544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.393176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:44.401899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.402392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.403014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.403885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.404520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.405113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.446697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.458997 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-871bc71b-9333-4ea0-a9df-461833a714db tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.544739 Oct 26 05:14:44.461942 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1728/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:43 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:44.489421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.490910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:44.497892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.498534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.499103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.499907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.500433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.501119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.562830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.574099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-520bbaa3-3fb6-4484-804c-43e0c46d317e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1294 microversion: 2.1 time: 0.198279 Oct 26 05:14:44.575164 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1691/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:44 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1294 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:44.589629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64837a15-cf27-4854-b262-bdc8a352684f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '.version_select at 0x7f470ea0cee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.591778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:44.602582 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5f6489f-a880-4196-86bd-1e3447e399e7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1273 microversion: 2.1 time: 0.127821 Oct 26 05:14:44.603183 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1729/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:44 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:44.613560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.614181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:44.625010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.625745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.626372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.627577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.628417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.629053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.633910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:44.638313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64837a15-cf27-4854-b262-bdc8a352684f tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-359180275" status: 204 len: 0 microversion: 2.54 time: 0.057245 Oct 26 05:14:44.642435 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1692/3421] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-359180275 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:14:44.652486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.657350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:44.670966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.671645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.672080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.673025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.673563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.674003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.719190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:14:44.784378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:44.857531 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94128c3a-2551-4f73-87ca-49930807c98c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 204 len: 0 microversion: 2.54 time: 0.209498 Oct 26 05:14:44.861628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1693/3422] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:14:44 2022] DELETE /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 26 05:14:44.872116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:44.873109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:44.890945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.892816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.893491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:44.894534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:44.895284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:44.895943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.054870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.075125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.080207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56d39e50-7a92-4d0f-bc50-fd7483d3c8e2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.472659 Oct 26 05:14:45.082230 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1730/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:44 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:45.088570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:45.089426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:45.092717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.095468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.097190 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c5748d5f-e814-410f-bbaa-2cb7e3a61492 tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1405 microversion: 2.54 time: 0.232266 Oct 26 05:14:45.098543 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1694/3424] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:44 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:45.102668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.105603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-047b6b7b-f527-46dd-8281-c34412bfb4d7 req-f3e7338c-1ce1-44dd-8bfa-133005d9f94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0a1d8a-ad5e-4660-a523-115cc3f1f953", "name": "network-vif-plugged", "status": "completed", "tag": "c90dafd6-dcb4-4e3f-984e-b68fa8508d27"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:45.106573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.108584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.122239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.123352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.131836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.155206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-047b6b7b-f527-46dd-8281-c34412bfb4d7 req-f3e7338c-1ce1-44dd-8bfa-133005d9f94b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.155996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-047b6b7b-f527-46dd-8281-c34412bfb4d7 req-f3e7338c-1ce1-44dd-8bfa-133005d9f94b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.156444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-047b6b7b-f527-46dd-8281-c34412bfb4d7 req-f3e7338c-1ce1-44dd-8bfa-133005d9f94b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.183201 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-047b6b7b-f527-46dd-8281-c34412bfb4d7 req-f3e7338c-1ce1-44dd-8bfa-133005d9f94b service nova] Creating event network-vif-plugged:c90dafd6-dcb4-4e3f-984e-b68fa8508d27 for instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 on n-h2-862416-4 Oct 26 05:14:45.190806 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-047b6b7b-f527-46dd-8281-c34412bfb4d7 req-f3e7338c-1ce1-44dd-8bfa-133005d9f94b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089636 Oct 26 05:14:45.199751 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1695/3425] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:45.207093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:45.210670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:45.219688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.220456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.220956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.221807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.222410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.222897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.606128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.613985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b29dd3c-cfa7-4470-bd72-bbd1b8b71a2d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.530401 Oct 26 05:14:45.614568 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1731/3426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:45 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:45.622070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:45.626203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:45.636453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.637612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.639566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.640208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.640682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.641394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.659606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.662446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:45.669666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ca24c02e-0516-4730-9e9a-df02641ff6c8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.467811 Oct 26 05:14:45.670749 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1696/3427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:45 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:45.675077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:45.675690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:45.691323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.691826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.692672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.693063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.693669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.697657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.809458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.822359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cbbb8091-2417-4f3b-8993-2730be7789c1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1302 microversion: 2.1 time: 0.149731 Oct 26 05:14:45.823474 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1697/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:45 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:45.828627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:45.829342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:45.850016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.850379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.850866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.851585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:45.852047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:45.852486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:45.987849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:45.997835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abb05714-b59f-4573-b090-82a7486a25dd tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1316 microversion: 2.1 time: 0.379184 Oct 26 05:14:46.014328 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1732/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:45 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:46.019556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-862c6ccd-8b84-45c5-bc63-ae3c39143dd3 req-b28f3a51-f843-4260-ad93-866fc034d7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af56f892-cb85-4dca-8cb2-fedb9604f881", "tag": "d8d3cc79-a546-4b67-81fd-8b7a433f044e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:46.030376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-862c6ccd-8b84-45c5-bc63-ae3c39143dd3 req-b28f3a51-f843-4260-ad93-866fc034d7f9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.031383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-862c6ccd-8b84-45c5-bc63-ae3c39143dd3 req-b28f3a51-f843-4260-ad93-866fc034d7f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.032123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-862c6ccd-8b84-45c5-bc63-ae3c39143dd3 req-b28f3a51-f843-4260-ad93-866fc034d7f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.044309 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-862c6ccd-8b84-45c5-bc63-ae3c39143dd3 req-b28f3a51-f843-4260-ad93-866fc034d7f9 service nova] Creating event network-changed:d8d3cc79-a546-4b67-81fd-8b7a433f044e for instance af56f892-cb85-4dca-8cb2-fedb9604f881 on n-h2-862416-4 Oct 26 05:14:46.049888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-862c6ccd-8b84-45c5-bc63-ae3c39143dd3 req-b28f3a51-f843-4260-ad93-866fc034d7f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033765 Oct 26 05:14:46.050831 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1733/3430] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:46.069298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.077800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba6ff356-4aa6-4da6-896a-5a1ca2fef685 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.252984 Oct 26 05:14:46.078415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1698/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:45 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:46.106993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:46.107716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:46.113939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.114434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.114999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.115710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.116177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.116654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.129352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:46.129352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:46.136967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.137568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.138082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.138877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.139414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.140797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.250884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.271642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.273477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.275010 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9b23e73-63f2-4647-b717-220b515fb74c tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1405 microversion: 2.54 time: 0.150843 Oct 26 05:14:46.304304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1699/3432] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:46 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:46.310417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fa78cff3-6e87-47dd-a88f-4b68ebe9e1f2 req-fae5df28-b554-492e-b312-e98491b8e9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f", "tag": "013a77ed-1e88-42f4-98fd-3a6567b8e685"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:46.322734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fa78cff3-6e87-47dd-a88f-4b68ebe9e1f2 req-fae5df28-b554-492e-b312-e98491b8e9ff service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.323382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fa78cff3-6e87-47dd-a88f-4b68ebe9e1f2 req-fae5df28-b554-492e-b312-e98491b8e9ff service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.324143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fa78cff3-6e87-47dd-a88f-4b68ebe9e1f2 req-fae5df28-b554-492e-b312-e98491b8e9ff service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.340199 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fa78cff3-6e87-47dd-a88f-4b68ebe9e1f2 req-fae5df28-b554-492e-b312-e98491b8e9ff service nova] Creating event network-changed:013a77ed-1e88-42f4-98fd-3a6567b8e685 for instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f on n-h2-862416-4 Oct 26 05:14:46.345517 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fa78cff3-6e87-47dd-a88f-4b68ebe9e1f2 req-fae5df28-b554-492e-b312-e98491b8e9ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039709 Oct 26 05:14:46.346836 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1700/3433] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:46.378279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.390856 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca1563d2-d11a-47c5-bc62-b7be4dec8051 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.287408 Oct 26 05:14:46.392255 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1734/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:46 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:46.642404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:46.643732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:46.653448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.654029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.654761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.655561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.656142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.656626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.694685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:46.695300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:46.720791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.721701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.729763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.730528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.731010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.731452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.932295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.942415 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73199712-b2e1-4a75-a30a-1f1157ed1e74 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1521 microversion: 2.1 time: 0.306753 Oct 26 05:14:46.943515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1701/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:46 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:46.948937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:46.949757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:46.958929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.959619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.960021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.961917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:46.962686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:46.963114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:46.976971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:46.985331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3996e496-19ac-499c-a79c-beb1d708994e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.294426 Oct 26 05:14:46.985950 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1735/3436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:46 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:47.023208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:47.024974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:47.032900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.033663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.034347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.035525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.036316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.037961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.053606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.066195 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49fe5726-165b-47d7-a748-d2784b71141f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1300 microversion: 2.1 time: 0.121367 Oct 26 05:14:47.066964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1702/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:46 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:47.103805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:47.109994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:47.120386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.121774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.122860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.123890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.124802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.126700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.274236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.285155 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-002b65c7-968b-436a-aa1d-647891d4e8fc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1466 microversion: 2.1 time: 0.268848 Oct 26 05:14:47.286673 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1736/3438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:47 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1466 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:47.311217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:47.313618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:47.319319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.329550 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-664c6fd6-450c-4eb6-b7ce-3c21283a9b11 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.231853 Oct 26 05:14:47.333293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.334038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.334477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.335266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.335756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.337932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.349651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1703/3439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:47 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:47.354849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:47.356311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:47.365597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.366384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.366994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.368676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.369456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.370180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.499652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.514191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.522198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc24f39a8942439385df1d409065db51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6d046a389421fb784ea3bc741c72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.523660 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16f9ce8b-b9f2-437e-b1d2-3eccc6b7fa6b tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 200 len: 1405 microversion: 2.54 time: 0.220054 Oct 26 05:14:47.524942 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1737/3440] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:47 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:14:47.530357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:47.542576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:47.562929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.564003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.564703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.565697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.566385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.567040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.778958 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f64f566-fca3-42e0-892a-80616dd99833 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1617 microversion: 2.1 time: 0.427691 Oct 26 05:14:47.780001 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1704/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:47 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1617 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:47.845087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:47.858444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e01dc06e-f6c9-4338-b3de-c26d82a3cd6b tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.331608 Oct 26 05:14:47.871922 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1738/3442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:47 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:47.972410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:47.972796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:47.988652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.989338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:47.990485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:47.998765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:47.999512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:48.000105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:48.010841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:48.019787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:48.052070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:48.053900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:48.055232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:48.059369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:48.061232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:48.061915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:48.881510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:48.883929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:48.893699 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b3ebe9b-ddf0-4a4a-943a-d54987361877 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.888089 Oct 26 05:14:48.894500 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1739/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:48 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:48.900265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2136879932", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["01534544-bfd6-4966-ae95-7dd5271c956f"]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:48.917024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7015a1e9-7b64-4e07-8917-ed448f435ae8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1506 microversion: 2.1 time: 0.949995 Oct 26 05:14:48.918042 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1705/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:47 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1506 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:48.929179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:48.933240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:48.946124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:48.947179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:48.947872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:48.948889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:48.949604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:48.950281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:48.990347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] validate_networks() for None {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:49.300283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:49.311212 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5af49d50-a0d2-4f63-88c8-237c249434c0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.390234 Oct 26 05:14:49.311818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1706/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:48 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:49.332575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:49.333163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:49.341701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.342400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.343020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.343906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.354534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.355825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.500816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:49.501636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:49.502401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:49.503040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:49.503682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:49.515566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=23 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:49.517746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.518580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.519256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.520437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.521693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.522574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.544648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:49.551734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:49.566592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:49.569450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:49.580774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:49.590742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2ae67f9b-930b-4863-97ae-6450a09a1e66 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.263750 Oct 26 05:14:49.591609 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1707/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:49 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:49.596572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:49.597186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] [instance: a5d64ff2-43b2-4344-8d0b-4715f578b827] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:49.604713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.605582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.606258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.607378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.608045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.608681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.624586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] HTTP exception thrown: Instance a5d64ff2-43b2-4344-8d0b-4715f578b827 could not be found. Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Request method failure captured: Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 HTTP/1.1 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMISunom3xzb94PPsOqSQO74PBsr8DtizrHadIyxcrZjR_ThI1dxTk7Nz5CaZRQXKrounL4wc9ACI873WdIyDb5mKAGr9M77MDsQaw8IBSKHb3aKdNcl5q2yI_IexBiNAiGpgnA8CB8DwgeAXVALk7b2JRSA1G7xcgheMkGUcn_X1_E Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.54 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f5d6d046a389421fb784ea3bc741c72c Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerShowV254Test-1271507724 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5d6d046a389421fb784ea3bc741c72c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5d6d046a389421fb784ea3bc741c72c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5d6d046a389421fb784ea3bc741c72c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5d6d046a389421fb784ea3bc741c72c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerShowV254Test-1271507724 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f5d6d046a389421fb784ea3bc741c72c Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerShowV254Test-1271507724 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerShowV254Test-1271507724-project Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: bc24f39a8942439385df1d409065db51 Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerShowV254Test-1271507724-project Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a5d64ff2-43b2-4344-8d0b-4715f578b827 could not be found. Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a5d64ff2-43b2-4344-8d0b-4715f578b827'} Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d64ff2-43b2-4344-8d0b-4715f578b827 could not be found. Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d64ff2-43b2-4344-8d0b-4715f578b827 could not be found. Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:14:49.626790 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d64ff2-43b2-4344-8d0b-4715f578b827 could not be found. Oct 26 05:14:49.631998 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:14:49.632464 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e74b92e-5b83-4590-a83d-4ce7484c4854 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736037 Oct 26 05:14:49.632464 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1740/3447] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:49.636763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:49.637419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:49.644020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] Returning 404 to user: Instance a5d64ff2-43b2-4344-8d0b-4715f578b827 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:14:49.644325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.644669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.645442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.646063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.646513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.647193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93904fa8-7c34-42d1-a800-7dda8f3977ad tempest-ServerShowV254Test-1271507724 tempest-ServerShowV254Test-1271507724-project] 10.222.0.16 "GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827" status: 404 len: 111 microversion: 2.54 time: 0.053503 Oct 26 05:14:49.647411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.658460 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1708/3448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:14:49 2022] GET /compute/v2.1/servers/a5d64ff2-43b2-4344-8d0b-4715f578b827 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:14:49.672724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:49.678797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:49.688396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.688899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.689372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.690096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:49.690558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:49.691047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:49.941733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:49.953878 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-922ce1e3-9288-45ef-852d-f573877a4de3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.319984 Oct 26 05:14:49.954482 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1741/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:49 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:49.970458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:49.982757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e4b93026-ec14-44ac-82be-d0a22135cd93 req-4c599112-d07b-4687-b7ae-84b70c883270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faecb167-ae90-48fa-b2e7-055201f222b7", "name": "network-vif-plugged", "status": "completed", "tag": "ee82704b-b288-4a19-9444-cee93e35624b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:49.985021 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a7db396-4c85-4ff8-ba92-48d9731f7e20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 200 len: 1506 microversion: 2.1 time: 0.318717 Oct 26 05:14:49.986564 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1709/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:49 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:49.998194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b163467-ac07-4e00-b2de-e79c2322a4fe tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:50.000539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b163467-ac07-4e00-b2de-e79c2322a4fe tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:50.003215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e4b93026-ec14-44ac-82be-d0a22135cd93 req-4c599112-d07b-4687-b7ae-84b70c883270 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.004024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e4b93026-ec14-44ac-82be-d0a22135cd93 req-4c599112-d07b-4687-b7ae-84b70c883270 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.005105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e4b93026-ec14-44ac-82be-d0a22135cd93 req-4c599112-d07b-4687-b7ae-84b70c883270 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.044088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e4b93026-ec14-44ac-82be-d0a22135cd93 req-4c599112-d07b-4687-b7ae-84b70c883270 service nova] Creating event network-vif-plugged:ee82704b-b288-4a19-9444-cee93e35624b for instance faecb167-ae90-48fa-b2e7-055201f222b7 on n-h1-862416-4 Oct 26 05:14:50.058605 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e4b93026-ec14-44ac-82be-d0a22135cd93 req-4c599112-d07b-4687-b7ae-84b70c883270 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099382 Oct 26 05:14:50.061445 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1742/3451] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:50.081881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b163467-ac07-4e00-b2de-e79c2322a4fe tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:50.092398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1fb1b94d-58a4-4275-b5b3-46f6f4b4a830 req-f35288c4-d2e4-4b90-8601-43b1b5bac6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7", "tag": "8cd48dda-e734-42af-b120-97cab68bef79"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:50.107979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1fb1b94d-58a4-4275-b5b3-46f6f4b4a830 req-f35288c4-d2e4-4b90-8601-43b1b5bac6c5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.109200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1fb1b94d-58a4-4275-b5b3-46f6f4b4a830 req-f35288c4-d2e4-4b90-8601-43b1b5bac6c5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.110045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1fb1b94d-58a4-4275-b5b3-46f6f4b4a830 req-f35288c4-d2e4-4b90-8601-43b1b5bac6c5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.113098 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b163467-ac07-4e00-b2de-e79c2322a4fe tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1217 microversion: 2.1 time: 0.125018 Oct 26 05:14:50.113877 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1710/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:49 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:50.123341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:50.124738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:50.132963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.133873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.134488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.135538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.136237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.137128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.153344 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1fb1b94d-58a4-4275-b5b3-46f6f4b4a830 req-f35288c4-d2e4-4b90-8601-43b1b5bac6c5 service nova] Creating event network-changed:8cd48dda-e734-42af-b120-97cab68bef79 for instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 on n-h1-862416-4 Oct 26 05:14:50.166779 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1fb1b94d-58a4-4275-b5b3-46f6f4b4a830 req-f35288c4-d2e4-4b90-8601-43b1b5bac6c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101022 Oct 26 05:14:50.167731 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1743/3453] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:50.178510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:50.180008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:50.194284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.195434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.196996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.197707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.205226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.205761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.257232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:14:50.334000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:50.343924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5989a97-64ca-4d27-98e0-c2df5a4da832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.224154 Oct 26 05:14:50.344620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1711/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:50 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:50.361434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:50.362306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:50.375930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.376963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.377461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.379492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.380002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.380593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.387833 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4abb94fb-ccb9-4be7-8e07-9a0cdfe8ca75 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 204 len: 0 microversion: 2.1 time: 0.218243 Oct 26 05:14:50.389401 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1744/3455] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:14:50 2022] DELETE /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:14:50.560117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-606061561", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bac81520-1baa-4c42-8100-ebc9048d81f4"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:50.640232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] validate_networks() for [('bac81520-1baa-4c42-8100-ebc9048d81f4', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:14:50.777700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:50.786254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:50.791767 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-745e2c2a-0b35-410c-b15f-c670721bf31c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.437823 Oct 26 05:14:50.792663 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1712/3456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:50 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:50.817503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:50.819220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:50.827511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.830124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.830711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:50.831685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:50.832341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:50.835045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.166927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:51.178278 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09d79adc-4f19-4707-b0b2-a4a7881b2694 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.383281 Oct 26 05:14:51.179924 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1713/3457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:50 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:51.186205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:51.187006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:51.193477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:51.195156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.195815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.196366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.197072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.197630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.198057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.576692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:51.586237 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7af80db-4fe9-44e8-a196-dcdef6efae24 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.403840 Oct 26 05:14:51.586919 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1714/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:51 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:51.592770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:51.593963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:51.605049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.605853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.606371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.607163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.607701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.608403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.722007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:14:51.722479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:14:51.722924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:14:51.723420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:14:51.723597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:51.724901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:14:51.736854 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-466cfa8a-ff50-4453-b7fc-892dda8a1c82 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1269 microversion: 2.1 time: 0.148516 Oct 26 05:14:51.737457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1715/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:51 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:51.742812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:51.744158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:51.746483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.747146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.747683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.748711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.749435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.751094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.751545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.751673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.752033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.752733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.753384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.754468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.800931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Getting quotas for project 70a976fe749244c58556050fb4c7a70b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:14:51.805244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:51.808884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Getting quotas for user 9dc40bd8c6f54e0ba9a74a5844816c11 and project 70a976fe749244c58556050fb4c7a70b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:14:51.826458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:14:51.829608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:14:51.882361 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0998896e-ae68-435d-bd1e-0aaa132b51a7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326560 Oct 26 05:14:51.883029 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1745/3460] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:14:51.893833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:51.894931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:51.903571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.904463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.904589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:51.905195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:51.905697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:51.906123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.102893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:52.112701 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15cc71b1-4710-4a74-834c-033416deac29 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.374231 Oct 26 05:14:52.113498 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1716/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:51 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:52.119582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cf0e6ac-a437-4ab8-911c-75e6b997eb5d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:52.120405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cf0e6ac-a437-4ab8-911c-75e6b997eb5d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:52.132587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:52.141408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c87b2368-fa04-4f28-af0e-ec3d0992c299 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.254948 Oct 26 05:14:52.142006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1746/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:51 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:52.202799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:52.203424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:52.207406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4cf0e6ac-a437-4ab8-911c-75e6b997eb5d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:52.211907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:52.212548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:52.213599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.215385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:52.216145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:52.217009 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cf0e6ac-a437-4ab8-911c-75e6b997eb5d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1217 microversion: 2.1 time: 0.101702 Oct 26 05:14:52.217338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.218129 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1717/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:52 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:52.386433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:52.396414 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d027978-0219-4156-85dc-b264a2439ea4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.197408 Oct 26 05:14:52.397323 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1747/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:52 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:52.612034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:52.612942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:52.619559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:52.619917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:52.620433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.621156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:52.621649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:52.622078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.765412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:52.766118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:52.783473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:52.783974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:52.784435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.785129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:52.792622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:52.793124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:52.823704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:52.878206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:52.891842 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6483a2b9-0d53-417b-8de2-221b6fa572e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1318 microversion: 2.1 time: 0.283459 Oct 26 05:14:52.893287 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1718/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:52 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:52.977608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:52.985840 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b59015d-45b8-45d4-b592-84cf75cd64ea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1269 microversion: 2.1 time: 0.225367 Oct 26 05:14:52.997672 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1748/3466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:52 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:53.140704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:53.141657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:53.149725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.150640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.151471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.153233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.153899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.154428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.169029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:53.169921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:53.182951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.183924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.185822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.188183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.188827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.189803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.435630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:53.444631 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f431211-f294-4bee-a49a-e58bf04fc15a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.309198 Oct 26 05:14:53.445223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1719/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:53 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:53.461247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:53.462156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:53.477174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.477730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.478179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.478901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.479358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.481374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.485745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:53.497499 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3353acf7-1842-4b09-a7c4-5256c121e048 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.332367 Oct 26 05:14:53.515433 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1749/3468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:53 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:53.528060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:53.529031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:53.540151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.540993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.541657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.543070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.543759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.544397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.591734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:53.612420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05d66755-e127-45bc-8644-41398d266e12 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1269 microversion: 2.1 time: 0.161845 Oct 26 05:14:53.613016 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1720/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:53 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:53.876180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:53.884522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9fcd1b7-912f-4aea-8a84-4030120789ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.367531 Oct 26 05:14:53.901603 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1750/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:53 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:53.918537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:53.919451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:53.929196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.930050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.930670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:53.931618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:53.932450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:53.932891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.015255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:54.016208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:54.019229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:14:54.026620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.027451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.028064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.028947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.029737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.030338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.151372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:54.176035 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-091c0ef8-96f0-4b3e-8017-79aec0f6c3ed tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1275 microversion: 2.1 time: 0.164810 Oct 26 05:14:54.178059 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1751/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:54 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:54.469289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:54.470113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:54.482280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.483100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.483719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.484711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.485376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.486422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.816871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:54.829327 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fb79b94-00c5-47e4-92ee-f1c9f7172e29 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1468 microversion: 2.1 time: 0.915983 Oct 26 05:14:54.830228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1721/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:53 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1468 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:54.837650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:54.838984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:54.848214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.849164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.850135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.851097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.851884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.852772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.953666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:54.963026 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f9705b2-0e8f-4615-95ed-6c13a8d9808e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.497714 Oct 26 05:14:54.964395 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1752/3473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:54 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:14:54.980228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:54.981437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:54.987990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.988952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.989689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:54.990656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:54.991363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:54.992022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.083470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:55.096962 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b449f685-51f0-4acb-a878-a179b2488637 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1269 microversion: 2.1 time: 0.131268 Oct 26 05:14:55.097600 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1753/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:54 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1269 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:55.123944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:55.124493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:55.131814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:55.132327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:55.132773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.133530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:55.133977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:55.134406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.168067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lazy-loading 'flavor' on Instance uuid faecb167-ae90-48fa-b2e7-055201f222b7 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:14:55.267812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d625260b-7788-4086-81e4-1347ac2c9262 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7/action" status: 202 len: 0 microversion: 2.1 time: 0.168812 Oct 26 05:14:55.268636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1754/3475] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:14:55 2022] POST /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:14:55.276639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:55.277807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:55.287309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:55.288290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:55.289655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.290762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:55.291423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:55.292381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.410533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:55.429124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e137fa1e-283a-4c5b-bc89-95e0ba80c4f8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.596329 Oct 26 05:14:55.430599 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1722/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:54 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:55.461097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:55.461757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:55.483732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:55.487558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:55.488672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.492650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:55.497389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:55.498077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:55.954695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:55.971309 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3b69160-79f4-4367-b900-5bb8799f0e21 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.701031 Oct 26 05:14:55.991225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1755/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:55 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:56.003477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:56.004110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:56.016461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.016980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.018119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.019526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.020164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.020842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.096446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:56.111219 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa624e99-889e-4c65-bb14-4ed4fe35ab18 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.659352 Oct 26 05:14:56.114402 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1723/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:55 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:56.137783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ba9d0d6e-19ff-4080-a2ae-c0ba459af95e req-e0edf813-32e7-417c-8343-09f4c6801b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6972bbd4-137b-43ca-a304-395253f71651", "tag": "9d7b08a9-484b-4917-8fab-54ec8ef33a7b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:56.165710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ba9d0d6e-19ff-4080-a2ae-c0ba459af95e req-e0edf813-32e7-417c-8343-09f4c6801b09 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.166559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ba9d0d6e-19ff-4080-a2ae-c0ba459af95e req-e0edf813-32e7-417c-8343-09f4c6801b09 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.167650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ba9d0d6e-19ff-4080-a2ae-c0ba459af95e req-e0edf813-32e7-417c-8343-09f4c6801b09 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.198489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ba9d0d6e-19ff-4080-a2ae-c0ba459af95e req-e0edf813-32e7-417c-8343-09f4c6801b09 service nova] Creating event network-changed:9d7b08a9-484b-4917-8fab-54ec8ef33a7b for instance 6972bbd4-137b-43ca-a304-395253f71651 on n-h1-862416-4 Oct 26 05:14:56.206133 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ba9d0d6e-19ff-4080-a2ae-c0ba459af95e req-e0edf813-32e7-417c-8343-09f4c6801b09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089734 Oct 26 05:14:56.207125 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1724/3479] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:56.214488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:56.215487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:56.230027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.230974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.231648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.232579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.233242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.233960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.733904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:56.742193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-14e061b1-9535-43d8-9261-ec3a7d32c0d2 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1459 microversion: 2.1 time: 0.749761 Oct 26 05:14:56.743064 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1756/3480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:55 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1459 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:56.762136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:56.762759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:56.774507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.776272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.777222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.779948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.780686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.781417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.883464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:56.904043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bb0babd0-8f87-4a3f-ad9d-8f9bd2838c5f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.694842 Oct 26 05:14:56.906477 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1725/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:56 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:56.926869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:56.928413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:56.939172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.940169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.943146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.947057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:56.948583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:56.948839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:56.950005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:56.957140 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f6af097-0379-4328-a648-236bd917d9fd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1275 microversion: 2.1 time: 0.212769 Oct 26 05:14:56.967753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1757/3482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:56 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:56.972411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6a00112a-dbf6-4563-9709-ab07499d3934 req-fc8c1659-a99d-4996-a13a-45f62a6db236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7", "name": "network-vif-plugged", "status": "completed", "tag": "8cd48dda-e734-42af-b120-97cab68bef79"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:57.007434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6a00112a-dbf6-4563-9709-ab07499d3934 req-fc8c1659-a99d-4996-a13a-45f62a6db236 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:57.008231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6a00112a-dbf6-4563-9709-ab07499d3934 req-fc8c1659-a99d-4996-a13a-45f62a6db236 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:57.008860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6a00112a-dbf6-4563-9709-ab07499d3934 req-fc8c1659-a99d-4996-a13a-45f62a6db236 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:57.027127 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6a00112a-dbf6-4563-9709-ab07499d3934 req-fc8c1659-a99d-4996-a13a-45f62a6db236 service nova] Creating event network-vif-plugged:8cd48dda-e734-42af-b120-97cab68bef79 for instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 on n-h1-862416-4 Oct 26 05:14:57.032793 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6a00112a-dbf6-4563-9709-ab07499d3934 req-fc8c1659-a99d-4996-a13a-45f62a6db236 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073318 Oct 26 05:14:57.033949 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1758/3483] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:57.047132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:57.048385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:57.058914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:57.060696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:57.063184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:57.064189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:57.064920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:57.066266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:57.439072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:57.452492 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e9e5686-3fbe-4c29-acf5-1dc0be05c387 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.544632 Oct 26 05:14:57.453282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1726/3484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:56 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:57.472403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:57.473038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:57.500435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:57.500888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:57.501354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:57.502688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:57.503159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:57.503596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:58.530683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:58.541860 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f116cc8c-53eb-44c8-9ee2-e33f883e7620 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 1.087170 Oct 26 05:14:58.546034 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1727/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:57 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:58.548722 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed482da8-f722-453e-89aa-9c675cf6758b tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1610 microversion: 2.1 time: 1.509969 Oct 26 05:14:58.549349 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1759/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:57 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1610 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:58.573125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:58.573791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:58.581847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:58.582478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:58.586981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:58.587604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:58.588106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:58.588832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:58.589298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:58.589762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:58.607422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:58.608444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:58.609399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:58.610521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:58.612194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:58.612846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:58.919533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:58.946079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:58.972314 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d812043-2cb5-49da-9478-88ae90fa4e2e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.408601 Oct 26 05:14:58.973259 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e2c10d7-7876-4983-868a-b6a9eddb3708 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.425968 Oct 26 05:14:58.988010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1728/3487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:58 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:58.996180 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1760/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:58 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:59.006317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-25bd9ced-9467-404d-9e59-1ad103015585 req-10478f0c-574a-42e1-8d9e-16f296418f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0a1d8a-ad5e-4660-a523-115cc3f1f953", "name": "network-vif-deleted", "tag": "c90dafd6-dcb4-4e3f-984e-b68fa8508d27"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:14:59.008457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:59.009441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:59.016561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:59.017686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:59.018203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:59.018993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:59.019521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:59.020021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:59.031158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-25bd9ced-9467-404d-9e59-1ad103015585 req-10478f0c-574a-42e1-8d9e-16f296418f7c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:59.031559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-25bd9ced-9467-404d-9e59-1ad103015585 req-10478f0c-574a-42e1-8d9e-16f296418f7c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:59.032008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-25bd9ced-9467-404d-9e59-1ad103015585 req-10478f0c-574a-42e1-8d9e-16f296418f7c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:59.061967 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-25bd9ced-9467-404d-9e59-1ad103015585 req-10478f0c-574a-42e1-8d9e-16f296418f7c service nova] Creating event network-vif-deleted:c90dafd6-dcb4-4e3f-984e-b68fa8508d27 for instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 on n-h2-862416-4 Oct 26 05:14:59.075448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-25bd9ced-9467-404d-9e59-1ad103015585 req-10478f0c-574a-42e1-8d9e-16f296418f7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077127 Oct 26 05:14:59.086345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1761/3489] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:14:59.127517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:14:59.132627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:14:59.149123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:59.152402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:59.153059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:59.154295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:14:59.161013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:14:59.162666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:14:59.939825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:14:59.958164 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7a18139-07ef-4acc-8e22-bc0520f000cd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.949748 Oct 26 05:14:59.960672 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1729/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:58 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:14:59.976609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:00.003518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.007425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.007886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.014780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.015273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.016547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.040797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:00.049873 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a66a2046-f2b9-4468-bfac-0fc29ceaaacf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1368 microversion: 2.1 time: 0.948693 Oct 26 05:15:00.054623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1762/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:14:59 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1368 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:00.062598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-88da2edc-0903-45bb-b40f-53f6fdae4b1a req-a3981a7a-d6c1-4f6e-ad85-3c1279f48efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af56f892-cb85-4dca-8cb2-fedb9604f881", "name": "network-vif-plugged", "status": "completed", "tag": "d8d3cc79-a546-4b67-81fd-8b7a433f044e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:00.085827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-88da2edc-0903-45bb-b40f-53f6fdae4b1a req-a3981a7a-d6c1-4f6e-ad85-3c1279f48efc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.088648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-88da2edc-0903-45bb-b40f-53f6fdae4b1a req-a3981a7a-d6c1-4f6e-ad85-3c1279f48efc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.089415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-88da2edc-0903-45bb-b40f-53f6fdae4b1a req-a3981a7a-d6c1-4f6e-ad85-3c1279f48efc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.113775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-88da2edc-0903-45bb-b40f-53f6fdae4b1a req-a3981a7a-d6c1-4f6e-ad85-3c1279f48efc service nova] Creating event network-vif-plugged:d8d3cc79-a546-4b67-81fd-8b7a433f044e for instance af56f892-cb85-4dca-8cb2-fedb9604f881 on n-h2-862416-4 Oct 26 05:15:00.149749 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-88da2edc-0903-45bb-b40f-53f6fdae4b1a req-a3981a7a-d6c1-4f6e-ad85-3c1279f48efc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093486 Oct 26 05:15:00.165592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1763/3492] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:00.171576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6f05e575-b167-4b76-bd55-aa9f1d8544ae req-0710ea17-73ed-423f-bd0a-d9ed6c45a14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a559397-2c7c-45eb-8baf-24b76b3ed44c", "tag": "55253328-935e-47a1-b261-547e499ce0f3"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:00.201984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f05e575-b167-4b76-bd55-aa9f1d8544ae req-0710ea17-73ed-423f-bd0a-d9ed6c45a14b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.202473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f05e575-b167-4b76-bd55-aa9f1d8544ae req-0710ea17-73ed-423f-bd0a-d9ed6c45a14b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.204942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f05e575-b167-4b76-bd55-aa9f1d8544ae req-0710ea17-73ed-423f-bd0a-d9ed6c45a14b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.229455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50f2e75c-57b9-4122-8c05-897bc45d29a0 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.266736 Oct 26 05:15:00.236787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1730/3493] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:14:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:00.244791 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6f05e575-b167-4b76-bd55-aa9f1d8544ae req-0710ea17-73ed-423f-bd0a-d9ed6c45a14b service nova] Creating event network-changed:55253328-935e-47a1-b261-547e499ce0f3 for instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c on n-h2-862416-4 Oct 26 05:15:00.254066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6f05e575-b167-4b76-bd55-aa9f1d8544ae req-0710ea17-73ed-423f-bd0a-d9ed6c45a14b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086613 Oct 26 05:15:00.258653 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1764/3494] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:00.266046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:00.271756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:00.274239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:00.279298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:00.295597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.298591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.299393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.303370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.305139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.308848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.309649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.310474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.311119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.313382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:00.315103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:00.319593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:00.977751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:00.983030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:00.994108 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-401eb8fd-2945-46db-88a7-400e6acd2fbd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.750450 Oct 26 05:15:00.996416 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1731/3495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:00 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:00.998875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:01.006699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:01.007674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.014697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.015420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.016738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.017981 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e1dd728d-a37a-4308-b4dc-6cfcfd05b933 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.755319 Oct 26 05:15:01.019111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.019597 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1765/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:00 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:01.026769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": true, "disk_over_commit": false}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:01.030188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.031274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.032064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.039883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.040583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.042147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.069252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.073120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.075998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.090601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:01.182655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Lazy-loading 'flavor' on Instance uuid faecb167-ae90-48fa-b2e7-055201f222b7 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:15:01.202386 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance faecb167-ae90-48fa-b2e7-055201f222b7 while it is in vm_state suspended Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Request method failure captured: Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7/action HTTP/1.1 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 97 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMIpiU13cJ0eaGQHwk4xGD3Kw0GzOtnQcCxBBBdhuGj7vulWUGMOCPxu1-oj7K4g1s7U4LE5ajJ0906XD9KKS_RqkbVXnBlfjjLde9eSxjOzpnsQHanwm9WsTwa7GIYQEqMVtqfL6oWipNSf3GCzD4gWLH-3d3s1XJEtKvXxqn6swnQ Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6dc227184acf4fe896dd25b1a1dbe3d0 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-LiveMigrationNegativeTest-874300947 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dc227184acf4fe896dd25b1a1dbe3d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-LiveMigrationNegativeTest-874300947 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6dc227184acf4fe896dd25b1a1dbe3d0 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-874300947 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-LiveMigrationNegativeTest-874300947-project-admin Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: ef8e495b229d401ab882e4ccc8e82dc4 Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-LiveMigrationNegativeTest-874300947-project-admin Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: {"os-migrateLive": {"host": "n-h2-862416-4", "block_migration": true, "disk_over_commit": false}} Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'os-migrateLive' instance faecb167-ae90-48fa-b2e7-055201f222b7 while it is in vm_state suspended Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'faecb167-ae90-48fa-b2e7-055201f222b7', 'body': {'os-migrateLive': {'host': 'n-h2-862416-4', 'block_migration': True, 'disk_over_commit': False}}} Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance faecb167-ae90-48fa-b2e7-055201f222b7 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:01.204657 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance faecb167-ae90-48fa-b2e7-055201f222b7 while it is in vm_state suspended Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance faecb167-ae90-48fa-b2e7-055201f222b7 while it is in vm_state suspended Oct 26 05:15:01.209626 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:01.212505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance faecb167-ae90-48fa-b2e7-055201f222b7 while it is in vm_state suspended {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:01.213641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ede43a9-af03-4420-9fa3-641c7740ede9 tempest-LiveMigrationNegativeTest-874300947 tempest-LiveMigrationNegativeTest-874300947-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7/action" status: 409 len: 155 microversion: 2.1 time: 0.192600 Oct 26 05:15:01.214712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1766/3497] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:01 2022] POST /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7/action => generated 155 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:15:01.223773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:01.225187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.231345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.231847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.232288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.233187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.233869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.234474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.424206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:01.452425 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5dad87ea-cf45-4a51-a71d-4bae97685e30 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.453170 Oct 26 05:15:01.453638 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1732/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:00 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:01.461031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:01.476056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.508339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.509878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.510494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.511414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.512029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.512631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.613820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:01.623416 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8b28e379-6336-437f-86be-1fa2b9d5082a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.407462 Oct 26 05:15:01.633913 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1767/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:01 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:01.646214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:01.650147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.664553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.665497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.666173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.667493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.668074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.668744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.720331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:01.776018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:01.810998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:01.822281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=11 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:01.824785 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98022cc0-7123-43c2-97dd-d8628210ffa2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1558 microversion: 2.1 time: 0.369862 Oct 26 05:15:01.834034 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1733/3500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:01 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1558 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:01.859056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:01.862812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.877384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.886079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.886720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.887107 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-744423b2-a2de-41ce-950f-92dcb90d4d35 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "DELETE /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 204 len: 0 microversion: 2.1 time: 0.251188 Oct 26 05:15:01.888232 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1768/3501] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:01 2022] DELETE /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:01.888769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.889580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.890393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.896967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:01.897718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:01.905435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.905941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.906450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:01.907220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:01.907693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:01.908133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.090735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ef5bdb4-1b6d-44e2-85f2-dfb393d8cdbe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235734 Oct 26 05:15:02.097481 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1734/3502] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:15:01 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:02.102263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:02.124865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:02.142098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.142611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.144449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.147987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.148548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.149003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.213651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=22 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:02.218446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:02.234204 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05085624-9a7d-41ac-9c1b-424467ee76e4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1465 microversion: 2.1 time: 0.336473 Oct 26 05:15:02.246124 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1769/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:01 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1465 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:02.252289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:02.252916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:02.267134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.267859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.268458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.269552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.270434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.273877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.506026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:02.516535 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f929e60e-2348-4f03-9c46-edda07c4b8cc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.423680 Oct 26 05:15:02.534786 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1735/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:02 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:02.550523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a3444a25-ad07-46a2-946e-9b18c2876abb req-190177cb-dfc6-49f5-98af-aa0e4877cbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f", "name": "network-vif-plugged", "status": "completed", "tag": "013a77ed-1e88-42f4-98fd-3a6567b8e685"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:02.576088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a3444a25-ad07-46a2-946e-9b18c2876abb req-190177cb-dfc6-49f5-98af-aa0e4877cbbb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.576700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a3444a25-ad07-46a2-946e-9b18c2876abb req-190177cb-dfc6-49f5-98af-aa0e4877cbbb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.579108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a3444a25-ad07-46a2-946e-9b18c2876abb req-190177cb-dfc6-49f5-98af-aa0e4877cbbb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.608258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:02.617131 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a3444a25-ad07-46a2-946e-9b18c2876abb req-190177cb-dfc6-49f5-98af-aa0e4877cbbb service nova] Creating event network-vif-plugged:013a77ed-1e88-42f4-98fd-3a6567b8e685 for instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f on n-h2-862416-4 Oct 26 05:15:02.634473 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a15c41b-586d-42c4-b7eb-313b190036f8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.372846 Oct 26 05:15:02.644233 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1770/3505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:02 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:02.646972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:02.653036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:02.666612 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a3444a25-ad07-46a2-946e-9b18c2876abb req-190177cb-dfc6-49f5-98af-aa0e4877cbbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118768 Oct 26 05:15:02.669839 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1736/3506] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:02.683010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.683999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.686364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.689678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.693383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.693946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.694123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:02.695478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:02.724755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.725937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.726492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:02.727366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:02.730078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:02.730698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.261174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:03.271655 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93289c1c-07eb-4858-b90b-aeee4311194d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.631470 Oct 26 05:15:03.282075 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1771/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:02 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:03.299865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:03.301887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:03.314240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:03.318196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:03.318882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.319785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:03.320428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:03.331061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.396416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:03.415005 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f8ba6df-1a97-4551-b787-81c6082fa456 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.741981 Oct 26 05:15:03.415597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1737/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:02 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:03.556480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:03.557281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:03.569351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:03.570046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:03.570681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.577140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:03.577820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:03.578458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.729981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:03.738156 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37785e4b-536b-4f1d-8179-2f807d19c8f4 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1465 microversion: 2.1 time: 0.454791 Oct 26 05:15:03.742426 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1772/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:03 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1465 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:03.749355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:03.755772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:03.763929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:03.764427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:03.764875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.765639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:03.766111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:03.766548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:03.867022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:03.878747 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6654a42-9b0c-4250-b5a5-fabb493cf9a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.327200 Oct 26 05:15:03.885493 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1738/3510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:03 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:03.949703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:03.957379 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e14df1a4-03a8-449c-8892-42352efdb87c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.213599 Oct 26 05:15:03.970265 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1773/3511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:03 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:04.069669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bb9246b-9cfb-4831-9814-674dd083d313 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'create', calling method: .version_select at 0x7f4709ffb790>, body: {"keypair": {"name": "tempest-keypair-429347002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzmzJ+DLwUU+eRnpoqkA4BwSlQh2t5SNRrJwoQuifp3eKaplZMvXFuR0JS/QYLuXiN6yN3VL+RPfGvNAetpx3X+pEpLwQJ3rwk5mSSsIqy15EtCF4uqqcHbmp3BlMo6EA=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:04.087988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6bb9246b-9cfb-4831-9814-674dd083d313 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:04.094653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6bb9246b-9cfb-4831-9814-674dd083d313 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for user fba70f93f3fc434eac4137621494d0e3 and project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:04.121480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bb9246b-9cfb-4831-9814-674dd083d313 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.234460 Oct 26 05:15:04.122431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1739/3512] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:15:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:15:04.315205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:04.315960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:04.323320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.324146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.324760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.325693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.326333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.326962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.417703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-bd386b74-b866-4720-b880-157c7bc39e5e req-7fff447e-7688-48e9-a14c-a0b288238529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7", "tag": "8cd48dda-e734-42af-b120-97cab68bef79"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:04.441903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd386b74-b866-4720-b880-157c7bc39e5e req-7fff447e-7688-48e9-a14c-a0b288238529 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.448741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd386b74-b866-4720-b880-157c7bc39e5e req-7fff447e-7688-48e9-a14c-a0b288238529 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.449210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd386b74-b866-4720-b880-157c7bc39e5e req-7fff447e-7688-48e9-a14c-a0b288238529 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.466320 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-bd386b74-b866-4720-b880-157c7bc39e5e req-7fff447e-7688-48e9-a14c-a0b288238529 service nova] Creating event network-changed:8cd48dda-e734-42af-b120-97cab68bef79 for instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 on n-h1-862416-4 Oct 26 05:15:04.493539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-bd386b74-b866-4720-b880-157c7bc39e5e req-7fff447e-7688-48e9-a14c-a0b288238529 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082458 Oct 26 05:15:04.494160 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1740/3513] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:04.504056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:04.505041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:04.524521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.525027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.525686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.526591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.527050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.527489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.629210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:04.638161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32d36c8a-f70a-464b-b3f3-d13880162a0b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.328694 Oct 26 05:15:04.638768 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1774/3514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:04 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:04.706658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-87bd3d08-a88e-4cdc-b5d5-3440efde7682 req-09ce38c6-439d-4e06-b8a4-01c796e865f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6972bbd4-137b-43ca-a304-395253f71651", "name": "network-vif-plugged", "status": "completed", "tag": "9d7b08a9-484b-4917-8fab-54ec8ef33a7b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:04.719620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-87bd3d08-a88e-4cdc-b5d5-3440efde7682 req-09ce38c6-439d-4e06-b8a4-01c796e865f5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.720544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-87bd3d08-a88e-4cdc-b5d5-3440efde7682 req-09ce38c6-439d-4e06-b8a4-01c796e865f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.721236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-87bd3d08-a88e-4cdc-b5d5-3440efde7682 req-09ce38c6-439d-4e06-b8a4-01c796e865f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.737616 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-87bd3d08-a88e-4cdc-b5d5-3440efde7682 req-09ce38c6-439d-4e06-b8a4-01c796e865f5 service nova] Creating event network-vif-plugged:9d7b08a9-484b-4917-8fab-54ec8ef33a7b for instance 6972bbd4-137b-43ca-a304-395253f71651 on n-h1-862416-4 Oct 26 05:15:04.744667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-87bd3d08-a88e-4cdc-b5d5-3440efde7682 req-09ce38c6-439d-4e06-b8a4-01c796e865f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041910 Oct 26 05:15:04.746117 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1775/3515] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:04.767316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:04.768760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:04.800408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.801600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.802947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.806163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.806856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.807464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.807717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:04.830778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-031ba907-7d96-4b1b-b9fd-53b03fd94c6b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.333722 Oct 26 05:15:04.832655 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1741/3516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:04 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:04.909525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:04.910415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:04.917833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.919050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.920672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:04.921719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:04.922423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:04.923288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.166753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:05.181832 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f020d131-899d-4092-b53c-f1c8a970fd3f tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1465 microversion: 2.1 time: 0.420777 Oct 26 05:15:05.184551 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1776/3517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:04 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1465 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:05.190337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:05.191371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:05.198576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:05.199627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:05.200443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.201443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:05.202166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:05.202851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.221996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:05.235930 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0af459e9-94a9-4313-9125-2d4101d82ce4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1315 microversion: 2.1 time: 0.331555 Oct 26 05:15:05.241268 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1742/3518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:04 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:05.457713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:05.467266 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eafd8a06-2559-4eb6-a47a-e8df52572622 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1315 microversion: 2.1 time: 0.281261 Oct 26 05:15:05.481338 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1777/3519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:05 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:05.666975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:05.668383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:05.677893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:05.678912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:05.679610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.681166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:05.682956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:05.686673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.863078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:05.864343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:05.874084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:05.874777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:05.875760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.876498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:05.876968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:05.877431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:05.963632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:05.987501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3c6847ef-dd29-4686-9bde-8cbbfbeaf128 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.313509 Oct 26 05:15:05.992211 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1743/3520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:05 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:06.144369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:06.157626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-20bc2821-522b-414d-8644-671dafc1bda7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.302401 Oct 26 05:15:06.158786 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1778/3521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:05 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:06.213120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:06.214126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:06.246525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.247390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.248068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.249002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.252535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.253240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.264691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:06.265481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:06.278265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.280951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.282090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.284030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.284532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.284973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.459854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:06.483739 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-97c8c491-a08a-4612-8fbd-f99b4a1f7500 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 200 len: 1294 microversion: 2.1 time: 0.275296 Oct 26 05:15:06.486946 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1744/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:06 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 1294 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:06.507937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:06.508867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:06.518276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.518936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.519487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.520434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.521060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.521949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.752196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:06.769796 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f1b18a8-f9d3-482b-8289-fda0d479be7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1502 microversion: 2.1 time: 0.509198 Oct 26 05:15:06.771535 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1779/3523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:06 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1502 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:06.793671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d47ab46b-b28a-4ed9-a87c-59ad3e8fe9a3 req-0d7fa5e6-c012-48d5-98ce-32e688447b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faecb167-ae90-48fa-b2e7-055201f222b7", "name": "network-vif-deleted", "tag": "ee82704b-b288-4a19-9444-cee93e35624b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:06.816322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d47ab46b-b28a-4ed9-a87c-59ad3e8fe9a3 req-0d7fa5e6-c012-48d5-98ce-32e688447b43 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.816905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d47ab46b-b28a-4ed9-a87c-59ad3e8fe9a3 req-0d7fa5e6-c012-48d5-98ce-32e688447b43 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.817775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d47ab46b-b28a-4ed9-a87c-59ad3e8fe9a3 req-0d7fa5e6-c012-48d5-98ce-32e688447b43 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.828677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:06.831955 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d47ab46b-b28a-4ed9-a87c-59ad3e8fe9a3 req-0d7fa5e6-c012-48d5-98ce-32e688447b43 service nova] Creating event network-vif-deleted:ee82704b-b288-4a19-9444-cee93e35624b for instance faecb167-ae90-48fa-b2e7-055201f222b7 on n-h1-862416-4 Oct 26 05:15:06.837490 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ff996b9-b137-44b6-a05d-450c29ae1ebc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1503 microversion: 2.1 time: 0.340626 Oct 26 05:15:06.837974 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1745/3524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:06 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:06.839579 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d47ab46b-b28a-4ed9-a87c-59ad3e8fe9a3 req-0d7fa5e6-c012-48d5-98ce-32e688447b43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066725 Oct 26 05:15:06.840808 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1780/3525] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:06.857763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:06.858371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:06.866166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.866672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:06.869968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:06.874297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.875004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.875929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.876567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.877208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.878805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.879305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.879756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.880680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:06.881218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:06.881713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:06.940486 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b94c4f7b-c69f-4ed4-a39d-c639f9e959f7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.079285 Oct 26 05:15:06.945185 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1781/3526] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:06 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:06.948271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'flavor' on Instance uuid 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:15:07.015237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:07.016234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:07.028131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:07.028653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:07.029107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:07.029855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:07.032513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:07.033913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:07.373134 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f70bd2c-5043-478f-b52b-d6f188ad8f08 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f/action" status: 202 len: 0 microversion: 2.1 time: 0.519724 Oct 26 05:15:07.375230 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1746/3527] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:06 2022] POST /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:07.402702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:07.406471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:07.452260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:07.452759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:07.457812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:07.459192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:07.462502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:07.471571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:07.909861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:07.914782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:07.925135 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d559ccf4-7920-477a-93dd-c10392c278c0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1317 microversion: 2.1 time: 0.914418 Oct 26 05:15:07.926002 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1782/3528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:07 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:07.932754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:07.933757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:07.949906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:07.951281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:07.952018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:07.953171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:07.953905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:07.954674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.018993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:08.029944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e45a0bdf-e48e-4bcf-8875-2a4161c2e91b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.649545 Oct 26 05:15:08.043874 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1747/3529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:07 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:08.056388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:08.062763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: faecb167-ae90-48fa-b2e7-055201f222b7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:08.089674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.090350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.092326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.093449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.094746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.096457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.123173 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] HTTP exception thrown: Instance faecb167-ae90-48fa-b2e7-055201f222b7 could not be found. Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Request method failure captured: Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 HTTP/1.1 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIopPqFw9H-b9TeKG6yXco1-wSDaP5EOQndnky3oLid-UIlpifX9zxscv199tj3PGhW_t8bc33pqyiKPvPQI6h1nxX_ArlVT8og-c-rffYydNvrKwpfY8Zjsa8abXXJ409PtGS8J7KE4L_VysBFRpU_ELrdfZlM4Q8GmIWPWxhdrKQ Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 2fb02f78470f4d21bab5069d61e3395f Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-LiveMigrationNegativeTest-961327744 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-LiveMigrationNegativeTest-961327744 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 2fb02f78470f4d21bab5069d61e3395f Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-961327744 Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-LiveMigrationNegativeTest-961327744-project Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 97ae9a317def4487817c994bb8c0bbac Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-LiveMigrationNegativeTest-961327744-project Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance faecb167-ae90-48fa-b2e7-055201f222b7 could not be found. Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'faecb167-ae90-48fa-b2e7-055201f222b7'} Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faecb167-ae90-48fa-b2e7-055201f222b7 could not be found. Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faecb167-ae90-48fa-b2e7-055201f222b7 could not be found. Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:08.125503 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faecb167-ae90-48fa-b2e7-055201f222b7 could not be found. Oct 26 05:15:08.130012 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:08.135089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Returning 404 to user: Instance faecb167-ae90-48fa-b2e7-055201f222b7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:08.136256 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02b3932f-791b-4c06-a2df-7e6af78ff8e9 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7" status: 404 len: 111 microversion: 2.1 time: 0.084803 Oct 26 05:15:08.137391 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1748/3530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:08 2022] GET /compute/v2.1/servers/faecb167-ae90-48fa-b2e7-055201f222b7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:08.145743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:08.148662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:08.156850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.157779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.158484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.159426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.160112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.160764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.211869 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20fb9ccf-e538-4504-b8d5-bbada43d7ded tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.072668 Oct 26 05:15:08.216271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1749/3531] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:08 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:08.218677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:08.219282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:08.227790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.228290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.228740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.229489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.229953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.230388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.253187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:08.278026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:08.357774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:08.370436 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a100c624-3a66-48ed-83f8-77dd5320254d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.443064 Oct 26 05:15:08.371038 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1783/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:07 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:08.417844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70b016d4-fa1e-413c-b9c4-09de2cf230e3 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 204 len: 0 microversion: 2.1 time: 0.202139 Oct 26 05:15:08.422219 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1750/3533] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:08 2022] DELETE /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:08.428939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:08.429766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:08.446767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.447168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.447607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.448311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.448772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.449215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.763005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:08.774287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b9e6d4c7-c1f8-484f-9cfa-922106624c59 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1474 microversion: 2.1 time: 0.350339 Oct 26 05:15:08.790132 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1784/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:08 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:08.959210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:08.960318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:08.967323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.968189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.968892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:08.969888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:08.970578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:08.971246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:09.019513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-311971714", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750735e9-b3b5-47b8-9394-1c0c5714587a"}], "security_groups": [{"name": "tempest-securitygroup--1525932766"}], "key_name": "tempest-keypair-429347002", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:09.153123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:09.164120 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1638127d-fb09-449e-aada-70f05cc62fd0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1467 microversion: 2.1 time: 0.210719 Oct 26 05:15:09.179542 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1751/3535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:08 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1467 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:09.204077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:09.204780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:09.212550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:09.213051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:09.213812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:09.214933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:09.215561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:09.216162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:09.220213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] validate_networks() for [('750735e9-b3b5-47b8-9394-1c0c5714587a', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:15:09.516616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:09.527473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10978822-e0c6-4545-9ff5-0df0f97f375f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.331571 Oct 26 05:15:09.542080 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1752/3536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:09 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:09.562851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:09.566026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:09.582090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:09.582818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:09.585809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:09.586657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:09.587309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:09.587994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.025421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:15:10.026544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:15:10.027034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:15:10.027452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:15:10.027877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:15:10.039287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.040433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.041114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.042238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.043316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.043996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.074803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:10.085461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for user fba70f93f3fc434eac4137621494d0e3 and project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:10.086466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4839f853-f7ad-4412-832a-9b396fd581d0 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1618 microversion: 2.1 time: 0.542598 Oct 26 05:15:10.087820 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1753/3537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:09 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1618 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:10.094464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:10.100635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:15:10.101023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:10.104231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:15:10.109269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:10.110377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:10.112337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.113440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.116454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.118826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.119501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.120111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.187963 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7bdbf7d-53f8-4be0-bbce-b72c6b3258b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.174302 Oct 26 05:15:10.189521 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1785/3538] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:15:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:15:10.199521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:10.200529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:10.211458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.212564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.213477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.215102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.215905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.216569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.220284 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e216ad3c-4f04-483b-84f0-004620ed4c9d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.130685 Oct 26 05:15:10.221896 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1754/3539] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:10 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:10.227836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:10.228532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:10.248066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.248827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.252056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.252865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.253373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.253826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.696919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:10.710291 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5877b0e-78e7-43c6-b779-339cbaa70e89 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.519349 Oct 26 05:15:10.727462 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1786/3540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:10 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:10.744603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f99cb92-630a-4de3-996b-d2ce53210548 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:10.747053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f99cb92-630a-4de3-996b-d2ce53210548 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:10.772124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:10.788882 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94684df3-2340-49f7-acc9-cfad397db2f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1474 microversion: 2.1 time: 0.561719 Oct 26 05:15:10.789854 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1755/3541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:10 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1474 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:10.808868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1556881300", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "01534544-bfd6-4966-ae95-7dd5271c956f"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:10.905030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:15:10.926682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f99cb92-630a-4de3-996b-d2ce53210548 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:10.939193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f99cb92-630a-4de3-996b-d2ce53210548 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:10.941204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f99cb92-630a-4de3-996b-d2ce53210548 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:10.942906 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f99cb92-630a-4de3-996b-d2ce53210548 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1280 microversion: 2.20 time: 0.214004 Oct 26 05:15:10.944018 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1787/3542] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:10 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:10.981274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:10.982161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:10.991782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.992579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.993222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:10.994622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:10.995692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:10.996331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.574066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:11.584214 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a845ef6-aec8-4175-bad0-673942038d45 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.620091 Oct 26 05:15:11.584845 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1788/3543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:10 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:11.604297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-de9f982c-2853-4dbc-8281-228b08eff0ee req-f98b5f3f-df45-4f72-8916-2101e0d72861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a559397-2c7c-45eb-8baf-24b76b3ed44c", "name": "network-vif-plugged", "status": "completed", "tag": "55253328-935e-47a1-b261-547e499ce0f3"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:11.631275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:11.642638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-de9f982c-2853-4dbc-8281-228b08eff0ee req-f98b5f3f-df45-4f72-8916-2101e0d72861 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.647419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-de9f982c-2853-4dbc-8281-228b08eff0ee req-f98b5f3f-df45-4f72-8916-2101e0d72861 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.647916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-de9f982c-2853-4dbc-8281-228b08eff0ee req-f98b5f3f-df45-4f72-8916-2101e0d72861 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.667575 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-de9f982c-2853-4dbc-8281-228b08eff0ee req-f98b5f3f-df45-4f72-8916-2101e0d72861 service nova] Creating event network-vif-plugged:55253328-935e-47a1-b261-547e499ce0f3 for instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c on n-h2-862416-4 Oct 26 05:15:11.673683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-de9f982c-2853-4dbc-8281-228b08eff0ee req-f98b5f3f-df45-4f72-8916-2101e0d72861 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087295 Oct 26 05:15:11.685174 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1789/3544] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:11.696735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e8854a2b-c715-4b7f-b09d-cfd248faa826 req-a39aa5cc-49f0-44da-9fe8-daafa5ee6c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca587e39-b569-4c22-a594-4ef3a5ab2186", "name": "network-vif-deleted", "tag": "8f388013-a99e-4311-af48-6dac6d91d267"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:11.722069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e8854a2b-c715-4b7f-b09d-cfd248faa826 req-a39aa5cc-49f0-44da-9fe8-daafa5ee6c80 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.722546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e8854a2b-c715-4b7f-b09d-cfd248faa826 req-a39aa5cc-49f0-44da-9fe8-daafa5ee6c80 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.722981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e8854a2b-c715-4b7f-b09d-cfd248faa826 req-a39aa5cc-49f0-44da-9fe8-daafa5ee6c80 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.750575 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e8854a2b-c715-4b7f-b09d-cfd248faa826 req-a39aa5cc-49f0-44da-9fe8-daafa5ee6c80 service nova] Creating event network-vif-deleted:8f388013-a99e-4311-af48-6dac6d91d267 for instance ca587e39-b569-4c22-a594-4ef3a5ab2186 on n-h1-862416-4 Oct 26 05:15:11.751194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:15:11.752235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:15:11.752727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:15:11.759508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:15:11.763070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:15:11.765654 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e8854a2b-c715-4b7f-b09d-cfd248faa826 req-a39aa5cc-49f0-44da-9fe8-daafa5ee6c80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078891 Oct 26 05:15:11.773011 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1790/3545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:11.781452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:11.784046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:11.789678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.790621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.791688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.792517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.793009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.793146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.793576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.794289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.795881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.796722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.797295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.797931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.819808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:11.828096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Getting quotas for user a8d7f43e1be74767ba46fcd3ab436d2d and project da4c1e5717cb42bebda3fbe1433f2cd7. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:11.845511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bad107d1-81bf-46d2-a1bf-f3889c294099 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.070338 Oct 26 05:15:11.847042 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1791/3546] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:11 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:11.850163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:15:11.853091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:15:11.858553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:11.859275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:11.873729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.883051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.883614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.884566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.885118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.888663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.921835 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bfb04341-563e-4f3c-a62e-1e603ff03958 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125801 Oct 26 05:15:11.923199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1756/3547] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:15:11.928097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:11.929083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:11.935691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.936262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.936799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.937603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.938271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.938896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.976027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:11.976769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:11.977436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:11.978315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lazy-loading 'fault' on Instance uuid ca587e39-b569-4c22-a594-4ef3a5ab2186 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:15:12.081889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ae9a317def4487817c994bb8c0bbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb02f78470f4d21bab5069d61e3395f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.096698 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cbb48597-0744-4a47-ab40-874c7979456a tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 200 len: 1309 microversion: 2.1 time: 0.169781 Oct 26 05:15:12.099836 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1757/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:11 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:12.120211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be426c05-3408-449e-9ba3-54a4a431bff5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:12.125875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be426c05-3408-449e-9ba3-54a4a431bff5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:12.306183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.315430 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d54ffc1-7087-4cb5-a3fd-26b4271b88cf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.466925 Oct 26 05:15:12.329878 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1792/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:11 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:12.332658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be426c05-3408-449e-9ba3-54a4a431bff5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.339984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:12.341004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:12.348192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:12.349904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:12.350645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:12.351695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:12.352780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:12.353493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:12.360562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be426c05-3408-449e-9ba3-54a4a431bff5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1217 microversion: 2.1 time: 0.254126 Oct 26 05:15:12.361668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1758/3550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:12 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:12.456709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.467351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.473520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.477760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78cc3405-44ef-4015-864e-c1c2a4df3693 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1332 microversion: 2.20 time: 0.146677 Oct 26 05:15:12.478632 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1793/3551] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:12 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:12.613346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:12.614607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:12.627089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:12.628826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:12.630775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:12.632751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:12.633360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:12.636131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:12.862135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:12.864980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:12.870227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:12.878169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:12.878924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:12.879589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:12.881374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:12.882166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:12.882390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28b590fe-a48c-472a-a425-38e1fed2101c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1317 microversion: 2.1 time: 0.273618 Oct 26 05:15:12.883031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:12.884155 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1759/3552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:12 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:13.090409 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4565253b-3086-463a-b9d3-2b379e09753e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.236118 Oct 26 05:15:13.091241 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1794/3553] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:12 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:13.122718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:13.123782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] [instance: ca587e39-b569-4c22-a594-4ef3a5ab2186] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:13.133343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.134284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.135089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.136542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.137184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.137870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.178974 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] HTTP exception thrown: Instance ca587e39-b569-4c22-a594-4ef3a5ab2186 could not be found. Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Request method failure captured: Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 HTTP/1.1 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMIopPqFw9H-b9TeKG6yXco1-wSDaP5EOQndnky3oLid-UIlpifX9zxscv199tj3PGhW_t8bc33pqyiKPvPQI6h1nxX_ArlVT8og-c-rffYydNvrKwpfY8Zjsa8abXXJ409PtGS8J7KE4L_VysBFRpU_ELrdfZlM4Q8GmIWPWxhdrKQ Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 2fb02f78470f4d21bab5069d61e3395f Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-LiveMigrationNegativeTest-961327744 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fb02f78470f4d21bab5069d61e3395f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-LiveMigrationNegativeTest-961327744 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 2fb02f78470f4d21bab5069d61e3395f Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-961327744 Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-LiveMigrationNegativeTest-961327744-project Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 97ae9a317def4487817c994bb8c0bbac Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-LiveMigrationNegativeTest-961327744-project Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance ca587e39-b569-4c22-a594-4ef3a5ab2186 could not be found. Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'ca587e39-b569-4c22-a594-4ef3a5ab2186'} Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca587e39-b569-4c22-a594-4ef3a5ab2186 could not be found. Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca587e39-b569-4c22-a594-4ef3a5ab2186 could not be found. Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:13.183205 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca587e39-b569-4c22-a594-4ef3a5ab2186 could not be found. Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] Returning 404 to user: Instance ca587e39-b569-4c22-a594-4ef3a5ab2186 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:13.191011 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a24c3e76-0475-4e9e-9697-0839b19b85f8 tempest-LiveMigrationNegativeTest-961327744 tempest-LiveMigrationNegativeTest-961327744-project] 10.222.0.16 "GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186" status: 404 len: 111 microversion: 2.1 time: 0.068135 Oct 26 05:15:13.200257 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1760/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:13 2022] GET /compute/v2.1/servers/ca587e39-b569-4c22-a594-4ef3a5ab2186 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:13.356554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:13.359691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:13.390071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:13.390590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.390888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:13.391548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.392199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.394429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.395168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.398101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.424278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.424890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.431468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.432390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.434071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.435855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.814332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:13.831695 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e58a90b-6f9e-4779-9c1a-c9d3b0c98357 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1269 microversion: 2.1 time: 0.445960 Oct 26 05:15:13.832855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1761/3555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:13 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1269 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:13.853461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:13.853984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:13.871678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.872321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.872589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:13.873331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:13.873792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:13.874221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.018840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:14.033215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:14.036740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:14.040506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fc1691a-8d53-48c8-85b0-25dfdc7dc8cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1338 microversion: 2.20 time: 0.205503 Oct 26 05:15:14.041163 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1762/3556] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:13 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1338 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:14.055395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:14.056232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:14.066996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.068850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.069645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.073343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.074282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.074940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.254620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:14.266147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec82a77e-2c7b-4a57-a948-b0fdd2b4615c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.916567 Oct 26 05:15:14.268590 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1795/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:13 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:14.274422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:14.277625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:14.298291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.300859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.301528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.304648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.306014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.306623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.343274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:14.353024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3175366-8498-4e57-8c6f-abc4dbc07fd0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1507 microversion: 2.1 time: 0.306150 Oct 26 05:15:14.354006 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1763/3558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:14 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:14.387339 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-11ee51b1-6e5f-4f5d-87e5-2c45e37853ac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.117136 Oct 26 05:15:14.388362 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1796/3559] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:14 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:14.392231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:14.394399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:14.411741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.412338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.412791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.413577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.414048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.425023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.836747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:14.845352 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b431586-61e9-42b8-a090-8aee9633dc51 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1507 microversion: 2.1 time: 0.466103 Oct 26 05:15:14.855853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1764/3560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:14 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:14.866109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:14.866109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:14.873151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:14.885922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.886426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.886870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.889154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:14.898029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.898540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.904940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.913980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.914476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.914912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:14.921004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:14.923058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:14.923673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.160560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80e3cdbc-33af-43b7-b435-38c12c9564ff tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "PUT /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1079 microversion: 2.1 time: 0.291847 Oct 26 05:15:15.164432 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1765/3561] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:15:14 2022] PUT /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1079 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:15.174114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:15.192191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:15.226483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.230737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.231403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.233816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.236446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.242508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.276281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:15.288471 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e368bc79-1f88-403e-a156-59ee4534b0df tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1275 microversion: 2.1 time: 0.432245 Oct 26 05:15:15.310265 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1797/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:14 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1275 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:15.320764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:15.324561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:15.341360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.344821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.347473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.349243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.349992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.352858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.795075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:15.807864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:15.812024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:15.823548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:15.827236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:15.828338 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-551921d8-4f8d-4465-b944-33bd3b94cdb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.662413 Oct 26 05:15:15.830756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82993183-3c3f-41db-8fa3-1b9b1cfa8b0d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1505 microversion: 2.1 time: 0.518019 Oct 26 05:15:15.835477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1798/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:15 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:15.844191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:15.845440 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1766/3564] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:15 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:15.846142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:15.854244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.855252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.855932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.866032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.867813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.868786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.871503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:15.873922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:15.897164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.918591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.919571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.921474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:15.923407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:15.925829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:15.985841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4bf996fa-3d5e-4ed9-b247-e453dddf4f20 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 14 microversion: 2.1 time: 0.139045 Oct 26 05:15:15.986488 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1767/3565] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:15 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:15.996875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:15.997732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:16.019545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:16.020067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:16.020520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:16.024214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:16.024718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:16.025165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:16.948721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:16.963692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:16.965521 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b13a781-6f0d-4338-9ab8-921d6aad4ae0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 1.128269 Oct 26 05:15:16.976130 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1799/3566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:15 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:16.978755 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-97116c69-636f-46a8-8e3f-92c72078df0a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1505 microversion: 2.1 time: 0.989430 Oct 26 05:15:16.981945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1768/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:15 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1505 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:16.987535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:16.992502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:16.998823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-79e5fc38-0e74-4d81-ab4f-0ec6721b1344 req-d4ada08e-bec4-43be-b63a-2d02e9f61b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:17.015003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.017787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.018289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.019030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.021690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.022623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-79e5fc38-0e74-4d81-ab4f-0ec6721b1344 req-d4ada08e-bec4-43be-b63a-2d02e9f61b31 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.023297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.023834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-79e5fc38-0e74-4d81-ab4f-0ec6721b1344 req-d4ada08e-bec4-43be-b63a-2d02e9f61b31 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.024296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-79e5fc38-0e74-4d81-ab4f-0ec6721b1344 req-d4ada08e-bec4-43be-b63a-2d02e9f61b31 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.060314 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-79e5fc38-0e74-4d81-ab4f-0ec6721b1344 req-d4ada08e-bec4-43be-b63a-2d02e9f61b31 service nova] Creating event network-changed:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h2-862416-4 Oct 26 05:15:17.065412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-79e5fc38-0e74-4d81-ab4f-0ec6721b1344 req-d4ada08e-bec4-43be-b63a-2d02e9f61b31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082026 Oct 26 05:15:17.066375 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1769/3568] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:17.072329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:17.081465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:17.097184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.098009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.098627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.100171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.106422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.106915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.519301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:17.529498 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-512b7841-3d24-41f0-a146-14a26c8d13f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.552007 Oct 26 05:15:17.534839 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1800/3569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:16 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:17.545489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:17.549353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:17.558827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.559556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.560511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.572633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:17.579630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.580480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.582200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.584704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:17.589147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:17.590360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd6fe28a-c9b2-48be-8cf7-498418fba7b8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.522499 Oct 26 05:15:17.592347 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1770/3570] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:17 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:17.599317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:17.602784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:17.612394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.613599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.615125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.617180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.618412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.619187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.731496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:15:17.732441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:15:17.733160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:15:17.733915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:15:17.734750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:15:17.813417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:17.821358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.822356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.822991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.823914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.824494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.825167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.864760 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ba49dcb-499b-4d5d-b073-50096685eede tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "POST /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c/action" status: 202 len: 1111 microversion: 2.1 time: 0.269921 Oct 26 05:15:17.866495 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1771/3571] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:17 2022] POST /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c/action => generated 1111 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 05:15:17.890720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:17.891452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:17.898200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.898734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.899179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:17.899888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:17.900373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:17.900759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.051154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:18.059557 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08e03865-d226-4918-8ae2-03b3d9d6e30c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.173002 Oct 26 05:15:18.060154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1772/3572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:17 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:18.064738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.065399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:18.072414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.072945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.073484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.074242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.074806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.075252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.212920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:18.221727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b00a4eae-c844-4d32-bc9c-11cefe70f035 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.160551 Oct 26 05:15:18.222306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1773/3573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:18.355442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.359124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.360824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.361365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.362128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.362581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.363008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.401846 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-657a3b90-62c2-4c1b-b147-ae13f06a4717 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.178465 Oct 26 05:15:18.402993 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1774/3574] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:18.414897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.418475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.418958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.419846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.420102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.421060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.421447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.447138 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad43e3da-cbc6-459f-a8ed-2418c653c124 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862416-4" status: 200 len: 578 microversion: 2.1 time: 0.035857 Oct 26 05:15:18.448328 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1775/3575] 10.222.0.16 () {58 vars in 1172 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/os-services?host=n-d-862416-4 => generated 578 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:18.462099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.466495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.467080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.467591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.468389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.468973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.469446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.494965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7bc98896-374f-45f6-bbbb-d5e5af69efde tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037691 Oct 26 05:15:18.495578 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1776/3576] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:18.508721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.512900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.512900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.513382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.514186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.514715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.515211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.540678 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-00bf798c-dac0-4d59-a8b8-3a85455c1653 tempest-ServicesAdminTestJSON-1553987263 tempest-ServicesAdminTestJSON-1553987263-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.036130 Oct 26 05:15:18.541388 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1777/3577] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:18.555045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.555747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:18.562891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.563471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.563986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.564759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.565288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.565808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.731573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:18.743685 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-085d0e78-d12a-4a8d-b29c-4c976aab6578 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.192465 Oct 26 05:15:18.744406 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1778/3578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:18.753507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:18.757857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:18.766181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.766734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.767284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.768117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:18.768767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:18.769303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:18.960172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:18.976062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:18.978328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:18.979574 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cd0e2360-6a7c-4950-82f2-ccb5800bdad4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.233909 Oct 26 05:15:19.003010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1779/3579] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:18 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:19.083022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:19.083901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:19.091708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.092275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.092996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.093851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.094541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.095175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.375309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:19.383954 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fea13a0a-fbbb-47c5-b405-d455e4cbbd60 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.305182 Oct 26 05:15:19.384983 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1780/3580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:19 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:19.391324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:19.392065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:19.399016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.399735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.400261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.401046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.401629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.402188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.575848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:19.584498 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad000603-d04a-4026-9c26-7d820fe010c0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.198235 Oct 26 05:15:19.585083 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1781/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:19 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:19.749231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eddc03c5-2d3c-4457-959d-a50cc972348a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action" status: 200 len: 16391 microversion: 2.1 time: 2.212630 Oct 26 05:15:19.754694 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1801/3582] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:17 2022] POST /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881/action => generated 16391 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:15:19.770428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:19.771860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:19.772026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:19.773040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:19.781705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.782530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.783085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.784206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.784938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.787698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.793716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.796137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.796769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:19.799180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:19.799841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:19.801687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.062129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:20.168600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:20.173874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:20.190797 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f04b1ab0-6c0a-4f0e-8ee6-8ff117591f98 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.433919 Oct 26 05:15:20.191979 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1782/3583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:19 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:20.200605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:20.201846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:20.211649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.212529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.213478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.214486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.215448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.218245 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41214bf9-57a8-426d-ad4e-c1c5a32ca5c4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.454741 Oct 26 05:15:20.219342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.221506 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1802/3584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:19 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:20.238423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:20.239509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:20.256372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.257122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.257902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.260067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.260857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.261484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.598247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:20.601095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:20.611270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:20.615357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:20.616097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:20.620394 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d0c64cef-d2f4-48ae-89b7-d0bb7c2d798a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.426312 Oct 26 05:15:20.621371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2c1bdb9-4d30-4b79-bca3-5934c4890cf3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.396369 Oct 26 05:15:20.622851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1803/3585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:20 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:20.623777 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1783/3586] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:20 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:20.639010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:20.639867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:20.644059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:20.644692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:20.646532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.647287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.648162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.648882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.649587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.650203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.664850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.666646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.667132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.669143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:20.669649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:20.671745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:20.939006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:21.041958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:21.053779 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3046bd21-79de-4572-b385-75619089e7d8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.428829 Oct 26 05:15:21.054569 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1784/3587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:20 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:21.060873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:21.064392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:21.065678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:21.076007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.076509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.077065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.077790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.077971 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2f85aac-fb8c-4ba3-b99a-24e8e4796cae tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.453623 Oct 26 05:15:21.078576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.078723 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1804/3588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:20 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:21.079878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.093124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:21.247070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:21.247943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:21.254888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.255528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.256349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.257067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.257705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.258143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.470898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:21.487314 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1d67f8e-7a7f-4110-804c-992ad2986f80 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.427385 Oct 26 05:15:21.488033 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1785/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:21 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:21.516509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b99cc497-c7b8-4e5b-a8a6-22c3ca89258e req-c1cbf9a3-cc63-4a20-9fdb-834ed2ad4f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d33be-44fe-4df6-83c8-a0242434ffbb", "tag": "a3ab681c-cf56-4e18-b04d-f259077656f1"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:21.546029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b99cc497-c7b8-4e5b-a8a6-22c3ca89258e req-c1cbf9a3-cc63-4a20-9fdb-834ed2ad4f82 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.546708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b99cc497-c7b8-4e5b-a8a6-22c3ca89258e req-c1cbf9a3-cc63-4a20-9fdb-834ed2ad4f82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.547322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b99cc497-c7b8-4e5b-a8a6-22c3ca89258e req-c1cbf9a3-cc63-4a20-9fdb-834ed2ad4f82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.562559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b99cc497-c7b8-4e5b-a8a6-22c3ca89258e req-c1cbf9a3-cc63-4a20-9fdb-834ed2ad4f82 service nova] Creating event network-changed:a3ab681c-cf56-4e18-b04d-f259077656f1 for instance 685d33be-44fe-4df6-83c8-a0242434ffbb on n-h2-862416-4 Oct 26 05:15:21.570740 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b99cc497-c7b8-4e5b-a8a6-22c3ca89258e req-c1cbf9a3-cc63-4a20-9fdb-834ed2ad4f82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067471 Oct 26 05:15:21.572511 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1786/3590] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:21.581704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:21.584131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:21.592691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.593265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.593802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.594578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.595163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.595599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.624165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:21.634750 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e93cd45a-a6f8-45ec-8d5c-37185b605d35 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.391794 Oct 26 05:15:21.635355 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1805/3591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:21 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:21.652703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:21.653347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:21.674997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.676197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.677055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.677971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:21.678502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:21.678939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:21.969659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:21.972733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:21.982962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a1c82b78-bf0c-4553-9351-3472edebf94e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.407798 Oct 26 05:15:21.983698 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1787/3592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:21 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:21.998917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:22.000920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:22.013354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b560bb6-ea15-4e7f-acb5-6d3c18bd2c8d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.364282 Oct 26 05:15:22.019078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:22.019931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:22.031634 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1806/3593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:21 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:15:22.032183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.035961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.037046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.037572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.038648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.039163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.079334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:22.080389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:22.089363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.090180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.090848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.091557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.092205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.092793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.114198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Locking {{(pid=120585) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 26 05:15:22.211666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43243cc7-2beb-4712-87c5-f21f290ced3f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.204931 Oct 26 05:15:22.212540 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1788/3594] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:22 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:22.223495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:22.224685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:22.228736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:22.233072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.233594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.234040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.234749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.235193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.235667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.354714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:22.479698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:22.491140 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09f1cb50-1030-4327-9d3c-965890f36064 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.416585 Oct 26 05:15:22.495782 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1807/3595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:22 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:22.509290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:22.509717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:22.514750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:22.521396 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e7c0c58-63f8-4c53-9c0d-e1b4db4151cf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.303760 Oct 26 05:15:22.522951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1789/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:22 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:22.539457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.539973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.540425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.541150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.542003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.542586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.661112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:22.662099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:22.668729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.669228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.669701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.670407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.671449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.683722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.741236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:22.752953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa518b87-5b2e-4185-975b-cba24bb73100 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.255696 Oct 26 05:15:22.766003 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1808/3597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:22 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:22.780997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:22.788558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.789326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.789977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.824811 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] HTTP exception thrown: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b is locked Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Request method failure captured: Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action HTTP/1.1 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 15 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFERA5hFKUBC7Yk-hBJT8hf7aopZJMv4XXckSQ2n1DhHt1THbsHDCU5UeVcKK2EpLnhOIME8Ip4KOI0Xh1l6AGYmqRkDA_arSa7zxSGL7D0eE2LAWZXlchIZSrkndPq2wBVuMZvSouEbv0qoQCJx63yxYQuxDT0hs51JkMyfHGcX84 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-387462898 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4c2aa94263344a7eb33bcc7c6594229a Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: {"os-stop": {}} Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b is locked Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f28fd521-ae28-4e01-8fae-4cca07aee55b', 'body': {'os-stop': {}}} Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b is locked Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b is locked Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b is locked Oct 26 05:15:22.826610 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:22.831941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Returning 409 to user: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b is locked {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:22.832834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c4fa504-3589-44a4-8e8e-a78f8a88d0be tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 409 len: 107 microversion: 2.1 time: 0.058243 Oct 26 05:15:22.834422 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1809/3598] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:22 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 107 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:15:22.842489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:22.843450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:22.852307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.853175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.853917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.854730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:22.855350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:22.855883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:22.879110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:22.889542 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cbf1de7d-e1b8-46fe-912b-bb056b6e0eb8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.233105 Oct 26 05:15:22.891013 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1790/3599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:22 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:22.917549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Unlocking {{(pid=120586) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 26 05:15:22.985338 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fac40f66-b90d-42ae-9282-ed850d5858a3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.146646 Oct 26 05:15:22.986464 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1810/3600] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:22 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:22.994401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4904e3b-607e-4771-9450-da6ac0cb9f7a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:23.000371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4904e3b-607e-4771-9450-da6ac0cb9f7a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.000862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4904e3b-607e-4771-9450-da6ac0cb9f7a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.001303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4904e3b-607e-4771-9450-da6ac0cb9f7a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.035981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4904e3b-607e-4771-9450-da6ac0cb9f7a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Going to try to stop instance {{(pid=120585) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:15:23.044975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:23.045625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:23.058059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.058560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.058999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.059706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.060141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.060564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.131543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4904e3b-607e-4771-9450-da6ac0cb9f7a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.139756 Oct 26 05:15:23.132642 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1791/3601] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:22 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:15:23.143079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:23.144628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:23.155326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.156104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.156869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.157984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.158788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.159766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.658178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:23.669889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:23.672209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:23.673645 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-25e4aa1b-04d0-47f8-ae01-a9d0b9b51156 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.634093 Oct 26 05:15:23.674311 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1811/3602] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:23 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:15:23.701817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:23.712044 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5fd73af-9dfc-4e49-ad5e-72b788fe7b83 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.573586 Oct 26 05:15:23.713276 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1792/3603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:23 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:23.719179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:23.720037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:23.726770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.727533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.728161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.729037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.729575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.730007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.834226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:23.838857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.839350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.840302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.841530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.842378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.842993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.872336 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30d8b0af-e825-48fb-b221-cb6cc2558d92 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.196745 Oct 26 05:15:23.873134 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1812/3604] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:23 2022] GET /compute/v2.1/os-services => generated 944 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:23.885980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:23.886715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:23.894192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.894678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.895116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.896600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.897350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.897949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.965111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:23.972871 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f9703a15-3abe-4c3e-8170-9d1d071f8b95 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.258316 Oct 26 05:15:23.973467 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1793/3605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:23 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:23.983322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:23.983322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.983322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.983322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:23.983754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:23.983933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:23.984338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.010146 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fe758485-99e3-4484-9440-4c4513284752 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.035346 Oct 26 05:15:24.011546 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1794/3606] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:15:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:24.016041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.016649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:24.023964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.024456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.024899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.025629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.026085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.026515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.201948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.212754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-52dca287-abc9-4448-ab98-aa1025bcac20 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.330462 Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1813/3607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:23 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.225247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.250219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec3ea40f-3449-415f-ab33-85fb7d7f3041 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.035106 Oct 26 05:15:24.250832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1814/3608] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:24.263435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.267183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.267744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.268291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.269193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.269744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.270248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.296294 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1d1186a-9744-4d72-b127-3c35c70e2a9c tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862416-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.036362 Oct 26 05:15:24.296995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1815/3609] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/os-services?host=n-d-862416-4&binary=xxx => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:15:24.307298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.310315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.314667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.315336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.315970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.316951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.318168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.319026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.341119 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-55996b7f-b7f4-4ade-9471-f3c405a3c823 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.322293 Oct 26 05:15:24.343791 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9255d8ec-91ab-4d13-81f8-9eb2d22ded73 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037363 Oct 26 05:15:24.344897 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1816/3610] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:24.345174 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1795/3611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:24.358002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.378446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.387305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.387814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.388640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.389126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.389591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.413418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd5cfd08-6bca-4010-9d83-45203ab1f9a9 tempest-ServicesAdminNegativeTestJSON-944112814 tempest-ServicesAdminNegativeTestJSON-944112814-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.059317 Oct 26 05:15:24.414151 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1817/3612] 10.222.0.16 () {58 vars in 1198 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:15:24.564495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-954697eb-0460-4add-8335-2f14f68523a3 tempest-ServicesAdminNegativeTestJSON-1623803320 tempest-ServicesAdminNegativeTestJSON-1623803320-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.568681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-954697eb-0460-4add-8335-2f14f68523a3 tempest-ServicesAdminNegativeTestJSON-1623803320 tempest-ServicesAdminNegativeTestJSON-1623803320-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b2aed344de144c8fb177e61392f94950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0494d5989eb4eca96e544963ab01cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-954697eb-0460-4add-8335-2f14f68523a3 tempest-ServicesAdminNegativeTestJSON-1623803320 tempest-ServicesAdminNegativeTestJSON-1623803320-project] Request method failure captured: Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJq896iZ_2XUy8m-ChM202_Tp7eTKALd2s2nYabSbkDC-WRIliwpt6aoNbUuV4YTwcqck3Fi7iMr2RG5NTEvo9E-LwFKssbV_eWV9ykC_4TAw54W1njU9XqqewjoayP_a52m_VHpMmodUkmjppZ54qp9OQ6FBpCUkv4Jx6zS74gsfQ Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: d0494d5989eb4eca96e544963ab01cee Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1623803320 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0494d5989eb4eca96e544963ab01cee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0494d5989eb4eca96e544963ab01cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0494d5989eb4eca96e544963ab01cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0494d5989eb4eca96e544963ab01cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1623803320 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: d0494d5989eb4eca96e544963ab01cee Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1623803320 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServicesAdminNegativeTestJSON-1623803320-project Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: b2aed344de144c8fb177e61392f94950 Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1623803320-project Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: action_args: {} Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 05:15:24.570983 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-954697eb-0460-4add-8335-2f14f68523a3 tempest-ServicesAdminNegativeTestJSON-1623803320 tempest-ServicesAdminNegativeTestJSON-1623803320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-954697eb-0460-4add-8335-2f14f68523a3 tempest-ServicesAdminNegativeTestJSON-1623803320 tempest-ServicesAdminNegativeTestJSON-1623803320-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.149836 Oct 26 05:15:24.575746 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1796/3613] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/os-services => generated 112 bytes in 151 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:24.700182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.701075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:24.707603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.708865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.709518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.710460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.711138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.711732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.736114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:24.736733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:24.754773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.756210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.756830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.758801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:24.761800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:24.762174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:24.981833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.991744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.996977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.999121 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6eaf3f12-f564-4237-99b1-c995655bc1cc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.267022 Oct 26 05:15:24.999379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:24.999712 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1797/3614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:25.001149 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-951bf92e-2c32-418e-b524-6ea85232f7ac tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.305022 Oct 26 05:15:25.015677 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1818/3615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:24 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:15:25.020455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:25.022924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:25.038137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-81530c18-daf9-466b-9ad2-8bd3dd5dfa80 req-d483e846-283b-4fe8-a917-807cbad85234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "name": "network-vif-plugged", "status": "completed", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:25.038590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.039091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.039798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.040911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.042337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.044295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.053205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81530c18-daf9-466b-9ad2-8bd3dd5dfa80 req-d483e846-283b-4fe8-a917-807cbad85234 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.053832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81530c18-daf9-466b-9ad2-8bd3dd5dfa80 req-d483e846-283b-4fe8-a917-807cbad85234 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.054654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81530c18-daf9-466b-9ad2-8bd3dd5dfa80 req-d483e846-283b-4fe8-a917-807cbad85234 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.073970 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-81530c18-daf9-466b-9ad2-8bd3dd5dfa80 req-d483e846-283b-4fe8-a917-807cbad85234 service nova] Creating event network-vif-plugged:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h2-862416-4 Oct 26 05:15:25.080546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-81530c18-daf9-466b-9ad2-8bd3dd5dfa80 req-d483e846-283b-4fe8-a917-807cbad85234 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063470 Oct 26 05:15:25.081341 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1798/3616] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:25.242890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:25.244164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:25.252470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.253346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.254106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.255569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.256205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.256789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.525436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:25.534190 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-771c96e0-9050-487e-bacd-acd17cbf1576 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.526424 Oct 26 05:15:25.535015 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1819/3617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:25 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:25.539752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:25.540751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:25.555822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.556357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.556799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.558445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:25.558917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:25.559790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:25.681013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:25.690151 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ea36b5f-5ae9-49c6-9aeb-663bf5049f23 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.453069 Oct 26 05:15:25.691377 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1799/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:25 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:25.944806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:25.955195 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b1a42d2-8366-4408-b93e-11dbb1f15581 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.418958 Oct 26 05:15:25.965502 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1820/3619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:25 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:26.033778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:26.036369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:26.038616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:26.039217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:26.054132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.055606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.056359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.057608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.058350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.060575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.061879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.062358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.063056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.063522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.063952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.065528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.109996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:26.370470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:26.382109 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64f9300d-0043-4e12-81fc-5a31085b01f1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.355329 Oct 26 05:15:26.383107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1821/3620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:26 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:26.417099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:26.439015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:26.460330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:26.461782 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e43a610-489b-433a-be9b-9e1b700842f1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1406 microversion: 2.20 time: 0.437522 Oct 26 05:15:26.467958 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1800/3621] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:26 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:26.561286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:26.562085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:26.571130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.573392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.574027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.575570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.576633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.579617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.717614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:26.718520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:26.730421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.731256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.731915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.732813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:26.733450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:26.734030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:26.790165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:26.974647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:26.983071 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9aff396-2c8d-4f6e-b42a-a504b0d20622 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.425669 Oct 26 05:15:26.983740 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1822/3622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:26 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:26.998636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:26.999511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:27.018459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:27.019936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:27.022170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:27.023672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:27.024690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:27.025383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:27.245648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:27.254047 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3136fbae-e60e-4557-93bc-9040dd8519eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.543131 Oct 26 05:15:27.254630 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1801/3623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:26 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:27.375405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:27.391596 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-104711e9-7c7a-470f-b259-9b53d87807d4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.396844 Oct 26 05:15:27.392199 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1823/3624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:26 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:27.409251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:27.409989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:27.416635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:27.417545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:27.418258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:27.419200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:27.419863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:27.420687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:27.494596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:27.495925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:27.504636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:27.506174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:27.507186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:27.508192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:27.508948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:27.510146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:27.986603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:27.994845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:27.996930 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-835da280-6c17-4d40-8510-ab59d4179a03 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.591575 Oct 26 05:15:28.006407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:28.008236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:28.009703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-db7f9072-31df-4230-9ed8-1145308d6b20 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1599 microversion: 2.20 time: 0.521668 Oct 26 05:15:28.024813 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1824/3625] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:15:27 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1599 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:15:28.026327 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1802/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:27 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:28.034645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.035909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:28.040337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.041103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:28.045341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.046376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.047230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.048319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.050159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.050970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.062018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.063699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.066103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.068138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.068732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.069494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.212351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43799d3d-76bf-49bf-a6b2-7f5316254bcf tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.177154 Oct 26 05:15:28.221785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1803/3627] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:15:28.263370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:28.272077 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4212a9b7-6afc-4dad-ad87-b1e9cd5df252 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.246411 Oct 26 05:15:28.272665 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1825/3628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:28.279494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.280757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:28.294330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.296093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.296949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.299393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.301163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.301927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.418189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.419145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:28.425822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.426560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.427264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.428251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:28.428886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:28.429514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:28.538808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:28.550545 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66bd3515-56f8-4fa5-be9f-5a1618ca8dc0 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.275920 Oct 26 05:15:28.566090 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1804/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:28.647468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:28.656912 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a31acb14-97f9-471f-b225-f6081b6405ec tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.242332 Oct 26 05:15:28.657990 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1826/3630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:28.877972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-142febb7-6873-4bbc-bdc4-ba10daee8a70 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.890629 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-142febb7-6873-4bbc-bdc4-ba10daee8a70 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.167742 Oct 26 05:15:28.891482 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1805/3631] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:28.908108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23047815-240f-4879-af5d-3655cbe20979 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.937032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23047815-240f-4879-af5d-3655cbe20979 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.033390 Oct 26 05:15:28.937741 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1827/3632] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:28.952918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad9adb67-185e-430e-aefe-57f15860156b tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.962812 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad9adb67-185e-430e-aefe-57f15860156b tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013527 Oct 26 05:15:28.964224 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1806/3633] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:28.977955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f012e3b2-fd77-4465-ab38-4132a0c468c4 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:28.985671 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f012e3b2-fd77-4465-ab38-4132a0c468c4 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012276 Oct 26 05:15:28.986258 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1828/3634] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:28.999424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a556f518-a5c4-427a-a6a0-0da942fda2c1 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.031904 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a556f518-a5c4-427a-a6a0-0da942fda2c1 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.036726 Oct 26 05:15:29.044614 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1807/3635] 10.222.0.16 () {58 vars in 1165 bytes} [Wed Oct 26 05:15:28 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:29.054762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5810e5c-4a70-4b92-8d2f-906e7dbfb717 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.065181 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5810e5c-4a70-4b92-8d2f-906e7dbfb717 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018421 Oct 26 05:15:29.074673 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1808/3636] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:29.087127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc696230-05c0-481b-9b71-1001b2ce3aef tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.134759 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc696230-05c0-481b-9b71-1001b2ce3aef tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.059010 Oct 26 05:15:29.135581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1809/3637] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:29.154927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fda748d9-ed3d-4718-8fa5-10f7ba1790a7 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.177439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fda748d9-ed3d-4718-8fa5-10f7ba1790a7 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.026465 Oct 26 05:15:29.178809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1810/3638] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:29.191835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f543b394-cb0e-4342-8438-396d9d0265c2 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.199849 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f543b394-cb0e-4342-8438-396d9d0265c2 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011776 Oct 26 05:15:29.200765 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1811/3639] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:29.213238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6590c9f3-3e16-443a-83fb-831f69485dc7 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.216177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.216686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:29.229211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.231812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.232286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.233021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.233520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.235624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.252880 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6590c9f3-3e16-443a-83fb-831f69485dc7 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.043715 Oct 26 05:15:29.253811 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1812/3640] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:29.274110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60dc3753-6bfd-439a-bb07-63ac8ae65b59 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.283336 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60dc3753-6bfd-439a-bb07-63ac8ae65b59 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017276 Oct 26 05:15:29.285787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1813/3641] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:29.297082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.302372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:29.312318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.313263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.313951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.314765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.315577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.316019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.459947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:29.468444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a0033ca-afe0-4c0b-9d6c-de890eec163e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.432228 Oct 26 05:15:29.469571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1829/3642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:29.476186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd2a52cb-42b4-4064-af11-8bb89adf76ae tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.508720 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd2a52cb-42b4-4064-af11-8bb89adf76ae tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.037648 Oct 26 05:15:29.509947 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1830/3643] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:29.519355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:29.529406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-235660b5-df90-4731-8b50-c0d1e14f07bd tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.531844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-56d49a67-e6be-438f-aad5-b5437a13c5e5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.238846 Oct 26 05:15:29.532864 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1814/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:29.554050 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-235660b5-df90-4731-8b50-c0d1e14f07bd tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028537 Oct 26 05:15:29.554876 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1831/3645] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:29.573732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7236ec6c-4b1a-45c3-b648-02cb67366732 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.578122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.578926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:29.586781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.587421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.589202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.590101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.591044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.591491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.593500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7236ec6c-4b1a-45c3-b648-02cb67366732 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.023819 Oct 26 05:15:29.594841 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1815/3646] 10.222.0.16 () {58 vars in 1148 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:29.615719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00f246b6-55b7-4fca-9142-add2ea8b3bf4 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.628423 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-00f246b6-55b7-4fca-9142-add2ea8b3bf4 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016446 Oct 26 05:15:29.629694 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1816/3647] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:29.652310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ba09ec4-116d-4ad1-ae42-8a031d5c830d tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.666111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ba09ec4-116d-4ad1-ae42-8a031d5c830d tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021842 Oct 26 05:15:29.667017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1817/3648] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:29.681050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.682587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:29.694434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.695010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.695655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.696436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:29.696976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:29.697569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:29.823488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:29.838786 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b38a07e6-2c3f-4204-b4e7-4abf3feb16c8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.263730 Oct 26 05:15:29.854401 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1832/3649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:29.862143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37db9eb6-3851-47a7-9335-307bf88b9166 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.897533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:29.908581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2883d0d9-a118-42e7-878c-77d7ad365764 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.232163 Oct 26 05:15:29.915909 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37db9eb6-3851-47a7-9335-307bf88b9166 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.059390 Oct 26 05:15:29.917127 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1833/3650] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:29.921262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1818/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:29.938820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bac924d7-3487-4951-a55d-fd829d00d9de tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:29.944893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:29.965870 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bac924d7-3487-4951-a55d-fd829d00d9de tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030843 Oct 26 05:15:29.966670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1834/3652] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:30.002220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47fe2562-95f3-448a-aa95-d36edce45c29 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:30.011507 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47fe2562-95f3-448a-aa95-d36edce45c29 tempest-FlavorsV2TestJSON-319849926 tempest-FlavorsV2TestJSON-319849926-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014930 Oct 26 05:15:30.012368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1819/3653] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:15:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:30.208960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ad20b2a4-8567-4513-abef-0dc59e1da7fd req-210071f2-dff0-4bc6-82e3-5ed4ae008a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d33be-44fe-4df6-83c8-a0242434ffbb", "name": "network-vif-plugged", "status": "completed", "tag": "a3ab681c-cf56-4e18-b04d-f259077656f1"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:30.229050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ad20b2a4-8567-4513-abef-0dc59e1da7fd req-210071f2-dff0-4bc6-82e3-5ed4ae008a6c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.229748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ad20b2a4-8567-4513-abef-0dc59e1da7fd req-210071f2-dff0-4bc6-82e3-5ed4ae008a6c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.230009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ad20b2a4-8567-4513-abef-0dc59e1da7fd req-210071f2-dff0-4bc6-82e3-5ed4ae008a6c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.247421 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ad20b2a4-8567-4513-abef-0dc59e1da7fd req-210071f2-dff0-4bc6-82e3-5ed4ae008a6c service nova] Creating event network-vif-plugged:a3ab681c-cf56-4e18-b04d-f259077656f1 for instance 685d33be-44fe-4df6-83c8-a0242434ffbb on n-h2-862416-4 Oct 26 05:15:30.262729 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ad20b2a4-8567-4513-abef-0dc59e1da7fd req-210071f2-dff0-4bc6-82e3-5ed4ae008a6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058987 Oct 26 05:15:30.267055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1835/3654] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:30.420635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d89280f5-ff30-4b8c-8675-b4abb50f88ca req-470bbf65-7b2a-478f-bcb8-a905f7279fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:30.446783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d89280f5-ff30-4b8c-8675-b4abb50f88ca req-470bbf65-7b2a-478f-bcb8-a905f7279fdb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.447469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d89280f5-ff30-4b8c-8675-b4abb50f88ca req-470bbf65-7b2a-478f-bcb8-a905f7279fdb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.450528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d89280f5-ff30-4b8c-8675-b4abb50f88ca req-470bbf65-7b2a-478f-bcb8-a905f7279fdb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.482472 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d89280f5-ff30-4b8c-8675-b4abb50f88ca req-470bbf65-7b2a-478f-bcb8-a905f7279fdb service nova] Creating event network-changed:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h2-862416-4 Oct 26 05:15:30.499927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:30.502201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:30.512227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d89280f5-ff30-4b8c-8675-b4abb50f88ca req-470bbf65-7b2a-478f-bcb8-a905f7279fdb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094289 Oct 26 05:15:30.514953 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1820/3655] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:30.517637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.518365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.518996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.519887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.521620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.522539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.559103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:30.560219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:30.567817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.579970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.581817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.582483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.587407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.588083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.866312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:30.874679 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73fb6760-09f5-4ac9-8389-6519b7a44427 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.381448 Oct 26 05:15:30.889754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1836/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:30 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:30.898587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:30.899205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:30.900255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:30.906647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.907409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.908019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.908894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.909549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.910139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.913223 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ded4c0af-0151-4bf2-b9f2-249c5375b8be tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.358499 Oct 26 05:15:30.918131 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1821/3657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:30 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:30.937660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:30.938281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:30.957637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.959008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.959614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:30.960357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:30.960820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:30.961247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:31.313768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:31.325472 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a56d4950-85a9-4045-a6aa-27d03c7d190f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.434212 Oct 26 05:15:31.326565 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1837/3658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:30 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:31.342227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:31.351328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54bb0aac-be28-4a9d-8644-57e7fc0ca9c8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1317 microversion: 2.1 time: 0.420964 Oct 26 05:15:31.352249 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1822/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:30 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:31.904112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:31.904643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:31.911352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:31.911853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:31.912636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:31.913562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:31.914033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:31.914463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:31.941282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:31.941932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:31.950592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:31.951098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:31.951767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:31.952683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:31.953254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:31.953910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.211948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:32.222041 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d55fa08d-c4aa-4387-8253-b09703a163d6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.321873 Oct 26 05:15:32.222635 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1838/3660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:31 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:32.227536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:32.247688 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-973aebb6-b220-4724-a5f5-8151e24383a2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.310187 Oct 26 05:15:32.257615 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1823/3661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:31 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:32.357494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:32.358184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:32.379218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.380690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.382039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.383017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.383792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.384766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.524411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1518126-5909-4714-8d55-3166395d915c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f4709ea0280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKEsNZPVMgar0fhNaQDEPCnFaWQDabWdTSshllZREb9b2gvGS2nZOh9kP60NVdUm34r78gvLx+uMfJBbBOE4rzbC6M64Oac8RRr12FZC/ZsR7Zu6DVzWiC74dfSQVgdRQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1518126-5909-4714-8d55-3166395d915c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 257 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKEsNZPVMgar0fhNaQDEPCnFaWQDabWdTSshllZREb9b2gvGS2nZOh9kP60NVdUm34r78gvLx+uMfJBbBOE4rzbC6M64Oac8RRr12FZC/ZsR7Zu6DVzWiC74dfSQVgdRQ=="}} Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKEsNZPVMgar0fhNaQDEPCnFaWQDabWdTSshllZREb9b2gvGS2nZOh9kP60NVdUm34r78gvLx+uMfJBbBOE4rzbC6M64Oac8RRr12FZC/ZsR7Zu6DVzWiC74dfSQVgdRQ=='}}} Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 26 05:15:32.529121 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.534473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1518126-5909-4714-8d55-3166395d915c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:32.537302 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1518126-5909-4714-8d55-3166395d915c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.169722 Oct 26 05:15:32.537302 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1824/3662] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:15:32.541772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:32.542395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:32.550353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.550926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.551242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.552960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.553217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.553535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.580521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:32.589219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bd77cfb-a4b2-477c-a273-24c83ba7a0d7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.235402 Oct 26 05:15:32.600222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1839/3663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:32 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:32.605776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f4709b89940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1850154483", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.622376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:32.627675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for user 09386ec3d8344a1b8417f90d67dfedc6 and project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:32.651131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 2167 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1850154483", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:15:32.674325 n-d-862416-4 devstack@n-api.service[120586]: exception: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1850154483', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:32.677827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df9dff02-495c-4916-a807-133196c50161 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.074529 Oct 26 05:15:32.680979 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1840/3664] 10.222.0.16 () {60 vars in 1160 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:15:32.690391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-89881fcd-6d69-4ae2-86ea-9ef02312906f tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f4709b10ee0>, body: {"keypair": {"name": "tempest-keypair-289459540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkwgrdgXtAKE8XahXJZ/Ui1ktz+Y4N3sSY+cM+XYEAzq/ZlqaRfycF6P57AQ5C0WpbLEgv5gSeDQpiZ6szJQiEQR8PNUlqOZhinnYEwhB10RAaSGFSmtDjcEpZACNmJJw=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.707274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-89881fcd-6d69-4ae2-86ea-9ef02312906f tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:32.713593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-89881fcd-6d69-4ae2-86ea-9ef02312906f tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for user 09386ec3d8344a1b8417f90d67dfedc6 and project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:32.724521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:32.734078 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0baa582f-07b0-4436-bbf5-98c638e2a31a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1467 microversion: 2.1 time: 0.196182 Oct 26 05:15:32.735027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1825/3665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:32 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1467 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:32.739372 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-89881fcd-6d69-4ae2-86ea-9ef02312906f tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052739 Oct 26 05:15:32.748864 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1841/3666] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:32.756459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f4709af74c0>, body: {"keypair": {"name": "tempest-keypair-289459540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkk0BHtCzJFvKd1DOzAoCYx0tWd0XJiTpjWWYDHU3kwXySiJLOBExsMO+wRQwnTjDGCHSOcnfjgcwfL55mqEQkVirHZf+WxQXAMlminOTk2GCp7ML2jgNwYz0IzK18oBQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.757340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:32.757964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:32.764507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.764987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.765457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.766160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.766611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.767032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.775842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:32.781060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for user 09386ec3d8344a1b8417f90d67dfedc6 and project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:32.804756 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] HTTP exception thrown: Key pair 'tempest-keypair-289459540' already exists. Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 272 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: {"keypair": {"name": "tempest-keypair-289459540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkk0BHtCzJFvKd1DOzAoCYx0tWd0XJiTpjWWYDHU3kwXySiJLOBExsMO+wRQwnTjDGCHSOcnfjgcwfL55mqEQkVirHZf+WxQXAMlminOTk2GCp7ML2jgNwYz0IzK18oBQ=="}} Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: exception: Key pair 'tempest-keypair-289459540' already exists. Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-289459540', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkk0BHtCzJFvKd1DOzAoCYx0tWd0XJiTpjWWYDHU3kwXySiJLOBExsMO+wRQwnTjDGCHSOcnfjgcwfL55mqEQkVirHZf+WxQXAMlminOTk2GCp7ML2jgNwYz0IzK18oBQ=='}}} Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result.read() Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '09386ec3d8344a1b8417f90d67dfedc6-tempest-keypair-289459540' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 26 05:15:32.808126 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi session.flush() Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result.read() Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 26 05:15:32.812804 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '09386ec3d8344a1b8417f90d67dfedc6-tempest-keypair-289459540' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 26, 5, 15, 32, 798380), 'updated_at': None, 'name': 'tempest-keypair-289459540', 'user_id': '09386ec3d8344a1b8417f90d67dfedc6', 'fingerprint': '86:45:ab:b8:a7:97:1c:d4:e5:c1:9d:be:e5:ba:ae:97', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkk0BHtCzJFvKd1DOzAoCYx0tWd0XJiTpjWWYDHU3kwXySiJLOBExsMO+wRQwnTjDGCHSOcnfjgcwfL55mqEQkVirHZf+WxQXAMlminOTk2GCp7ML2jgNwYz0IzK18oBQ==', 'type': 'ssh'}] Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi keypair.create() Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._create() Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-289459540' already exists. Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 26 05:15:32.822398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-289459540' already exists. Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-289459540' already exists. Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 409 to user: Key pair 'tempest-keypair-289459540' already exists. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-387e901a-9a40-4b0c-abe3-ac429f5db6d2 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.058933 Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1826/3667] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:15:32.827473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfdb9b4a-20dc-432e-9023-cb42ee9635f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Calling method '.version_select at 0x7f4709f81f70>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:32.839534 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfdb9b4a-20dc-432e-9023-cb42ee9635f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289459540" status: 202 len: 0 microversion: 2.1 time: 0.024961 Oct 26 05:15:32.840094 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1827/3668] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:15:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289459540 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:15:32.852076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfc841be-ff92-40e9-b7b4-bbb25a539cda tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f470eb01ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6l+8lO410zSLDzt2E+FyArmldp7epCEtAJaXj4yn2zkxrPY/KGDyAAB6FL8ed/c7QE8LCePXXlYNMlGGco0TNO2c9OZk1rVMUuUgelDebzjO+krDEIXO9Er5Lye7mM3g=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfc841be-ff92-40e9-b7b4-bbb25a539cda tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 247 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6l+8lO410zSLDzt2E+FyArmldp7epCEtAJaXj4yn2zkxrPY/KGDyAAB6FL8ed/c7QE8LCePXXlYNMlGGco0TNO2c9OZk1rVMUuUgelDebzjO+krDEIXO9Er5Lye7mM3g=="}} Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6l+8lO410zSLDzt2E+FyArmldp7epCEtAJaXj4yn2zkxrPY/KGDyAAB6FL8ed/c7QE8LCePXXlYNMlGGco0TNO2c9OZk1rVMUuUgelDebzjO+krDEIXO9Er5Lye7mM3g=='}}} Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi '' Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:15:32.855783 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfc841be-ff92-40e9-b7b4-bbb25a539cda tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfc841be-ff92-40e9-b7b4-bbb25a539cda tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009483 Oct 26 05:15:32.862900 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1828/3669] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:15:32.867183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f4709a57670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2135392866", "public_key": " "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.883784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:32.889369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for user 09386ec3d8344a1b8417f90d67dfedc6 and project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:32.914103 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 95 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2135392866", "public_key": " "}} Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: exception: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2135392866', 'public_key': ' '}}} Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.917145 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1aa038ea-a1e3-4207-b3e6-58097540f5f4 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.056870 Oct 26 05:15:32.924834 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1829/3670] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:15:32.934660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-320efb68-8796-49cf-bfa8-7457a8c3eb76 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f4709c53310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw037ftD8dgAnrx1lpL1hpY0CSR9Py92n/k7mM46lI63M9I/dhTR2O+g4UKbVxpnnImXx1/mG/BCVDc7mMvaOOvCYGIVIbK/0PuFbvrzuSMhe+ufuUhUI1gZWESAz3T2w=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-320efb68-8796-49cf-bfa8-7457a8c3eb76 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 507 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw037ftD8dgAnrx1lpL1hpY0CSR9Py92n/k7mM46lI63M9I/dhTR2O+g4UKbVxpnnImXx1/mG/BCVDc7mMvaOOvCYGIVIbK/0PuFbvrzuSMhe+ufuUhUI1gZWESAz3T2w=="}} Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw037ftD8dgAnrx1lpL1hpY0CSR9Py92n/k7mM46lI63M9I/dhTR2O+g4UKbVxpnnImXx1/mG/BCVDc7mMvaOOvCYGIVIbK/0PuFbvrzuSMhe+ufuUhUI1gZWESAz3T2w=='}}} Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 26 05:15:32.938670 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 26 05:15:32.942803 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:32.950156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-320efb68-8796-49cf-bfa8-7457a8c3eb76 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:32.953351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-320efb68-8796-49cf-bfa8-7457a8c3eb76 tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.020558 Oct 26 05:15:32.953351 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1830/3671] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:15:32.960422 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-96bb5355-ea40-4c32-a1c3-b706d726e959 tempest-ServersOnMultiNodesTest-1516109096 tempest-ServersOnMultiNodesTest-1516109096-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1618 microversion: 2.1 time: 0.206862 Oct 26 05:15:32.961017 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1842/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:32 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1618 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:32.964194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Action: 'create', calling method: .version_select at 0x7f470a7490d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-108086031", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:32.976780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:32.985120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:32.985653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:32.991177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:15:32.993222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.994048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.994548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.995719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:32.996428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:32.997083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:32.998134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Getting quotas for user 09386ec3d8344a1b8417f90d67dfedc6 and project ed9639c78eed486fb2dc0f214d6ff2c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:15:33.021340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 117 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-108086031", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: exception: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-108086031', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 26 05:15:33.023361 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:33.028299 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc8af34e-e7ba-48c2-94c1-808e4b211a2b tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.068190 Oct 26 05:15:33.031721 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1831/3673] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:15:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 26 05:15:33.031833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:33.035194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd20df6b-154a-45a6-a799-9e2a3a1b833c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Calling method '.version_select at 0x7f4709a56dc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:33.049775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-bd20df6b-154a-45a6-a799-9e2a3a1b833c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-36222383 not found for user 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd20df6b-154a-45a6-a799-9e2a3a1b833c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Request method failure captured: Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-36222383 HTTP/1.1 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJ07VqO23jMRzhJTORvAmKKjJhxqLYFvnBrtwqzMnLrY_V4vXYd54brVGhI1mIZ8OhHOmkS_59l4yO5U4P-7P_3xFna61rHCTFN5LU5FEOxEjdZG_FFUg2u3eT0XJK_xEWOGQ1C0vxy14zUwTEqGSdlfHCio6d-bYlAY96UIOqyc2w Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed9639c78eed486fb2dc0f214d6ff2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ed9639c78eed486fb2dc0f214d6ff2c2 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-249765140 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-KeyPairsNegativeTestJSON-249765140-project Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: exception: Keypair tempest-keypair-non-existent-36222383 not found for user 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'tempest-keypair-non-existent-36222383'} Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise self.value Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-36222383 not found for user 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.051582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-36222383 not found for user 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-36222383 not found for user 09386ec3d8344a1b8417f90d67dfedc6 Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd20df6b-154a-45a6-a799-9e2a3a1b833c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] Returning 404 to user: Keypair tempest-keypair-non-existent-36222383 not found for user 09386ec3d8344a1b8417f90d67dfedc6 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd20df6b-154a-45a6-a799-9e2a3a1b833c tempest-KeyPairsNegativeTestJSON-249765140 tempest-KeyPairsNegativeTestJSON-249765140-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-36222383" status: 404 len: 143 microversion: 2.1 time: 0.022744 Oct 26 05:15:33.060006 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1832/3674] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 26 05:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-36222383 => generated 143 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:33.249220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:33.250549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:33.259423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.260010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.260551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.261497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.262532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.263482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.400639 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba275c0d-7e8c-49ff-8240-757014607ab2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 204 len: 0 microversion: 2.1 time: 0.418890 Oct 26 05:15:33.402572 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1843/3675] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:32 2022] DELETE /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:15:33.409681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:33.410768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:33.418269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.418998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.419567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.420351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.421433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.421936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.589119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:33.598305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81e2e3c5-2e4c-4e8b-ba73-677fd363b584 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.355722 Oct 26 05:15:33.598933 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1833/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:33 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:33.604457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:33.606822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:33.616567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.617063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.617669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.618391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.618846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.619489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.683763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:33.691412 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b7b87e9-f0ea-4025-b10f-0d092de7c7ab tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.287700 Oct 26 05:15:33.691968 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1844/3677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:33 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:33.714420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:33.715830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:33.725411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.726232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.726873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.727602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:33.728228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:33.728825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:33.733275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:33.928477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:33.937039 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70a91e16-7bcd-41d1-a8c7-0783374c2811 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1473 microversion: 2.1 time: 0.336545 Oct 26 05:15:33.937678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1834/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:33 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:34.036948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:34.045837 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eab4b66a-2198-4402-bf5d-54ecd41b8e22 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.352389 Oct 26 05:15:34.046749 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1845/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:33 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:34.622336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:34.623754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:34.628117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:34.635236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:34.635823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:34.636332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:34.637102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:34.637808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:34.638240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:34.719568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:34.721736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:34.727073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:34.736026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:34.736524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:34.738077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:34.740006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:34.740504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:34.741155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:34.905534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:34.923635 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-adf245f4-7d0a-4f6f-bca7-2eea9010ef31 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1655 microversion: 2.1 time: 0.305968 Oct 26 05:15:34.924612 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1835/3680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:34 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1655 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:34.948522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e857462-a192-4f8b-ab46-2fb659b479b4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:34.955447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e857462-a192-4f8b-ab46-2fb659b479b4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:34.956019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e857462-a192-4f8b-ab46-2fb659b479b4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:34.956446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e857462-a192-4f8b-ab46-2fb659b479b4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:34.992480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e857462-a192-4f8b-ab46-2fb659b479b4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Going to try to start instance {{(pid=120585) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 05:15:35.010468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:35.018377 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7573901-156d-4707-a796-3800075f75b4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.304972 Oct 26 05:15:35.018977 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1846/3681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:34 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:35.033265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:35.033265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:35.044337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:35.044881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:35.045385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:35.046362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:35.046853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:35.047287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:35.076898 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e857462-a192-4f8b-ab46-2fb659b479b4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.132169 Oct 26 05:15:35.078761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1836/3682] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:34 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:15:35.095074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:35.100557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:35.134300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:35.135562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:35.136343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:35.137284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:35.137984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:35.138722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:35.433484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:35.444705 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4f9aa44-794e-46f1-844b-c836ef0c17f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1473 microversion: 2.1 time: 0.423454 Oct 26 05:15:35.444705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1847/3683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:35 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:35.468578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:35.469511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:35.478989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:35.483068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:35.487378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:35.487572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:35.488326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:35.495305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef37e9aa-6b82-4037-90d1-318eca30d0eb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.407411 Oct 26 05:15:35.495903 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1837/3684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:35 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:35.496273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:35.496825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:35.744811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:35.755602 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a4f0e83-8ae5-4894-bf0c-c5d028e4b350 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1664 microversion: 2.1 time: 0.308913 Oct 26 05:15:35.756437 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1848/3685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:35 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1664 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:36.048340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:36.048965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:36.057230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.058000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.058816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.059527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.059982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.060762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.198946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:36.208474 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20f6490f-e85c-43e7-bb26-1c3f6464983c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.164797 Oct 26 05:15:36.209558 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1838/3686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:36 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:36.466234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:36.467180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:36.479094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.480206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.480869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.482745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.484054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.485304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.540647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:36.542082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:36.569742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.578165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.578772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.579632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.580197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.581148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.592688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:36.645287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:36.668271 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6b28c9d7-beb0-4249-a3e0-0127970f6ec3 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1431 microversion: 2.1 time: 0.205692 Oct 26 05:15:36.670486 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1849/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:36 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1431 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:36.707790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-41dee4f2-b6af-44c7-bf0b-765e58d2208c req-1723a008-5387-40d6-8eac-332743128625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d33be-44fe-4df6-83c8-a0242434ffbb", "name": "network-vif-deleted", "tag": "a3ab681c-cf56-4e18-b04d-f259077656f1"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:36.738672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-41dee4f2-b6af-44c7-bf0b-765e58d2208c req-1723a008-5387-40d6-8eac-332743128625 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.742338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-41dee4f2-b6af-44c7-bf0b-765e58d2208c req-1723a008-5387-40d6-8eac-332743128625 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.742875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-41dee4f2-b6af-44c7-bf0b-765e58d2208c req-1723a008-5387-40d6-8eac-332743128625 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.782207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-41dee4f2-b6af-44c7-bf0b-765e58d2208c req-1723a008-5387-40d6-8eac-332743128625 service nova] Creating event network-vif-deleted:a3ab681c-cf56-4e18-b04d-f259077656f1 for instance 685d33be-44fe-4df6-83c8-a0242434ffbb on n-h2-862416-4 Oct 26 05:15:36.796394 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-41dee4f2-b6af-44c7-bf0b-765e58d2208c req-1723a008-5387-40d6-8eac-332743128625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122328 Oct 26 05:15:36.798094 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1850/3688] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:36.834195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:36.837697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:36.854390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.856132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.856647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.859924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:36.861144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:36.865198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:36.953621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:36.971030 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d0ed1b4b-ec9e-4609-bfa9-a025091b307b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.453323 Oct 26 05:15:36.986420 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1839/3689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:36 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:37.141970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:37.171662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86a9695b-f38e-4d3b-85aa-180d326449a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1664 microversion: 2.1 time: 0.364603 Oct 26 05:15:37.182529 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1851/3690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:36 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1664 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:37.232063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:37.232632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:37.241724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:37.242678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:37.243444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:37.252491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:37.253402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:37.256099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:37.476443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:37.487643 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7209f487-7de6-4ea6-847a-8106c1503658 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.258722 Oct 26 05:15:37.489993 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1840/3691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:37 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:37.698415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:37.700336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:37.738388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:37.739739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:37.743769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:37.748710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:37.749569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:37.750273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:37.829951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:37.831309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:37.835616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:37.836116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lazy-loading 'fault' on Instance uuid 685d33be-44fe-4df6-83c8-a0242434ffbb {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:15:37.944081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:37.951687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5858fdb1-d88b-43f1-9dfb-f09433e302cc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 200 len: 1307 microversion: 2.1 time: 0.261340 Oct 26 05:15:37.952987 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1852/3692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:37 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 1307 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:38.000657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:38.001467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:38.008641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.009252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.010165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.010945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.011469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.011961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.201635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:38.203610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:38.211846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.212361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.212806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.213552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.214123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.214428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.576879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:38.590255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d35a4f56-88a9-4ce4-95c0-ffacdfa44a95 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.593970 Oct 26 05:15:38.591578 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1841/3693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:37 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:38.604016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:38.605166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:38.620534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.621570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.623094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.626016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.627599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.628271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.821273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:38.831307 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9ff4cef-3a7a-4e94-98b8-2b5d05eb5479 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.635724 Oct 26 05:15:38.842413 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1853/3694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:38 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:38.865129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:38.865627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:38.876697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.877822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.878460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.879204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.880208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.881187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.901744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:38.910973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ecf6c18-5fe3-4907-b28d-1a967e0a0651 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.317744 Oct 26 05:15:38.911884 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1842/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:38 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:38.977663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:38.978500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 685d33be-44fe-4df6-83c8-a0242434ffbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:38.987214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.988017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.988708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:38.990120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:38.990994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:38.991599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.029562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance 685d33be-44fe-4df6-83c8-a0242434ffbb could not be found. Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb HTTP/1.1 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 685d33be-44fe-4df6-83c8-a0242434ffbb could not be found. Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '685d33be-44fe-4df6-83c8-a0242434ffbb'} Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685d33be-44fe-4df6-83c8-a0242434ffbb could not be found. Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685d33be-44fe-4df6-83c8-a0242434ffbb could not be found. Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:39.033458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685d33be-44fe-4df6-83c8-a0242434ffbb could not be found. Oct 26 05:15:39.039589 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:39.043379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance 685d33be-44fe-4df6-83c8-a0242434ffbb could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:39.044449 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1cbe7e90-9bcd-484f-95ad-b85d214adf5a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb" status: 404 len: 111 microversion: 2.1 time: 0.072785 Oct 26 05:15:39.045660 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1843/3696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:38 2022] GET /compute/v2.1/servers/685d33be-44fe-4df6-83c8-a0242434ffbb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:15:39.055743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:39.057657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:39.069813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.070320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.070770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.071814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.072486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.073132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.099535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:39.110860 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00da635d-945e-4822-b117-70a7730e7f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.255959 Oct 26 05:15:39.111805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1854/3697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:38 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:39.140248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:39.179418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:39.190494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:39.204439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.207104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.208464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.210612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.216481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.217218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.331919 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b84f1c6e-cd48-430c-a2cf-9dd2134b0098 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 204 len: 0 microversion: 2.1 time: 0.281910 Oct 26 05:15:39.337489 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1844/3698] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:39 2022] DELETE /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:39.344497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Unlocking {{(pid=120586) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 26 05:15:39.348128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:39.349488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:39.378378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.379834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.381029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.382197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.382829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.383495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.416853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cdbe46ac-3c0a-44bb-95ef-60830002ec7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.253020 Oct 26 05:15:39.417572 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1855/3699] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:39 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:39.429901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:39.430752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:39.452977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.453793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.455934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.466404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.471017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.471486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.611891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:39.623082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a37686d-e478-4ddb-a3c8-d11929105342 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1473 microversion: 2.1 time: 0.282220 Oct 26 05:15:39.626677 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1845/3700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:39 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:39.656591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:39.658221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:39.680277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.682293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.684000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:39.685545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:39.688096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:39.688747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.000788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.013467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8cf0aad3-8f13-494f-a1a2-8fbaf9ddd6d1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.368136 Oct 26 05:15:40.014279 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1846/3701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:39 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:40.035276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:40.036231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:40.051141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.057145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.064174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.067130 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c943f331-a1ff-44c2-9c06-76d15e2932fc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.642780 Oct 26 05:15:40.068034 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1856/3702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:39 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:40.071716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.073331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.074314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.074996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.090619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:40.091706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:40.098271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.099936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.100683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.101686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.102391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.103073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.342831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.352306 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-74fcc13d-78f5-44fc-a48a-7cfdec5d73a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.265637 Oct 26 05:15:40.371057 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1857/3703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:40 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:40.374939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.376548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:40.377163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:40.385540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.386052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.386503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.387228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.387699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.388137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.388865 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a374f86a-0356-43ff-8c81-b23732347839 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1508 microversion: 2.1 time: 0.359775 Oct 26 05:15:40.402014 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1847/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:40 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:40.552306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.562132 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b61127c0-5074-4ca2-9ceb-cdc64a44a89d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.189330 Oct 26 05:15:40.571754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1858/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:40 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:40.586536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:40.588292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:40.594928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.595668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.596524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.597462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.598122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.599176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.655845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:40.656735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:40.664909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.665865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.666480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.668085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.668758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.669448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.686282 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b57b8f99-10ba-4a0f-9ded-fe80c190e3a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.103675 Oct 26 05:15:40.690989 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1848/3706] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:40 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:40.697602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:40.698413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:40.705594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.706678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.707338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.708873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:40.709744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:40.710357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:40.845529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.849334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:40.857007 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d5238da-6e28-47b1-a835-b413b3654a26 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1473 microversion: 2.1 time: 0.204891 Oct 26 05:15:40.858599 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1859/3707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:40 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1473 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:40.972332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:40.981629 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-619eae74-edcc-4551-9d45-ae8fbb0827c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1673 microversion: 2.1 time: 0.288594 Oct 26 05:15:40.982651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1849/3708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:40 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1673 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:41.042040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:41.043151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:41.050737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.051486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.053650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.054646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.055322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.055955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.247128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:41.247742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:41.260017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.260567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.265351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.266164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.266867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.267713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.351683 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-669a76da-d75a-4d9e-abee-85249ed674b6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.100681 Oct 26 05:15:41.358978 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1850/3709] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:15:41 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/ips => generated 150 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:41.365588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:41.375819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8319f15-18e0-4f9c-8967-77a2351037ca tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.340612 Oct 26 05:15:41.381637 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1860/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:41 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:41.414232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:41.414849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:41.424265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.426287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.428023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.431070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.447390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.447727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.766200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:41.779981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08f440d0-47d2-4c04-81ee-ec8873bb77f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1529 microversion: 2.1 time: 0.365933 Oct 26 05:15:41.781688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1851/3711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:41 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1529 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:41.880887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:41.881948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:41.893254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.897722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.898361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:41.902019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:41.902740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:41.903387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:42.007363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:42.008481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:42.022494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:42.025493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:42.028152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:42.029342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:42.029928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:42.031605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:42.383820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:42.402511 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f5eb479-3bf1-4286-bb10-71bcbf007567 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1653 microversion: 2.1 time: 0.400209 Oct 26 05:15:42.425924 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1852/3712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:42 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1653 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:42.440588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:42.441656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:42.460629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:42.462397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:42.463095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:42.466160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:42.467961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:42.468176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:42.721383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:42.933031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:42.945152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09aeaa43-477f-457a-8e3e-c3155bfa9b00 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 200 len: 1473 microversion: 2.1 time: 1.068978 Oct 26 05:15:42.953464 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1861/3713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:41 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 1473 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:42.972920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:42.982436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:42.997301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:42.998575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:42.999721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:43.000467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:43.000944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:43.001608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:43.007335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:43.155846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:43.195752 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39686a37-10f0-4670-9560-5bbcffc0f685 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.754513 Oct 26 05:15:43.215668 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51cdd11e-b514-41ea-b60e-85e5692a35a7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.252373 Oct 26 05:15:43.217033 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1862/3715] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:15:42 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:43.217396 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1853/3715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:42 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:43.222275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:43.222890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:43.230895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6ec7e683-09bc-4e96-8ab1-c1392df4c39a req-a574e8f1-7043-44fb-a726-319b64cc8bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6972bbd4-137b-43ca-a304-395253f71651", "name": "network-vif-deleted", "tag": "9d7b08a9-484b-4917-8fab-54ec8ef33a7b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:43.254353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6ec7e683-09bc-4e96-8ab1-c1392df4c39a req-a574e8f1-7043-44fb-a726-319b64cc8bc8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:43.255901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6ec7e683-09bc-4e96-8ab1-c1392df4c39a req-a574e8f1-7043-44fb-a726-319b64cc8bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:43.257432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6ec7e683-09bc-4e96-8ab1-c1392df4c39a req-a574e8f1-7043-44fb-a726-319b64cc8bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:43.280160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:43.280680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:43.281131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:43.288323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:43.292125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:43.296023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:43.309747 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6ec7e683-09bc-4e96-8ab1-c1392df4c39a req-a574e8f1-7043-44fb-a726-319b64cc8bc8 service nova] Creating event network-vif-deleted:9d7b08a9-484b-4917-8fab-54ec8ef33a7b for instance 6972bbd4-137b-43ca-a304-395253f71651 on n-h1-862416-4 Oct 26 05:15:43.323451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6ec7e683-09bc-4e96-8ab1-c1392df4c39a req-a574e8f1-7043-44fb-a726-319b64cc8bc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104350 Oct 26 05:15:43.324342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1863/3716] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:43.336385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:43.338253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:43.352085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:43.355356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:43.355965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:43.356861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:43.358143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:43.358902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:43.361675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.099333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:44.111401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:44.147193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21c8a651-c36a-444b-a6d6-5652aab73b61 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1529 microversion: 2.1 time: 0.928082 Oct 26 05:15:44.149073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1854/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:43 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1529 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:44.155469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:44.156531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 6972bbd4-137b-43ca-a304-395253f71651] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:44.159003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2386ef47-a456-46cc-b1cf-63e68c4bf0fe tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1660 microversion: 2.1 time: 0.830021 Oct 26 05:15:44.163535 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1864/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:43 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1660 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:44.166141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.166697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.167247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.167907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.168549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.169134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.195050 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance 6972bbd4-137b-43ca-a304-395253f71651 could not be found. Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 HTTP/1.1 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 6972bbd4-137b-43ca-a304-395253f71651 could not be found. Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '6972bbd4-137b-43ca-a304-395253f71651'} Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6972bbd4-137b-43ca-a304-395253f71651 could not be found. Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6972bbd4-137b-43ca-a304-395253f71651 could not be found. Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:44.197002 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6972bbd4-137b-43ca-a304-395253f71651 could not be found. Oct 26 05:15:44.203009 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:44.204244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance 6972bbd4-137b-43ca-a304-395253f71651 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:44.205475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a868b657-fda1-4741-af76-30cbcb71e032 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651" status: 404 len: 111 microversion: 2.1 time: 0.055169 Oct 26 05:15:44.206439 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1855/3719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:44 2022] GET /compute/v2.1/servers/6972bbd4-137b-43ca-a304-395253f71651 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:44.216765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:44.225368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:44.237928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce4a40bd-afcb-4751-8faf-6bf4963d9ac0"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:44.242473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:44.243821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.244612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.245282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.247686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.248412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.252315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.253038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.253190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.253803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.254944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.255584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.256176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.310649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:44.577500 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22b6a8ba-b6de-4fbe-b61a-76ae3b457045 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 204 len: 0 microversion: 2.1 time: 0.365265 Oct 26 05:15:44.581590 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1865/3720] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:44 2022] DELETE /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:44.595891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:44.596920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:44.617300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.618365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.619128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.620490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.621844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.622550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.853149 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-280cc624-dbef-4c66-ab5b-cdaf922ced75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620141 Oct 26 05:15:44.854561 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1856/3721] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:15:44 2022] POST /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:44.861664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:44.862452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:44.871867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.872704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.873420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.875928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:44.890896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:44.896764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:44.979796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:45.006275 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a361ddd0-3371-4760-ad60-c95dba9b42c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.423385 Oct 26 05:15:45.008222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1866/3722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:44 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:45.090786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-08ee495d-1db5-484f-b769-f7ee098fa7f9 req-4b3f2e60-be72-43d3-b298-db674820a4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f", "name": "network-vif-plugged", "status": "completed", "tag": "013a77ed-1e88-42f4-98fd-3a6567b8e685"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:45.112043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-08ee495d-1db5-484f-b769-f7ee098fa7f9 req-4b3f2e60-be72-43d3-b298-db674820a4fe service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:45.113329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-08ee495d-1db5-484f-b769-f7ee098fa7f9 req-4b3f2e60-be72-43d3-b298-db674820a4fe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:45.114046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-08ee495d-1db5-484f-b769-f7ee098fa7f9 req-4b3f2e60-be72-43d3-b298-db674820a4fe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:45.195797 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-08ee495d-1db5-484f-b769-f7ee098fa7f9 req-4b3f2e60-be72-43d3-b298-db674820a4fe service nova] Creating event network-vif-plugged:013a77ed-1e88-42f4-98fd-3a6567b8e685 for instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f on n-h2-862416-4 Oct 26 05:15:45.215497 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-08ee495d-1db5-484f-b769-f7ee098fa7f9 req-4b3f2e60-be72-43d3-b298-db674820a4fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133272 Oct 26 05:15:45.216109 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1867/3723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:45.221435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:45.222152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:45.224300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:45.245797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:45.246030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:45.246685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:45.247802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:45.248525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:45.249174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:45.601057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:45.615693 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7353ad4e-5703-4a03-8f68-a87a9f04dfb0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1472 microversion: 2.1 time: 0.759727 Oct 26 05:15:45.632069 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1857/3724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:44 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:45.632069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:45.632069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:45.632069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:45.632621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:45.636345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:45.643739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:45.650173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:45.651015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:45.671873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:45.685198 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed667feb-67d6-4b03-96c4-4b4b6fbd54cd tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1529 microversion: 2.1 time: 0.465124 Oct 26 05:15:45.686010 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1868/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:45 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1529 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:45.936986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:45.953997 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-84176906-70db-49c3-b3ba-e8c88ade7492 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.335840 Oct 26 05:15:45.955294 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1858/3726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:45 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:45.980980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:45.982286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:46.007475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.008272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.008890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.009825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.010462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.011088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.038983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:46.039634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:46.069593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.075497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.079413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.084324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.085036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.088289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.523951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:46.532601 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43ffa380-1def-4d7d-ab84-acde9e41d28a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.500839 Oct 26 05:15:46.536249 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1859/3727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:46 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:46.621055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:46.630842 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a39e2b0-72e0-40e1-be4e-3e26de137a18 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.654528 Oct 26 05:15:46.656710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:46.657924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:46.665191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.665950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.666561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.666953 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1869/3728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:45 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:46.667642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.668251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.668857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.672681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:46.673351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:46.681831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.682334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.682784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:46.683495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:46.683958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:46.684388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:47.061936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:47.078435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:47.078949 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8331ae99-594f-417e-a2cd-d3b4a2b07ce2 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 200 len: 1472 microversion: 2.1 time: 0.430180 Oct 26 05:15:47.087925 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b370a36-bc4b-4c7d-a0c8-ffa7d53c2f4f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.419777 Oct 26 05:15:47.102319 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1860/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:46 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:47.102973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1870/3730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:46 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:47.107342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:47.108177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:47.115969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:47.116707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:47.117837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:47.118975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:47.119588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:47.120175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:47.269489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dae8f4d0-aaab-4a51-9a38-1eb7a02f0790 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470a77d280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2085883917", "description": "tempest-description-52942858"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:47.562099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:47.578630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cd99c50d-7d4f-4ef5-b18b-9231a154d34d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.480634 Oct 26 05:15:47.581524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1861/3731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:47 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:47.604831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:47.605865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:47.616305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:47.617101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:47.619696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:47.626255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:47.628133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:47.633084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.073658 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dae8f4d0-aaab-4a51-9a38-1eb7a02f0790 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.969251 Oct 26 05:15:48.074928 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1871/3732] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:47 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:48.080258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-50e58549-bc4f-459c-9c7f-1553ca9bd2dc req-9c71d16e-e9d7-422c-a2ee-8811259775a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c79f9e-a919-4948-97a1-1bbf306f2bcf", "name": "network-vif-deleted", "tag": "80c7a31e-48cf-40b2-a8ee-98b44b4b22b5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:48.104422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:48.115712 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a0ffc6a-388c-44c7-93c2-6f0b7be8c540 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.512155 Oct 26 05:15:48.129637 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1862/3733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:47 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:48.135413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-50e58549-bc4f-459c-9c7f-1553ca9bd2dc req-9c71d16e-e9d7-422c-a2ee-8811259775a9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.136106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-50e58549-bc4f-459c-9c7f-1553ca9bd2dc req-9c71d16e-e9d7-422c-a2ee-8811259775a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.136569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-50e58549-bc4f-459c-9c7f-1553ca9bd2dc req-9c71d16e-e9d7-422c-a2ee-8811259775a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.142412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:48.143406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:48.158266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.158771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.159215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.159920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.160375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.164683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-50e58549-bc4f-459c-9c7f-1553ca9bd2dc req-9c71d16e-e9d7-422c-a2ee-8811259775a9 service nova] Creating event network-vif-deleted:80c7a31e-48cf-40b2-a8ee-98b44b4b22b5 for instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf on n-h1-862416-4 Oct 26 05:15:48.166659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.174453 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-50e58549-bc4f-459c-9c7f-1553ca9bd2dc req-9c71d16e-e9d7-422c-a2ee-8811259775a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097996 Oct 26 05:15:48.176273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1872/3734] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:48.195081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2d4f868-01e8-4716-8895-2c32c70a458c tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470aa76280>, body: {"security_group_rule": {"parent_group_id": "054c0f2a-96e0-4f0f-a4be-87b08e2257e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:48.595668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:48.616658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e46c032-4610-48fe-bff3-e0dc9e694981 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.485342 Oct 26 05:15:48.617255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1863/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:48 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:48.652041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:48.653295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e8c79f9e-a919-4948-97a1-1bbf306f2bcf] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:48.668386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.671155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.673215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.674523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.675373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.679155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.716240 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf could not be found. Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf HTTP/1.1 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf could not be found. Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e8c79f9e-a919-4948-97a1-1bbf306f2bcf'} Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf could not be found. Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf could not be found. Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:48.724430 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf could not be found. Oct 26 05:15:48.729025 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:15:48.737192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance e8c79f9e-a919-4948-97a1-1bbf306f2bcf could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:48.738796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88e6e506-0bfe-4e39-9dec-386373170b98 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf" status: 404 len: 111 microversion: 2.1 time: 0.098060 Oct 26 05:15:48.745212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1864/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:48 2022] GET /compute/v2.1/servers/e8c79f9e-a919-4948-97a1-1bbf306f2bcf => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:48.749380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:48.754380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:48.772746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.774748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.777490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.779706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.780649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.781329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.936760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2d4f868-01e8-4716-8895-2c32c70a458c tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.752384 Oct 26 05:15:48.937394 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1873/3737] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:15:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:48.950756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:48.951498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:48.965402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.966325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.967033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:48.968162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:48.968878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:48.969865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.157586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:49.166549 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9da7309-c3d2-4a3d-9a8a-07d3c7144d0a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.422749 Oct 26 05:15:49.167151 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1865/3738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:48 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:49.171952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:49.172451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:49.207475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.210715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.212306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.214213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.219693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.220413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.274765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:49.281400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:49.294654 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19274783-af98-4198-a88d-45ecfd14c155 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.347631 Oct 26 05:15:49.295743 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1874/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:48 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:49.309826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d77227e-49e1-4227-8933-83869ef93186 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470a0d55e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1017532529", "description": "tempest-description-178129794"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:49.523183 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83a5c252-9486-4117-8365-423a736d5266 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 204 len: 0 microversion: 2.1 time: 0.354753 Oct 26 05:15:49.528884 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1866/3740] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:49 2022] DELETE /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:49.535791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:49.538561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:49.561908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.562430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.562885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.566050 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d77227e-49e1-4227-8933-83869ef93186 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.268799 Oct 26 05:15:49.567851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1875/3741] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:49.568219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.568674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.569124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.574380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:49.575180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:49.599462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.603248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.605646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.607295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.609965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.610514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.665365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:49.843648 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ee514a5a-0e31-48b0-b68d-cd355e36df91 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 204 len: 0 microversion: 2.1 time: 0.273353 Oct 26 05:15:49.849622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1876/3742] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:49 2022] DELETE /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:49.857124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2f79b38-36dc-44b8-8b76-d19134801db2 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f4709b81c10>, body: {"security_group_rule": {"parent_group_id": "fd38f38f-cdbe-467c-8be2-afb5c3ff03f4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:49.893202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:49.922874 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b01d5eea-5f1f-4e17-8952-71ca10552ab9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.392680 Oct 26 05:15:49.924070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1867/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:49 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:49.929044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:49.934105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:49.942961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.943748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.944384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:49.945805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:49.947950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:49.950126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:50.266998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:50.276411 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4b6c036-5d70-4d84-85f3-01ec222ff25b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.351035 Oct 26 05:15:50.277002 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1868/3744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:49 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:50.286674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:50.287666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:50.294976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:50.295791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:50.296730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:50.297789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:50.298649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:50.299328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:50.323535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:50.342382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2f79b38-36dc-44b8-8b76-d19134801db2 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.490921 Oct 26 05:15:50.344054 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1877/3745] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:15:49 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:50.359257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:50.360722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:50.383974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:50.391913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:50.393039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:50.397133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:50.397956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:50.398697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:50.410544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:50.699003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:50.712341 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a440eff2-532e-4d90-8a5b-c8d33f3ffd31 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1475 microversion: 2.1 time: 0.427979 Oct 26 05:15:50.713256 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1869/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:50 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1475 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:50.724219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be6881a8-db59-43c4-96e3-3ae15417f053 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f47099e0700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1069618476", "description": "tempest-description-692436913"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:50.811888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:50.823313 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e631e733-6751-44d6-a01b-6db3f6ecb591 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.477715 Oct 26 05:15:50.825229 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1878/3747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:50 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:51.013362 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be6881a8-db59-43c4-96e3-3ae15417f053 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.297976 Oct 26 05:15:51.014387 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1870/3748] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:51.029201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6fcf496c-8348-471f-b620-78a7b7befb7c tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f4709b81c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-695271758", "description": "tempest-description-1154531057"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:51.304771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:51.306093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:51.319846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:51.320595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:51.321262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:51.323387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:51.325719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:51.326431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:51.405078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6fcf496c-8348-471f-b620-78a7b7befb7c tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.378597 Oct 26 05:15:51.416533 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1879/3749] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:51.449577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f21c0341-dce8-415d-ab8a-5a64b22cb548 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470aa76ee0>, body: {"security_group_rule": {"parent_group_id": "8c459d5c-c74b-4405-aa99-1530b88b9d2a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a4c953d7-b7c1-4685-900e-28bc4a91c767"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:51.711675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:51.730336 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-182e6edf-649a-422f-b0f7-a23a378e9608 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1516 microversion: 2.1 time: 0.430593 Oct 26 05:15:51.734714 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1871/3750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:51 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1516 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:51.753464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:51.755774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:51.772261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:51.778112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:51.778825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:51.781084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:51.781799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:51.784457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:52.290803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:52.301366 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6d46f3f-f080-404d-a7a2-1a28b2ab5a9f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1475 microversion: 2.1 time: 0.558813 Oct 26 05:15:52.304185 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1872/3751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:51 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1475 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:52.323785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:52.324468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:52.326997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:15:52.329378 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f21c0341-dce8-415d-ab8a-5a64b22cb548 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.910005 Oct 26 05:15:52.344589 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1880/3752] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:15:51 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:52.350221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccdc9650-f169-448b-ba2b-72ee447a021b tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470a2018b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1915938329", "description": "tempest-description-732850805"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:52.360039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:52.360855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:52.361355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:52.362158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:52.362688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:52.363470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:52.730910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:52.739812 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b7442a7-3ab1-49b3-930a-87a870473f7f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.434000 Oct 26 05:15:52.742535 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1873/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:52 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:52.763860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:52.764833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:52.783174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:52.784760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:52.788482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:52.789579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:52.790510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:52.791265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:52.835719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ccdc9650-f169-448b-ba2b-72ee447a021b tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.489631 Oct 26 05:15:52.845813 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1881/3754] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:52.857897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41f53e17-6863-4161-abcc-99db98a41d1a tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470a2175e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-452401947", "description": "tempest-description-699200246"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:53.204818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:53.215580 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b29ef0c3-ee00-4985-b420-56b34bb85f00 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1522 microversion: 2.1 time: 0.456205 Oct 26 05:15:53.219113 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1874/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:52 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:53.337653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:53.338726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:53.363628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:53.364671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:53.365124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:53.365876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:53.366341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:53.366787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:53.573602 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41f53e17-6863-4161-abcc-99db98a41d1a tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.726672 Oct 26 05:15:53.575212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1882/3756] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:53.590616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:53.592187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1604912a-9b35-45c5-9777-4ec1922eb9d2 req-6acd1ab0-6966-4e8e-a565-a649a248c47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c7e9c1-06d6-4967-92b1-2f2f09153754", "name": "network-vif-deleted", "tag": "eb9faf62-61f1-4905-80f8-f63931ef692c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:53.599228 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7dab1970-367c-48d7-99da-b8b373824ff8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1433 microversion: 2.1 time: 0.272592 Oct 26 05:15:53.599825 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1875/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:53 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1433 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:53.619615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1604912a-9b35-45c5-9777-4ec1922eb9d2 req-6acd1ab0-6966-4e8e-a565-a649a248c47d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:53.622701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1604912a-9b35-45c5-9777-4ec1922eb9d2 req-6acd1ab0-6966-4e8e-a565-a649a248c47d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:53.626427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1604912a-9b35-45c5-9777-4ec1922eb9d2 req-6acd1ab0-6966-4e8e-a565-a649a248c47d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:53.642626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1604912a-9b35-45c5-9777-4ec1922eb9d2 req-6acd1ab0-6966-4e8e-a565-a649a248c47d service nova] Creating event network-vif-deleted:eb9faf62-61f1-4905-80f8-f63931ef692c for instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 on n-h2-862416-4 Oct 26 05:15:53.644023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b9433b6-73a4-4baa-a10b-b2d902e77098 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f4709bb5f70>, body: {"security_group_rule": {"parent_group_id": "f8b7d789-4bf0-4da4-b1a7-167a99448568", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9c2ebd25-7316-471d-8cda-d10b8c3b29b2"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:53.651892 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1604912a-9b35-45c5-9777-4ec1922eb9d2 req-6acd1ab0-6966-4e8e-a565-a649a248c47d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074302 Oct 26 05:15:53.652983 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1883/3758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:53.767844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:53.770844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:53.783782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:53.786801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:53.791660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:53.792640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:53.795010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:53.795626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:54.215024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:54.222945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b9433b6-73a4-4baa-a10b-b2d902e77098 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.600660 Oct 26 05:15:54.224723 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1876/3759] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:15:53 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:54.233732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d802c80-e3a0-4ca5-ba51-631a1797fe9b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.469817 Oct 26 05:15:54.236865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-985117d7-73bf-41cd-b2cf-1bda4b21acfa tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f47099e05e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:54.238227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1884/3760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:53 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:54.255848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:54.256490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:54.263928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:54.264447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:54.265383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:54.266465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:54.266926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:54.267357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:54.688968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:54.713460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7d0442e-dd08-4143-abc6-db1118e13b18 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1522 microversion: 2.1 time: 0.474089 Oct 26 05:15:54.714055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1885/3761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:54 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:54.729830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:54.730656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:54.745013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:54.745970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:54.746583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:54.747512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:54.748145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:54.748777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:54.865403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:54.874131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5359fb0b-a741-450e-946c-774e357ab1a8 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1433 microversion: 2.1 time: 0.158841 Oct 26 05:15:54.874745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1886/3762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:54 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1433 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:54.923941 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-985117d7-73bf-41cd-b2cf-1bda4b21acfa tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9c2ebd25-7316-471d-8cda-d10b8c3b29b2" status: 202 len: 0 microversion: 2.1 time: 0.691410 Oct 26 05:15:54.925836 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1877/3763] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:54 2022] DELETE /compute/v2.1/os-security-groups/9c2ebd25-7316-471d-8cda-d10b8c3b29b2 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:15:54.935185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f622457c-3bb3-476a-bb99-06bd0ebaa342 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f470a227ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:55.049702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f622457c-3bb3-476a-bb99-06bd0ebaa342 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/f8b7d789-4bf0-4da4-b1a7-167a99448568" status: 200 len: 247 microversion: 2.1 time: 0.118422 Oct 26 05:15:55.050900 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1887/3764] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:15:54 2022] GET /compute/v2.1/os-security-groups/f8b7d789-4bf0-4da4-b1a7-167a99448568 => generated 247 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:55.070747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac5b888f-21b4-483d-a93b-f3346cb6287a tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f470998c280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1655356879", "description": "tempest-description-1147847961"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:55.262761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:55.264166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:55.283455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:55.286184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:55.287197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:55.290957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:55.291808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:55.292502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:55.342480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac5b888f-21b4-483d-a93b-f3346cb6287a tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.278686 Oct 26 05:15:55.344227 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1878/3765] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:15:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:55.359149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e0e2511-c932-4ce3-b8c4-eb898067afcd tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f4709934040>, body: {"security_group_rule": {"parent_group_id": "c775b6e5-d0f6-4a11-ad6e-79f91bda2d31", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:55.800102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:55.821555 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f4fdd71-a718-49a5-8828-7b073a311f41 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.564195 Oct 26 05:15:55.822144 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1888/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:55 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:55.829135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-bc34e517-6223-410d-9825-236ec5a60ff0 req-d00f1ff4-3f5c-4283-a13a-5ffadec25094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a60e804-2fa4-4840-8b63-cba29a9c55bc", "name": "network-vif-deleted", "tag": "b8519565-855d-4738-a1cb-8c878e604e0f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:55.840493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bc34e517-6223-410d-9825-236ec5a60ff0 req-d00f1ff4-3f5c-4283-a13a-5ffadec25094 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:55.840993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bc34e517-6223-410d-9825-236ec5a60ff0 req-d00f1ff4-3f5c-4283-a13a-5ffadec25094 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:55.841788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bc34e517-6223-410d-9825-236ec5a60ff0 req-d00f1ff4-3f5c-4283-a13a-5ffadec25094 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:55.869286 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-bc34e517-6223-410d-9825-236ec5a60ff0 req-d00f1ff4-3f5c-4283-a13a-5ffadec25094 service nova] Creating event network-vif-deleted:b8519565-855d-4738-a1cb-8c878e604e0f for instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc on n-h1-862416-4 Oct 26 05:15:55.882174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-bc34e517-6223-410d-9825-236ec5a60ff0 req-d00f1ff4-3f5c-4283-a13a-5ffadec25094 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058118 Oct 26 05:15:55.883980 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1889/3767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:55.891947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:55.892859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:55.946709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:55.949214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:55.951037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:55.960814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:55.963229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:55.964344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:55.972028 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e0e2511-c932-4ce3-b8c4-eb898067afcd tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.617922 Oct 26 05:15:55.982079 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1879/3768] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:15:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:55.988859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:55.990682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:55.997839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:55.998580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:55.999351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:56.000860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:56.001562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:56.002685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:56.061048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:56.061640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:56.062714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:56.063343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lazy-loading 'fault' on Instance uuid e2c7e9c1-06d6-4967-92b1-2f2f09153754 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:15:56.183648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:56.205502 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9833179-c446-4abc-94b9-ed65d523ea80 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 200 len: 1309 microversion: 2.1 time: 0.221662 Oct 26 05:15:56.206089 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1880/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:55 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:56.211495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a4a2b2e-0841-4f9d-9649-75c9b6ce22f8 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Action: 'create', calling method: .version_select at 0x7f47099d1ca0>, body: {"security_group_rule": {"parent_group_id": "c775b6e5-d0f6-4a11-ad6e-79f91bda2d31", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:56.375301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:56.383853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-072efa15-63dd-4eb5-8612-fe91ed84f929 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1522 microversion: 2.1 time: 0.497265 Oct 26 05:15:56.384864 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1890/3770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:55 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:56.573277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e32ba6c5-ce45-4c99-b034-a19b06871b4a req-944a9342-d2c9-49e7-bcfd-672d1da8f179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a559397-2c7c-45eb-8baf-24b76b3ed44c", "name": "network-vif-unplugged", "status": "completed", "tag": "55253328-935e-47a1-b261-547e499ce0f3"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:56.599641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e32ba6c5-ce45-4c99-b034-a19b06871b4a req-944a9342-d2c9-49e7-bcfd-672d1da8f179 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:56.603379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e32ba6c5-ce45-4c99-b034-a19b06871b4a req-944a9342-d2c9-49e7-bcfd-672d1da8f179 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:56.605562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e32ba6c5-ce45-4c99-b034-a19b06871b4a req-944a9342-d2c9-49e7-bcfd-672d1da8f179 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:56.652132 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e32ba6c5-ce45-4c99-b034-a19b06871b4a req-944a9342-d2c9-49e7-bcfd-672d1da8f179 service nova] Creating event network-vif-unplugged:55253328-935e-47a1-b261-547e499ce0f3 for instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c on n-h2-862416-4 Oct 26 05:15:56.680000 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a4a2b2e-0841-4f9d-9649-75c9b6ce22f8 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.472522 Oct 26 05:15:56.680707 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1881/3771] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:15:56 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:56.686360 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e32ba6c5-ce45-4c99-b034-a19b06871b4a req-944a9342-d2c9-49e7-bcfd-672d1da8f179 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119158 Oct 26 05:15:56.692956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05a51913-10b5-42cf-a1db-a40cce3cc603 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f470999f790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:56.694540 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1891/3772] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:56.774352 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05a51913-10b5-42cf-a1db-a40cce3cc603 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/c775b6e5-d0f6-4a11-ad6e-79f91bda2d31" status: 200 len: 665 microversion: 2.1 time: 0.084653 Oct 26 05:15:56.775521 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1882/3773] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:15:56 2022] GET /compute/v2.1/os-security-groups/c775b6e5-d0f6-4a11-ad6e-79f91bda2d31 => generated 665 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:15:56.794152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f189e59b-7b1f-43be-bcd7-6dda87f3caf0 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f4709e471f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:56.852919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:56.853585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:56.861136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:56.861992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:56.866779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:56.867991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:56.868676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:56.869516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.111722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:57.120188 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fc4cc9d-a90f-4f11-9f4d-317fb26b6f2b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.274412 Oct 26 05:15:57.134833 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1883/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:56 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:57.142895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f189e59b-7b1f-43be-bcd7-6dda87f3caf0 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/894b61c7-2a82-46ad-aa54-4b9a562a0dfd" status: 202 len: 0 microversion: 2.1 time: 0.353995 Oct 26 05:15:57.144186 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1892/3775] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 26 05:15:56 2022] DELETE /compute/v2.1/os-security-group-rules/894b61c7-2a82-46ad-aa54-4b9a562a0dfd => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:57.157240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-645c3258-906b-48fb-9676-14fff8f77cba tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f47099d19d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.239832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.240684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: e2c7e9c1-06d6-4967-92b1-2f2f09153754] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:57.249245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.250190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.251727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.252980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.253786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.254826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.273288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 could not be found. Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 HTTP/1.1 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 could not be found. Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e2c7e9c1-06d6-4967-92b1-2f2f09153754'} Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 could not be found. Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 could not be found. Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.276465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 could not be found. Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance e2c7e9c1-06d6-4967-92b1-2f2f09153754 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7805b6a1-0e6e-4c67-9cd9-58217682d26a tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754" status: 404 len: 111 microversion: 2.1 time: 0.048887 Oct 26 05:15:57.285416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1893/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:57 2022] GET /compute/v2.1/servers/e2c7e9c1-06d6-4967-92b1-2f2f09153754 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:57.292186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.293956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 5a60e804-2fa4-4840-8b63-cba29a9c55bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:57.301186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.301838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.302378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.303201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.303975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.304418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.326108 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc could not be found. Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc HTTP/1.1 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc could not be found. Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '5a60e804-2fa4-4840-8b63-cba29a9c55bc'} Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc could not be found. Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc could not be found. Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.328819 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc could not be found. Oct 26 05:15:57.337082 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.340804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance 5a60e804-2fa4-4840-8b63-cba29a9c55bc could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:57.340804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc084a3b-6b52-4226-aea7-d8628c13198d tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc" status: 404 len: 111 microversion: 2.1 time: 0.051030 Oct 26 05:15:57.340804 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1894/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:57 2022] GET /compute/v2.1/servers/5a60e804-2fa4-4840-8b63-cba29a9c55bc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:57.348643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45ec05ec-6bc5-4e71-ac47-d61505156d0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.386289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45ec05ec-6bc5-4e71-ac47-d61505156d0f tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d394639b-d1b0-4e15-80a4-5f77e6651892" status: 204 len: 0 microversion: 2.1 time: 0.041963 Oct 26 05:15:57.391783 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1895/3778] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:15:57 2022] DELETE /compute/v2.1/os-server-groups/d394639b-d1b0-4e15-80a4-5f77e6651892 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:15:57.405438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.406207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:57.455190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.455840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.456364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.457252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.458472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.459411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.493914 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-645c3258-906b-48fb-9676-14fff8f77cba tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c775b6e5-d0f6-4a11-ad6e-79f91bda2d31" status: 202 len: 0 microversion: 2.1 time: 0.341725 Oct 26 05:15:57.494879 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1884/3779] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/c775b6e5-d0f6-4a11-ad6e-79f91bda2d31 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:57.500313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.502110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:57.515865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.519120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.521148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.522083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:57.525609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.526302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.527370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.639637 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-33251ef4-085f-4336-a65b-84f507075ac4 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 204 len: 0 microversion: 2.1 time: 0.244676 Oct 26 05:15:57.641954 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1896/3780] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:57 2022] DELETE /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:57.654143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f470a0d5790>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.695216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:15:57.696685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Neutron security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:15:57.697568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] HTTP exception thrown: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.697568 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Request method failure captured: Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-security-groups/9c2ebd25-7316-471d-8cda-d10b8c3b29b2 HTTP/1.1 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMKCtovUsTAnxSSf4nlhH6bW4wTisR8munTz5nN9uzJQPFgAC-Q0QynQrrFTqIU-JUx_1Ujz3h2_KSKLPmi7CjS66sZwEzTghA6Too8ylX6HhUxNyfcjFbE63crrf57a6fYGHYa-1nPA2jjcqnFILj9WwoVSG2HMjQbjUc-OseUA31g Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6c615eadd4aa4459a8942d1c94a2eb08 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1648261138 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c615eadd4aa4459a8942d1c94a2eb08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c615eadd4aa4459a8942d1c94a2eb08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c615eadd4aa4459a8942d1c94a2eb08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c615eadd4aa4459a8942d1c94a2eb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1648261138 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6c615eadd4aa4459a8942d1c94a2eb08 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1648261138 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupRulesTestJSON-1648261138-project Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5b981be589a74eec92abdf8d7a52aed4 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1648261138-project Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '9c2ebd25-7316-471d-8cda-d10b8c3b29b2'} Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:15:57.706754 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] Oct 26 05:15:57.712966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:15:57.722487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Returning 404 to user: Security group 9c2ebd25-7316-471d-8cda-d10b8c3b29b2 does not exist Oct 26 05:15:57.722487 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-fba0f620-e6c4-4566-9743-82865057b7ca'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:15:57.724955 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60bed800-c50d-47aa-bd97-aab88cdb3321 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9c2ebd25-7316-471d-8cda-d10b8c3b29b2" status: 404 len: 194 microversion: 2.1 time: 0.080607 Oct 26 05:15:57.725767 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1897/3781] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/9c2ebd25-7316-471d-8cda-d10b8c3b29b2 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:15:57.741690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.743232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:57.761808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.762599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.763208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.764099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.764975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.765587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.771839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:57.781073 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-872464fb-462e-436c-af92-bc3b006fdbbd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1522 microversion: 2.1 time: 0.284747 Oct 26 05:15:57.781631 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1885/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:57 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:57.789751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-62e26bab-2acb-4e19-afc7-05a83d99850d tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f4709a56af0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.805195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:15:57.948425 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bcc2be5d-eebf-478c-81c0-34f1a54069fb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 204 len: 0 microversion: 2.1 time: 0.218162 Oct 26 05:15:57.952322 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1898/3783] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:15:57 2022] DELETE /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:15:57.964042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:57.964769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:57.975216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.977158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.977650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:57.978383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:57.978823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:57.980756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:58.421224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-62e26bab-2acb-4e19-afc7-05a83d99850d tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f8b7d789-4bf0-4da4-b1a7-167a99448568" status: 202 len: 0 microversion: 2.1 time: 0.638426 Oct 26 05:15:58.422753 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1886/3784] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:57 2022] DELETE /compute/v2.1/os-security-groups/f8b7d789-4bf0-4da4-b1a7-167a99448568 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:58.455189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:58.455816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:58.470999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:58.479048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:58.479924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:58.481852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:58.482975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:58.484801 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe005f5a-1d2f-4d0f-987d-12f3b75ec341 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1473 microversion: 2.1 time: 0.528512 Oct 26 05:15:58.485068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:58.485730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:58.498512 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1899/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:57 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1473 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:15:58.507751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c91525e-c736-4853-9a13-4a482b00b5ab tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f470a2270d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:58.778795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:58.787415 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02080cd8-6263-4a32-b3eb-69c0e122b4d4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.363095 Oct 26 05:15:58.793429 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1887/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:58 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:58.812871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:58.813647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:58.826888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:58.827813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:58.828489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:58.830325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:58.831005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:58.831617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:58.873119 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c91525e-c736-4853-9a13-4a482b00b5ab tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a4c953d7-b7c1-4685-900e-28bc4a91c767" status: 202 len: 0 microversion: 2.1 time: 0.385230 Oct 26 05:15:58.877205 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1900/3787] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:58 2022] DELETE /compute/v2.1/os-security-groups/a4c953d7-b7c1-4685-900e-28bc4a91c767 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:58.883883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b7667c2-71eb-4040-a7fc-118e426325b7 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f470a0d5d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:59.132377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:59.152917 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11a838ac-f6a8-4a41-861a-ba9386698fdb tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1522 microversion: 2.1 time: 0.348359 Oct 26 05:15:59.153752 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1888/3788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:58 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:15:59.295888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b7667c2-71eb-4040-a7fc-118e426325b7 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8c459d5c-c74b-4405-aa99-1530b88b9d2a" status: 202 len: 0 microversion: 2.1 time: 0.416963 Oct 26 05:15:59.300488 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1901/3789] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:58 2022] DELETE /compute/v2.1/os-security-groups/8c459d5c-c74b-4405-aa99-1530b88b9d2a => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:59.305961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-14138f25-9a59-4c21-9f0f-3579dea32e79 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f4709934b80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:59.511001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d49b29a4-e665-4ddf-b9f0-6a6520c81b58 req-e5791b7b-6cc5-45d1-84de-87cf00320931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a559397-2c7c-45eb-8baf-24b76b3ed44c", "name": "network-vif-plugged", "status": "completed", "tag": "55253328-935e-47a1-b261-547e499ce0f3"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:15:59.542938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d49b29a4-e665-4ddf-b9f0-6a6520c81b58 req-e5791b7b-6cc5-45d1-84de-87cf00320931 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:59.543517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d49b29a4-e665-4ddf-b9f0-6a6520c81b58 req-e5791b7b-6cc5-45d1-84de-87cf00320931 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:59.544230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d49b29a4-e665-4ddf-b9f0-6a6520c81b58 req-e5791b7b-6cc5-45d1-84de-87cf00320931 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:59.570800 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d49b29a4-e665-4ddf-b9f0-6a6520c81b58 req-e5791b7b-6cc5-45d1-84de-87cf00320931 service nova] Creating event network-vif-plugged:55253328-935e-47a1-b261-547e499ce0f3 for instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c on n-h2-862416-4 Oct 26 05:15:59.585168 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d49b29a4-e665-4ddf-b9f0-6a6520c81b58 req-e5791b7b-6cc5-45d1-84de-87cf00320931 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075351 Oct 26 05:15:59.588493 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1902/3790] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:15:59.604576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:59.607428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:59.633663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:59.635047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:59.635966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:59.637210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:59.637884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:59.638510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:59.817510 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-14138f25-9a59-4c21-9f0f-3579dea32e79 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/fd38f38f-cdbe-467c-8be2-afb5c3ff03f4" status: 202 len: 0 microversion: 2.1 time: 0.515456 Oct 26 05:15:59.818308 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1889/3791] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:59 2022] DELETE /compute/v2.1/os-security-groups/fd38f38f-cdbe-467c-8be2-afb5c3ff03f4 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:15:59.824350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:15:59.831122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:15:59.852075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:59.855236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:59.855785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:59.856600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:15:59.857359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:15:59.859771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:15:59.965156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:15:59.984854 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7fc2815-6d93-460d-ad6a-9efe78c9ae43 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1473 microversion: 2.1 time: 0.393445 Oct 26 05:15:59.990024 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1903/3792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:59 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:00.003069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-81ddd252-30c1-4214-a58d-a95c3b971207 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] Calling method '.version_select at 0x7f4709b7cf70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:00.124444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:00.143007 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-985e8055-7712-47b4-8602-8a296e51631c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.323368 Oct 26 05:16:00.144033 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1890/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:15:59 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:00.180751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:00.181881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:00.194294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:00.195995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:00.198029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:00.199040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:00.201115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:00.203100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:00.471587 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-81ddd252-30c1-4214-a58d-a95c3b971207 tempest-SecurityGroupRulesTestJSON-1648261138 tempest-SecurityGroupRulesTestJSON-1648261138-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/054c0f2a-96e0-4f0f-a4be-87b08e2257e6" status: 202 len: 0 microversion: 2.1 time: 0.474799 Oct 26 05:16:00.472075 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1904/3794] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:15:59 2022] DELETE /compute/v2.1/os-security-groups/054c0f2a-96e0-4f0f-a4be-87b08e2257e6 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:00.495089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:00.507160 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29fcefd5-19ca-40fa-b3fd-e3654dbc9f13 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1522 microversion: 2.1 time: 0.331134 Oct 26 05:16:00.507755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1891/3795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:00 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:01.015013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:01.015627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:01.026899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:01.027725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:01.028715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:01.034732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:01.035597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:01.036298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:01.171299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:01.174471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:01.191450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:01.192506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:01.193153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:01.198239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:01.198892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:01.199494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:01.847452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:01.868768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07a7484f-6199-462c-bc81-8bfce771e789 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1473 microversion: 2.1 time: 0.848430 Oct 26 05:16:01.871446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1905/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:01 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1473 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:01.875686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:01.887005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:01.890483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:01.892216 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-abb4eeaf-be73-436a-ba75-1f2ed709c1ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.725229 Oct 26 05:16:01.912539 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1892/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:01 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:01.915113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:01.916587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:01.917535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:01.920788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:01.922152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:01.925612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:01.975754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:02.013203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6cbf65e6-0864-448a-b8ee-988b5059c8de tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: .version_select at 0x7f47099d1790>, body: {"keypair": {"name": "tempest-keypair-561545558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJukMuAsbw6hEias0ojEdaT8/FewlOnAMFTDH2de5ZakzekdZutk+//VKubrDltP1Jt6/ZfyqbupUmJpq/SoLcAKXdx1qkXPbcz4kAMYrSZQTlh5l3KtGdHtIPWUh2F2Ng=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:02.068072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6cbf65e6-0864-448a-b8ee-988b5059c8de tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:02.090028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6cbf65e6-0864-448a-b8ee-988b5059c8de tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:02.150937 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6cbf65e6-0864-448a-b8ee-988b5059c8de tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141880 Oct 26 05:16:02.157990 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1893/3798] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:16:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:02.320318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:02.331724 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-683895d2-facc-44a2-822b-3437cbb287c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1507 microversion: 2.1 time: 0.455271 Oct 26 05:16:02.335297 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1906/3799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:01 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:02.368565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:02.369927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:02.383440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:02.384313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:02.385109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:02.386163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:02.386841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:02.387482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:02.695617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:02.712660 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d99634b9-725f-4f0c-af82-98c5d1fbce3c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 200 len: 1507 microversion: 2.1 time: 0.354806 Oct 26 05:16:02.714944 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1894/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:02 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:02.741551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:02.742323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:02.754442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:02.754969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:02.755422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:02.756314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:02.756640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:02.758141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:02.856270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:16:02.908585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:02.910099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:02.926085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:02.927154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:02.929990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:02.932734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:02.935763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:02.936438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:03.067040 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dfdf350d-7771-49ef-ad6c-1de306566af7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 204 len: 0 microversion: 2.1 time: 0.329982 Oct 26 05:16:03.069083 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1907/3801] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:02 2022] DELETE /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:16:03.080378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:03.086812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:03.106721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:03.111172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:03.112291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:03.114722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:03.117045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:03.118989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:03.417087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:03.427464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bdb71023-9965-4576-a921-7cc4596d8fbc tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 200 len: 1431 microversion: 2.1 time: 0.534575 Oct 26 05:16:03.428058 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1895/3802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:02 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 1431 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:03.458341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1125514751", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bac81520-1baa-4c42-8100-ebc9048d81f4"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:03.601799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] validate_networks() for [('bac81520-1baa-4c42-8100-ebc9048d81f4', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:16:03.829800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:03.847985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2b9c2840-1ccc-4af4-85b8-23a1a175aa2d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.775566 Oct 26 05:16:03.867794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1908/3803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:03 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:03.884341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-843b36b0-914e-49ae-b96f-8aa4b37a4478 req-6f99fd2c-6202-4556-9f6c-98d7da3299e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2aecf79-7575-4b25-95c2-58a59a2d7d35", "name": "network-vif-deleted", "tag": "7acab832-94d5-4e97-92d1-3e6916283146"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:03.907487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-843b36b0-914e-49ae-b96f-8aa4b37a4478 req-6f99fd2c-6202-4556-9f6c-98d7da3299e3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:03.911029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-843b36b0-914e-49ae-b96f-8aa4b37a4478 req-6f99fd2c-6202-4556-9f6c-98d7da3299e3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:03.913265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-843b36b0-914e-49ae-b96f-8aa4b37a4478 req-6f99fd2c-6202-4556-9f6c-98d7da3299e3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:03.947174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-843b36b0-914e-49ae-b96f-8aa4b37a4478 req-6f99fd2c-6202-4556-9f6c-98d7da3299e3 service nova] Creating event network-vif-deleted:7acab832-94d5-4e97-92d1-3e6916283146 for instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 on n-h1-862416-4 Oct 26 05:16:03.971629 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-843b36b0-914e-49ae-b96f-8aa4b37a4478 req-6f99fd2c-6202-4556-9f6c-98d7da3299e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093867 Oct 26 05:16:03.974119 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1909/3804] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:04.462511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:04.463402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: d2aecf79-7575-4b25-95c2-58a59a2d7d35] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:04.472182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.474666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.477601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:04.478809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.479756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.480667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:04.502399 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 could not be found. Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 HTTP/1.1 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 could not be found. Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd2aecf79-7575-4b25-95c2-58a59a2d7d35'} Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 could not be found. Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 could not be found. Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:04.505945 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 could not be found. Oct 26 05:16:04.513999 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:04.519433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance d2aecf79-7575-4b25-95c2-58a59a2d7d35 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:04.521534 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef78da34-93bf-434c-a476-2efc2d8dcbea tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35" status: 404 len: 111 microversion: 2.1 time: 0.069567 Oct 26 05:16:04.522771 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1910/3805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:04 2022] GET /compute/v2.1/servers/d2aecf79-7575-4b25-95c2-58a59a2d7d35 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:16:04.578703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:04.588082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:04.609112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.609559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.610289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:04.611470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.612196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.612903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:04.665110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.670254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.670721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:04.671302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lazy-loading 'fault' on Instance uuid 99d681fe-d1fc-45af-9272-6470713e3c1d {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:16:04.857111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:04.869061 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2c3ace7-33c3-4301-b9d7-6cff1958498b tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 200 len: 1308 microversion: 2.1 time: 0.316016 Oct 26 05:16:04.869983 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1911/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:04 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:04.897342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:04.899895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:04.913381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.920008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.924593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:04.930135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:04.931786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:04.936574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:05.599499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:05.616172 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56525952-5ede-41a9-958a-d1c885d93be3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.729384 Oct 26 05:16:05.623681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:16:05.624351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:16:05.624935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:16:05.625473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:16:05.626004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:16:05.644842 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1912/3807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:04 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:05.653887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:05.654690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:05.655346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:05.656304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:05.657003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:05.657687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:05.680454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Getting quotas for project 70a976fe749244c58556050fb4c7a70b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:05.689234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Getting quotas for user 9dc40bd8c6f54e0ba9a74a5844816c11 and project 70a976fe749244c58556050fb4c7a70b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:05.703525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:16:05.706417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:16:05.779375 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2faec79a-5724-4ec7-8800-20d45dc2de8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336753 Oct 26 05:16:05.782094 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1896/3808] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:16:05.795102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e6657ed-9fcf-464b-b9d8-7947c003653d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:05.795741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e6657ed-9fcf-464b-b9d8-7947c003653d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:05.924494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:05.927669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 99d681fe-d1fc-45af-9272-6470713e3c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:05.944813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:05.945556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:05.946255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:05.947090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:05.947840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:05.948524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:05.965821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:05.978474 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance 99d681fe-d1fc-45af-9272-6470713e3c1d could not be found. Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d HTTP/1.1 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 99d681fe-d1fc-45af-9272-6470713e3c1d could not be found. Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '99d681fe-d1fc-45af-9272-6470713e3c1d'} Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d681fe-d1fc-45af-9272-6470713e3c1d could not be found. Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d681fe-d1fc-45af-9272-6470713e3c1d could not be found. Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:05.980684 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d681fe-d1fc-45af-9272-6470713e3c1d could not be found. Oct 26 05:16:05.986866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:05.989285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance 99d681fe-d1fc-45af-9272-6470713e3c1d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:05.990376 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d390115b-0a94-4a38-85bb-a8b9deb51ef0 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d" status: 404 len: 111 microversion: 2.1 time: 0.098492 Oct 26 05:16:05.991437 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1897/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:05 2022] GET /compute/v2.1/servers/99d681fe-d1fc-45af-9272-6470713e3c1d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:06.004078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e733f66-7462-42e3-95e1-9546d3233418 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:06.056431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e6657ed-9fcf-464b-b9d8-7947c003653d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:06.072044 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e6657ed-9fcf-464b-b9d8-7947c003653d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1218 microversion: 2.1 time: 0.280692 Oct 26 05:16:06.089341 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1913/3810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:05 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:06.089341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0fc708ae-c47a-446f-919e-c449ba5b618b req-d4a39aef-3e6d-40f1-9597-a519055e11c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d681fe-d1fc-45af-9272-6470713e3c1d", "name": "network-vif-deleted", "tag": "de9c87dd-eab7-4e05-b333-119c6fc97fd8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:06.092855 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e733f66-7462-42e3-95e1-9546d3233418 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/b761d15b-bebf-4351-ad4c-fea51b5de71d" status: 204 len: 0 microversion: 2.1 time: 0.096249 Oct 26 05:16:06.094025 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1898/3811] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:16:05 2022] DELETE /compute/v2.1/os-server-groups/b761d15b-bebf-4351-ad4c-fea51b5de71d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:16:06.104096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:06.105857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:06.121331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0fc708ae-c47a-446f-919e-c449ba5b618b req-d4a39aef-3e6d-40f1-9597-a519055e11c8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.121899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0fc708ae-c47a-446f-919e-c449ba5b618b req-d4a39aef-3e6d-40f1-9597-a519055e11c8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.123516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0fc708ae-c47a-446f-919e-c449ba5b618b req-d4a39aef-3e6d-40f1-9597-a519055e11c8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:06.126979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.127856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.131191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:06.132207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.133715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.134421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:06.157634 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0fc708ae-c47a-446f-919e-c449ba5b618b req-d4a39aef-3e6d-40f1-9597-a519055e11c8 service nova] Creating event network-vif-deleted:de9c87dd-eab7-4e05-b333-119c6fc97fd8 for instance 99d681fe-d1fc-45af-9272-6470713e3c1d on n-h1-862416-4 Oct 26 05:16:06.171037 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0fc708ae-c47a-446f-919e-c449ba5b618b req-d4a39aef-3e6d-40f1-9597-a519055e11c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092053 Oct 26 05:16:06.181138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:16:06.181291 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1914/3812] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:06.390371 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82a1f8ce-cb22-4ffc-be16-7dab0d9a84da tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 204 len: 0 microversion: 2.1 time: 0.288043 Oct 26 05:16:06.391465 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1899/3813] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:06 2022] DELETE /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:16:06.402361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:06.403224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:06.413464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:06.418115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.425135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.425772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:06.427117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.428038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.428415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:06.661977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:06.663395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:06.685009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.688114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.688821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:06.698738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:06.705160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:06.705872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:07.040577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:07.049505 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b5cda42-d2d8-4d04-b929-f01c856cf3a1 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1471 microversion: 2.1 time: 0.653581 Oct 26 05:16:07.050100 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1915/3814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:06 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1471 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:07.099011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:07.099648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:07.113192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:07.116470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:07.116949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:07.117734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:07.118218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:07.118661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:07.298485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:07.311849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:07.321879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99f7d651-9c16-4d9f-b817-cbe9d3118121 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1214 microversion: 2.1 time: 0.226593 Oct 26 05:16:07.323326 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1dd24ccf-6520-4038-b5e0-74bbf79a6d3f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.667555 Oct 26 05:16:07.325033 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1916/3815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:07 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:07.325954 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1900/3816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:06 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:08.073873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:08.075875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:08.092586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:08.093789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:08.096652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:08.097784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:08.098977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:08.118384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:08.252527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c022b932-2171-4adc-9e78-9fa0ccd7503b req-867595eb-334f-4b72-92c8-21683e599110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a559397-2c7c-45eb-8baf-24b76b3ed44c", "name": "network-vif-deleted", "tag": "55253328-935e-47a1-b261-547e499ce0f3"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:08.276280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c022b932-2171-4adc-9e78-9fa0ccd7503b req-867595eb-334f-4b72-92c8-21683e599110 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:08.277104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c022b932-2171-4adc-9e78-9fa0ccd7503b req-867595eb-334f-4b72-92c8-21683e599110 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:08.278549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c022b932-2171-4adc-9e78-9fa0ccd7503b req-867595eb-334f-4b72-92c8-21683e599110 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:08.304131 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c022b932-2171-4adc-9e78-9fa0ccd7503b req-867595eb-334f-4b72-92c8-21683e599110 service nova] Creating event network-vif-deleted:55253328-935e-47a1-b261-547e499ce0f3 for instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c on n-h2-862416-4 Oct 26 05:16:08.319354 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c022b932-2171-4adc-9e78-9fa0ccd7503b req-867595eb-334f-4b72-92c8-21683e599110 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070461 Oct 26 05:16:08.320580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1901/3817] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:08.354384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:08.355579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:08.365569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:08.368559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:08.369740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:08.370665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:08.371795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:08.373116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:08.992437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:09.011391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed2c7537-e33d-470c-bb30-2a3419b264f5 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1471 microversion: 2.1 time: 0.942794 Oct 26 05:16:09.029810 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1917/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:08 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1471 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:09.040386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:09.042485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:09.070904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:09.072153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:09.072941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:09.079076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:09.080685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:09.081436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:09.167113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:09.219476 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9bf220a-4cb3-4285-bec0-d9451dab7ebc tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.870624 Oct 26 05:16:09.231692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:09.246028 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-20ffe6c3-acc7-412a-8a71-43c72c66b2c2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1276 microversion: 2.1 time: 0.214518 Oct 26 05:16:09.246455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1902/3819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:08 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:09.252716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-18230619", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dfe50ec-535f-4512-94ac-24b3da81845a"}], "security_groups": [{"name": "tempest-securitygroup--1749452727"}], "key_name": "tempest-keypair-561545558", "user_data": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:09.266114 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1918/3820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:09 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:09.528131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] validate_networks() for [('4dfe50ec-535f-4512-94ac-24b3da81845a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:16:10.037127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:10.038006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:10.044470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.056094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.057029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.058066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.058752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.059406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.200951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:10.209218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f158d1c2-8d8c-47fe-82cb-8364ce9bb0f9 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1429 microversion: 2.1 time: 0.176220 Oct 26 05:16:10.213112 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1919/3821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:10 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1429 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:10.250528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:10.251187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:10.264929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.265460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.265905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.269196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.269705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.270712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.312946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:16:10.314295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:16:10.316709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:16:10.317989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:16:10.321998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:16:10.346346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.349857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.350512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.356452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.357371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.357948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.399030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:10.409305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:10.505838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:16:10.508145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:16:10.534155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:10.545207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8132e5e1-74ef-455a-9537-a29706226989 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1524 microversion: 2.1 time: 0.298583 Oct 26 05:16:10.546810 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1920/3822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:10 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1524 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:10.554149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:10.555145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:10.562603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.563360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.564016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.564917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.565573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.566167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.686205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:10.691708 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac51ccbd-0552-4413-b681-355b87093c66 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.435655 Oct 26 05:16:10.698566 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-28c3be93-9851-40b2-b722-7ef71c715639 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1276 microversion: 2.1 time: 0.148936 Oct 26 05:16:10.698735 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1903/3823] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:16:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:16:10.710278 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1921/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:10 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:10.710533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-bd701ced-aa98-483f-a892-b91768d038fb req-9b9e8f01-87b0-4f02-99f1-010b06ff4901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01534544-bfd6-4966-ae95-7dd5271c956f", "name": "network-vif-deleted", "tag": "ad3ac6ca-a0ca-4241-8d8b-4b347431b29d"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:10.725587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc6b8316-4dc6-4723-bb46-97cc97614e4d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:10.726444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc6b8316-4dc6-4723-bb46-97cc97614e4d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:10.744686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd701ced-aa98-483f-a892-b91768d038fb req-9b9e8f01-87b0-4f02-99f1-010b06ff4901 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:10.745180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd701ced-aa98-483f-a892-b91768d038fb req-9b9e8f01-87b0-4f02-99f1-010b06ff4901 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:10.745652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd701ced-aa98-483f-a892-b91768d038fb req-9b9e8f01-87b0-4f02-99f1-010b06ff4901 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:10.760416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-bd701ced-aa98-483f-a892-b91768d038fb req-9b9e8f01-87b0-4f02-99f1-010b06ff4901 service nova] Creating event network-vif-deleted:ad3ac6ca-a0ca-4241-8d8b-4b347431b29d for instance 01534544-bfd6-4966-ae95-7dd5271c956f on n-h2-862416-4 Oct 26 05:16:10.766375 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-bd701ced-aa98-483f-a892-b91768d038fb req-9b9e8f01-87b0-4f02-99f1-010b06ff4901 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066489 Oct 26 05:16:10.767338 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1904/3825] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:10.803930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc6b8316-4dc6-4723-bb46-97cc97614e4d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:10.812394 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc6b8316-4dc6-4723-bb46-97cc97614e4d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1239 microversion: 2.1 time: 0.099619 Oct 26 05:16:10.813286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1922/3826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:10 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:11.238461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:11.239559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:11.245561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:11.247885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.248975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.249762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:11.250725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.251353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.252128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:11.296466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.297540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.298149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:11.298783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lazy-loading 'fault' on Instance uuid 01534544-bfd6-4966-ae95-7dd5271c956f {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:16:11.349487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d7f43e1be74767ba46fcd3ab436d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4c1e5717cb42bebda3fbe1433f2cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:11.362977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ff0a79a-24f8-4341-9221-0e242dc556cb tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 200 len: 1307 microversion: 2.1 time: 0.129202 Oct 26 05:16:11.365214 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1905/3827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:11 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:11.584928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:11.586154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:11.606723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.609627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.610321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:11.611902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.613598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.615438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:11.729708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:11.730331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:11.736374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.736873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.737330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:11.738043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:11.738497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:11.743939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:12.056486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:12.068236 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84224c08-c796-465a-91a6-fec8eb4a564f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1506 microversion: 2.1 time: 0.495710 Oct 26 05:16:12.084793 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1923/3828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:11 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:12.092637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:12.093753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:12.101827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:12.102889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:12.103499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:12.104266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:12.104730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:12.105551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:12.142558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:12.162416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cbaff42e-5818-4cbf-9c63-90e3b707ad93 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.437268 Oct 26 05:16:12.163008 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1906/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:11 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:12.197881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:12.211402 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84b219d5-7f0a-4624-a462-de9b176c61be tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1291 microversion: 2.1 time: 0.137274 Oct 26 05:16:12.212076 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1924/3830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:12 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1291 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:12.393450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:12.395462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] [instance: 01534544-bfd6-4966-ae95-7dd5271c956f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:12.403490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:12.404937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:12.405654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:12.406552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:12.407593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:12.408357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:12.431461 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] HTTP exception thrown: Instance 01534544-bfd6-4966-ae95-7dd5271c956f could not be found. Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Request method failure captured: Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f HTTP/1.1 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMHPmat-4qwSbBgbIAXQyc_d15wpURXKX63OpyHRLOAFzgNuLn2sbXwcjp4_COGETfLl1-8SuqpsILR2OfhKbUoOooRGeCPLSQQWjvUeWO_aFWHPW6Rp0vvOb9aox2O2g_MUkZZUuUZdX9udgoTi2QNPdVOxnR_glPve-g9mVsb-ToQ Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da4c1e5717cb42bebda3fbe1433f2cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: da4c1e5717cb42bebda3fbe1433f2cd7 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1750475993 Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a8d7f43e1be74767ba46fcd3ab436d2d Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersOnMultiNodesTest-1750475993-project Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 01534544-bfd6-4966-ae95-7dd5271c956f could not be found. Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '01534544-bfd6-4966-ae95-7dd5271c956f'} Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01534544-bfd6-4966-ae95-7dd5271c956f could not be found. Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01534544-bfd6-4966-ae95-7dd5271c956f could not be found. Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:12.447732 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01534544-bfd6-4966-ae95-7dd5271c956f could not be found. Oct 26 05:16:12.453353 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:12.455640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] Returning 404 to user: Instance 01534544-bfd6-4966-ae95-7dd5271c956f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:12.456773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b103ae43-b6ef-488c-adad-78d5d4398f09 tempest-ServersOnMultiNodesTest-1750475993 tempest-ServersOnMultiNodesTest-1750475993-project] 10.222.0.16 "GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f" status: 404 len: 111 microversion: 2.1 time: 0.067463 Oct 26 05:16:12.461134 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1907/3831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:12 2022] GET /compute/v2.1/servers/01534544-bfd6-4966-ae95-7dd5271c956f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:13.093961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:13.096229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:13.109518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.110261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.111489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.112904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.113985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.116311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.124942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:13.187285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:13.188147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:13.199308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.199920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.200549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.202199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.204368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.205066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.584096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:13.598940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97930a44-8f93-405e-970a-9f8da58751a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1506 microversion: 2.1 time: 0.510694 Oct 26 05:16:13.615453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:13.616001 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1925/3832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:13 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:13.626690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c99fa6d9-fb46-4b02-96e6-f1df9b317b28 req-23ab185d-8064-4b47-9ec7-1d7a62846b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb9eec7-763a-4a86-931d-7cf61d767f19", "tag": "231634bb-0ed0-4a7f-a7b1-060c89d19b60"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:13.628224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ead9b9d-8ac0-4a30-b983-c11ed9c8f473 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.445262 Oct 26 05:16:13.639124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c99fa6d9-fb46-4b02-96e6-f1df9b317b28 req-23ab185d-8064-4b47-9ec7-1d7a62846b94 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.639676 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1908/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:13 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:13.640161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c99fa6d9-fb46-4b02-96e6-f1df9b317b28 req-23ab185d-8064-4b47-9ec7-1d7a62846b94 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.641452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c99fa6d9-fb46-4b02-96e6-f1df9b317b28 req-23ab185d-8064-4b47-9ec7-1d7a62846b94 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.645986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:13.647899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:13.655437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.655929 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c99fa6d9-fb46-4b02-96e6-f1df9b317b28 req-23ab185d-8064-4b47-9ec7-1d7a62846b94 service nova] Creating event network-changed:231634bb-0ed0-4a7f-a7b1-060c89d19b60 for instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 on n-h1-862416-4 Oct 26 05:16:13.656393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.657039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.657996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.661621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.662163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.666951 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c99fa6d9-fb46-4b02-96e6-f1df9b317b28 req-23ab185d-8064-4b47-9ec7-1d7a62846b94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048709 Oct 26 05:16:13.668081 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1926/3834] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:13.752723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:13.761334 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-26bc08ce-ef33-4147-aefc-30c0a0b9d9af tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1297 microversion: 2.1 time: 0.120377 Oct 26 05:16:13.761936 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1909/3835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:13 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:13.845875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-42b9fccb-9186-4c14-8823-dd735cf94607 req-9fffcb99-8981-490d-b698-47073d4bc6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f", "name": "network-vif-unplugged", "status": "completed", "tag": "013a77ed-1e88-42f4-98fd-3a6567b8e685"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:13.862710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-42b9fccb-9186-4c14-8823-dd735cf94607 req-9fffcb99-8981-490d-b698-47073d4bc6c1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:13.863474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-42b9fccb-9186-4c14-8823-dd735cf94607 req-9fffcb99-8981-490d-b698-47073d4bc6c1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:13.864021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-42b9fccb-9186-4c14-8823-dd735cf94607 req-9fffcb99-8981-490d-b698-47073d4bc6c1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:13.883829 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-42b9fccb-9186-4c14-8823-dd735cf94607 req-9fffcb99-8981-490d-b698-47073d4bc6c1 service nova] Creating event network-vif-unplugged:013a77ed-1e88-42f4-98fd-3a6567b8e685 for instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f on n-h2-862416-4 Oct 26 05:16:13.893227 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-42b9fccb-9186-4c14-8823-dd735cf94607 req-9fffcb99-8981-490d-b698-47073d4bc6c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223599 Oct 26 05:16:13.893964 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1927/3836] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:14.628193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:14.630147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:14.637223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:14.637763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:14.638210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:14.638925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:14.639542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:14.639982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:14.672335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:14.674532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:14.686321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:14.687813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:14.688256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:14.689145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:14.689799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:14.690337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:15.168688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:15.198354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:15.198563 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5ff2959-527f-4db3-b4c6-34b2ba67646d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 200 len: 1509 microversion: 2.1 time: 0.572844 Oct 26 05:16:15.200143 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1910/3837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:14 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:15.211340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:15.212273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:15.213910 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f6282c5-7dfd-4d54-8204-6ed5a1374859 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.550207 Oct 26 05:16:15.216426 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1928/3838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:14 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:15.235276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:15.235789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:15.236762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:15.237638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:15.239187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:15.241922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:15.244517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:15.245030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:15.258577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:15.260382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:15.262268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:15.265971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:15.266744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:15.268805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:15.339499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:16:15.359831 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Working on deleting snapshot 50629b27-cebc-4dd8-9ea0-b5ae2178d3ca from shelved instance... Oct 26 05:16:15.557218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:15.571993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-38d19843-a101-41e0-a65d-c504d8ff751f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.363891 Oct 26 05:16:15.574113 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1911/3839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:15 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:16.243027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:16.243723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:16.250857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:16.251242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:16.251689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:16.252401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:16.265374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:16.265953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:16.547893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Doing local delete in cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=120586) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 26 05:16:16.549434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:16.551718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:16.552436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:16.553145 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 26 05:16:16.557215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] deallocate_for_instance() {{(pid=120586) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 26 05:16:16.601398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:16.612721 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1e3b329-a4d4-4007-96b4-bf2300dac773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.373782 Oct 26 05:16:16.613349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1912/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:16 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:16.630018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:16.631018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:16.643221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:16.643929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:16.644542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:16.646817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:16.647488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:16.648152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:17.188874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:17.199130 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23a9a7f2-98bc-46a6-ab75-60083d94d129 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.580398 Oct 26 05:16:17.202815 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1913/3841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:16 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:17.641259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3c4576cb-70f6-4546-80d6-389e6c0fd6a4 req-01c84bfe-a273-477b-ba3c-67dcdaffce23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da72c67d-c2eb-4917-9051-70592110c760", "tag": "8048d852-5511-4a0d-9f3e-7a9f39f4adbc"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:17.657985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3c4576cb-70f6-4546-80d6-389e6c0fd6a4 req-01c84bfe-a273-477b-ba3c-67dcdaffce23 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:17.658475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3c4576cb-70f6-4546-80d6-389e6c0fd6a4 req-01c84bfe-a273-477b-ba3c-67dcdaffce23 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:17.663850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3c4576cb-70f6-4546-80d6-389e6c0fd6a4 req-01c84bfe-a273-477b-ba3c-67dcdaffce23 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:17.677364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3c4576cb-70f6-4546-80d6-389e6c0fd6a4 req-01c84bfe-a273-477b-ba3c-67dcdaffce23 service nova] Creating event network-changed:8048d852-5511-4a0d-9f3e-7a9f39f4adbc for instance da72c67d-c2eb-4917-9051-70592110c760 on n-h2-862416-4 Oct 26 05:16:17.694351 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3c4576cb-70f6-4546-80d6-389e6c0fd6a4 req-01c84bfe-a273-477b-ba3c-67dcdaffce23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.486824 Oct 26 05:16:17.694988 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1914/3842] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:17.707527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:17.716755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:17.741461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:17.744040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:17.744544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:17.745292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:17.745789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:17.746224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:17.831136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Updating instance_info_cache with network_info: [] {{(pid=120586) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:16:17.899719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:17.920866 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b17b1278-6383-4380-a3e0-e997f5a342a6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.217256 Oct 26 05:16:17.929228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1915/3843] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:16:17 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:17.939978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:17.941251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:17.952417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:17.953216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:17.953872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:17.954754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:17.955387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:17.955990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.170925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:18.172799 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd921d4c-b9aa-42ff-bc6b-46d510b06f5c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 204 len: 0 microversion: 2.1 time: 2.946582 Oct 26 05:16:18.176960 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1929/3844] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:15 2022] DELETE /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 0 bytes in 2949 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:16:18.199908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-796ddf0c-4f77-47e9-9898-18760c914ba8 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.262250 Oct 26 05:16:18.214212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1916/3845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:17 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:18.242228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:18.243131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:18.257152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.257679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.258130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.259093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.259468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.259933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.303865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2110598610", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:18.406440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:16:18.407625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:16:18.408338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:16:18.409016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:16:18.409726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:16:18.435844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.440198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.440661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.441489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.442496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.442942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.478557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Getting quotas for project 248f23e7e5db4d13b008a504c22dc0ab. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:18.486581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Getting quotas for user f8736c83fce1403bac00ae7d0a01a3b5 and project 248f23e7e5db4d13b008a504c22dc0ab. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:18.503959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:16:18.507497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:18.508544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:16:18.518413 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3d9dc751-880a-4ec8-be25-9e6215a8185a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1670 microversion: 2.1 time: 0.282709 Oct 26 05:16:18.530882 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1917/3846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:18 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1670 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:18.542076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:18.542764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:18.549793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.550318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.550795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.551652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.552296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.552738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.572288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88e5fc63-1940-432c-8e9d-65d91766e38e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.393377 Oct 26 05:16:18.572561 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f HTTP/1.1 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f'} Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:18.574541 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a7d9f22-5172-4413-9828-f1d7c306afbf tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 404 len: 111 microversion: 2.1 time: 0.045452 Oct 26 05:16:18.579412 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1918/3847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:18 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:18.589812 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1930/3848] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:16:18.590057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:18.590057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:18.597394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c4dbd20-6fbd-4864-8fc6-f67c024dd363 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:18.597394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c4dbd20-6fbd-4864-8fc6-f67c024dd363 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:18.606541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.607203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.607754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.609165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:18.609165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:18.613719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:18.669935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c4dbd20-6fbd-4864-8fc6-f67c024dd363 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:18.680605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c4dbd20-6fbd-4864-8fc6-f67c024dd363 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:18.682094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c4dbd20-6fbd-4864-8fc6-f67c024dd363 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:18.699089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c4dbd20-6fbd-4864-8fc6-f67c024dd363 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1454 microversion: 2.91 time: 0.113252 Oct 26 05:16:18.699684 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1931/3849] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:18 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:18.773423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1834840087", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:18.855792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:18.867704 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-851c049f-9b3d-488d-8e7f-838ca4f493f5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.288618 Oct 26 05:16:18.868291 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1919/3850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:18 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:18.918686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:16:19.229695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:19.230414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:19.241342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.242435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.243122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.244108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.244797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.249948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.568871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:16:19.569679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:16:19.570364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:16:19.570952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:16:19.571733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:16:19.584740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:19.587260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.587757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.588416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.589880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.590827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.591460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.599827 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10df4073-c595-49aa-ad30-f8d469830cfa tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.373657 Oct 26 05:16:19.600382 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1920/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:19 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:19.612066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:19.619195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:19.635732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:16:19.636047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:19.636677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:19.638636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:16:19.646970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.653874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.655777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.656811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.657456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.658135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.707273 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-47ded52f-bff0-4fdd-a999-d610336f920d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940901 Oct 26 05:16:19.709178 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1932/3852] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:16:19.715195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d05656eb-3dc3-44b7-9c02-a55b9ca2985c req-e81af8e3-a482-45ed-aed2-aca6a2cd86f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f", "name": "network-vif-deleted", "tag": "013a77ed-1e88-42f4-98fd-3a6567b8e685"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:19.730225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d05656eb-3dc3-44b7-9c02-a55b9ca2985c req-e81af8e3-a482-45ed-aed2-aca6a2cd86f2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.730868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d05656eb-3dc3-44b7-9c02-a55b9ca2985c req-e81af8e3-a482-45ed-aed2-aca6a2cd86f2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.731406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d05656eb-3dc3-44b7-9c02-a55b9ca2985c req-e81af8e3-a482-45ed-aed2-aca6a2cd86f2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.775138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.compute.server_external_events [req-d05656eb-3dc3-44b7-9c02-a55b9ca2985c req-e81af8e3-a482-45ed-aed2-aca6a2cd86f2 service nova] Unable to find a host for instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f. Dropping event network-vif-deleted {{(pid=120586) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 05:16:19.776732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d05656eb-3dc3-44b7-9c02-a55b9ca2985c req-e81af8e3-a482-45ed-aed2-aca6a2cd86f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.065866 Oct 26 05:16:19.777721 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1933/3853] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 05:16:19.787533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3de39604-ffaa-4c73-ae42-28fb541613d0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:19.788247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3de39604-ffaa-4c73-ae42-28fb541613d0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:19.881800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3de39604-ffaa-4c73-ae42-28fb541613d0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:19.895845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:19.898932 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3de39604-ffaa-4c73-ae42-28fb541613d0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1215 microversion: 2.1 time: 0.119958 Oct 26 05:16:19.901423 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1934/3854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:19 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:19.906002 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba8a9bf3-2f20-422a-9afa-41d8d3fa63e6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1670 microversion: 2.1 time: 0.283859 Oct 26 05:16:19.917361 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1921/3855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:19 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1670 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:19.917361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:19.917361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:19.923493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.927673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.929368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.930300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.930951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.934956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.938383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:19.939135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:19.952870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.953609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.954448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:19.955295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:19.955900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:19.957019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.170501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:20.185659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:20.187333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:20.210415 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-efae5779-45e1-41b9-96de-8f1c6d8e3a83 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1458 microversion: 2.91 time: 0.307646 Oct 26 05:16:20.222421 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1935/3856] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:19 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1458 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:20.375144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:20.391002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:20.408373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e31d4727-9a26-41e0-b88a-5fedf0cb9703 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.500420 Oct 26 05:16:20.413203 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1922/3857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:19 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:20.614420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0dbcf2c0-7240-4408-8f38-e9377e576f08 req-b9be4d04-b535-4452-81ed-121426126dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb9eec7-763a-4a86-931d-7cf61d767f19", "name": "network-vif-plugged", "status": "completed", "tag": "231634bb-0ed0-4a7f-a7b1-060c89d19b60"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:20.627644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:20.628511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:20.630538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dbcf2c0-7240-4408-8f38-e9377e576f08 req-b9be4d04-b535-4452-81ed-121426126dc7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:20.631409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=16 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:20.632117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dbcf2c0-7240-4408-8f38-e9377e576f08 req-b9be4d04-b535-4452-81ed-121426126dc7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:20.633804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dbcf2c0-7240-4408-8f38-e9377e576f08 req-b9be4d04-b535-4452-81ed-121426126dc7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.653174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0dbcf2c0-7240-4408-8f38-e9377e576f08 req-b9be4d04-b535-4452-81ed-121426126dc7 service nova] Creating event network-vif-plugged:231634bb-0ed0-4a7f-a7b1-060c89d19b60 for instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 on n-h1-862416-4 Oct 26 05:16:20.661565 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0dbcf2c0-7240-4408-8f38-e9377e576f08 req-b9be4d04-b535-4452-81ed-121426126dc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051882 Oct 26 05:16:20.662827 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1936/3858] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:20.668835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:20.669701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:20.670305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.671033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:20.672572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:20.673029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.929079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:20.930052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:20.960334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:20.968089 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8a2d88b-fb78-411d-8383-98900da470c1 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.345282 Oct 26 05:16:20.983445 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1923/3859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:20 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:20.983668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:20.983668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:20.983668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.983668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:20.983668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:20.983668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.984532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:20.984846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:20.996686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:20.997233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:20.997731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:20.998571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:21.000192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:21.000697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:21.628670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:21.640516 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-101c8a1d-5d98-43d9-898c-ca2592ecbb9e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1219 microversion: 2.1 time: 0.718750 Oct 26 05:16:21.649368 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1937/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:20 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1219 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:21.667024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:21.668080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:21.685560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:21.686085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:21.686544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:21.687274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:21.687746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:21.688185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:21.796060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:21.810434 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71a16b6d-029b-4217-abaa-c9b36d7435ff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1675 microversion: 2.1 time: 0.828111 Oct 26 05:16:21.811042 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1924/3861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:20 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1675 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:21.826397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:21.827336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:21.831891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:21.836032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:21.836640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:21.841372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:21.841372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:21.841372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:21.841372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:21.842072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:21.851665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:21.859926 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-076daccd-b606-4dd8-a9c0-4f89b76dd6ec tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1512 microversion: 2.91 time: 0.204811 Oct 26 05:16:21.870233 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1938/3862] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:21 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:21.991507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:21.992307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:22.027089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.029129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.029812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.032320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.033011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.036614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.132781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:22.142669 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee69015e-12c8-445d-85fc-10b4a27e29c3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.330369 Oct 26 05:16:22.157993 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1925/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:21 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:22.385899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:22.394258 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-87ece207-710c-429b-bd6f-e1e756757341 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1318 microversion: 2.1 time: 0.407599 Oct 26 05:16:22.412995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1939/3864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:21 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:22.672260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:22.672795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:22.680865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.681373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.682017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.682888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.683682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.684121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.752660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:22.762347 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7073bb77-81f7-4ece-b652-d5d2ebfde1f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1275 microversion: 2.1 time: 0.094244 Oct 26 05:16:22.763484 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1926/3865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:22 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:22.836768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:22.837418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:22.845534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.846608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.847370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.848867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.849650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.850310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.890337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:22.890944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:22.898796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.899286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.899722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:22.902722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:22.905925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:22.906389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.020624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.052660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.056934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.070978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.073918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23f0842d-b618-4031-b7f3-dab0dde1cce1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1512 microversion: 2.91 time: 0.186311 Oct 26 05:16:23.075279 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1927/3866] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:22 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:23.088838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8205a696-5781-48d5-b95d-15966c7d8880 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.255947 Oct 26 05:16:23.090266 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1940/3867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:22 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:23.173508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:23.174468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:23.194677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.195378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.196103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.199655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.202245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.203296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.419465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.427512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:23.428142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:23.430187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:23.433066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50b0bea3-e332-4ab0-bdf5-235f7d83a931 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.263254 Oct 26 05:16:23.434901 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1928/3868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:23 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:23.451533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.452042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.452491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.453769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.454403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.455012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.479748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:23.636735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.646155 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abd0d376-9519-43d2-8074-97e73f77b7dc tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1509 microversion: 2.1 time: 0.223040 Oct 26 05:16:23.650096 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1941/3869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:23 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:23.670979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:23.672523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:23.689793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.690842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.691452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.693110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.693745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.694509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.787524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:23.788152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:23.799521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.801350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.802163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.804296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:23.805025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:23.807899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:23.952807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.955556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:23.965116 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df156d25-85e3-4809-9142-43ff3980e9c6 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1509 microversion: 2.1 time: 0.299137 Oct 26 05:16:23.966987 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0c2647ce-4903-475a-9371-792e9726a82e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1275 microversion: 2.1 time: 0.184316 Oct 26 05:16:23.968669 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1929/3870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:23 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:23.991111 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1942/3871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:23 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:23.992869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:23.995528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:24.008448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.009098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.009740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.012017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.012613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.020948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.114682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e370c2df-560b-4e4b-9f67-6fa784a8c1b6 req-44f0f21a-bfbc-4cb5-840a-717a00cc0bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da72c67d-c2eb-4917-9051-70592110c760", "name": "network-vif-plugged", "status": "completed", "tag": "8048d852-5511-4a0d-9f3e-7a9f39f4adbc"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:24.137338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e370c2df-560b-4e4b-9f67-6fa784a8c1b6 req-44f0f21a-bfbc-4cb5-840a-717a00cc0bb9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.137882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e370c2df-560b-4e4b-9f67-6fa784a8c1b6 req-44f0f21a-bfbc-4cb5-840a-717a00cc0bb9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.143882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e370c2df-560b-4e4b-9f67-6fa784a8c1b6 req-44f0f21a-bfbc-4cb5-840a-717a00cc0bb9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.190397 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c66e757-8c18-4a3a-8869-aea62ff9c12b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "PUT /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1081 microversion: 2.1 time: 0.201494 Oct 26 05:16:24.191540 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1930/3872] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:16:23 2022] PUT /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1081 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:24.194590 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e370c2df-560b-4e4b-9f67-6fa784a8c1b6 req-44f0f21a-bfbc-4cb5-840a-717a00cc0bb9 service nova] Creating event network-vif-plugged:8048d852-5511-4a0d-9f3e-7a9f39f4adbc for instance da72c67d-c2eb-4917-9051-70592110c760 on n-h2-862416-4 Oct 26 05:16:24.197235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:24.198123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:24.205099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.205958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.206889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.208523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.209204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.209837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.213411 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e370c2df-560b-4e4b-9f67-6fa784a8c1b6 req-44f0f21a-bfbc-4cb5-840a-717a00cc0bb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104993 Oct 26 05:16:24.214730 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1943/3873] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:16:24.222034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:24.236914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:24.245524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.246251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.246998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.248043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.248922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.250009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.294167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:24.303945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:24.305528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:24.310862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89481af0-7e3d-4f4b-ace0-28afeeb01d79 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1512 microversion: 2.91 time: 0.117916 Oct 26 05:16:24.311446 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1931/3874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:24 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1512 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:24.414533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:24.443907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-626990ad-7d88-44a1-a826-d337b23acc8b tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1507 microversion: 2.1 time: 0.217043 Oct 26 05:16:24.444508 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1944/3875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:24 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:24.475664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:24.476578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:24.484227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.484943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.485656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.487215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.487894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.488581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.562541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29403c2c-8a49-49d2-9c7a-45bf46c2299c tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f470995d310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1193267632", "description": "tempest-description-1079475923"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:24.770760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:24.779140 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b49afa3-7786-4574-8963-efcc0f7718e3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.325918 Oct 26 05:16:24.780076 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1945/3876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:24 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:24.784987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:24.786585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:24.793041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.793810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.794535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.795532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:24.796162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:24.796600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:24.965217 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29403c2c-8a49-49d2-9c7a-45bf46c2299c tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.605191 Oct 26 05:16:24.966773 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1932/3877] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:16:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:24.980823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cab69b0e-1af4-46f9-af5c-8a69c0ab8869 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f4709965e50>, body: {"security_group_rule": {"parent_group_id": "af144b39-1db4-47e2-a0dc-d990af13d6e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:25.159969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:25.169624 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-caf7831b-461a-448e-8872-68b4d0a5314a tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1507 microversion: 2.1 time: 0.388623 Oct 26 05:16:25.170344 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1946/3878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:24 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:25.175459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:25.176792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:25.183197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.183777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.184467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.185283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.185986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.186633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.287209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:25.295683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3e460933-8254-4de1-9862-c843f17811de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1273 microversion: 2.1 time: 0.124251 Oct 26 05:16:25.296600 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1947/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:25 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:25.323017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:25.325700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:25.334199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.334796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.335562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.336817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.337522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.337961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.414063 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10507f93-1fa9-4fea-8d5c-24aa063561a2 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "PUT /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1083 microversion: 2.1 time: 0.098590 Oct 26 05:16:25.414713 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1948/3880] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:16:25 2022] PUT /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1083 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:25.420089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:25.420876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:25.428297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.429630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.430351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.431619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.432321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.433004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.454005 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cab69b0e-1af4-46f9-af5c-8a69c0ab8869 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.477563 Oct 26 05:16:25.455196 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1933/3881] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:16:25.461199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:25.462288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:25.472578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.473922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.474596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.475555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.476385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.477074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.499149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:25.602954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:25.618825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:25.635097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:25.650924 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-67b5a6e9-eb3e-47b0-8b6b-934824e3879e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1512 microversion: 2.91 time: 0.232181 Oct 26 05:16:25.662276 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1949/3882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:25 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:25.678182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-338eee2d-c628-409e-b5a7-ac403e9aada0 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f470a1a3f70>, body: {"security_group_rule": {"parent_group_id": "af144b39-1db4-47e2-a0dc-d990af13d6e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:25.856091 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-338eee2d-c628-409e-b5a7-ac403e9aada0 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: This rule already exists in group af144b39-1db4-47e2-a0dc-d990af13d6e5 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-338eee2d-c628-409e-b5a7-ac403e9aada0 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 138 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: {"security_group_rule": {"parent_group_id": "af144b39-1db4-47e2-a0dc-d990af13d6e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: exception: This rule already exists in group af144b39-1db4-47e2-a0dc-d990af13d6e5 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'af144b39-1db4-47e2-a0dc-d990af13d6e5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group af144b39-1db4-47e2-a0dc-d990af13d6e5 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group af144b39-1db4-47e2-a0dc-d990af13d6e5 Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:25.858090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group af144b39-1db4-47e2-a0dc-d990af13d6e5 Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-338eee2d-c628-409e-b5a7-ac403e9aada0 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 400 to user: This rule already exists in group af144b39-1db4-47e2-a0dc-d990af13d6e5 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-338eee2d-c628-409e-b5a7-ac403e9aada0 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.189246 Oct 26 05:16:25.864505 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1950/3883] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:16:25.866538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:25.867155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:25.875039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:25.884893 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54a43849-c1fd-4284-8a00-c033181722bd tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1509 microversion: 2.1 time: 0.428336 Oct 26 05:16:25.886940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.888083 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1934/3884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:25 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:25.889928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.893736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73fa8bf6-001d-4641-974f-8779a174391f tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f470995daf0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:25.894197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:25.895675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:25.895945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:25.896477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.288454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:26.308847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73fa8bf6-001d-4641-974f-8779a174391f tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/a989d673-45c1-4a2d-8fa6-16d3e00b8f3d" status: 202 len: 0 microversion: 2.1 time: 0.419471 Oct 26 05:16:26.309799 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1935/3885] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 26 05:16:25 2022] DELETE /compute/v2.1/os-security-group-rules/a989d673-45c1-4a2d-8fa6-16d3e00b8f3d => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:26.310119 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe92cc53-d2df-472f-8b14-1a9f3a36d8fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1365 microversion: 2.1 time: 0.448107 Oct 26 05:16:26.311055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1951/3886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:25 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1365 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:26.325141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e3d98bd-da40-45b2-b18c-0dca3080b6ee tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f470a99fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-153514743", "description": "tempest-description-2017374091"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:26.329444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:26.334465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:26.346259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.348523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.349408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.350617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.351296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.352071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.623104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:26.640144 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb22d869-2d6f-4b52-9457-7651213f5773 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1509 microversion: 2.1 time: 0.327569 Oct 26 05:16:26.653453 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1936/3887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:26 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:26.655771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:26.661853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:26.671231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e3d98bd-da40-45b2-b18c-0dca3080b6ee tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.354401 Oct 26 05:16:26.671470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.672090 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1952/3888] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:16:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:26.679951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:26.680803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:26.681627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.682310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.683232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.683840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.684372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.702545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.703392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.704199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.705848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.706551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.707172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.741115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:16:26.865981 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63b0c315-fc6f-428d-bf20-c775ac1f3eaf tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 204 len: 0 microversion: 2.1 time: 0.192158 Oct 26 05:16:26.876072 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1953/3889] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:26 2022] DELETE /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:16:26.876295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:26.876953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:26.884374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.885826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.886469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.887389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:26.888029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:26.888636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:26.972165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:26.985249 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49f335f5-20dd-45c2-931d-f2699576c6d9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.333697 Oct 26 05:16:26.986134 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1937/3890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:26 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:26.992939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-439d2341-d022-4271-a052-68551f97a5d2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f4709a561f0>, body: {"security_group_rule": {"parent_group_id": "f957015e-65af-482c-9b69-4e0dafdb63ca", "ip_protocol": "tcp", "from_port": 110192472, "to_port": 22}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:26.993172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:27.006611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:27.008331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:27.014864 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f89ff202-1596-4042-a9cf-56fad9c14ac5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1533 microversion: 2.91 time: 0.145456 Oct 26 05:16:27.015930 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1954/3891] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:26 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1533 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:27.022048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:27.022685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:27.030177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.030820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.031500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.032897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.033476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.033987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.072450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:16:27.126540 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-439d2341-d022-4271-a052-68551f97a5d2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Invalid port range 110192472:22. Former value cannot be greater than the later Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-439d2341-d022-4271-a052-68551f97a5d2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 145 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: {"security_group_rule": {"parent_group_id": "f957015e-65af-482c-9b69-4e0dafdb63ca", "ip_protocol": "tcp", "from_port": 110192472, "to_port": 22}} Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid port range 110192472:22. Former value cannot be greater than the later Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f957015e-65af-482c-9b69-4e0dafdb63ca', 'ip_protocol': 'tcp', 'from_port': 110192472, 'to_port': 22}}} Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 110192472:22. Former value cannot be greater than the later Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 110192472:22. Former value cannot be greater than the later Oct 26 05:16:27.128268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 110192472:22. Former value cannot be greater than the later Oct 26 05:16:27.134404 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.136120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-439d2341-d022-4271-a052-68551f97a5d2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 400 to user: Invalid port range 110192472:22. Former value cannot be greater than the later {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:27.137169 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-439d2341-d022-4271-a052-68551f97a5d2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.150085 Oct 26 05:16:27.139362 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1938/3892] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:26 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:16:27.197618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Instance is already in deleting state, ignoring this request Oct 26 05:16:27.198595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abbc6226-b3aa-44b1-b1ad-ab17445ebe53 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 204 len: 0 microversion: 2.1 time: 0.181639 Oct 26 05:16:27.200917 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1955/3893] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:27 2022] DELETE /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:16:27.215389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ac1bcaf-498c-451b-96e1-985600b07686 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f470ac54700>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-813919019", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:27.217763 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6ac1bcaf-498c-451b-96e1-985600b07686 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Security group id should be uuid Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ac1bcaf-498c-451b-96e1-985600b07686 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 130 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-813919019", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group id should be uuid Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-813919019', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:27.219574 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:27.225705 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 26 05:16:27.225705 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:27.226678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ac1bcaf-498c-451b-96e1-985600b07686 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 400 to user: Security group id should be uuid {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:27.227713 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ac1bcaf-498c-451b-96e1-985600b07686 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027193 Oct 26 05:16:27.228463 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1956/3894] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:27 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:16:27.242596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:27.243236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:27.257884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.258412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.259969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.260214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.260699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.261225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.377144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:27.378211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:27.392586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.394357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.395068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.395938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.396650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.397362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.564495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lazy-loading 'services' on Instance uuid 17f7c413-78d5-4215-b442-e6f36028b93b {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:16:27.570355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:27.604552 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98cc9c63-981e-4727-beef-c2f7c50b5e49 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1515 microversion: 2.1 time: 0.374879 Oct 26 05:16:27.605139 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1957/3895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:27 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:27.614807 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f288c45d-d99f-4052-aa9a-cc801c829571 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1938 microversion: 2.91 time: 0.473390 Oct 26 05:16:27.615852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8644fd6-8671-4a0e-a3c7-5ad58461031c tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f470a1c0310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-881070936", "description": "tempest-description-1908055061"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:27.625838 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1939/3896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:27 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1938 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:27.639905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:27.640553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:27.669877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.671291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.673489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:27.674434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:27.676187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:27.676806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.128859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:28.142874 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-725447b9-0aa6-4cd3-9d76-f207f45f5ba0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1555 microversion: 2.1 time: 0.515159 Oct 26 05:16:28.143819 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1940/3897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:27 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1555 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:28.155471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:28.156458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:28.166736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.167341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.168021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.169304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.169808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.170248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.229079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8644fd6-8671-4a0e-a3c7-5ad58461031c tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.622676 Oct 26 05:16:28.230016 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1958/3898] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:16:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:28.234588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:28.235601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:28.243628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.244702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.245343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.246777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.247880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.248700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.252428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:28.448372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lazy-loading 'services' on Instance uuid 17f7c413-78d5-4215-b442-e6f36028b93b {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:16:28.499709 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95a21290-5061-4fad-a114-a3d070508c94 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1938 microversion: 2.91 time: 0.352939 Oct 26 05:16:28.529805 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1941/3899] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:28 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1938 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:28.536118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:28.537571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:28.544646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.545457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.546073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.547273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.547909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.548510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.720786 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03e467bd-d5a9-469d-8bb3-9877a0f6203c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188791 Oct 26 05:16:28.734921 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1942/3900] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:16:28 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:28.742166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c20b2cd0-f76e-41f7-97be-53f6cac72b21 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f4709a56ca0>, body: {"security_group_rule": {"parent_group_id": "52319f2c-6ac9-4341-858b-1976527dbee5", "ip_protocol": "tempest-999-207794682", "from_port": 22, "to_port": 22}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:28.785714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:28.805091 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-751b7f62-3ec9-4dd1-98eb-482cbe6868d6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.573976 Oct 26 05:16:28.806354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1959/3901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:28 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:28.816640 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-c20b2cd0-f76e-41f7-97be-53f6cac72b21 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Invalid IP protocol tempest-999-207794682. Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c20b2cd0-f76e-41f7-97be-53f6cac72b21 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 156 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: {"security_group_rule": {"parent_group_id": "52319f2c-6ac9-4341-858b-1976527dbee5", "ip_protocol": "tempest-999-207794682", "from_port": 22, "to_port": 22}} Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid IP protocol tempest-999-207794682. Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'security_group_rule': {'parent_group_id': '52319f2c-6ac9-4341-858b-1976527dbee5', 'ip_protocol': 'tempest-999-207794682', 'from_port': 22, 'to_port': 22}}} Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-207794682. Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-207794682. Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:28.818981 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-207794682. Oct 26 05:16:28.825491 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:28.826198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-59a1379c-bcd8-4737-8ddb-56d4899bfb55 req-4e6df2ae-386f-4355-abf6-a42d2d0730dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd8172c-1ff0-4df2-8099-d32c1e3e1517", "tag": "f8eecbf1-0455-434e-8c85-3e5f94c86c6b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:28.827623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c20b2cd0-f76e-41f7-97be-53f6cac72b21 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 400 to user: Invalid IP protocol tempest-999-207794682. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:28.829056 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c20b2cd0-f76e-41f7-97be-53f6cac72b21 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.092547 Oct 26 05:16:28.835752 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1943/3902] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:28 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 26 05:16:28.842838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:28.845648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-59a1379c-bcd8-4737-8ddb-56d4899bfb55 req-4e6df2ae-386f-4355-abf6-a42d2d0730dd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.846144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-59a1379c-bcd8-4737-8ddb-56d4899bfb55 req-4e6df2ae-386f-4355-abf6-a42d2d0730dd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.846586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-59a1379c-bcd8-4737-8ddb-56d4899bfb55 req-4e6df2ae-386f-4355-abf6-a42d2d0730dd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.849745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.850729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.852223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.866638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.868723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.869449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.877918 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-59a1379c-bcd8-4737-8ddb-56d4899bfb55 req-4e6df2ae-386f-4355-abf6-a42d2d0730dd service nova] Creating event network-changed:f8eecbf1-0455-434e-8c85-3e5f94c86c6b for instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 on n-h2-862416-4 Oct 26 05:16:28.889794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-59a1379c-bcd8-4737-8ddb-56d4899bfb55 req-4e6df2ae-386f-4355-abf6-a42d2d0730dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081725 Oct 26 05:16:28.890411 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1960/3903] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:28.903743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:28.904461 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58b8252f-c374-4152-8dd3-761b3f15296b tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.066655 Oct 26 05:16:28.905401 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1944/3904] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 26 05:16:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:16:28.906005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:28.913374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5520459-1675-47a0-b5e8-87202ffcfa07 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f47099253a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-887355066", "description": "tempest-description-1566297799"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:28.918874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.920118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.921007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:28.922219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:28.922791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:28.923648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.090909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:29.104352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ae9a157e-357f-493d-a403-ebc7b5b91832 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1473 microversion: 2.1 time: 0.212480 Oct 26 05:16:29.108643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1961/3905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:28 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:29.119494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:29.125614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:29.137278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.138139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.138831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.140572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.141293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.141970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.187186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lazy-loading 'flavor' on Instance uuid 17f7c413-78d5-4215-b442-e6f36028b93b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:16:29.524030 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a87fe2d-c334-4b3c-9885-c14fde1d4ced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action" status: 202 len: 0 microversion: 2.91 time: 0.412770 Oct 26 05:16:29.525849 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1962/3906] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:16:29 2022] POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:16:29.556533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:29.572832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:29.606141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:29.610261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.610800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.611261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.611998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.612471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.612902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.773658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5520459-1675-47a0-b5e8-87202ffcfa07 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.866628 Oct 26 05:16:29.788016 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1945/3907] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:16:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:29.793662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b40ccb42-bb8d-4599-8dbc-c4b0368c5fb2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f47098bcaf0>, body: {"security_group_rule": {"parent_group_id": "fae9ea19-1046-4d36-bd9e-465077502654", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:29.823029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:29.848563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:29.855631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:29.865367 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df598cd4-ae7c-4c68-b660-718cc5b4769b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.333693 Oct 26 05:16:29.870232 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1963/3908] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:29 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:29.880112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:29.885577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:29.897372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=20 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:29.901896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.905740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.906551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.907640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.909072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.909775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:29.932902 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b40ccb42-bb8d-4599-8dbc-c4b0368c5fb2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b40ccb42-bb8d-4599-8dbc-c4b0368c5fb2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 138 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: {"security_group_rule": {"parent_group_id": "fae9ea19-1046-4d36-bd9e-465077502654", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fae9ea19-1046-4d36-bd9e-465077502654', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 05:16:29.935100 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 26 05:16:29.944139 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:29.948079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b40ccb42-bb8d-4599-8dbc-c4b0368c5fb2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:29.950014 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b40ccb42-bb8d-4599-8dbc-c4b0368c5fb2 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.160464 Oct 26 05:16:29.950643 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1946/3909] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:29 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:16:29.963039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-40c1133a-30a6-4ee4-b8f1-e80e61beb51c req-ecdebd80-bc8e-46dd-ac3d-e3519adf0aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb9eec7-763a-4a86-931d-7cf61d767f19", "name": "network-vif-deleted", "tag": "231634bb-0ed0-4a7f-a7b1-060c89d19b60"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:29.990533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40c1133a-30a6-4ee4-b8f1-e80e61beb51c req-ecdebd80-bc8e-46dd-ac3d-e3519adf0aa7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:29.991298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40c1133a-30a6-4ee4-b8f1-e80e61beb51c req-ecdebd80-bc8e-46dd-ac3d-e3519adf0aa7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:29.991911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40c1133a-30a6-4ee4-b8f1-e80e61beb51c req-ecdebd80-bc8e-46dd-ac3d-e3519adf0aa7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:30.011999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-40c1133a-30a6-4ee4-b8f1-e80e61beb51c req-ecdebd80-bc8e-46dd-ac3d-e3519adf0aa7 service nova] Creating event network-vif-deleted:231634bb-0ed0-4a7f-a7b1-060c89d19b60 for instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 on n-h1-862416-4 Oct 26 05:16:30.031726 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-40c1133a-30a6-4ee4-b8f1-e80e61beb51c req-ecdebd80-bc8e-46dd-ac3d-e3519adf0aa7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072415 Oct 26 05:16:30.032677 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1947/3910] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:30.040837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e56caf40-dc46-4d39-9de9-92abc1c6e50b tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f4709a56ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1730208983", "description": "tempest-description-1391374479"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:30.240753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:30.254886 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24ca9fef-4697-4b6a-bad1-5d75cf33c462 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.381910 Oct 26 05:16:30.260441 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1964/3911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:29 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:30.265984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:30.266821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:30.289000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:30.291228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:30.292545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:30.294964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:30.298710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:30.299680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:30.374557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:30.375351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:30.376035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:30.376741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lazy-loading 'fault' on Instance uuid 4eb9eec7-763a-4a86-931d-7cf61d767f19 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:16:30.450226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc40bd8c6f54e0ba9a74a5844816c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a976fe749244c58556050fb4c7a70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:30.451420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e56caf40-dc46-4d39-9de9-92abc1c6e50b tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.416195 Oct 26 05:16:30.454508 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1948/3912] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 26 05:16:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:30.460032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5382ba9-86de-4b4b-ae49-83ea00a86eac tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 200 len: 1308 microversion: 2.1 time: 0.198457 Oct 26 05:16:30.479688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a960423-e3b3-48d8-b55c-727aabd55f04 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f4709927ca0>, body: {"security_group_rule": {"parent_group_id": "3bd2dc80-3bb9-49f7-8a10-548b72430963", "ip_protocol": "tcp", "from_port": 22, "to_port": 176360635}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:30.480442 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1965/3913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:30 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:30.515985 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1a960423-e3b3-48d8-b55c-727aabd55f04 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Invalid port range 22:176360635. Valid TCP ports should be between 1-65535 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a960423-e3b3-48d8-b55c-727aabd55f04 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 145 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: {"security_group_rule": {"parent_group_id": "3bd2dc80-3bb9-49f7-8a10-548b72430963", "ip_protocol": "tcp", "from_port": 22, "to_port": 176360635}} Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid port range 22:176360635. Valid TCP ports should be between 1-65535 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3bd2dc80-3bb9-49f7-8a10-548b72430963', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 176360635}}} Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:176360635. Valid TCP ports should be between 1-65535 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:176360635. Valid TCP ports should be between 1-65535 Oct 26 05:16:30.517705 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:176360635. Valid TCP ports should be between 1-65535 Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a960423-e3b3-48d8-b55c-727aabd55f04 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 400 to user: Invalid port range 22:176360635. Valid TCP ports should be between 1-65535 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:30.523178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a960423-e3b3-48d8-b55c-727aabd55f04 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.055721 Oct 26 05:16:30.526598 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1949/3914] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:30 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:16:30.532067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Action: 'create', calling method: .version_select at 0x7f4709b81dc0>, body: {"security_group_rule": {"parent_group_id": "794bac94-a7fc-4144-91f9-3d7a2be6843f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:30.556351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG neutronclient.v2_0.client [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist", "detail": ""}} {{(pid=120586) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:16:30.557609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.security_group_api [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Neutron security group 794bac94-a7fc-4144-91f9-3d7a2be6843f not found {{(pid=120586) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 26 05:16:30.558322 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.558322 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 138 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: {"security_group_rule": {"parent_group_id": "794bac94-a7fc-4144-91f9-3d7a2be6843f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: exception: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'security_group_rule': {'parent_group_id': '794bac94-a7fc-4144-91f9-3d7a2be6843f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:16:30.560696 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] Oct 26 05:16:30.565966 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.571167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 404 to user: Security group 794bac94-a7fc-4144-91f9-3d7a2be6843f does not exist Oct 26 05:16:30.571167 n-d-862416-4 devstack@n-api.service[120586]: Neutron server returns request_ids: ['req-5ef5eab5-ad49-4285-8a85-4e02541e6bdf'] {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:30.572063 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-354eb0bc-9e0a-4580-bdef-52721a289e7e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.044037 Oct 26 05:16:30.572664 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1966/3915] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 26 05:16:30 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:30.585654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f4709909dc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:30.610656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG neutronclient.v2_0.client [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist", "detail": ""}} {{(pid=120585) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 26 05:16:30.612319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.security_group_api [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Neutron security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 not found {{(pid=120585) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 26 05:16:30.612965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] HTTP exception thrown: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.612965 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Request method failure captured: Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/os-security-group-rules/ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 HTTP/1.1 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMKoMBiRQ4BHFbBlwTL96cCI5LxES2sB--oU2z9K38UkfoFCozUEzpMBtibb4Ilyw7U_uh_Lh49l6kf_pP32kY6okMN8oqazFMB6fNFIQZuoVKCUXIHZD_ADvfJPAQAA66N5QezIyF-cKCyy1yL5zb5UoMg9e0V8PZcBsWkO59uIKaQ Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1399611d2c7944e4b08b78eec7d899c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1399611d2c7944e4b08b78eec7d899c2 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6227a6da253d46218dc4086d40d453eb Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: exception: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'ca5a8dd0-5ad6-4aac-841c-779ac834f1b8'} Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 26 05:16:30.615342 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Returning 404 to user: Security group rule ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 does not exist Oct 26 05:16:30.620580 n-d-862416-4 devstack@n-api.service[120585]: Neutron server returns request_ids: ['req-2aae086a-50cf-4472-b127-22ca7ccc5d7e'] {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:30.624219 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e21f8ac2-c512-4c78-83b0-9004e5a5fc12 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/ca5a8dd0-5ad6-4aac-841c-779ac834f1b8" status: 404 len: 199 microversion: 2.1 time: 0.043076 Oct 26 05:16:30.624219 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1950/3916] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 26 05:16:30 2022] DELETE /compute/v2.1/os-security-group-rules/ca5a8dd0-5ad6-4aac-841c-779ac834f1b8 => generated 199 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:30.633909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-697bd097-51a5-4cb0-a8bf-2dbd302585bb tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f470a7ff550>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:30.893066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-697bd097-51a5-4cb0-a8bf-2dbd302585bb tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/3bd2dc80-3bb9-49f7-8a10-548b72430963" status: 202 len: 0 microversion: 2.1 time: 0.263514 Oct 26 05:16:30.896256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1967/3917] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:16:30 2022] DELETE /compute/v2.1/os-security-groups/3bd2dc80-3bb9-49f7-8a10-548b72430963 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:16:30.904405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:30.905534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2c44240-2d08-4fcd-945f-b501b84a2b79 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f470a7ff8b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:30.906096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:30.913419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:30.914235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:30.915489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:30.916444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:30.917304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:30.918019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.006036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:31.015656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:31.017618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:31.024324 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4965158b-9d70-4a8b-9b45-c3eddf46199f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.124764 Oct 26 05:16:31.025489 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1951/3918] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:30 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:31.179679 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2c44240-2d08-4fcd-945f-b501b84a2b79 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/fae9ea19-1046-4d36-bd9e-465077502654" status: 202 len: 0 microversion: 2.1 time: 0.279799 Oct 26 05:16:31.188577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1968/3919] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:16:30 2022] DELETE /compute/v2.1/os-security-groups/fae9ea19-1046-4d36-bd9e-465077502654 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:31.193238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed7505b0-b8a3-4c60-85b3-86c9b125b063 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f4709ea0790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.289813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.291524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:31.300699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.301792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.302528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.304677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.305421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.306102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.519016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:31.525871 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed7505b0-b8a3-4c60-85b3-86c9b125b063 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/52319f2c-6ac9-4341-858b-1976527dbee5" status: 202 len: 0 microversion: 2.1 time: 0.337626 Oct 26 05:16:31.526537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1952/3920] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:16:31 2022] DELETE /compute/v2.1/os-security-groups/52319f2c-6ac9-4341-858b-1976527dbee5 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:16:31.532023 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a7b31efd-3b2b-460b-94d1-21fdc57e6c4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.250039 Oct 26 05:16:31.532965 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1969/3921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:31 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:31.533392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.534076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 4eb9eec7-763a-4a86-931d-7cf61d767f19] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:31.544552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.545077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.547241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.548014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.549910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-837c7a59-682e-46bf-ac27-01a2e67fa811 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f470a823940>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.550574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.552067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.588750 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] HTTP exception thrown: Instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 could not be found. Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Request method failure captured: Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 HTTP/1.1 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMH4IRSdodqxRn2N4PC4joGtwAsk--fyX6HUXHaVrzz04OmYReCmLtgG64vTeLi5-mBUF2sZk_yoVsmtxSQNDPurdmWWoNXC5sJIvCsh0JHoBcENqmbi4mdKFY4ovfFNukH6sjkXMJN_00LJvfeZCRqFKNIuoMDKt4Kh7sOGjwRLGGU Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70a976fe749244c58556050fb4c7a70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9dc40bd8c6f54e0ba9a74a5844816c11 Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 could not be found. Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4eb9eec7-763a-4a86-931d-7cf61d767f19'} Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 could not be found. Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 could not be found. Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.591266 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 could not be found. Oct 26 05:16:31.596770 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.606223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Returning 404 to user: Instance 4eb9eec7-763a-4a86-931d-7cf61d767f19 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:31.607119 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2106d693-c0a2-4c1b-98f3-44c48cab7dc7 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19" status: 404 len: 111 microversion: 2.1 time: 0.079315 Oct 26 05:16:31.607698 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1953/3922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:31 2022] GET /compute/v2.1/servers/4eb9eec7-763a-4a86-931d-7cf61d767f19 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:31.616679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.617962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:31.624163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.624879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.625543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.627054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.627995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.628614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.651564 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] HTTP exception thrown: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Request method failure captured: Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c HTTP/1.1 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMH4IRSdodqxRn2N4PC4joGtwAsk--fyX6HUXHaVrzz04OmYReCmLtgG64vTeLi5-mBUF2sZk_yoVsmtxSQNDPurdmWWoNXC5sJIvCsh0JHoBcENqmbi4mdKFY4ovfFNukH6sjkXMJN_00LJvfeZCRqFKNIuoMDKt4Kh7sOGjwRLGGU Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70a976fe749244c58556050fb4c7a70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9dc40bd8c6f54e0ba9a74a5844816c11 Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8a559397-2c7c-45eb-8baf-24b76b3ed44c'} Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:31.653035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Returning 404 to user: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e2f2a253-eb3b-46ac-9e9c-f1d6b5f5044c tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 404 len: 111 microversion: 2.1 time: 0.042555 Oct 26 05:16:31.662229 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1954/3923] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:31 2022] DELETE /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:16:31.667661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.668510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 8a559397-2c7c-45eb-8baf-24b76b3ed44c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:31.675307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.675809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.677839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.677839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.677839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.678343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.695041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] HTTP exception thrown: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Request method failure captured: Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c HTTP/1.1 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMH4IRSdodqxRn2N4PC4joGtwAsk--fyX6HUXHaVrzz04OmYReCmLtgG64vTeLi5-mBUF2sZk_yoVsmtxSQNDPurdmWWoNXC5sJIvCsh0JHoBcENqmbi4mdKFY4ovfFNukH6sjkXMJN_00LJvfeZCRqFKNIuoMDKt4Kh7sOGjwRLGGU Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70a976fe749244c58556050fb4c7a70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9dc40bd8c6f54e0ba9a74a5844816c11 Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8a559397-2c7c-45eb-8baf-24b76b3ed44c'} Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.696609 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Returning 404 to user: Instance 8a559397-2c7c-45eb-8baf-24b76b3ed44c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f2cc337-6087-442e-b189-edfe1b1702e3 tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c" status: 404 len: 111 microversion: 2.1 time: 0.035351 Oct 26 05:16:31.701397 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1955/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:31 2022] GET /compute/v2.1/servers/8a559397-2c7c-45eb-8baf-24b76b3ed44c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:31.711784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.712572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:31.719200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.719976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.720595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.721731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.722366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.723122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.740408 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] HTTP exception thrown: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Request method failure captured: Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 HTTP/1.1 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMH4IRSdodqxRn2N4PC4joGtwAsk--fyX6HUXHaVrzz04OmYReCmLtgG64vTeLi5-mBUF2sZk_yoVsmtxSQNDPurdmWWoNXC5sJIvCsh0JHoBcENqmbi4mdKFY4ovfFNukH6sjkXMJN_00LJvfeZCRqFKNIuoMDKt4Kh7sOGjwRLGGU Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70a976fe749244c58556050fb4c7a70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9dc40bd8c6f54e0ba9a74a5844816c11 Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '9c0a1d8a-ad5e-4660-a523-115cc3f1f953'} Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:31.742546 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.747836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.749784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Returning 404 to user: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:31.750992 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-13375e97-097c-464a-90c1-53970b300c1d tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 404 len: 111 microversion: 2.1 time: 0.044457 Oct 26 05:16:31.752266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1956/3925] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:16:31 2022] DELETE /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:16:31.760625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:31.761490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] [instance: 9c0a1d8a-ad5e-4660-a523-115cc3f1f953] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:31.768561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.769210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.770710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.771773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:31.772375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:31.772916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:31.797747 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] HTTP exception thrown: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Request method failure captured: Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 HTTP/1.1 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMH4IRSdodqxRn2N4PC4joGtwAsk--fyX6HUXHaVrzz04OmYReCmLtgG64vTeLi5-mBUF2sZk_yoVsmtxSQNDPurdmWWoNXC5sJIvCsh0JHoBcENqmbi4mdKFY4ovfFNukH6sjkXMJN_00LJvfeZCRqFKNIuoMDKt4Kh7sOGjwRLGGU Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70a976fe749244c58556050fb4c7a70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70a976fe749244c58556050fb4c7a70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70a976fe749244c58556050fb4c7a70b Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1018899974 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9dc40bd8c6f54e0ba9a74a5844816c11 Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-1018899974-project Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '9c0a1d8a-ad5e-4660-a523-115cc3f1f953'} Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:16:31.799276 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] Returning 404 to user: Instance 9c0a1d8a-ad5e-4660-a523-115cc3f1f953 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:16:31.806548 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b4893ee-b898-4490-a786-db611d52f47f tempest-ServerDiskConfigTestJSON-1018899974 tempest-ServerDiskConfigTestJSON-1018899974-project] 10.222.0.16 "GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953" status: 404 len: 111 microversion: 2.1 time: 0.046169 Oct 26 05:16:31.808503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1957/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:31 2022] GET /compute/v2.1/servers/9c0a1d8a-ad5e-4660-a523-115cc3f1f953 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:16:31.835515 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-837c7a59-682e-46bf-ac27-01a2e67fa811 tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f957015e-65af-482c-9b69-4e0dafdb63ca" status: 202 len: 0 microversion: 2.1 time: 0.301332 Oct 26 05:16:31.836560 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1970/3927] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:16:31 2022] DELETE /compute/v2.1/os-security-groups/f957015e-65af-482c-9b69-4e0dafdb63ca => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:31.845295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ef3a625-f937-44f8-a501-5383ac02875e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] Calling method '.version_select at 0x7f47099814c0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:32.053695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:32.054300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:32.065536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:32.066046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:32.067056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:32.071491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:32.071989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:32.072437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:32.129800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ef3a625-f937-44f8-a501-5383ac02875e tempest-SecurityGroupRulesNegativeTestJSON-1448598700 tempest-SecurityGroupRulesNegativeTestJSON-1448598700-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/af144b39-1db4-47e2-a0dc-d990af13d6e5" status: 202 len: 0 microversion: 2.1 time: 0.287798 Oct 26 05:16:32.131297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1958/3928] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:16:31 2022] DELETE /compute/v2.1/os-security-groups/af144b39-1db4-47e2-a0dc-d990af13d6e5 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:32.136817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-77e2840c-2491-4b23-957b-c76edc7fe97e req-4a33bd59-1ab0-4377-8da2-0305358a98e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da72c67d-c2eb-4917-9051-70592110c760", "tag": "8048d852-5511-4a0d-9f3e-7a9f39f4adbc"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:32.159088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-77e2840c-2491-4b23-957b-c76edc7fe97e req-4a33bd59-1ab0-4377-8da2-0305358a98e8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:32.159973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-77e2840c-2491-4b23-957b-c76edc7fe97e req-4a33bd59-1ab0-4377-8da2-0305358a98e8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:32.161732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-77e2840c-2491-4b23-957b-c76edc7fe97e req-4a33bd59-1ab0-4377-8da2-0305358a98e8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:32.189918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-77e2840c-2491-4b23-957b-c76edc7fe97e req-4a33bd59-1ab0-4377-8da2-0305358a98e8 service nova] Creating event network-changed:8048d852-5511-4a0d-9f3e-7a9f39f4adbc for instance da72c67d-c2eb-4917-9051-70592110c760 on n-h2-862416-4 Oct 26 05:16:32.200395 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-77e2840c-2491-4b23-957b-c76edc7fe97e req-4a33bd59-1ab0-4377-8da2-0305358a98e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067520 Oct 26 05:16:32.201166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1959/3929] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:32.560727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:32.561632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:32.563688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:32.576627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:32.578178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:32.581292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:32.582616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:32.583285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:32.584315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:32.861054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:32.872241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:32.875514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:32.882674 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66a6ef5a-1e4f-44e1-9725-666728c2abeb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.834011 Oct 26 05:16:32.914420 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1971/3930] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:32 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:33.065876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:33.074529 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b209fe7-77fa-4a4c-991e-d10c027dce2e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.518074 Oct 26 05:16:33.075703 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1960/3931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:32 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:33.912472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:33.913048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:33.932295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:33.932798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:33.933246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:33.933993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:33.934461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:33.934900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:34.099588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:34.100216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:34.114383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:34.114932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:34.115388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:34.116120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:34.116585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:34.117025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:34.210596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:34.224011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:34.229287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:34.243423 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80cd1565-0818-49e3-a9a7-64fc313ebdfd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.333852 Oct 26 05:16:34.259806 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1972/3932] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:33 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:34.665427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:34.679972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d45e296b-bd4f-4876-af16-d82bcfd87dd1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.584695 Oct 26 05:16:34.696319 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1961/3933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:34 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:35.279321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:35.279957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:35.288955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:35.289889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:35.290770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:35.291724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:35.292414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:35.293070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:35.421195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:35.432982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:35.434809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:35.440512 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ebde603-301a-4ca8-bd34-8b8d94b86f04 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.165416 Oct 26 05:16:35.458087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1973/3934] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:35 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:35.708665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:35.710159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:35.730795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:35.732091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:35.732570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:35.733338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:35.734260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:35.739632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:36.416244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:36.436318 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f145b531-f5fe-4080-9d83-287c902a960c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.732887 Oct 26 05:16:36.438974 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1962/3935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:35 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:36.478382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:36.479011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:36.492037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:36.492537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:36.493212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:36.493970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:36.494436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:36.497048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:36.621997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:36.635502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:36.637688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:36.639296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0b5c092f-7442-4e02-9de9-dca54c781a69 req-4489f923-42e5-49ae-a081-0bb64df80eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd8172c-1ff0-4df2-8099-d32c1e3e1517", "name": "network-vif-plugged", "status": "completed", "tag": "f8eecbf1-0455-434e-8c85-3e5f94c86c6b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:36.644203 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a3d97ba-33b9-425e-8e76-9542b980e9de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.169804 Oct 26 05:16:36.655499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0b5c092f-7442-4e02-9de9-dca54c781a69 req-4489f923-42e5-49ae-a081-0bb64df80eca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:36.655993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0b5c092f-7442-4e02-9de9-dca54c781a69 req-4489f923-42e5-49ae-a081-0bb64df80eca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:36.656429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0b5c092f-7442-4e02-9de9-dca54c781a69 req-4489f923-42e5-49ae-a081-0bb64df80eca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:36.659006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1974/3936] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:36 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:36.691826 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0b5c092f-7442-4e02-9de9-dca54c781a69 req-4489f923-42e5-49ae-a081-0bb64df80eca service nova] Creating event network-vif-plugged:f8eecbf1-0455-434e-8c85-3e5f94c86c6b for instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 on n-h2-862416-4 Oct 26 05:16:36.701159 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0b5c092f-7442-4e02-9de9-dca54c781a69 req-4489f923-42e5-49ae-a081-0bb64df80eca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061880 Oct 26 05:16:36.705627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1963/3937] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:37.491441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:37.492992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:37.501626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:37.502532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:37.503207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:37.504426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:37.505706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:37.506387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:37.682790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:37.684143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:37.702299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:37.703102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:37.703735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:37.704650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:37.706326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:37.707027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:37.899672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:37.909860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:37.912190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:37.918346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-18ad93b5-32e8-4d03-b749-774dbc1497e9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.248089 Oct 26 05:16:37.919567 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1964/3938] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:37 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:38.004706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:38.032258 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f22f283-5d4a-4d71-83d0-82ead89863d3 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1315 microversion: 2.1 time: 0.536571 Oct 26 05:16:38.036256 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1975/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:37 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:38.958807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:38.959436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:38.962296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:38.971704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:38.972148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:38.972592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:38.980153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:38.980678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:38.981100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:39.063164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:39.064770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:39.107350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:39.107933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:39.116464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:39.117303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:39.117870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:39.129185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:39.131635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:39.146941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:39.148842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:39.158921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f133d2a4-5531-4083-8885-65a6ac5fc7ce tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.204849 Oct 26 05:16:39.162737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1965/3940] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:38 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:39.576609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:39.598357 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e981a503-73b3-4280-8bef-2f03ab2455f6 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1503 microversion: 2.1 time: 0.536222 Oct 26 05:16:39.600076 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1976/3941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:39 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1503 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:39.626144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ffdf1d9-1043-4c7c-af1d-1d609a5e7899 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:39.636812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ffdf1d9-1043-4c7c-af1d-1d609a5e7899 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:39.637348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ffdf1d9-1043-4c7c-af1d-1d609a5e7899 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:39.641610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ffdf1d9-1043-4c7c-af1d-1d609a5e7899 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:39.711270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ffdf1d9-1043-4c7c-af1d-1d609a5e7899 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Going to try to stop instance {{(pid=120585) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:16:39.747205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:39.819312 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ffdf1d9-1043-4c7c-af1d-1d609a5e7899 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517/action" status: 202 len: 0 microversion: 2.1 time: 0.195384 Oct 26 05:16:39.821044 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1966/3942] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:16:39 2022] POST /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:16:39.829536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:39.830512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:39.839790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:39.844492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:39.846117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:39.849210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:39.850001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:39.851780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:40.179103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:40.192945 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42a28f7a-e75d-4dc2-ac73-f660cf5a52a9 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.367532 Oct 26 05:16:40.193602 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1977/3943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:39 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:40.195540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:40.196239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:40.215418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:40.216430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:40.216941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:40.217692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:40.218144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:40.218678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:40.336409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:40.356916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:40.367839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:40.378178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b166190-84a2-4b41-ba99-f4e0b52938f0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.187609 Oct 26 05:16:40.379239 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1967/3944] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:40 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:41.219079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:41.219847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:41.233264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:41.235311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:41.235843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:41.236647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:41.238367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:41.241251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:41.246985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:41.409276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:41.411433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:41.434256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:41.435785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:41.437988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:41.439566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:41.440252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:41.443122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:41.526501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:41.539876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d681aea1-713e-4210-a386-eeaae993d30e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.323927 Oct 26 05:16:41.541736 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1978/3945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:41 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:41.592152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:41.612265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:41.614285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:41.629625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3d774d17-c150-4c8f-8bfe-91898360bc91 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.223628 Oct 26 05:16:41.645708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1968/3946] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:41 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:42.568486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:42.569907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:42.580964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:42.585611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:42.586192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:42.588422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:42.588581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:42.591938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:42.659729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:42.661597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:42.673722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:42.674249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:42.675004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:42.676403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:42.676932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:42.678557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:42.782156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:42.804668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:42.813702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:42.825904 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc4ca155-3ec3-4c81-85ea-1f5dcf65e20a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.169887 Oct 26 05:16:42.837474 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1969/3947] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:42 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:42.838653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:42.848442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1c07938-53ea-44e8-9188-d3bfedf7c8d1 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.284540 Oct 26 05:16:42.858933 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1979/3948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:42 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:43.860033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:43.861255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:43.875629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:43.876234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:43.876758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:43.876882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:43.877555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:43.877872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:43.878020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:43.878440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:43.890967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:43.893171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:43.895193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:43.897919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:43.898594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:43.903350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:44.163418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:44.190680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:44.192707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:44.201222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7b8c4bd-d48a-419c-9a6d-e0daf9e59775 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.344908 Oct 26 05:16:44.202802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1970/3949] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:43 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:44.483810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:44.526807 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00076a7f-9c02-45b8-9967-5a5ed233fd4a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.635126 Oct 26 05:16:44.527945 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1980/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:43 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:45.235093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:45.236322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:45.256734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:45.258887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:45.261438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:45.263768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:45.264563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:45.267362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:45.555058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:45.557574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:45.560718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:45.565779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:45.567594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:45.568324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:45.569224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:45.574251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:45.576069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:45.576539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:45.579298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:45.596223 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d282dea3-5c04-4713-9f3a-37515152cced tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.366984 Oct 26 05:16:45.605123 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1971/3951] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:45 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:46.014634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:46.042510 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-909e6421-2d04-4b57-8b0e-4602d702f929 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.490608 Oct 26 05:16:46.072354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1981/3952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:45 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:46.626478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:46.627173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:46.644204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:46.645237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:46.646137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:46.647037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:46.649997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:46.650682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:46.903470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:46.917001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:46.922755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:46.943839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-663d6ef1-e71c-4b29-ae2a-3dfa31d0f44f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.322053 Oct 26 05:16:46.944444 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1972/3953] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:46 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:47.078522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:47.081267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:47.102669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:47.104801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:47.105630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:47.108220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:47.108921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:47.110165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:47.573550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:47.591582 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-76ddad1c-d67d-4910-9471-d808e95e552c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.520624 Oct 26 05:16:47.594492 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1982/3954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:47 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:47.977128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:47.978432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:47.995199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:47.995713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:47.996149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:47.996871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:47.997348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:47.997790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:48.246861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:48.260264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:48.262049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:48.281888 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf21668f-2b72-4e91-8e4d-95f7e4df778b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.307395 Oct 26 05:16:48.283950 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1973/3955] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:47 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:48.455996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1682572471", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "2554f384-a60a-41b1-89f3-b55ea4170292"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:48.570158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] validate_networks() for [('2554f384-a60a-41b1-89f3-b55ea4170292', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:16:48.619818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:48.620437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:48.630714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:48.631218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:48.631660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:48.632378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:48.632838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:48.633271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:49.254459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:49.262939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-941a497a-6338-4c14-a08a-d432e4bc1784 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.647454 Oct 26 05:16:49.267068 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1974/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:48 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:49.312302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:49.313174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:49.320558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:49.321382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:49.322011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:49.323210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:49.324246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:49.329280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:49.427843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:49.452758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:49.454277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:49.470573 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ecddb6ee-1752-44b3-9507-063544379bee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.163434 Oct 26 05:16:49.481398 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1975/3957] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:49 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:49.746444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:16:49.747436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:16:49.748093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:16:49.748701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:16:49.749369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:16:49.769277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:49.770898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:49.775072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:49.776472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:49.777502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:49.778990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:49.813421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Getting quotas for project 1688daf0256241d2ace95c3e398d2617. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:49.819994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Getting quotas for user 9db119cedad4434490c6c4b58597c7dd and project 1688daf0256241d2ace95c3e398d2617. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:49.839286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:49.841476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:16:49.850891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:16:49.935742 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5282b755-0714-4374-85d3-ea152568506b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.661955 Oct 26 05:16:49.944107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1983/3958] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:16:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:16:49.950389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a427cf80-fa9a-4e02-b61b-b437b6ec22f4 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:49.951014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a427cf80-fa9a-4e02-b61b-b437b6ec22f4 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:50.112919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a427cf80-fa9a-4e02-b61b-b437b6ec22f4 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.124204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a427cf80-fa9a-4e02-b61b-b437b6ec22f4 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.127357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a427cf80-fa9a-4e02-b61b-b437b6ec22f4 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.129421 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a427cf80-fa9a-4e02-b61b-b437b6ec22f4 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1259 microversion: 2.21 time: 0.184199 Oct 26 05:16:50.130861 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1976/3959] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:49 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:50.296620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:50.297786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:50.323715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:50.343455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:50.343955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:50.346708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:50.349481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:50.351020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:50.501105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:50.502357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:50.522273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:50.523045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:50.523697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:50.524613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:50.525242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:50.525884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:50.700384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.716290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.717796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.727382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:50.734312 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89d2e5c3-f786-4e72-991c-3bed42d6ad5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.237886 Oct 26 05:16:50.734913 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1977/3960] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:50 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:50.762951 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de3bfd31-1bc7-4891-a7fa-62ed1beae97c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.466106 Oct 26 05:16:50.780451 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1984/3961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:50 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:51.160154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:51.161025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:51.169000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:51.169789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:51.170429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:51.171313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:51.171942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:51.175506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:51.266906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:51.281965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:51.283569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:51.291308 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19a8710a-74be-4fc9-9f65-39e134f60c15 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1255 microversion: 2.21 time: 0.128906 Oct 26 05:16:51.293777 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1978/3962] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:51 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1255 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:51.769251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:51.770467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:51.788338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:51.789146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:51.789501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:51.790238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:51.795187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:51.796670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:51.797664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:51.798319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:51.801637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:51.802274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:51.802810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:51.805036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:51.806485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:51.809961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:51.971069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:51.984656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:51.991396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:52.004684 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-380ceea5-6dce-4189-abfd-c29ca698f6e8 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.239170 Oct 26 05:16:52.019106 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1985/3963] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:51 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:52.278149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:52.286768 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bafef894-2aa6-41c9-bb8f-cbf343ae917a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.503354 Oct 26 05:16:52.291002 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1979/3964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:51 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:52.324757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:52.325761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:52.337612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:52.338433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:52.339068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:52.341436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:52.342337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:52.343286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:52.485759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:52.533884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:52.537955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:52.541575 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1e84ca43-1a8b-492c-bfa4-e8ed88967806 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1317 microversion: 2.21 time: 0.222162 Oct 26 05:16:52.546267 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1986/3965] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:52 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:53.038788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:53.040711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:53.055499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:53.056326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:53.057019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9dafbf6a-766e-4318-ac17-0a06fb6eecbc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Action: 'create', calling method: .version_select at 0x7f4709a5a820>, body: {"keypair": {"name": "tempest-keypair-2075158436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiIeH5UoTvImGPlb7YAKa4o7Xo8d9w3JSnP6bxWid5hBS/nuvFqq40GxJ4WOqp08SELoU55lmgQpuj8udNturkFhJ+RabatbpbaC2ODuwC3L8De0+lWVRkHXUk21KhYgA=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:53.057898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:53.058866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:53.059529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:53.060161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:53.081536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9dafbf6a-766e-4318-ac17-0a06fb6eecbc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Getting quotas for project 3eb400dc73bf4e7a86cacf67e28e1218. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:53.091949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9dafbf6a-766e-4318-ac17-0a06fb6eecbc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Getting quotas for user f4becac669f840d6a026ac76705d804e and project 3eb400dc73bf4e7a86cacf67e28e1218. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:53.138591 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9dafbf6a-766e-4318-ac17-0a06fb6eecbc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.472845 Oct 26 05:16:53.139814 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1980/3966] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:16:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:53.175588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.192131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.194203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.200813 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7dd38899-ed9b-443c-bb9d-4684709e8a50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.168647 Oct 26 05:16:53.202021 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1987/3967] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:53 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:53.315764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:53.316771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:53.339264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:53.342111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:53.342829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:53.344090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:53.344742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:53.345237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:53.576100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:53.576720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:53.587399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:53.587907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:53.588540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:53.596024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:53.596534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:53.598276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:53.837899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.850442 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7471daf6-ce93-4914-afd6-c5dce44e8c3b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.539102 Oct 26 05:16:53.851045 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1981/3968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:53 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:53.954481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.967082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.970671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:53.973184 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97071b3e-0343-4312-9fb6-e05339ef132f tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.399726 Oct 26 05:16:53.976131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1988/3969] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:53 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:54.234717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:54.235435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:54.247869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:54.248548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:54.249001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:54.249755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:54.254509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:54.254987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:54.402024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:54.418102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:54.420582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:54.435621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61ca69eb-a52f-4b07-a90f-7e0d3eadf25b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.205394 Oct 26 05:16:54.450538 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1982/3970] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:54 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:54.730439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-cfdab6cb-0b3d-4f1d-a347-869801f47b74 req-deab59ad-7415-4fee-a674-adb82b784a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acae0023-1a23-4ee4-984d-196d91a1354d", "tag": "f6a8a33d-609f-4091-b10f-2b58b164cff6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:54.755752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cfdab6cb-0b3d-4f1d-a347-869801f47b74 req-deab59ad-7415-4fee-a674-adb82b784a44 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:54.759948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cfdab6cb-0b3d-4f1d-a347-869801f47b74 req-deab59ad-7415-4fee-a674-adb82b784a44 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:54.760467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cfdab6cb-0b3d-4f1d-a347-869801f47b74 req-deab59ad-7415-4fee-a674-adb82b784a44 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:54.808431 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-cfdab6cb-0b3d-4f1d-a347-869801f47b74 req-deab59ad-7415-4fee-a674-adb82b784a44 service nova] Creating event network-changed:f6a8a33d-609f-4091-b10f-2b58b164cff6 for instance acae0023-1a23-4ee4-984d-196d91a1354d on n-h1-862416-4 Oct 26 05:16:54.818061 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-cfdab6cb-0b3d-4f1d-a347-869801f47b74 req-deab59ad-7415-4fee-a674-adb82b784a44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091969 Oct 26 05:16:54.818975 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1989/3971] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:16:54.881073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:54.884089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:54.895225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:54.899989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:54.902606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:54.904197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:54.904687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:54.905119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:55.008147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:55.009375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:55.024272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:55.024991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:55.026978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:55.030118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:55.030807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:55.031546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:55.305175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.321863 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66040faa-f1f6-46f5-98bc-dfd79e640648 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.444778 Oct 26 05:16:55.326773 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1983/3972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:54 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:55.396447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.407206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.410810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.412983 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9060df28-7337-4e66-9968-312cd6511fd0 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.414769 Oct 26 05:16:55.414330 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1990/3973] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:54 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:55.474883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:55.475555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:55.494661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:55.495169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:55.495623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:55.496351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:55.496816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:55.497251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:55.552659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:55.728539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.743289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.745050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:55.760632 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0fd8e068-6eb2-44bd-9238-76157f15bf58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.290586 Oct 26 05:16:55.773365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1984/3974] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:55 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:55.837781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:55.838460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:55.850592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:55.852469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:55.853337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:55.856205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:55.857700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:55.860395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.149857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:56.171008 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffb91482-d104-4848-ba57-38074976aea1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.339555 Oct 26 05:16:56.180130 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1991/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:55 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:56.216344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:56.216969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:56.272687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.273453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.274011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.274810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.275432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.275917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.355623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:56.358660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:56.381519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.383481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.384006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.386230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.387796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.388255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.497749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:56.514526 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c365d781-28ef-4a7e-b4ff-7dfc3a92348e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.307713 Oct 26 05:16:56.538994 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1985/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:56 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:56.544437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:56.545049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:56.567565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.568593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.569375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.574651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.575157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.575814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.771667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:56.783410 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-721301b8-b325-4726-aa7d-988fff0e868f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.434809 Oct 26 05:16:56.794116 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1992/3977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:56 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:56.794116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:56.794116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:56.809039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:56.817606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:56.819108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:56.819392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.820105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.820254 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d0a68d6-9d04-4bcd-b3ff-5014822aa21e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.279939 Oct 26 05:16:56.829350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.829701 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1986/3978] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:56 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:56.830879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.841067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:56.841365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.841365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.841905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:56.858535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.859319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.859839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:56.860691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:56.861123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:56.861591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:57.011916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:57.027034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:57.030945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:57.038981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f488d54c-c154-4cdc-a3c0-b02b49e13929 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.214509 Oct 26 05:16:57.041254 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1987/3979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:56 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:57.164170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:57.174738 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9ce16cc-81a0-4d4f-8ac5-203529ca3739 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.389669 Oct 26 05:16:57.175484 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1993/3980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:56 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:57.200701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:57.201354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:57.210890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:57.213411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:57.213810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:57.214540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:57.218511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:57.220485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:57.423962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:57.434076 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed64107c-c12e-42e9-a1cf-171d69ff945b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.238037 Oct 26 05:16:57.434826 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1988/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:57 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:57.587626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-228934347", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "51e64d69-11bc-4d31-bfc7-b6ed610b422e"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:16:57.662665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] validate_networks() for [('51e64d69-11bc-4d31-bfc7-b6ed610b422e', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:16:57.819938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:57.822276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:57.855134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:57.857405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:57.861918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:57.865098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:57.867088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:57.867646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.212119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.230585 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f8b2d9c-8ae9-4cc7-9764-e4818fad7eaa tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.414643 Oct 26 05:16:58.231881 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1989/3982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:57 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:16:58.243753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:58.244719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:58.262341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:16:58.266593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.267537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.270815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.271774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.272446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.273063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.574095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.582837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.584214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.585375 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-556d0a5f-d04d-4f00-8072-00911750d0ec tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.352232 Oct 26 05:16:58.586177 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1990/3983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:58 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:58.591066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:58.591665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:58.597782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.598509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.599149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.600024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.600635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.601221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.639397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:16:58.640636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:16:58.641345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:16:58.641767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:16:58.642355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:16:58.653786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.654570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.655187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.656858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.657533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.658134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.676630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.683850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:16:58.690181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for user 4c2aa94263344a7eb33bcc7c6594229a and project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:16:58.698126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.700510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.703714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:16:58.706364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:16:58.710718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54f25751-44e9-4830-8661-ccff2217d55b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.123168 Oct 26 05:16:58.711351 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1991/3984] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:58 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:16:58.717754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:58.718438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:58.724708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.725229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.725737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.726446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:58.726951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:58.727324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:58.761194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62a14886-d48e-4aa4-b80d-24e3f6c9e387 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179032 Oct 26 05:16:58.762342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1994/3985] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:16:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:16:58.765726 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0127dd5-fb32-4ea1-a49e-156583fe0644 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/ips" status: 200 len: 153 microversion: 2.20 time: 0.049428 Oct 26 05:16:58.766554 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1992/3986] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 26 05:16:58 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/ips => generated 153 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:16:58.774380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5aa288e-65fb-46d5-a4a9-ab5ef79c5377 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:58.775904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5aa288e-65fb-46d5-a4a9-ab5ef79c5377 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:58.854300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5aa288e-65fb-46d5-a4a9-ab5ef79c5377 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:58.866352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5aa288e-65fb-46d5-a4a9-ab5ef79c5377 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1214 microversion: 2.1 time: 0.097068 Oct 26 05:16:58.867212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1995/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:58 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:59.259095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:59.259720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:59.270214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.274696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.276049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.277048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.280889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.281397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.492443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.510456 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0321fd7-3553-425b-bde3-a0ea8c61d529 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.250880 Oct 26 05:16:59.511995 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1993/3988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:59 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:16:59.613418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:59.614435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:59.640407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.641118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.641365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.651991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.652491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.652941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.742610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:59.743200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:59.756534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.757217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.757887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.767353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.768253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.769109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.890967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.903337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.907746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.922610 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d260728-b480-4206-9e55-cc8968efe400 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.184078 Oct 26 05:16:59.924662 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1994/3989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:59 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:16:59.942252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:16:59.943563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:16:59.953075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.953836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.954678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.962804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.973643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.974955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:16:59.975625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:16:59.976224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:16:59.982157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:16:59.983572 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65b5c8c7-4c5e-4b29-9f65-2ebbd2e2840e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.375156 Oct 26 05:16:59.984144 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1996/3990] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:16:59 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:00.063764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:00.077833 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e6cb605e-33ff-4861-8337-0ca694b92bec tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1266 microversion: 2.1 time: 0.151131 Oct 26 05:17:00.078653 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1995/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:16:59 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:00.542056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:00.542810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:00.550687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:00.551356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:00.551905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:00.553286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:00.553920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:00.554726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:00.728234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:00.731121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:00.742599 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a5a3619-9ccc-4de5-a739-b86941c7ba0e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.210384 Oct 26 05:17:00.743971 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1997/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:00 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:00.959493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:00.960182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:00.969103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:00.970143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:00.970868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:00.971776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:00.972232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:00.973424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:01.020683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:01.021707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:01.031735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:01.032708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:01.033483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:01.035011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:01.035806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:01.036748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:01.069937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.087734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.089944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.098398 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5566008f-9b4c-450d-90b4-697c99b0e52f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.145304 Oct 26 05:17:01.099377 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1996/3993] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:00 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:01.120202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:01.122244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:01.134315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:01.147723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:01.148441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:01.150541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:01.151274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:01.153838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:01.300582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.310929 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d2f3b199-6362-4fc5-b84d-62a726cc2518 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1274 microversion: 2.1 time: 0.194756 Oct 26 05:17:01.312002 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1997/3994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:01 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:01.388719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.397944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.404724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:01.406254 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca3e5f21-a750-4d9a-a9ec-34ac040e3a4e tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.395499 Oct 26 05:17:01.407355 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1998/3995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:01 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:01.766783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:01.773440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:01.787772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:01.790211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:01.791589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:01.797699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:01.799395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:01.800426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.002481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-088db2cd-4479-4f8c-bb5c-2777ad953249 req-1ac3b043-7b95-4e65-bbbb-fd99e573b264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acae0023-1a23-4ee4-984d-196d91a1354d", "name": "network-vif-plugged", "status": "completed", "tag": "f6a8a33d-609f-4091-b10f-2b58b164cff6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:02.023273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-088db2cd-4479-4f8c-bb5c-2777ad953249 req-1ac3b043-7b95-4e65-bbbb-fd99e573b264 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.024080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-088db2cd-4479-4f8c-bb5c-2777ad953249 req-1ac3b043-7b95-4e65-bbbb-fd99e573b264 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.024552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-088db2cd-4479-4f8c-bb5c-2777ad953249 req-1ac3b043-7b95-4e65-bbbb-fd99e573b264 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.039231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:02.050671 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88791661-c445-4efe-8162-9cc8bc6346ff tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.286378 Oct 26 05:17:02.065627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1998/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:01 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:02.065784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-088db2cd-4479-4f8c-bb5c-2777ad953249 req-1ac3b043-7b95-4e65-bbbb-fd99e573b264 service nova] Creating event network-vif-plugged:f6a8a33d-609f-4091-b10f-2b58b164cff6 for instance acae0023-1a23-4ee4-984d-196d91a1354d on n-h1-862416-4 Oct 26 05:17:02.070974 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-088db2cd-4479-4f8c-bb5c-2777ad953249 req-1ac3b043-7b95-4e65-bbbb-fd99e573b264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072781 Oct 26 05:17:02.078031 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 1999/3997] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:17:02.144436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:02.146801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:02.168109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.168761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.169332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.170452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.171135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.171608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.221700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:02.223144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:02.235591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.235769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.236099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.236833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.237294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.237757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.306062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lazy-loading 'flavor' on Instance uuid 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:02.427569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:02.444736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:02.466720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:02.500469 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b51c6f8-9121-4e40-953a-805e5c51411d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.372889 Oct 26 05:17:02.541382 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 1999/3998] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:02 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:02.554886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:02.556361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:02.568392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.569194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.587718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.588711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.589383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.590007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.762323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5380ca21-8b2c-461f-8d09-9253e850f889 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/action" status: 202 len: 0 microversion: 2.20 time: 0.547501 Oct 26 05:17:02.763475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2000/3999] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:17:02 2022] POST /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:17:02.772184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:02.772892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:02.779447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.781781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.782233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.782938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:02.783627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:02.784528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:02.995596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.006975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-428b7e51-227e-4d1f-b3e6-66a4f27c6e91 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.461627 Oct 26 05:17:03.006975 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2000/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:02 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:03.026171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:03.026704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:03.039108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:03.039873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:03.041004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:03.042028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:03.042674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:03.043111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:03.062698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:03.099594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:03.499464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.508720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.514092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.515742 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f374041-639e-4654-a02c-e5a287d627be tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1359 microversion: 2.21 time: 0.750726 Oct 26 05:17:03.516577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2001/4001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:02 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1359 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:03.522156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:03.523046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:03.531769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:03.532603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:03.533299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:03.534384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:03.535601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:03.536263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:03.746749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.757552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.759442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.760625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7213611b-70c3-45ac-8c85-5c77454a242c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.746168 Oct 26 05:17:03.777491 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2001/4002] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:03 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:03.779902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:03.780519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:03.786737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:03.787241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:03.787691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:03.788404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:03.788868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:03.790686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:03.815639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.830038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65d0f3a2-cfe5-4118-8c9a-2c6122884c8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.311736 Oct 26 05:17:03.830726 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2002/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:03 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:03.887763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.898776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.900563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:03.906184 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7fdefab-7a36-474e-a732-13270dee2b21 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.131066 Oct 26 05:17:03.907584 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2002/4004] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:03 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:04.028186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:04.028807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:04.035249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.036124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.036795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.037641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.038188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.038678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.251568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.262516 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6943c6b5-2af2-42b1-97f6-ff0a1f9712a5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.238219 Oct 26 05:17:04.273844 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2003/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:04 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:04.324345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4563f92a-c5b5-411d-8793-7d31827ee10f req-fed5f06e-a0f9-45e9-9c28-599749ebcaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185fb210-0f41-4d8a-b479-cb3056131016", "tag": "2cb44100-3770-46de-9af8-c44a82a18829"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:04.335900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4563f92a-c5b5-411d-8793-7d31827ee10f req-fed5f06e-a0f9-45e9-9c28-599749ebcaae service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.336387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4563f92a-c5b5-411d-8793-7d31827ee10f req-fed5f06e-a0f9-45e9-9c28-599749ebcaae service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.336811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4563f92a-c5b5-411d-8793-7d31827ee10f req-fed5f06e-a0f9-45e9-9c28-599749ebcaae service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.361342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4563f92a-c5b5-411d-8793-7d31827ee10f req-fed5f06e-a0f9-45e9-9c28-599749ebcaae service nova] Creating event network-changed:2cb44100-3770-46de-9af8-c44a82a18829 for instance 185fb210-0f41-4d8a-b479-cb3056131016 on n-h2-862416-4 Oct 26 05:17:04.361342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4563f92a-c5b5-411d-8793-7d31827ee10f req-fed5f06e-a0f9-45e9-9c28-599749ebcaae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046133 Oct 26 05:17:04.361342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2003/4006] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:04.543574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:04.544111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:04.550386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.551474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.551944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.552655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.553117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.553584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.786010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.788338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:04.789506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:04.796758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.799175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.799369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.799867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.801838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-304bfd96-4927-4b04-be6c-e5e5d9915e06 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1551 microversion: 2.21 time: 0.262404 Oct 26 05:17:04.803311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.804160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.804556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.805000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.818566 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2004/4007] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:04 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1551 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:04.843186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:04.844115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:04.859047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.859913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.860641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.864335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:04.865489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:04.866135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:04.896620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:17:04.971393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.981760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.983399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:04.984574 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15917cbb-d09c-4cab-b156-ed6ae5590b6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.200993 Oct 26 05:17:04.985614 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2004/4008] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:04 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:05.007563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:05.008675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:05.011142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc333821-880c-46c5-90aa-957518d17b39 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 204 len: 0 microversion: 2.21 time: 0.184158 Oct 26 05:17:05.011954 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2005/4009] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:17:04 2022] DELETE /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:17:05.015301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.015805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.016252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.017214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.017851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.019678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.020077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:05.020817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:05.032447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.033085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.033591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.034313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.036592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.037036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.154136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.164608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.166183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.179991 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0bab516-daee-4861-9149-a8a1e48ac782 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.166496 Oct 26 05:17:05.181569 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2006/4010] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:05 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:05.186651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:05.187499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:05.194065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.194976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.196160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.197430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.198089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.198534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.209953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.218519 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b607401-bfd9-4f74-adb0-32f52ea49375 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.231819 Oct 26 05:17:05.219003 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2005/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:04 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:05.287896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:05.288780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:05.296683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.297722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.298368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.299256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:05.299713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:05.300155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:05.401070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.413818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.415702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.421479 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da5a24dd-482c-413b-b4b2-5c76afd64282 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1557 microversion: 2.21 time: 0.238431 Oct 26 05:17:05.422755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2007/4012] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:05 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1557 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:05.488509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:05.496391 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ebdce299-6fd0-43d6-8c35-d46668569840 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.212848 Oct 26 05:17:05.496966 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2006/4013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:05 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:06.013598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:06.014250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:06.022624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.023372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.023997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.024874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.025535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.026138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.181293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.192540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.196819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.198403 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7324636b-2b27-4546-8d18-9740bbaedc98 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.189102 Oct 26 05:17:06.199801 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2008/4014] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:06 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:06.223747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:06.224632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:06.230839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.231335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.231782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.232492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.232954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.233407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.244751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:06.245434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:06.252491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.253010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.253490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.254461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.254941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.255381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.354894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.368981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.370566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.388587 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20cfea3f-d1d2-47ec-a5b7-add7ea21fbb5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.172777 Oct 26 05:17:06.391326 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2007/4015] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:06 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:06.447967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:06.449113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:06.466126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.466833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.468041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.469894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.471363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.472074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.509875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.524276 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc4e1d9c-11d6-4273-b94f-a730d407375c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.283189 Oct 26 05:17:06.526142 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2009/4016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:06 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:06.554556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:06.555674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:06.577655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.579549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.580291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.581265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:06.584539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:06.585272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:06.747884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.759111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.760579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.770769 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-285967e8-5661-4c06-a667-d8ca42573e8b tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1557 microversion: 2.21 time: 0.317748 Oct 26 05:17:06.771821 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2008/4017] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:06 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1557 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:06.851894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:06.861478 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e1d35dd8-f401-4356-bc6d-bbcc2ab88ad9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.333781 Oct 26 05:17:06.862407 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2010/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:06 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:07.081909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-37795b34-5b44-4df5-90eb-1e4a603e9a0b req-5fa6c38e-264d-48ab-8ea3-8f633e413f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acae0023-1a23-4ee4-984d-196d91a1354d", "name": "network-vif-deleted", "tag": "f6a8a33d-609f-4091-b10f-2b58b164cff6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:07.095148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-37795b34-5b44-4df5-90eb-1e4a603e9a0b req-5fa6c38e-264d-48ab-8ea3-8f633e413f1a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.095938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-37795b34-5b44-4df5-90eb-1e4a603e9a0b req-5fa6c38e-264d-48ab-8ea3-8f633e413f1a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.096831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-37795b34-5b44-4df5-90eb-1e4a603e9a0b req-5fa6c38e-264d-48ab-8ea3-8f633e413f1a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.116195 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-37795b34-5b44-4df5-90eb-1e4a603e9a0b req-5fa6c38e-264d-48ab-8ea3-8f633e413f1a service nova] Creating event network-vif-deleted:f6a8a33d-609f-4091-b10f-2b58b164cff6 for instance acae0023-1a23-4ee4-984d-196d91a1354d on n-h1-862416-4 Oct 26 05:17:07.131218 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-37795b34-5b44-4df5-90eb-1e4a603e9a0b req-5fa6c38e-264d-48ab-8ea3-8f633e413f1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050992 Oct 26 05:17:07.136053 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2009/4019] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:07.227923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:07.228544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:07.239664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.240235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.240680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.241476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.247674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.248141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.276928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:07.422808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:07.423666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:07.425773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.435612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.436507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.437251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.439386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.442067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.442788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.444475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.445987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.449968 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37c6b7a7-aa01-45e7-84ec-149bd4461515 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.226120 Oct 26 05:17:07.450961 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2011/4020] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:07 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:07.528139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.539618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.541094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.550656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:07.551277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:07.561203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec4e660b-2756-4bdc-93c1-bff3b85d567a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.142858 Oct 26 05:17:07.561963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.562465 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2010/4021] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:07 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:07.565935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.566549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.567445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.568021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.568532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.749758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.773134 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-050c7c3c-c9cd-4475-aaf6-d79c35eb847b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1513 microversion: 2.1 time: 0.217074 Oct 26 05:17:07.776763 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2012/4022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:07 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:07.795989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:07.796633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:07.803897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.804388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.804826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.805834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.806296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.806725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.844917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.845339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.845793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.846271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lazy-loading 'fault' on Instance uuid acae0023-1a23-4ee4-984d-196d91a1354d {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:07.886136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:07.887054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:07.894413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.895314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.895520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.896209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:07.901566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:07.902045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.903431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:07.913929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.915582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9db119cedad4434490c6c4b58597c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1688daf0256241d2ace95c3e398d2617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:07.916870 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b8a29f8-ff4d-4720-963f-7111aca1cdcc tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 200 len: 1349 microversion: 2.21 time: 0.124810 Oct 26 05:17:07.928196 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2011/4023] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:07 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 1349 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:08.101125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.111323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82ff52b4-fc86-458b-9cba-6cd302326cac tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.229125 Oct 26 05:17:08.112087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2013/4024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:07 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:08.477682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:08.478294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:08.493096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.493608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.494053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.494765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.495273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.495820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.591597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:08.593332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:08.600650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.604882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.605928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.606491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.606964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.607418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.670510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:08.763055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.785187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.787170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.794154 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46ca2fdc-7e6f-4845-863f-f24ebd8ea2c5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.206644 Oct 26 05:17:08.795838 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2014/4025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:08 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:08.802058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:08.802765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:08.817154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.817805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.818264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.821802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.822282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.822718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.862148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=14 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:08.867592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.876186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.877857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:08.880203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93e8c3a9-cb82-494c-bc73-44ed7d60ef04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.407595 Oct 26 05:17:08.880988 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2012/4026] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:08 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:08.945180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:08.946188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:08.952885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.953439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.953914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.954602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:08.955063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:08.955494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:08.973335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] HTTP exception thrown: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Request method failure captured: Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d HTTP/1.1 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMLAQq2nU5799wHVj3uAEFsYtPkKk8pXYcjRkxOLfqt4V6HlbYf-v_d5H8FcwFD9Y163jdG2gotX3amJS0bnkbhmz62kS6nGa_7yKEXm2TVPhtCnKH2-j7uZkfmU1QK1uICJP8MBeZMq3aeeYfID4k9wmiuUf8OCOz6Ud9EE3YrqjwY Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.21 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1688daf0256241d2ace95c3e398d2617 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1688daf0256241d2ace95c3e398d2617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1688daf0256241d2ace95c3e398d2617 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceActionsV221TestJSON-1319615342-project Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9db119cedad4434490c6c4b58597c7dd Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceActionsV221TestJSON-1319615342-project Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'acae0023-1a23-4ee4-984d-196d91a1354d'} Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:08.975178 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Returning 404 to user: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7610cc82-2a83-44e5-aba6-ff7173d8e5de tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 404 len: 111 microversion: 2.21 time: 0.036533 Oct 26 05:17:08.984168 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2013/4027] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:08 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:17:08.987532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '.version_select at 0x7f47098e7a60>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:08.988180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:08.999902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.000405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.000852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.001588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.002047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.002478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.071131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:09.081527 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a0baa1c-d096-4cfa-81d9-e8e92b94382a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1490 microversion: 2.1 time: 0.284434 Oct 26 05:17:09.105989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2015/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:08 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1490 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:09.119721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.121426 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73edb801-c3f7-418c-a15c-25dc6b734d12 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.138202 Oct 26 05:17:09.122600 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2014/4029] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Oct 26 05:17:08 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d/os-instance-actions => generated 611 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:17:09.122857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.125958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:09.140552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.143983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.144955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.145575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.147260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.147465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.149007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.149519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.160178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.162379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.163834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.166405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.166874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.167311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.212532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:17:09.366934 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6e5acf4-d1f0-4a1b-8195-8d8011445034 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 204 len: 0 microversion: 2.1 time: 0.258959 Oct 26 05:17:09.367537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2016/4030] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:09 2022] DELETE /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:17:09.380533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.381158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.387693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.388434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.389066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.390243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.391008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.392151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.416149 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] HTTP exception thrown: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Request method failure captured: Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d HTTP/1.1 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMLAQq2nU5799wHVj3uAEFsYtPkKk8pXYcjRkxOLfqt4V6HlbYf-v_d5H8FcwFD9Y163jdG2gotX3amJS0bnkbhmz62kS6nGa_7yKEXm2TVPhtCnKH2-j7uZkfmU1QK1uICJP8MBeZMq3aeeYfID4k9wmiuUf8OCOz6Ud9EE3YrqjwY Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.21 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1688daf0256241d2ace95c3e398d2617 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1688daf0256241d2ace95c3e398d2617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1688daf0256241d2ace95c3e398d2617 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-InstanceActionsV221TestJSON-1319615342-project Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 9db119cedad4434490c6c4b58597c7dd Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-InstanceActionsV221TestJSON-1319615342-project Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'acae0023-1a23-4ee4-984d-196d91a1354d'} Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:09.421092 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.427498 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.430998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Returning 404 to user: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:09.454514 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a92697a-7ea6-4d39-a954-4992a8e3a42c tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 404 len: 111 microversion: 2.21 time: 0.078570 Oct 26 05:17:09.456374 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2017/4031] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:17:09 2022] DELETE /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:17:09.467053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.474283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.487741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:09.495126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.495912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.497193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.498744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a04b697-3af1-4010-9142-a60aebf6d596 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.367293 Oct 26 05:17:09.499333 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2015/4032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:09 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:09.499874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.500607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.504913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.506947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.526570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] [instance: acae0023-1a23-4ee4-984d-196d91a1354d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.535816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.536631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.537272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.538356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.538992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.539665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.561395 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] HTTP exception thrown: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Request method failure captured: Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d HTTP/1.1 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMLAQq2nU5799wHVj3uAEFsYtPkKk8pXYcjRkxOLfqt4V6HlbYf-v_d5H8FcwFD9Y163jdG2gotX3amJS0bnkbhmz62kS6nGa_7yKEXm2TVPhtCnKH2-j7uZkfmU1QK1uICJP8MBeZMq3aeeYfID4k9wmiuUf8OCOz6Ud9EE3YrqjwY Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.21 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 1688daf0256241d2ace95c3e398d2617 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1688daf0256241d2ace95c3e398d2617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1688daf0256241d2ace95c3e398d2617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 1688daf0256241d2ace95c3e398d2617 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1319615342 Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceActionsV221TestJSON-1319615342-project Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9db119cedad4434490c6c4b58597c7dd Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceActionsV221TestJSON-1319615342-project Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'acae0023-1a23-4ee4-984d-196d91a1354d'} Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.563605 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. Oct 26 05:17:09.568716 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:09.570886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] Returning 404 to user: Instance acae0023-1a23-4ee4-984d-196d91a1354d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:09.571970 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9008ea16-15bd-468f-97b4-8aa8200f20e6 tempest-InstanceActionsV221TestJSON-1319615342 tempest-InstanceActionsV221TestJSON-1319615342-project] 10.222.0.16 "GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d" status: 404 len: 111 microversion: 2.21 time: 0.071721 Oct 26 05:17:09.573059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2016/4033] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:09 2022] GET /compute/v2.1/servers/acae0023-1a23-4ee4-984d-196d91a1354d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:17:09.740414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:09.753185 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-192d3696-49d2-47dc-a1fc-63475df788f2 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1496 microversion: 2.1 time: 0.294895 Oct 26 05:17:09.754366 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2018/4034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:09 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1496 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:09.825403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.826585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.834548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.836132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.836823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.837941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.838648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.839484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.906964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:09.907720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:09.915180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.921096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.921714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:09.923009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:09.926939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:09.928171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:10.025159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:10.036430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:10.038779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:10.057606 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd567bb8-ce84-4884-9e3a-bb874687b015 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.235771 Oct 26 05:17:10.059395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2017/4035] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:09 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:10.276747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:10.290744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:10.292739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:10.298220 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-855a1150-1a26-48ca-af3e-691b3ca8112b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.395049 Oct 26 05:17:10.300968 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2019/4036] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:09 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:10.529175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:10.530847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:10.551897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:10.556082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:10.557067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:10.560907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:10.562784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:10.563447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:10.779086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:10.780452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:10.803825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:10.809201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:10.810112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:10.812075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:10.813405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:10.817092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:11.276116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.314425 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-616b3dca-ea1a-49af-b368-ca7dbd3817a8 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.783938 Oct 26 05:17:11.322178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2018/4037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:10 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:11.350977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:11.353764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:11.361466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:11.362888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:11.363815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:11.364979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:11.365645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:11.366524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:11.510193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.527868 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b80d220d-2cc7-436b-8303-a1905c1a1642 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1496 microversion: 2.1 time: 0.753698 Oct 26 05:17:11.530720 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2020/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:10 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1496 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:11.532438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.548565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:11.549553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:11.550915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.557485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.563109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:11.570300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:11.570772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:11.575920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:11.576533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:11.576983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:11.577600 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20adcff4-b6a5-4728-9585-ea1a0b9838e0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.248945 Oct 26 05:17:11.578223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2019/4039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:11 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:11.964672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.978942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.982376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:11.986435 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5bde9e2a-b702-423f-adf9-f86aa024ceb1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.451577 Oct 26 05:17:11.988008 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2021/4040] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:11 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:12.345794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:12.349116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:12.366752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7d983e65-38a4-46e3-a76a-6d0d282df68f req-1072263e-d6ed-4749-99a8-81467f6b10d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd8172c-1ff0-4df2-8099-d32c1e3e1517", "name": "network-vif-deleted", "tag": "f8eecbf1-0455-434e-8c85-3e5f94c86c6b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:12.378233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.382385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.385705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.389385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.392679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.393717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.402952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7d983e65-38a4-46e3-a76a-6d0d282df68f req-1072263e-d6ed-4749-99a8-81467f6b10d7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.408216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7d983e65-38a4-46e3-a76a-6d0d282df68f req-1072263e-d6ed-4749-99a8-81467f6b10d7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.410027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7d983e65-38a4-46e3-a76a-6d0d282df68f req-1072263e-d6ed-4749-99a8-81467f6b10d7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.464154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:12.469262 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7d983e65-38a4-46e3-a76a-6d0d282df68f req-1072263e-d6ed-4749-99a8-81467f6b10d7 service nova] Creating event network-vif-deleted:f8eecbf1-0455-434e-8c85-3e5f94c86c6b for instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 on n-h2-862416-4 Oct 26 05:17:12.485639 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7d983e65-38a4-46e3-a76a-6d0d282df68f req-1072263e-d6ed-4749-99a8-81467f6b10d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123823 Oct 26 05:17:12.490951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2022/4041] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:17:12.514280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7b4c39ba-0949-4f44-b819-1cfbb485480f req-dd0b5f3a-95ea-4b0e-a18a-2f70cf1947c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185fb210-0f41-4d8a-b479-cb3056131016", "name": "network-vif-plugged", "status": "completed", "tag": "2cb44100-3770-46de-9af8-c44a82a18829"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:12.548148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7b4c39ba-0949-4f44-b819-1cfbb485480f req-dd0b5f3a-95ea-4b0e-a18a-2f70cf1947c3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.549292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7b4c39ba-0949-4f44-b819-1cfbb485480f req-dd0b5f3a-95ea-4b0e-a18a-2f70cf1947c3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.554700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7b4c39ba-0949-4f44-b819-1cfbb485480f req-dd0b5f3a-95ea-4b0e-a18a-2f70cf1947c3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.588202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7b4c39ba-0949-4f44-b819-1cfbb485480f req-dd0b5f3a-95ea-4b0e-a18a-2f70cf1947c3 service nova] Creating event network-vif-plugged:2cb44100-3770-46de-9af8-c44a82a18829 for instance 185fb210-0f41-4d8a-b479-cb3056131016 on n-h2-862416-4 Oct 26 05:17:12.598792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7b4c39ba-0949-4f44-b819-1cfbb485480f req-dd0b5f3a-95ea-4b0e-a18a-2f70cf1947c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098769 Oct 26 05:17:12.604609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2023/4042] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:12.615510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:12.616426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:12.636335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.640953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.641962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.644053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.649868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.653841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.860743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:12.867300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:12.869690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:12.870227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'fault' on Instance uuid fcd8172c-1ff0-4df2-8099-d32c1e3e1517 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:13.080440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.103201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d9e6ed3-5adf-4131-8d1b-6403fd5c0909 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 200 len: 1305 microversion: 2.1 time: 0.497634 Oct 26 05:17:13.104160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2024/4043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:12 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 1305 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:13.138811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:13.139953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:13.192923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:13.195371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:13.200072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:13.203682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:13.207659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:13.213665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.214110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:13.232288 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce77998f-edfc-4f66-a250-8de06bcac063 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 0.889172 Oct 26 05:17:13.233771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2020/4044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:12 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:13.250278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:13.250993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:13.265775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:13.267089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:13.268122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:13.269291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:13.271597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:13.272732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:13.388548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.408734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.410378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.431067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4fc1edb1-86f9-4ebd-8252-47ae2950cc20 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.313913 Oct 26 05:17:13.445363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2025/4045] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:13 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:13.693788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.704366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.717294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:13.718881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-542ecaba-79c6-4309-8477-a16a34948926 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.484066 Oct 26 05:17:13.744185 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2021/4046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:13 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:14.133739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:14.134422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:14.156921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:14.157468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:14.157986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:14.172247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:14.174441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:14.177334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:14.227438 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 HTTP/1.1 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'fcd8172c-1ff0-4df2-8099-d32c1e3e1517'} Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:14.231971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:14.238734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:14.242111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:14.261135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:14.262805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:14.267877 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e3efbe2e-a154-410d-b3b9-86b3b4b8132d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 404 len: 111 microversion: 2.1 time: 0.123664 Oct 26 05:17:14.288485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:14.288996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:14.297472 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2026/4047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:14 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:14.298090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:14.300636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:14.301592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:14.302825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:14.463833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:14.464467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:14.491940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:14.492466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:14.492921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:14.501589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:14.502167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:14.502630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:14.803188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:14.816945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:14.834683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:14.857555 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08d6ae5f-53cb-45b5-a2b2-7757641ef435 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.397660 Oct 26 05:17:14.873727 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2027/4048] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:14 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:14.902997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1672718696", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "248abf75-9d88-4658-992a-6f828f16175b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:15.045562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] validate_networks() for [('248abf75-9d88-4658-992a-6f828f16175b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:17:15.588820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:15.626371 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b66c2b29-792f-48a6-8f7e-eea0b059de92 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1314 microversion: 2.1 time: 1.362652 Oct 26 05:17:15.641356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2022/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:14 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1314 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:15.646803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:15.647636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:15.664321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:15.666231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:15.668576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:15.673540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:15.674360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:15.683887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.232140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:16.261871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:16.276502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:16.281921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0bc067cb-73c3-409f-82ac-c6f33b284bcc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.647671 Oct 26 05:17:16.284177 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2023/4050] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:15 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:16.303374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:16.308180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:16.325194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:16.328112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:16.328891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.332064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:16.333439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:16.339370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.572017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:16.586754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:16.588267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:16.615577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b58c09a-da48-4b11-8889-e67ab3d92bc0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.328643 Oct 26 05:17:16.617276 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2024/4051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:16 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:16.652922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:16.653796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:16.667167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:16.668016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:16.668670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.682367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:16.683118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:16.683737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.912975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:17:16.913571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:17:16.913957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:17:16.914371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:17:16.914794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:17:16.932196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:16.937222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:16.939230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.940416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:16.944165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:16.944990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:16.999312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:17.012130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Getting quotas for user e5723b278179404b9fd7de738b492f41 and project ec71918b8580462d8bea4141a5cf7419. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:17.049325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:17:17.052672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:17:17.061856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:17.092938 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6de9906-e59a-4ad9-bf3f-32e0632adc7f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1502 microversion: 2.1 time: 0.435669 Oct 26 05:17:17.094178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2025/4052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:16 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1502 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:17.123303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:17.124380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:17.136174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:17.136917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:17.137548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:17.138428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:17.140706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:17.141384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:17.198407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3929761-7748-45f6-8de1-e1b71ecf4736 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.323419 Oct 26 05:17:17.199820 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2028/4053] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:17:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:17:17.217956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90c7fd3b-0ad6-4921-9b88-a50fc8609f31 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:17.219179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-90c7fd3b-0ad6-4921-9b88-a50fc8609f31 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:17.406892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90c7fd3b-0ad6-4921-9b88-a50fc8609f31 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:17.415127 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90c7fd3b-0ad6-4921-9b88-a50fc8609f31 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1215 microversion: 2.1 time: 0.205679 Oct 26 05:17:17.419636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2029/4054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:17 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:17.427554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:17.429517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:17.460672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:17.461634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:17.462347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:17.463623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:17.469115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:17.469880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:17.494069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:17.572445 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Removing security group a19c209c-761c-4b66-a1d7-dab5c6698616 from port 2cb44100-3770-46de-9af8-c44a82a18829 Oct 26 05:17:17.950526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:17.977885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:17.988964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:17.997934 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07ffcac7-1f9e-4ea4-9681-4d694c48c416 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 0.573175 Oct 26 05:17:17.998717 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2030/4055] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:17 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:18.016846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:18.017844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:18.044040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:18.044915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:18.047274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:18.052002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:18.054073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:18.054769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:18.217599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:18.232894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:18.236392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:18.250628 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6496098b-9ab1-44f9-a97e-91b668784531 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.245152 Oct 26 05:17:18.255318 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2031/4056] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:18 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:18.525383 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-926e6802-da32-4452-b159-1e01fa347864 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016/action" status: 202 len: 0 microversion: 2.1 time: 1.406770 Oct 26 05:17:18.527108 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2026/4057] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:17:17 2022] POST /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016/action => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:17:18.536712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:18.537685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:18.557629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:18.558298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:18.569349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:18.570241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:18.570791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:18.571302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:18.875927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:18.902864 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e73d2e3c-0654-49d9-8f27-bf7406d627c0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1460 microversion: 2.1 time: 0.370772 Oct 26 05:17:18.913418 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2027/4058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:18 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1460 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:18.948236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f421232c-bd63-4397-8ae1-1e2913fed7ec req-b4849a0d-9fa4-492a-aabc-3fc96c6d1cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185fb210-0f41-4d8a-b479-cb3056131016", "tag": "2cb44100-3770-46de-9af8-c44a82a18829"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:18.974866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f421232c-bd63-4397-8ae1-1e2913fed7ec req-b4849a0d-9fa4-492a-aabc-3fc96c6d1cc5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:18.975570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f421232c-bd63-4397-8ae1-1e2913fed7ec req-b4849a0d-9fa4-492a-aabc-3fc96c6d1cc5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:18.976030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f421232c-bd63-4397-8ae1-1e2913fed7ec req-b4849a0d-9fa4-492a-aabc-3fc96c6d1cc5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:19.008757 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f421232c-bd63-4397-8ae1-1e2913fed7ec req-b4849a0d-9fa4-492a-aabc-3fc96c6d1cc5 service nova] Creating event network-changed:2cb44100-3770-46de-9af8-c44a82a18829 for instance 185fb210-0f41-4d8a-b479-cb3056131016 on n-h2-862416-4 Oct 26 05:17:19.038606 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f421232c-bd63-4397-8ae1-1e2913fed7ec req-b4849a0d-9fa4-492a-aabc-3fc96c6d1cc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123614 Oct 26 05:17:19.045692 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2028/4059] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:19.060184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:19.077385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:19.092764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:19.150903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:19.154660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:19.163494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:19.165104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:19.165775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:19.168460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:19.299178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:19.306451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:19.323035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:19.324484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:19.326275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:19.329460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:19.329903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:19.330695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:19.566478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:19.577637 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7676ec41-dec0-4487-a1c8-f851147c239c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1267 microversion: 2.1 time: 1.130719 Oct 26 05:17:19.579960 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2032/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:18 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1267 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:19.585651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:19.592768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:19.607930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:19.618179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:19.618966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:19.619735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:19.620354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:19.620873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.040103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.068301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.070363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.072073 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39a42af6-805c-408c-84bb-92f73dba25f5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1745 microversion: 2.20 time: 0.490825 Oct 26 05:17:20.074079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.075980 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2033/4061] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:19 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1745 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:20.098069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:20.105583 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-25a4b02f-1153-49b0-86d8-9416c042dbfb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 1.057984 Oct 26 05:17:20.107949 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2029/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:19 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:20.109629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:20.118223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.131990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.132626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.133888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.134263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:20.134572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.135269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.151325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:20.158089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.158863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.159518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.160462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.161734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.162373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.303610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.313380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.344144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.353340 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d59645e1-9a47-451c-b62f-660d41a5e5cd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.275134 Oct 26 05:17:20.357280 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2034/4063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:20 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:20.603323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.605410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:20.606033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:20.614322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.619710 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5b0a0fc-df04-44f2-b5c8-0175c29bd583 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.487004 Oct 26 05:17:20.620020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.620486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.621234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.621733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.622170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.641263 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2030/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:20 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:20.649865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:20.652351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:20.659358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.661783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.662568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.663690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:20.664325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:20.664945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:20.933567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:20.951021 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2f81d30-8045-4985-9807-a729d750164b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1273 microversion: 2.1 time: 0.345073 Oct 26 05:17:20.952272 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2035/4065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:20 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1273 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:21.107288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:21.108498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:21.117874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:21.118372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:21.118816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:21.119532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:21.120011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:21.120429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:21.279433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.294337 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b837bcc7-82f9-4d78-92d2-20722e1d7ecc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.649361 Oct 26 05:17:21.303773 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2031/4066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:20 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:21.328900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:21.330690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:21.345866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:21.349761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:21.350664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:21.354009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:21.359174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:21.360028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:21.461660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.482915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.495904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.499295 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9171927-2187-4125-8cf8-8bff0581fb3f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1745 microversion: 2.20 time: 0.396106 Oct 26 05:17:21.517813 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2036/4067] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:21 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1745 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:21.530035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:21.530744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:21.554535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:21.561442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:21.563908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:21.568971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:21.573809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:21.576029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:21.747502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.756631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.783220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.790672 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-847ecc66-f203-4909-a78f-ae70ab89548b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.460558 Oct 26 05:17:21.792037 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2032/4068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:21 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:17:21.795506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:21.802313 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9c9544b9-1962-4018-8f8f-7b8f39d9f09c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.293796 Oct 26 05:17:21.803821 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2037/4069] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:21 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:21.993911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:21.994874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:22.011571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:22.012738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:22.013438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:22.016966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:22.020107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:22.020824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:22.042871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1101666876", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "51e64d69-11bc-4d31-bfc7-b6ed610b422e"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:22.222858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] validate_networks() for [('51e64d69-11bc-4d31-bfc7-b6ed610b422e', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:17:22.558767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:22.567178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-74f11d66-d04f-4b3f-9abb-022c407a347e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.583940 Oct 26 05:17:22.571151 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2033/4070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:21 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:22.606311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:22.611035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:22.644584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:22.646860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:22.648653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:22.655975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:22.656695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:22.657910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.168132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:23.184070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:23.194608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:23.198331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2043aa19-d870-4dc4-a01d-d869857fc531 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1745 microversion: 2.20 time: 0.623701 Oct 26 05:17:23.202159 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2034/4071] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:22 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1745 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:23.209610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:23.218204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:23.230872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:23.232047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:23.234001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.235247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:23.238521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:23.239214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.516297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:23.526313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:23.531241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:23.542489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-86236a81-4dfd-4b36-adeb-f017d55926df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.337446 Oct 26 05:17:23.545899 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2035/4072] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:23 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:23.595527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:23.596918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:23.605114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:23.605941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:23.606545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.607513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:23.608172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:23.608932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.643270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:17:23.645455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:17:23.646274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:17:23.646925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:17:23.647575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:17:23.674156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:23.675249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:23.677256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.682678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:23.683531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:23.684427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:23.754201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:23.777704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Getting quotas for user 4c2aa94263344a7eb33bcc7c6594229a and project 70d8dd20e0fa4ea6bef886dce13eeffc. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:23.835838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:17:23.842232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:17:24.052996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a8f1cfb-0ec7-4d1c-b2ad-b0fa5d88ba49 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014650 Oct 26 05:17:24.072702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2038/4073] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:17:24.073823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:24.095595 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cf70694-b204-4aec-9af7-a018b4af054e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.498350 Oct 26 05:17:24.095873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f773c6e8-99e9-4347-a114-da8143564753 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:24.101670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f773c6e8-99e9-4347-a114-da8143564753 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:24.124623 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2036/4074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:23 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:24.243000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:24.244663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:24.275756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:24.276263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:24.292871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f773c6e8-99e9-4347-a114-da8143564753 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:24.300105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:24.306011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f773c6e8-99e9-4347-a114-da8143564753 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1215 microversion: 2.1 time: 0.231344 Oct 26 05:17:24.308617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:24.311626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:24.313490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:24.341390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2039/4075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:24 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:24.577031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:24.578271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:24.605514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:24.611904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:24.614713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:24.619462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:24.626519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:24.631110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:24.975226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:24.986058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:24.988145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:25.015916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:25.025826 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aee6d676-09e2-412c-95fe-6905cbd2346c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.453414 Oct 26 05:17:25.029985 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2040/4076] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:24 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:25.045725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-fe8de9e1-5917-487f-87f5-adc243c93995 req-7479b6e8-4bfa-4e3d-9a9a-e769fed6ac59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9489a0e-edb8-4532-b2ed-695abcfcfcd7", "tag": "0c846007-1460-4a7f-859e-d9a2c0213d25"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:25.107716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fe8de9e1-5917-487f-87f5-adc243c93995 req-7479b6e8-4bfa-4e3d-9a9a-e769fed6ac59 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:25.117632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fe8de9e1-5917-487f-87f5-adc243c93995 req-7479b6e8-4bfa-4e3d-9a9a-e769fed6ac59 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:25.118135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fe8de9e1-5917-487f-87f5-adc243c93995 req-7479b6e8-4bfa-4e3d-9a9a-e769fed6ac59 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:25.156570 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-fe8de9e1-5917-487f-87f5-adc243c93995 req-7479b6e8-4bfa-4e3d-9a9a-e769fed6ac59 service nova] Creating event network-changed:0c846007-1460-4a7f-859e-d9a2c0213d25 for instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 on n-h1-862416-4 Oct 26 05:17:25.166595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-fe8de9e1-5917-487f-87f5-adc243c93995 req-7479b6e8-4bfa-4e3d-9a9a-e769fed6ac59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135051 Oct 26 05:17:25.170292 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2041/4077] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:25.186218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:25.189555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:25.208542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:25.209057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:25.214969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:25.217087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:25.217637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:25.218096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:25.309389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:25.326191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:25.328321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:25.330241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab601220-300c-495b-981f-471be4cf5bdc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1745 microversion: 2.20 time: 1.100261 Oct 26 05:17:25.333189 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2037/4078] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:24 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1745 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:25.619268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-550767684", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "9da101bb-c3f5-4d08-8629-416901956d8f"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:25.683884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:25.694898 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de27c692-ea0c-439c-a86a-23b4d9fecd2a tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.523057 Oct 26 05:17:25.710951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2042/4079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:25 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:25.720203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f16c9af8-59ea-4d5a-9c55-63da223f6a77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:25.723224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f16c9af8-59ea-4d5a-9c55-63da223f6a77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:25.919876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f16c9af8-59ea-4d5a-9c55-63da223f6a77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:25.931337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f16c9af8-59ea-4d5a-9c55-63da223f6a77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1215 microversion: 2.1 time: 0.219195 Oct 26 05:17:25.936866 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2043/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:25 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:25.953559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-954c8e15-e9f1-4dcb-932e-975a2eac7e98 req-99ace5ee-3bb5-4b15-826a-e0ca0d40bb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "name": "network-vif-plugged", "status": "completed", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:25.984121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-954c8e15-e9f1-4dcb-932e-975a2eac7e98 req-99ace5ee-3bb5-4b15-826a-e0ca0d40bb7b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:25.985576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-954c8e15-e9f1-4dcb-932e-975a2eac7e98 req-99ace5ee-3bb5-4b15-826a-e0ca0d40bb7b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:25.986296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-954c8e15-e9f1-4dcb-932e-975a2eac7e98 req-99ace5ee-3bb5-4b15-826a-e0ca0d40bb7b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:26.008912 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-954c8e15-e9f1-4dcb-932e-975a2eac7e98 req-99ace5ee-3bb5-4b15-826a-e0ca0d40bb7b service nova] Creating event network-vif-plugged:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h2-862416-4 Oct 26 05:17:26.030692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-954c8e15-e9f1-4dcb-932e-975a2eac7e98 req-99ace5ee-3bb5-4b15-826a-e0ca0d40bb7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092279 Oct 26 05:17:26.031998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2044/4081] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:26.064553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:26.065355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:26.075787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:26.076810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:26.077611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:26.078594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:26.079483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:26.080345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:26.188250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:26.199655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:26.201933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:26.208915 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63d0cf84-127d-418d-bf31-2cfca2bb379e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.150310 Oct 26 05:17:26.210535 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2045/4082] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:26 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:26.361755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:26.362449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:26.376711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:26.381571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:26.382159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:26.383083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:26.383652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:26.384203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:26.868358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:26.878122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:26.885114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:26.888836 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f358d8c-4f47-42e8-bbbe-9a28dc47c0c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.531656 Oct 26 05:17:26.889611 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2046/4083] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:26 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:17:26.900158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:26.901450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:26.918464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:26.919379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:26.923981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:26.925713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:26.926546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:26.927216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:27.297440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:27.307978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-29831264-7464-4a6e-b7c8-c8a5f0885dd0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.415780 Oct 26 05:17:27.310805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2047/4084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:26 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:27.324523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:27.325229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:27.340734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:27.341244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:27.341850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:27.344652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:27.345129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:27.345604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:27.529505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:27.541377 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de3b4d39-0572-4299-a4b2-1c0c2a9b045b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1267 microversion: 2.1 time: 0.226449 Oct 26 05:17:27.543045 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2048/4085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:27 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:27.548979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:27.549669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:27.558780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:27.559214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:27.559713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:27.560520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:27.561458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:27.561867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:27.694912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:27.710357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:27.723113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:27.741946 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49a4b26c-0b69-474d-897b-10963c842d56 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.197556 Oct 26 05:17:27.743471 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2049/4086] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:27 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:27.920376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:27.921654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:27.931526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:27.932208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:27.932896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:27.933891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:27.934598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:27.935292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:28.294373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:28.323980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:28.325722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:28.326957 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc3a7d2a-efc5-4797-bcca-b307925fe86d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.412673 Oct 26 05:17:28.345128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2050/4087] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:27 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:28.365501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:28.372134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:28.403707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:28.404222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:28.404670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:28.405482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:28.405941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:28.406370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:28.462176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:28.872949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:28.884090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82a4049a-2bd5-4909-b404-30b70ea1b196 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.537363 Oct 26 05:17:28.910477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2051/4088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:28 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:28.916528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1137867954", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "718540b0-0ed9-461a-9a6d-b4c654c4ea60"}], "security_groups": [{"name": "tempest-securitygroup--1191698934"}], "key_name": "tempest-keypair-2075158436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "101c89cb-3603-476d-8bd9-a34afbd7bedb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:29.264471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] validate_networks() for [('718540b0-0ed9-461a-9a6d-b4c654c4ea60', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:17:30.774769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Getting quotas for project 3eb400dc73bf4e7a86cacf67e28e1218. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:30.795443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Getting quotas for user f4becac669f840d6a026ac76705d804e and project 3eb400dc73bf4e7a86cacf67e28e1218. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:30.824468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:17:30.827196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:17:30.827935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:17:30.828523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:17:30.830844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:17:30.849843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:30.852839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:30.853558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:30.856062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:30.856758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:30.857382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:30.906700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Getting quotas for project 3eb400dc73bf4e7a86cacf67e28e1218. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:30.924356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Getting quotas for user f4becac669f840d6a026ac76705d804e and project 3eb400dc73bf4e7a86cacf67e28e1218. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:31.123069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:17:31.125470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='101c89cb-3603-476d-8bd9-a34afbd7bedb',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:17:31.455402 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ad0f4bf-0f84-4be5-b815-92496afa544e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.542592 Oct 26 05:17:31.457349 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2052/4089] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:17:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 2546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:17:31.466512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:31.467190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:31.484867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:31.485749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:31.486543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:31.494289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:31.496385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:31.497757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:31.808028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:31.830518 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb71cfe1-aad8-4712-9616-8fc4c4c328ce tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1315 microversion: 2.1 time: 0.372026 Oct 26 05:17:31.851426 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2053/4090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:31 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:31.859004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:31.862280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:31.885596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:31.889035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:31.903806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:31.906168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:31.908125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:31.909103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:32.112066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:32.130060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:32.144384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:32.168094 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d003170a-8338-42fc-a04f-fe110d42ca5f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.315351 Oct 26 05:17:32.171603 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2054/4091] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:31 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:32.192395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:32.195463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:32.227498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:32.228843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:32.230943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:32.232956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:32.235781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:32.238484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:32.670080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:32.682520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:32.684125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:32.685152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55831510-b77d-4df2-9b79-382d804946d7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.512239 Oct 26 05:17:32.701745 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2055/4092] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:32 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:32.711543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:32.712227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:32.734573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:32.735145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:32.735733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:32.736488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:32.736968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:32.737527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:33.036600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:33.045579 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24b18eb1-e10d-40f2-a27b-570f3c960d23 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.342679 Oct 26 05:17:33.047554 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2056/4093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:32 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:33.061792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:33.062709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:33.075231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:33.079977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:33.080755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:33.082411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:33.083229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:33.085110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:33.195865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:33.205643 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6ed1966-9958-42d0-bf0d-92657365f3b2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1220 microversion: 2.1 time: 0.155272 Oct 26 05:17:33.206754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2057/4094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:33 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:33.212706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:33.213778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:33.220574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:33.221259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:33.222652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:33.223938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:33.224364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:33.224909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:33.560653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:33.573856 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d65991b-71bb-44c0-a7d8-94b9f4c1be5c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1315 microversion: 2.1 time: 0.365462 Oct 26 05:17:33.575528 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2058/4095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:33 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:33.935134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9fe7b844-5ca5-42df-a3c3-5a189bec703d req-7f18d5c8-92bf-441c-8040-ee3051f61a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bc13ba-5d74-4815-930c-2156a5bebbae", "tag": "5d39223b-8c2b-4b8c-b628-4870bb807434"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:34.009024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9fe7b844-5ca5-42df-a3c3-5a189bec703d req-7f18d5c8-92bf-441c-8040-ee3051f61a81 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:34.009734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9fe7b844-5ca5-42df-a3c3-5a189bec703d req-7f18d5c8-92bf-441c-8040-ee3051f61a81 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:34.013901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9fe7b844-5ca5-42df-a3c3-5a189bec703d req-7f18d5c8-92bf-441c-8040-ee3051f61a81 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:34.066733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9fe7b844-5ca5-42df-a3c3-5a189bec703d req-7f18d5c8-92bf-441c-8040-ee3051f61a81 service nova] Creating event network-changed:5d39223b-8c2b-4b8c-b628-4870bb807434 for instance f3bc13ba-5d74-4815-930c-2156a5bebbae on n-h1-862416-4 Oct 26 05:17:34.084469 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9fe7b844-5ca5-42df-a3c3-5a189bec703d req-7f18d5c8-92bf-441c-8040-ee3051f61a81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506830 Oct 26 05:17:34.088035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2059/4096] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:34.105651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:34.106880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:34.123200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:34.124142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:34.125695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:34.128933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:34.132687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:34.145851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:35.010443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:35.020044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:35.030318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:35.041672 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb76720d-58f2-494b-b1ff-66b8327ec017 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.948856 Oct 26 05:17:35.080398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2060/4097] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:34 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:35.104541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:35.105724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:35.130438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:35.140303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:35.151317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:35.152398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:35.153068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:35.153721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:35.316288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:35.662340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=21 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:35.682814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:35.692366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:35.694874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:35.695060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88c77485-ffde-4f2c-8079-d348970735f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.612694 Oct 26 05:17:35.695628 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2061/4098] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:35 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:35.732289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:35.732928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:35.752985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:35.754570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:35.755036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:35.755762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:35.756226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:35.756654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:36.330510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:36.345354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a3676cd-3ed4-404d-a129-f4c0df972070 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.648552 Oct 26 05:17:36.365414 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2062/4099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:35 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:36.374186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:36.375297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:36.386651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:36.387411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:36.388240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:36.406616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:36.408461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:36.413997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:36.878368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:36.889487 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c4e8ae5-89fd-4bb1-b908-0efe88fa41bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1238 microversion: 2.1 time: 0.520130 Oct 26 05:17:36.893386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2063/4100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:36 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1238 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:36.914652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:36.916493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:36.930006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:36.934770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:36.935934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:36.937043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:36.937736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:36.941577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:37.396159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:37.411126 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ec0f753-4da4-43cf-88a7-a68f1e3f7485 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1315 microversion: 2.1 time: 0.512418 Oct 26 05:17:37.411711 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2064/4101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:36 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:37.420448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5911296d-7dc0-4858-b3ab-f31467777fc1 req-d4bb4015-8fd1-4479-a54d-0eae664d064e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9489a0e-edb8-4532-b2ed-695abcfcfcd7", "name": "network-vif-plugged", "status": "completed", "tag": "0c846007-1460-4a7f-859e-d9a2c0213d25"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:37.440946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5911296d-7dc0-4858-b3ab-f31467777fc1 req-d4bb4015-8fd1-4479-a54d-0eae664d064e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:37.447557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5911296d-7dc0-4858-b3ab-f31467777fc1 req-d4bb4015-8fd1-4479-a54d-0eae664d064e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:37.448297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5911296d-7dc0-4858-b3ab-f31467777fc1 req-d4bb4015-8fd1-4479-a54d-0eae664d064e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:37.500032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5911296d-7dc0-4858-b3ab-f31467777fc1 req-d4bb4015-8fd1-4479-a54d-0eae664d064e service nova] Creating event network-vif-plugged:0c846007-1460-4a7f-859e-d9a2c0213d25 for instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 on n-h1-862416-4 Oct 26 05:17:37.514405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5911296d-7dc0-4858-b3ab-f31467777fc1 req-d4bb4015-8fd1-4479-a54d-0eae664d064e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101142 Oct 26 05:17:37.516933 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2065/4102] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:37.531500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:37.537698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:37.571192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:37.574581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:37.576399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:37.578574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:37.580227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:37.582278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:37.831407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:37.849812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:37.851292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:37.869396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8e1ad45-8ed6-4407-ad31-fff3f927df24 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.345565 Oct 26 05:17:37.871037 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2066/4103] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:37 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:37.876745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:37.877754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:37.885625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:37.886688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:37.887408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:37.888335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:37.889010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:37.889714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:37.961607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] validate_networks() for [('9da101bb-c3f5-4d08-8629-416901956d8f', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:17:38.243401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:38.251683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:38.253198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:38.254998 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a46b026-f423-414a-8afa-f1c94fe8014f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.382646 Oct 26 05:17:38.256097 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2067/4104] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:37 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:38.265409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:38.269266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:38.280757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:38.288892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:38.289651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:38.290565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:38.291205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:38.291828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:38.636673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:38.652721 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59cecce0-c35b-4342-a997-1be7f77970b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1315 microversion: 2.1 time: 0.395150 Oct 26 05:17:38.653388 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2068/4105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:38 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:38.676237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:38.676868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:38.685866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:38.716583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:38.717156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:38.717966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:38.724111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:38.727208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:38.924725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:17:38.926471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:17:38.930206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:17:38.932317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:17:38.932946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:17:38.959477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:38.966519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:38.971393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:38.973175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:38.978484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:38.979368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:39.027482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Getting quotas for project e7edaaf202ca492dab914b10ca9ea94b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:39.056256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Getting quotas for user 593f8670897a4798b22c77f5ddd40637 and project e7edaaf202ca492dab914b10ca9ea94b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:39.117572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:17:39.120581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:17:39.291404 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e0be585-05d0-4ae5-be9e-4663cdc34d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.956455 Oct 26 05:17:39.294178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2038/4106] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 13960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:17:39.327187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:39.340087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:39.367886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:39.374511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:39.378138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:39.378678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:39.379572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:39.381848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:39.392057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:39.392804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1d1ac564-9f7c-4669-9e6d-8a0168453c20 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1306 microversion: 2.1 time: 0.730040 Oct 26 05:17:39.392951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:39.397378 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2069/4107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:38 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1306 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:39.403804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:39.410818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:39.431721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:39.432632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:39.448631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:39.449710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:39.450477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:39.451157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:39.812725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:39.827301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:39.831888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:39.849009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b410cb3a-f374-410a-a956-4133cda5cd72 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1537 microversion: 2.91 time: 0.447847 Oct 26 05:17:39.850297 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2070/4108] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:39 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1537 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:39.860518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:39.861134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:39.878110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:39.900676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:39.900676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:39.901018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:39.901996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:39.902460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:39.902889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:40.337664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:40.358961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a74c28c8-b235-40f9-89e9-453f95abc2e9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1315 microversion: 2.1 time: 1.059772 Oct 26 05:17:40.364173 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2039/4109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:39 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:40.375298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1714234005", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "9da101bb-c3f5-4d08-8629-416901956d8f"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:40.617443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:40.626863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:40.630827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:40.632408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ebf7fa32-3505-473d-a20c-0507fcb5671d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.781193 Oct 26 05:17:40.634459 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2071/4110] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:39 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:40.651785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:40.652815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:40.659909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:40.661125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:40.661828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:40.663174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:40.663929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:40.664589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:40.884536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:40.902810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:40.912540 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0181eced-46c6-4a3c-8e2a-ef522cf5e649 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1502 microversion: 2.1 time: 0.276186 Oct 26 05:17:40.914446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2072/4111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:40 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:40.921432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-671cbc44-27a1-4472-80bb-fcfe0f684e51 req-7debcbe5-5dfc-436f-9176-f690832523ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de088b67-2832-44df-a8fa-756c18fd7892", "tag": "d85af49f-0e89-45c8-b063-ca374259b32b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:40.941986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-671cbc44-27a1-4472-80bb-fcfe0f684e51 req-7debcbe5-5dfc-436f-9176-f690832523ba service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:40.942511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-671cbc44-27a1-4472-80bb-fcfe0f684e51 req-7debcbe5-5dfc-436f-9176-f690832523ba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:40.942998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-671cbc44-27a1-4472-80bb-fcfe0f684e51 req-7debcbe5-5dfc-436f-9176-f690832523ba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:40.955469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=28 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:40.959008 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-671cbc44-27a1-4472-80bb-fcfe0f684e51 req-7debcbe5-5dfc-436f-9176-f690832523ba service nova] Creating event network-changed:d85af49f-0e89-45c8-b063-ca374259b32b for instance de088b67-2832-44df-a8fa-756c18fd7892 on n-h2-862416-4 Oct 26 05:17:40.965199 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-671cbc44-27a1-4472-80bb-fcfe0f684e51 req-7debcbe5-5dfc-436f-9176-f690832523ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048809 Oct 26 05:17:40.970432 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2073/4112] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:40.983551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:40.984562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:40.992591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:40.993093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:40.993587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:40.994308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:40.994771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:40.995214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:41.656439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:41.674372 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1a4ff7d-7de4-4b58-88b2-7839cfd8af3b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1306 microversion: 2.1 time: 0.702030 Oct 26 05:17:41.674989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2074/4113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:40 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1306 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:41.689552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-330f6759-0159-4d20-bf00-b1b9c4b23d10 req-fd29cbf3-8722-4772-af27-6cc6f6fb2158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bc13ba-5d74-4815-930c-2156a5bebbae", "name": "network-vif-plugged", "status": "completed", "tag": "5d39223b-8c2b-4b8c-b628-4870bb807434"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:41.731197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-330f6759-0159-4d20-bf00-b1b9c4b23d10 req-fd29cbf3-8722-4772-af27-6cc6f6fb2158 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:41.731862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-330f6759-0159-4d20-bf00-b1b9c4b23d10 req-fd29cbf3-8722-4772-af27-6cc6f6fb2158 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:41.732303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-330f6759-0159-4d20-bf00-b1b9c4b23d10 req-fd29cbf3-8722-4772-af27-6cc6f6fb2158 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:41.766550 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-330f6759-0159-4d20-bf00-b1b9c4b23d10 req-fd29cbf3-8722-4772-af27-6cc6f6fb2158 service nova] Creating event network-vif-plugged:5d39223b-8c2b-4b8c-b628-4870bb807434 for instance f3bc13ba-5d74-4815-930c-2156a5bebbae on n-h1-862416-4 Oct 26 05:17:41.779962 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-330f6759-0159-4d20-bf00-b1b9c4b23d10 req-fd29cbf3-8722-4772-af27-6cc6f6fb2158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099964 Oct 26 05:17:41.781596 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2075/4114] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:41.794867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:41.797028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:41.813635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:41.814401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:41.815083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:41.817343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:41.818034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:41.818717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:42.248540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:42.260430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:42.279299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:42.309628 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad026c81-9fa0-48b6-a972-47fa807e5948 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1540 microversion: 2.91 time: 0.526367 Oct 26 05:17:42.314096 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2076/4115] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:41 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1540 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:42.328727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:42.339169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:42.362189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:42.369242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:42.372411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:42.375006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:42.380104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:42.382909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:42.496821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'flavor' on Instance uuid e9489a0e-edb8-4532-b2ed-695abcfcfcd7 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:42.716623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3750c67-017c-4306-bd26-0fdd8a8600f5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "POST /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7/action" status: 202 len: 0 microversion: 2.1 time: 0.400908 Oct 26 05:17:42.726312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2077/4116] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:17:42 2022] POST /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:17:42.738507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:42.753199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:42.781961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:42.782460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:42.782898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:42.783604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:42.784073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:42.785260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.229730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:43.238400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc43a445-90a7-4d54-bfb3-41ba031cc6d9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1315 microversion: 2.1 time: 0.510432 Oct 26 05:17:43.257342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2078/4117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:42 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:43.257342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:43.257342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:43.266965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.270492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.271311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.272150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.272756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.273267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.476254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:43.485305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:43.490970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:43.493093 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ae4de18-48e0-41f1-a46d-401d3fb7aa3d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.246217 Oct 26 05:17:43.493889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2079/4118] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:43 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:43.500454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:43.505253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:43.513058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.526613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.529140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.529140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.529140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.529140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.613754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862416-4". {{(pid=120586) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 05:17:43.709527 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-069d9aad-69d4-4e11-ad08-1dbcad0cece4 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action" status: 202 len: 0 microversion: 2.91 time: 0.214379 Oct 26 05:17:43.710882 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2080/4119] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:17:43 2022] POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:17:43.719247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:43.720398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:43.728006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.728759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.729653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.730715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.731358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.731966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.891023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:43.902781 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c7ef333-8422-4d2c-a115-6d02742b55cc tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1306 microversion: 2.1 time: 0.190072 Oct 26 05:17:43.904142 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2081/4120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:43 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:43.911977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:43.912663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:43.919776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.920275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.920715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:43.921456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:43.921919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:43.922402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:44.643830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:44.652161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23eab8dc-f2fa-4937-9df0-c397f4d9f59c tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1493 microversion: 2.1 time: 0.746438 Oct 26 05:17:44.652965 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2082/4121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:43 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1493 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:44.657443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:44.660289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:44.666536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:44.667040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:44.667488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:44.668460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:44.668936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:44.669436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:44.754659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:44.763741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:44.765260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:44.771722 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ea9d5f9-f3d3-4aaf-bf0d-d51a15fa9928 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1488 microversion: 2.91 time: 0.117656 Oct 26 05:17:44.772623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2083/4122] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:44 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1488 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:44.777455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:44.778078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:44.784091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:44.785228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:44.785682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:44.786391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:44.786858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:44.787292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:44.947244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:44.952546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:44.961087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0db3aeb8-86d1-463f-954b-a2fbb6d9f78b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1502 microversion: 2.1 time: 0.187330 Oct 26 05:17:44.973103 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2084/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:44 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:44.973103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:44.973103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:44.979153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:44.979658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:44.980106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:44.980821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:44.981285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:44.981746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.159114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:45.168243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:45.170058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:45.171292 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4057c88c-b4f7-4b8c-ae96-753ecff94996 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.208526 Oct 26 05:17:45.171865 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2085/4124] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:44 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:45.199458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:45.199976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:45.216399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.217376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.218002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.219389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.220226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.220848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.262730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:17:45.436901 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a49b285f-4af7-4957-a708-25e62434c197 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 204 len: 0 microversion: 2.1 time: 0.249761 Oct 26 05:17:45.444286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2086/4125] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:45 2022] DELETE /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:17:45.455307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:45.459426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:45.468866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.469407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.469849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.470838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.471301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.479275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.669563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:45.682994 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34bd94f9-9503-4e2b-a6f3-cacb5eacb677 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.236281 Oct 26 05:17:45.694592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2087/4126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:45 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:45.702648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:45.703189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:45.719209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.719735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.720176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.722010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.724658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.725891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.830996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1befd757-e4d8-443f-97f4-61d01cbd90cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae/action" status: 202 len: 0 microversion: 2.1 time: 0.134710 Oct 26 05:17:45.835408 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2088/4127] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:17:45 2022] POST /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:17:45.841632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:45.842166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:45.850242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.850725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.851450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:45.852187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:45.853066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:45.853786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:46.090707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:46.100861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ecbf0074-a048-450c-b81e-35e524f5205e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1499 microversion: 2.1 time: 0.266310 Oct 26 05:17:46.105027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2089/4128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:45 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1499 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:46.137207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:46.137958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:46.154199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:46.154669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:46.155254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:46.156905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:46.160363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:46.160860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:46.458562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:46.473269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:46.482516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:46.495404 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd32c963-ea61-45a1-bab0-81f05bc2195b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1488 microversion: 2.91 time: 0.389065 Oct 26 05:17:46.519080 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2090/4129] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:46 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1488 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:46.531972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:46.532663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:46.547452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:46.548208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:46.548669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:46.549437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:46.555100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:46.555630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:46.831632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:46.843819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec50ee94-7cba-4503-9242-fb01b35491f2 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1507 microversion: 2.1 time: 0.323540 Oct 26 05:17:46.848128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2091/4130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:46 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:46.867133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:46.867763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:46.885581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:46.886163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:46.886628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:46.887364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:46.889352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:46.889352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.163307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:47.176846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:47.178358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:47.184876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62606b3a-7604-447a-8298-621a36a1e999 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.335743 Oct 26 05:17:47.185503 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2092/4131] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:46 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:47.190083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:47.193895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:47.224496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.224496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.224496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.226469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.228029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.228029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.621865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:47.633525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-87586770-afc0-4bba-8dc7-6cadb05de4e3 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.446875 Oct 26 05:17:47.634365 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2093/4132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:47 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:47.651258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4804c0c8-1b92-4c64-8ed5-8260b0db0dd6 req-e6303243-4c0c-48b6-8867-f356e6bf2e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92788f46-2da5-4d2d-8c1d-5d47eebb0d04", "tag": "3caed5c7-479c-4f71-bde3-c2a03e82b2cc"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:47.667697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4804c0c8-1b92-4c64-8ed5-8260b0db0dd6 req-e6303243-4c0c-48b6-8867-f356e6bf2e7d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.668612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4804c0c8-1b92-4c64-8ed5-8260b0db0dd6 req-e6303243-4c0c-48b6-8867-f356e6bf2e7d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.669596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4804c0c8-1b92-4c64-8ed5-8260b0db0dd6 req-e6303243-4c0c-48b6-8867-f356e6bf2e7d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.700527 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4804c0c8-1b92-4c64-8ed5-8260b0db0dd6 req-e6303243-4c0c-48b6-8867-f356e6bf2e7d service nova] Creating event network-changed:3caed5c7-479c-4f71-bde3-c2a03e82b2cc for instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 on n-h1-862416-4 Oct 26 05:17:47.708492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4804c0c8-1b92-4c64-8ed5-8260b0db0dd6 req-e6303243-4c0c-48b6-8867-f356e6bf2e7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065068 Oct 26 05:17:47.710037 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2094/4133] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:47.716433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:47.718003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:47.726660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.727926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.728483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.729304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.729896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.730801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.759646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d7a3c8e-6854-4bca-8aed-db194960c6a2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/ips" status: 200 len: 149 microversion: 2.1 time: 0.048099 Oct 26 05:17:47.770231 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2095/4134] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:17:47 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:47.777506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:47.777841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:47.791581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.793697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.794280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:47.795114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:47.795687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:47.796228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.016046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.030423 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7a32516-5e34-4187-bcf5-017309aae23e tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1499 microversion: 2.1 time: 0.258895 Oct 26 05:17:48.031503 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2096/4135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:47 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1499 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:48.041248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:48.041926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:48.049050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.050456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.051629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.052902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.053441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.053874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.154502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.167187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.169936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.178159 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c08cc90-f39e-4b41-a6e3-41b0910c4869 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1488 microversion: 2.91 time: 0.145287 Oct 26 05:17:48.179016 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2097/4136] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:48 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1488 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:48.184940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce4a40bd-afcb-4751-8faf-6bf4963d9ac0"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:48.188057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:48.196841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.200452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.200980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.201763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.202234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.202661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.394897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Invalid volume: volume ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 is already attached to instances: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/os-volume_attachments HTTP/1.1 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 74 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: {"volumeAttachment": {"volumeId": "ce4a40bd-afcb-4751-8faf-6bf4963d9ac0"}} Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid volume: volume ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 is already attached to instances: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': 'da72c67d-c2eb-4917-9051-70592110c760', 'body': {'volumeAttachment': {'volumeId': 'ce4a40bd-afcb-4751-8faf-6bf4963d9ac0'}}} Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 is already attached to instances: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:17:48.396689 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 is already attached to instances: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 is already attached to instances: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 400 to user: Invalid volume: volume ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 is already attached to instances: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0d1e43d-6812-4a4b-8727-bdca5baa4178 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.217855 Oct 26 05:17:48.402758 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2098/4137] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:17:48 2022] POST /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760/os-volume_attachments => generated 174 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:17:48.415142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:48.415773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:48.427650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.428167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.429206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.430007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.430443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.430879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.621094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.623988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:48.633938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6007a39b-f2a4-4936-b48b-5670e6641b34 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1487 microversion: 2.1 time: 0.228323 Oct 26 05:17:48.650308 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2099/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:48 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1487 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:48.655556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:48.657193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:48.665383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.666049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.666609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.667427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.667994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.668530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.857704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.866810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.868220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:48.869439 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-58b27962-a1f1-4034-ae5e-2ea7cebfa043 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.217868 Oct 26 05:17:48.870006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2100/4139] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:48 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:48.874830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:48.875545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:48.881937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.882437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.882944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.883664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:48.884138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:48.884592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:48.913545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:17:49.005762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4710ac9a-e505-497f-9953-ec1bb228ca22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 204 len: 0 microversion: 2.1 time: 0.134038 Oct 26 05:17:49.006482 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2101/4140] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:48 2022] DELETE /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:17:49.012633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:49.014161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:49.015315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:49.023690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.024404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.024652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.025549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.026030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.026464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.073882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:49.116590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] validate_networks() for [('9da101bb-c3f5-4d08-8629-416901956d8f', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:17:49.271792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:49.283720 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-03ae1a19-a61b-4017-a0d0-3038e0addbad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.275724 Oct 26 05:17:49.284320 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2102/4141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:49 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:49.289740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:49.290275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:49.296160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.296652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.297141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.298304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.298881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.299601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.328817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lazy-loading 'flavor' on Instance uuid f3bc13ba-5d74-4815-930c-2156a5bebbae {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:49.724064 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c47f1914-1ce7-47eb-ada6-3b7878a509a1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae/action" status: 202 len: 0 microversion: 2.1 time: 0.437687 Oct 26 05:17:49.725563 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2103/4142] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:17:49 2022] POST /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:17:49.752355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:49.756205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:49.792916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.796316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.800391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.803856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.804585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.806963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.847961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:17:49.848413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:17:49.848885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:17:49.849290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:17:49.849748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:17:49.880051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.880944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.881658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.882477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:49.887228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:49.888021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:49.929078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Getting quotas for project e7edaaf202ca492dab914b10ca9ea94b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:49.937448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Getting quotas for user 593f8670897a4798b22c77f5ddd40637 and project e7edaaf202ca492dab914b10ca9ea94b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:49.978848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:17:49.985855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:17:50.032783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.043427 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4ea7bcbc-462d-4529-9de7-2cd83876902a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1679 microversion: 2.1 time: 0.315555 Oct 26 05:17:50.044335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2104/4143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:49 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1679 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:50.050365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:50.051371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:50.059653 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71d56214-7185-4972-a0ca-d3b0a4586f5e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.687702 Oct 26 05:17:50.069005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.069676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.073976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2040/4144] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 9702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:17:50.076701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.077592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.078089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.078535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.081802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:50.082423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:50.095444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.096149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.096507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.099647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.100388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.100780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.117859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.118672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.119295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.119932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lazy-loading 'fault' on Instance uuid e9489a0e-edb8-4532-b2ed-695abcfcfcd7 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:50.194863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5723b278179404b9fd7de738b492f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec71918b8580462d8bea4141a5cf7419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.212076 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f44c4703-edba-40db-9752-6f0a459c04de tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 200 len: 1305 microversion: 2.1 time: 0.160141 Oct 26 05:17:50.212762 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2105/4145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:50 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 1305 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:50.223448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9ae544ee-5234-4ee6-8d4a-a5f076c0b85b req-3af93c36-eb34-4209-bb76-beb91fc192d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9489a0e-edb8-4532-b2ed-695abcfcfcd7", "name": "network-vif-deleted", "tag": "0c846007-1460-4a7f-859e-d9a2c0213d25"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:50.249104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9ae544ee-5234-4ee6-8d4a-a5f076c0b85b req-3af93c36-eb34-4209-bb76-beb91fc192d5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.249479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9ae544ee-5234-4ee6-8d4a-a5f076c0b85b req-3af93c36-eb34-4209-bb76-beb91fc192d5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.250804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9ae544ee-5234-4ee6-8d4a-a5f076c0b85b req-3af93c36-eb34-4209-bb76-beb91fc192d5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.270793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.278135 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9ae544ee-5234-4ee6-8d4a-a5f076c0b85b req-3af93c36-eb34-4209-bb76-beb91fc192d5 service nova] Creating event network-vif-deleted:0c846007-1460-4a7f-859e-d9a2c0213d25 for instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 on n-h1-862416-4 Oct 26 05:17:50.281626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.284420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.287219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9ae544ee-5234-4ee6-8d4a-a5f076c0b85b req-3af93c36-eb34-4209-bb76-beb91fc192d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073085 Oct 26 05:17:50.288029 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2106/4146] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:50.292571 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1aacd50d-cf43-43fc-8a79-9e466dbc1bca tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1488 microversion: 2.91 time: 0.216869 Oct 26 05:17:50.301340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:50.301340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:50.307811 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2041/4147] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:50 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1488 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:50.308183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:50.312086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.312086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.312086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.312614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.313236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.319755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.319942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:50.319942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:50.328434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.329251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.329913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.331008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.331602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.332419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.571348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.584753 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d4ead09e-dfe3-4f84-8579-0f330c2d28e5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1514 microversion: 2.1 time: 0.295379 Oct 26 05:17:50.597952 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2107/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:50 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:50.606891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1903947080", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "451", "networks": [{"uuid": "9da101bb-c3f5-4d08-8629-416901956d8f"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:50.610267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.628100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.630228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:50.633400 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2ae270ac-9b64-493c-8877-a75e7dba1d1e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1740 microversion: 2.20 time: 0.319531 Oct 26 05:17:50.635178 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2042/4149] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:50 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:50.661101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:50.661762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:50.687969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] validate_networks() for [('9da101bb-c3f5-4d08-8629-416901956d8f', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:17:50.690221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.691451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.691900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:50.706486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:50.706981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:50.707437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.056973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:51.067121 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9012c33a-3460-440c-8966-de91fdc356a6 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.430592 Oct 26 05:17:51.083552 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2043/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:50 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:51.089858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:51.091261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:51.098628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.099342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.099992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.100700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.101224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.103437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.541855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:51.551331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df3ef154-103d-4c66-8cd7-ffc13f3d3cf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1679 microversion: 2.1 time: 0.466278 Oct 26 05:17:51.552277 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2044/4151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:51 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1679 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:51.558023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:51.558746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:51.565211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.565860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.566839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.567799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.568478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.568980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.583389 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 HTTP/1.1 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e9489a0e-edb8-4532-b2ed-695abcfcfcd7'} Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:51.586505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc512e17-85b9-406e-8af4-cf9d857378a7 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 404 len: 111 microversion: 2.1 time: 0.035069 Oct 26 05:17:51.593890 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2045/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:51 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:51.595426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:51.595611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:51.604871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.607194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.607194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.607194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.607559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.607659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.752529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:51.761530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:17:51.762031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:17:51.762435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:51.762624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:17:51.762941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:17:51.763359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:17:51.765713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:51.772749 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-65b1fecf-e9f3-4c68-8c12-8e3b83d3529d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.182627 Oct 26 05:17:51.773735 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2046/4153] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:51 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:51.778833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:51.779493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:51.783580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.784235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.785457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.786222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.786704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.787273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.794697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.795326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.795873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.796591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.797055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.797520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.812820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Getting quotas for project e7edaaf202ca492dab914b10ca9ea94b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:17:51.814326 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 HTTP/1.1 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e9489a0e-edb8-4532-b2ed-695abcfcfcd7'} Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:51.817562 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:51.823035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:51.826016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-811e6f0f-fdbb-4ed5-90cc-a923ebf6f669 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 404 len: 111 microversion: 2.1 time: 0.049267 Oct 26 05:17:51.826016 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2047/4154] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:51 2022] DELETE /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:51.828159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Getting quotas for user 593f8670897a4798b22c77f5ddd40637 and project e7edaaf202ca492dab914b10ca9ea94b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:17:51.833243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:51.834132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:51.843457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.843457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.843457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.844452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.845293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.845948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.849751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:17:51.852643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:17:51.906324 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6dc5d10f-0956-4474-8954-2ebeedf1cdb3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.307112 Oct 26 05:17:51.912953 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2108/4155] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:17:51.919245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:51.920207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:51.929274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.930182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.930836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:51.932383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:51.933535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:51.933929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:52.848017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:52.873539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-76e06390-b89d-4b58-ad72-3d9cb3142f36 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1514 microversion: 2.1 time: 1.046551 Oct 26 05:17:52.883183 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2048/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:51 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1514 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:52.900852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:52.905827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: e9489a0e-edb8-4532-b2ed-695abcfcfcd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:52.935949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:52.937408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:52.939138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:52.942095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:52.942875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:52.946665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:52.974168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 HTTP/1.1 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e9489a0e-edb8-4532-b2ed-695abcfcfcd7'} Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:52.976799 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. Oct 26 05:17:52.982505 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:52.983132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:52.985452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance e9489a0e-edb8-4532-b2ed-695abcfcfcd7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:52.988044 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b00315cf-9d72-45dc-8a2c-03542ee2f46b tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7" status: 404 len: 111 microversion: 2.1 time: 0.103640 Oct 26 05:17:52.988794 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2049/4157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:52 2022] GET /compute/v2.1/servers/e9489a0e-edb8-4532-b2ed-695abcfcfcd7 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:52.993568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:52.995802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:52.997673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.000077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:53.001357 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e70323eb-a89b-460d-8ce7-d19ea039126c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1722 microversion: 2.20 time: 1.087013 Oct 26 05:17:53.002154 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2109/4158] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:51 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1722 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:53.006732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.007235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.007679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.008394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.008850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.009374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.013573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:53.014201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.029109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.032448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.033727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.034703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.037290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.040851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.228765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:53.239502 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-770719cf-c9bf-48f5-a1bf-87ec6414ce15 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1217 microversion: 2.1 time: 0.249229 Oct 26 05:17:53.250551 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2050/4159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:52 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:53.263923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:53.264930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.272799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.273428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.274270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.275442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.276108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.276761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.477920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:53.486674 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f636d5f-a07e-4032-a023-386fc273848d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1611 microversion: 2.1 time: 0.234767 Oct 26 05:17:53.499233 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2051/4160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:53 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1611 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:53.518132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:53.518810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.550917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.551873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.553290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.558387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.562352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.566163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.591416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:53.603982 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4562be30-c1e8-410e-a9f8-767dedd82e8d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.595279 Oct 26 05:17:53.630250 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2110/4161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:53 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:53.635471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:53.636036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.655266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.655897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.656360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.657093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.660752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.661353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.719487 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 HTTP/1.1 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'fcd8172c-1ff0-4df2-8099-d32c1e3e1517'} Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:53.721232 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22c106d9-ca4f-482b-bc87-93da8239ba44 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 404 len: 111 microversion: 2.1 time: 0.091861 Oct 26 05:17:53.728578 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2111/4162] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:53 2022] DELETE /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:53.773711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:53.775628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: fcd8172c-1ff0-4df2-8099-d32c1e3e1517] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.845769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.848803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.854769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.861741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.880194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.887947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.916074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 HTTP/1.1 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'fcd8172c-1ff0-4df2-8099-d32c1e3e1517'} Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:53.930968 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance fcd8172c-1ff0-4df2-8099-d32c1e3e1517 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:53.937108 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-02c9c72d-79de-4205-a471-a2a6a7f4eb8f tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517" status: 404 len: 111 microversion: 2.1 time: 0.189674 Oct 26 05:17:53.948581 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2112/4163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:53 2022] GET /compute/v2.1/servers/fcd8172c-1ff0-4df2-8099-d32c1e3e1517 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:53.962273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:53.966206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:53.982906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.983407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.984020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:53.984562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:53.985029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:53.985497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.101904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:54.116560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:54.128166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:54.164165 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf2062a9-f54e-4ceb-9957-765464b8008f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.663731 Oct 26 05:17:54.169434 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2052/4164] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:53 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:54.188076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:54.189105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:54.210763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:54.212733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:54.214748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.215761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:54.218174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:54.219573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.245988 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f HTTP/1.1 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f'} Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:54.261916 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:54.266866 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:54.272531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:54.275064 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-01e22b9b-91be-4243-8f31-10b07945bd7d tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 404 len: 111 microversion: 2.1 time: 0.103400 Oct 26 05:17:54.277418 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2053/4165] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:54 2022] DELETE /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:54.289371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:54.290744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:54.299488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:54.300744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:54.301414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.302424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:54.302984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:54.305752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.687070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:54.699179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e57fd20-8d33-45f2-acf1-a359445a10bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.748035 Oct 26 05:17:54.701712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2113/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:53 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:54.708937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:54.709833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:54.717431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:54.720072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:54.720731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.724940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:54.731552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:54.740001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:54.975571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:54.984167 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2244b993-a05d-479d-b7aa-47ae3c46b924 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1281 microversion: 2.1 time: 0.280569 Oct 26 05:17:54.984999 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2114/4167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:54 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:55.012184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.012710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.030014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.030521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.030968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.031684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.038782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.039634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.064763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:55.067157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f HTTP/1.1 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f'} Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:55.069612 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. Oct 26 05:17:55.075338 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.077270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:55.078379 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ccd9b02-603f-4305-9cc9-3a3e3d3190a5 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f" status: 404 len: 111 microversion: 2.1 time: 0.092674 Oct 26 05:17:55.082562 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2115/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:54 2022] GET /compute/v2.1/servers/7cb46a0d-930c-4a0f-92a8-2c4fc4910f5f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:55.089078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.097096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.113280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.114101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.115104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.116011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.116659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.117536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.295078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.305752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.314517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.321105 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a5171d0-c034-479e-8473-4de6a069d4d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1722 microversion: 2.20 time: 1.042313 Oct 26 05:17:55.333337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2054/4169] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:54 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1722 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:55.343526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.343526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.372869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.373477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.373929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.374659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.375113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.388381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.414966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.424702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d15ae515-0eeb-4445-8694-e9f530429149 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1611 microversion: 2.1 time: 0.340587 Oct 26 05:17:55.446458 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2116/4170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:55 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1611 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:55.451659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.452162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.485708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.486383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.486954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.487906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.488566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.490015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.523057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f HTTP/1.1 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '818c473d-f6f2-4328-89d6-14ec2860e77f'} Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:55.525652 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.530664 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.534074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:55.536405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f793633c-df40-4d89-b664-67157647e5ac tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 404 len: 111 microversion: 2.1 time: 0.088740 Oct 26 05:17:55.537203 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2117/4171] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:55 2022] DELETE /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:55.547369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.548878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.558489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.558982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.560207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.560920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.561437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.561869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.696595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.709172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.713332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.730033 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f17e89fb-810e-4104-ae6d-733ca745741e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.191175 Oct 26 05:17:55.730996 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2118/4172] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:55 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:55.741359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:55.755054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0c4d27b9-065b-4e25-b307-ec387370412c req-ede7000f-a972-49ad-9df0-6e798211bb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:55.755598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b98a07e-85a2-4b85-8dbc-9147c391446d tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.426469 Oct 26 05:17:55.756522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2055/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:55 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:55.777026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f0c59d82-9f31-4005-8f44-8e0b19f0302d req-c7af1347-2661-46fd-a61b-64bd09df34c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da72c67d-c2eb-4917-9051-70592110c760", "name": "network-vif-deleted", "tag": "8048d852-5511-4a0d-9f3e-7a9f39f4adbc"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:55.788675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0c4d27b9-065b-4e25-b307-ec387370412c req-ede7000f-a972-49ad-9df0-6e798211bb0a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.789173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0c4d27b9-065b-4e25-b307-ec387370412c req-ede7000f-a972-49ad-9df0-6e798211bb0a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.789666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0c4d27b9-065b-4e25-b307-ec387370412c req-ede7000f-a972-49ad-9df0-6e798211bb0a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.800308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f0c59d82-9f31-4005-8f44-8e0b19f0302d req-c7af1347-2661-46fd-a61b-64bd09df34c3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.801020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f0c59d82-9f31-4005-8f44-8e0b19f0302d req-c7af1347-2661-46fd-a61b-64bd09df34c3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.801512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f0c59d82-9f31-4005-8f44-8e0b19f0302d req-c7af1347-2661-46fd-a61b-64bd09df34c3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.820153 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0c4d27b9-065b-4e25-b307-ec387370412c req-ede7000f-a972-49ad-9df0-6e798211bb0a service nova] Creating event network-vif-unplugged:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h2-862416-4 Oct 26 05:17:55.827543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f0c59d82-9f31-4005-8f44-8e0b19f0302d req-c7af1347-2661-46fd-a61b-64bd09df34c3 service nova] Creating event network-vif-deleted:8048d852-5511-4a0d-9f3e-7a9f39f4adbc for instance da72c67d-c2eb-4917-9051-70592110c760 on n-h2-862416-4 Oct 26 05:17:55.829334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0c4d27b9-065b-4e25-b307-ec387370412c req-ede7000f-a972-49ad-9df0-6e798211bb0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096914 Oct 26 05:17:55.832389 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2119/4174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:55.840141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.840918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 818c473d-f6f2-4328-89d6-14ec2860e77f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.844548 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f0c59d82-9f31-4005-8f44-8e0b19f0302d req-c7af1347-2661-46fd-a61b-64bd09df34c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086600 Oct 26 05:17:55.849888 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2056/4175] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:55.861189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.863538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:55.871045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.871867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.872698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.873620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.875914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.876552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.885573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.887352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.890382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.891361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:55.895406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:55.896108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:55.934416 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f HTTP/1.1 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '818c473d-f6f2-4328-89d6-14ec2860e77f'} Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:55.937740 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. Oct 26 05:17:55.943516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:55.953186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 818c473d-f6f2-4328-89d6-14ec2860e77f could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:55.957391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-520199f9-08a6-405b-b960-3627e30f05ca tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f" status: 404 len: 111 microversion: 2.1 time: 0.123237 Oct 26 05:17:55.960492 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2120/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:55 2022] GET /compute/v2.1/servers/818c473d-f6f2-4328-89d6-14ec2860e77f => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:55.969567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:55.974826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:56.005751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.007411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.008092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.009036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.009741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.010588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.051746 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 HTTP/1.1 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '90e01b75-9d4c-4cf2-b1cc-843f93bffbe2'} Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:56.058266 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.064209 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.066582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:56.067827 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b4d9fae-c8b7-4bd0-955b-1a5467630a78 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2" status: 404 len: 111 microversion: 2.1 time: 0.102366 Oct 26 05:17:56.069614 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2121/4177] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:17:55 2022] DELETE /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:17:56.074598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:56.088919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:56.095917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.097232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.102403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.103852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.104356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.104808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.306948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:56.318078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb9989f0-5d09-46b2-8b9c-51c2ad0b0886 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1281 microversion: 2.1 time: 0.245621 Oct 26 05:17:56.318708 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2122/4178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:56 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:56.328084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:56.328705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:56.355233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:56.368741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.369272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.369719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.370069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f787baf5-993c-4068-a43b-a1de5a1f9138 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.515080 Oct 26 05:17:56.382083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.383138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.389492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.390549 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2057/4179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:55 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:56.401481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:56.402320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:56.419104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.419843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.420483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.425769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.429012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.430651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.517953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 HTTP/1.1 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '90e01b75-9d4c-4cf2-b1cc-843f93bffbe2'} Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:56.536560 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:17:56.542227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:56.542961 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f26bf303-e700-411d-b74e-752019a067c4 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2" status: 404 len: 111 microversion: 2.1 time: 0.218597 Oct 26 05:17:56.552405 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2123/4180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:56 2022] GET /compute/v2.1/servers/90e01b75-9d4c-4cf2-b1cc-843f93bffbe2 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:56.574805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:56.590806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:56.616116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.616568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.617038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.617787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.630097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.630720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.793931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:56.805111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:56.805111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:56.805111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lazy-loading 'fault' on Instance uuid da72c67d-c2eb-4917-9051-70592110c760 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:17:56.961023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:56.977968 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36e92fcc-2ddc-4feb-bca6-638f2e672d2d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 200 len: 1329 microversion: 2.1 time: 0.424348 Oct 26 05:17:56.978765 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2124/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:56 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 1329 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:57.000175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:57.001683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:57.029179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:57.033650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:57.038664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:57.040372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:57.043249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:57.044813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:57.250470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:57.265763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:57.286152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:57.290616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94a9fd27-d328-4feb-85da-d17a612ba7fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1722 microversion: 2.20 time: 0.897848 Oct 26 05:17:57.309632 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2058/4182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:56 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1722 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:57.318456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:57.319427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:57.350275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:57.353205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:57.356843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:57.374596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:57.380971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:57.382238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:57.384910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:57.390638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:57.414347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:57.420880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:57.482435 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4fc80405-ac05-4e75-83ac-9997afb31946 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.498178 Oct 26 05:17:57.511297 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2125/4183] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:56 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:57.543096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:57.547433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:57.606119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:57.609967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:57.611443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:57.616424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:57.617939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:57.620689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.116179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:58.125179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa2d0b05-9a87-4843-9201-1e1280c7d8a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1279 microversion: 2.1 time: 0.605838 Oct 26 05:17:58.127926 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2126/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:57 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1279 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:58.137534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:58.142581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:58.156458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.157261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.158828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.162688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.163482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.164707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.401375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:58.411516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b81eb4e8-525e-4cb9-91ab-f01599e0eb65 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 1.113481 Oct 26 05:17:58.423360 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2059/4185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:57 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:58.429171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5577ffa2-4e21-489e-9263-9f885b8bfd54 req-c24bf6e6-0803-4982-a591-cb9f251c336c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bc13ba-5d74-4815-930c-2156a5bebbae", "name": "network-vif-plugged", "status": "completed", "tag": "5d39223b-8c2b-4b8c-b628-4870bb807434"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:58.502395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5577ffa2-4e21-489e-9263-9f885b8bfd54 req-c24bf6e6-0803-4982-a591-cb9f251c336c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.504266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5577ffa2-4e21-489e-9263-9f885b8bfd54 req-c24bf6e6-0803-4982-a591-cb9f251c336c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.508224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5577ffa2-4e21-489e-9263-9f885b8bfd54 req-c24bf6e6-0803-4982-a591-cb9f251c336c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.581473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5577ffa2-4e21-489e-9263-9f885b8bfd54 req-c24bf6e6-0803-4982-a591-cb9f251c336c service nova] Creating event network-vif-plugged:5d39223b-8c2b-4b8c-b628-4870bb807434 for instance f3bc13ba-5d74-4815-930c-2156a5bebbae on n-h1-862416-4 Oct 26 05:17:58.608361 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5577ffa2-4e21-489e-9263-9f885b8bfd54 req-c24bf6e6-0803-4982-a591-cb9f251c336c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179316 Oct 26 05:17:58.614705 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2060/4186] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:58.632117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3ce6137a-e999-4312-95b1-85bbc4cdc940 req-d31521f4-c007-462b-b6be-2caa1fda5328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e2ce40-b981-49d3-b562-932638d5660c", "tag": "30adc2b8-b092-4686-9c43-3497fbad487f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:58.665258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3ce6137a-e999-4312-95b1-85bbc4cdc940 req-d31521f4-c007-462b-b6be-2caa1fda5328 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.670349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3ce6137a-e999-4312-95b1-85bbc4cdc940 req-d31521f4-c007-462b-b6be-2caa1fda5328 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.675239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3ce6137a-e999-4312-95b1-85bbc4cdc940 req-d31521f4-c007-462b-b6be-2caa1fda5328 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.707340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3ce6137a-e999-4312-95b1-85bbc4cdc940 req-d31521f4-c007-462b-b6be-2caa1fda5328 service nova] Creating event network-changed:30adc2b8-b092-4686-9c43-3497fbad487f for instance 05e2ce40-b981-49d3-b562-932638d5660c on n-h2-862416-4 Oct 26 05:17:58.714108 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3ce6137a-e999-4312-95b1-85bbc4cdc940 req-d31521f4-c007-462b-b6be-2caa1fda5328 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097846 Oct 26 05:17:58.719776 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2061/4187] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:17:58.728846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:58.729905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:58.739160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.740162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.740827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.741908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.742718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.743816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.764790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:58.768233 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 HTTP/1.1 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'da72c67d-c2eb-4917-9051-70592110c760'} Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:17:58.770398 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:17:58.776294 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:17:58.778308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:17:58.779197 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ad0c7f2-579d-4a2a-889f-47dcb2c74807 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 404 len: 111 microversion: 2.1 time: 0.057974 Oct 26 05:17:58.779774 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2062/4188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:58 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:17:58.788577 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-124ff2be-b7d5-4094-a949-8bd96d25cb2c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.653701 Oct 26 05:17:58.801112 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2127/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:58 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:58.806694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:58.807320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:58.812670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:58.817352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:58.825353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.825865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.826311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.827021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.828155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.840474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.844272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.845968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.846142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:58.849930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:58.852902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:58.855950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.094718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.108356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.114820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.129802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f32e5ad5-b6a2-480b-b3c1-2ce06bf5996a tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.327296 Oct 26 05:17:59.130475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2128/4190] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:58 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:59.136212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-50a3f314-c5ba-4304-a2db-0e80e7c46fac tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '.version_select at 0x7f4709b8bca0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:59.195003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-50a3f314-c5ba-4304-a2db-0e80e7c46fac tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-561545558" status: 202 len: 0 microversion: 2.1 time: 0.063211 Oct 26 05:17:59.196312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2129/4191] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-561545558 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:17:59.207128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:59.207933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:59.217804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:59.218455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:59.219004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.219844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:59.220416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:59.220953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.280422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.295462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.297085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.298599 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30b0fd88-b153-4633-849c-cf6f1dd8f5a7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1665 microversion: 2.20 time: 0.517629 Oct 26 05:17:59.329338 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2063/4192] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:17:58 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1665 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:17:59.347400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba8d76b-3760-474d-9c25-d1ce12039d06"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:17:59.350952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:59.364253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:59.364762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:59.365223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.366009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:59.366474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:59.367320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.401088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:17:59.409400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc7edefb-a197-4a33-8274-daa7685ca692 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1279 microversion: 2.1 time: 0.210267 Oct 26 05:17:59.410026 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2130/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:59 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:17:59.443533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:17:59.444218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:17:59.460013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:59.460446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:59.460897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.461648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:17:59.462117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:17:59.467822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:17:59.917549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:17:59.987791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:00.016710 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b5bd7a06-8235-44ce-859b-52c3a39f30f2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.668631 Oct 26 05:18:00.017597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2064/4194] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 26 05:17:59 2022] POST /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 188 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:18:00.046421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:00.047058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:00.102954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:00.144007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:00.150103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:00.154226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:00.156935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:00.166460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:00.543523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:00.567151 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-add63970-6751-44e9-9d45-ff447c2b0cd1 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 1.127913 Oct 26 05:18:00.567781 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2131/4195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:17:59 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:00.573214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:00.573853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:00.617950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:00.618710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:00.620082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:00.621352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:00.622540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:00.625230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:00.776756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:00.788156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:00.805436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:00.821959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65b6adcc-0cb0-4f78-890e-8dfc0d3e8f3b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.253098 Oct 26 05:18:00.837937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2132/4196] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:00 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:00.866089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:00.874211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:00.889521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:00.890449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:00.891400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:00.892387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:00.894156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:00.894829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:00.970875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120586) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 05:18:01.079414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:01.102174 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd6fe80c-d230-4b91-847f-f92bed68a995 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 1.067780 Oct 26 05:18:01.103183 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2065/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:00 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:01.107871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:01.108478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:01.143032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:01.143865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:01.144827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:01.145587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:01.146047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:01.156954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:01.249047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9201dae5-3099-46f6-ba9e-03b69bbef2dc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/action" status: 202 len: 0 microversion: 2.20 time: 0.409574 Oct 26 05:18:01.252396 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2133/4198] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:18:00 2022] POST /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:18:01.298928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92788f46-2da5-4d2d-8c1d-5d47eebb0d04", "name": "network-vif-plugged", "status": "completed", "tag": "3caed5c7-479c-4f71-bde3-c2a03e82b2cc"}, {"server_uuid": "de088b67-2832-44df-a8fa-756c18fd7892", "name": "network-vif-plugged", "status": "completed", "tag": "d85af49f-0e89-45c8-b063-ca374259b32b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:01.368605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:01.376510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:01.378365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:01.475278 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] Creating event network-vif-plugged:3caed5c7-479c-4f71-bde3-c2a03e82b2cc for instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 on n-h1-862416-4 Oct 26 05:18:01.483180 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] Creating event network-vif-plugged:d85af49f-0e89-45c8-b063-ca374259b32b for instance de088b67-2832-44df-a8fa-756c18fd7892 on n-h2-862416-4 Oct 26 05:18:01.522847 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-27627e8e-4baa-4d2a-b36c-df1c050714c3 req-03a1ac4c-a848-45c4-ac85-d7c1b995fdea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.262008 Oct 26 05:18:01.525012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2134/4199] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:01.562839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:01.567982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:01.594459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:01.602363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:01.605058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:01.606159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:01.612894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:01.613730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:01.797998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:01.835330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lazy-loading 'services' on Instance uuid f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:18:01.867238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:01.871112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:01.914830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:01.951778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b84f181-4712-4888-b007-576ae84f618d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.844148 Oct 26 05:18:01.953891 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2066/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:01 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:01.995169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:01.995909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:02.023835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ccc3f0f-72dc-4928-ae42-806c0915e8b7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments/ce4a40bd-afcb-4751-8faf-6bf4963d9ac0" status: 202 len: 0 microversion: 2.1 time: 0.483239 Oct 26 05:18:02.026113 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2135/4201] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:18:01 2022] DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments/ce4a40bd-afcb-4751-8faf-6bf4963d9ac0 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:02.041855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.055035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.057634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.060315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.062785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:02.063627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.070695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.078408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:02.115744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.119524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.124148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.134606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.138049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.138915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.535945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.552096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.554098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.555577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15c29dda-b103-411b-82cd-087ecad20ae3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.588321 Oct 26 05:18:02.556650 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2067/4202] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:01 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:02.570502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:02.571486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:02.585769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.587298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.589465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.590465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.593127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.594303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.718452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.728482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.741716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.750712 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a41be8c1-bae5-4c3e-a96e-de01fe1864bf tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1294 microversion: 2.1 time: 0.723033 Oct 26 05:18:02.751642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:02.755295 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2136/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:02 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1294 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:02.760524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:02.765123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7d403be-e92a-452e-b1c8-4e83ad774e05 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.207128 Oct 26 05:18:02.766036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2068/4204] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:02 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:02.776152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:02.777410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:02.781289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:02.794567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.802250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.803063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.804385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.806159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.806934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.808494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.809361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.814352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.816502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.821705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.830010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.892297 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-12fcae5f-d11f-4566-981a-25eec04ec6fe tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135496 Oct 26 05:18:02.893286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2137/4205] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:02 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:02.981616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:02.982919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:02.993796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:02.994744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:02.998002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:02.999295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:03.000116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:03.000829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:03.151238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:03.174866 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89437613-6b19-4dfb-91b6-f9f7c398675d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.404623 Oct 26 05:18:03.183088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2069/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:02 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:03.279691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:03.337570 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c03958a-c9a8-4d29-a5ac-db21883d378f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.337964 Oct 26 05:18:03.341507 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2138/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:02 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:03.584863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:03.585668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:03.589117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:03.615975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:03.625135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:03.625607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:03.630377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:03.634001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:03.635056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:03.697825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:03.698261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:03.706987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:03.714188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:03.716613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:03.718813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:03.723522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:03.725724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:03.797771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 HTTP/1.1 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '560a06b2-fb56-433f-8399-aa01b41b7fc2'} Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:18:03.813589 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:03.819294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:18:03.820659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d39f1825-a609-49e2-a034-33ba92d0d0b0 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 404 len: 111 microversion: 2.1 time: 0.126325 Oct 26 05:18:03.834573 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2139/4208] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:18:03 2022] DELETE /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:18:03.864053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-915dd29c-63fb-41fa-b46f-f1f1569f2c17 req-cd611e1a-e412-497e-9458-92e2b4a0a47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c70ace4-fae3-4d50-80a0-ffe193fee989", "tag": "e4528b36-80e9-4534-9bc8-4bccd0e486de"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:03.933131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-915dd29c-63fb-41fa-b46f-f1f1569f2c17 req-cd611e1a-e412-497e-9458-92e2b4a0a47d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:03.936780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-915dd29c-63fb-41fa-b46f-f1f1569f2c17 req-cd611e1a-e412-497e-9458-92e2b4a0a47d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:03.938286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-915dd29c-63fb-41fa-b46f-f1f1569f2c17 req-cd611e1a-e412-497e-9458-92e2b4a0a47d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.005904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-915dd29c-63fb-41fa-b46f-f1f1569f2c17 req-cd611e1a-e412-497e-9458-92e2b4a0a47d service nova] Creating event network-changed:e4528b36-80e9-4534-9bc8-4bccd0e486de for instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 on n-h2-862416-4 Oct 26 05:18:04.027415 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-915dd29c-63fb-41fa-b46f-f1f1569f2c17 req-cd611e1a-e412-497e-9458-92e2b4a0a47d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191443 Oct 26 05:18:04.038015 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2140/4209] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:04.054233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:04.057214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:04.086253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.087040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.087973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.090374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.091030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.092178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.272463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.293667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.295692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.299335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c050c3fb-d8d6-4f98-846c-19b1a6bd2b1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.719166 Oct 26 05:18:04.325227 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2070/4210] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:03 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:04.331074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:04.344918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:04.367864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.369000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.369749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.370745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.371439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.372103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.615112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.630873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.632521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.641357 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f1321b7-94c6-4f03-8ead-c2e942cad284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.314471 Oct 26 05:18:04.649634 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2071/4211] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:04 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:04.655254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:04.656158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 560a06b2-fb56-433f-8399-aa01b41b7fc2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:04.678805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.679658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.680284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.681205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.682774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.683902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.718188 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:04.720082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 HTTP/1.1 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '560a06b2-fb56-433f-8399-aa01b41b7fc2'} Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:04.720458 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. Oct 26 05:18:04.727059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:04.728807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 560a06b2-fb56-433f-8399-aa01b41b7fc2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:18:04.730924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0de80cc5-baef-45b1-9cb5-b2e3a75ad629 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2" status: 404 len: 111 microversion: 2.1 time: 0.079297 Oct 26 05:18:04.737444 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2072/4212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:04 2022] GET /compute/v2.1/servers/560a06b2-fb56-433f-8399-aa01b41b7fc2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:18:04.738455 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68504254-8548-46db-b818-05630c042353 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1485 microversion: 2.1 time: 0.697832 Oct 26 05:18:04.741557 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2141/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:04 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1485 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:04.747027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:04.748293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:04.751878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:04.753548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:04.754882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:04.772557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.773227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.781861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.783005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.783676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.784106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.784448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.784897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.785845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:04.795144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:04.806540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:04.807412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.001193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd9748c4-5835-4e0a-aebb-1ba95abecf62 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262208 Oct 26 05:18:05.011962 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2073/4214] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:04 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:05.023406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:05.032566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:05.063199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.063753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.064238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.068415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.071626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.073267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.372662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:05.388310 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f73a9842-273c-4e39-aa4e-2821e0592243 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.645533 Oct 26 05:18:05.412197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2142/4215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:04 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:05.426724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:05.427380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:05.443091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.443812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.446366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.447468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.448164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.450500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.493712 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 HTTP/1.1 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '35a4edf8-969f-4a82-be7a-6c76cfa8d8a7'} Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:18:05.495783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.498725 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.500979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:18:05.504653 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ccfd9acd-bb08-4629-a8b3-a4dcbe34f0e8 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 404 len: 111 microversion: 2.1 time: 0.091067 Oct 26 05:18:05.508714 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2143/4216] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:18:05 2022] DELETE /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:18:05.520541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:05.531260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:05.551392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.552067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.557063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.558173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.558776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.559333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.599723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:05.614925 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39f66fe1-8cc3-4c19-a5e8-b728b9bbb7ae tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.601682 Oct 26 05:18:05.619326 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2074/4217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:05 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:05.629217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e3a108d6-cb14-4afd-8663-4b0ddf1a9fc6 req-bad0d3f9-8f93-4a1b-8a2c-76b86cabc445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e2ce40-b981-49d3-b562-932638d5660c", "name": "network-vif-plugged", "status": "completed", "tag": "30adc2b8-b092-4686-9c43-3497fbad487f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:05.663734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e3a108d6-cb14-4afd-8663-4b0ddf1a9fc6 req-bad0d3f9-8f93-4a1b-8a2c-76b86cabc445 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.665525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e3a108d6-cb14-4afd-8663-4b0ddf1a9fc6 req-bad0d3f9-8f93-4a1b-8a2c-76b86cabc445 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.666178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e3a108d6-cb14-4afd-8663-4b0ddf1a9fc6 req-bad0d3f9-8f93-4a1b-8a2c-76b86cabc445 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.708391 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e3a108d6-cb14-4afd-8663-4b0ddf1a9fc6 req-bad0d3f9-8f93-4a1b-8a2c-76b86cabc445 service nova] Creating event network-vif-plugged:30adc2b8-b092-4686-9c43-3497fbad487f for instance 05e2ce40-b981-49d3-b562-932638d5660c on n-h2-862416-4 Oct 26 05:18:05.717161 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e3a108d6-cb14-4afd-8663-4b0ddf1a9fc6 req-bad0d3f9-8f93-4a1b-8a2c-76b86cabc445 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095643 Oct 26 05:18:05.725939 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2075/4218] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:05.732766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:05.739387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:05.758435 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ead94e1f-01a6-4be2-985d-df3f88145b0b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247910 Oct 26 05:18:05.759322 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2144/4219] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:18:05 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:05.761332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.761936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.762484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.765436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:05.766306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] [instance: 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:05.766568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.767389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.767753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.777511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.779098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.783673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.787196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.787878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.790877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.820603 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] HTTP exception thrown: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Request method failure captured: Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 HTTP/1.1 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMGwUisq89tf0FgvbWZ6CIdD8VNVSr-LZk8rgvc8aQmqRaw4pM5Z0aI_DTlytiPa6GuURWkdYJjdxciMsgFsM1efomcDlAMQcxXxP6EviFSml-LE7p24flJe1xhiW5w8ZdTQAGfnZnaB8bz2v2iHHyPj3gh-jveQGeyZLcXOiez6FQw Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec71918b8580462d8bea4141a5cf7419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: ec71918b8580462d8bea4141a5cf7419 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-284303872 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e5723b278179404b9fd7de738b492f41 Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-284303872-project Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '35a4edf8-969f-4a82-be7a-6c76cfa8d8a7'} Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:05.835422 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:18:05.838516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] Returning 404 to user: Instance 35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:18:05.838893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:05.838969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6bdab79b-7204-4450-9746-34248c0af636 tempest-DeleteServersTestJSON-284303872 tempest-DeleteServersTestJSON-284303872-project] 10.222.0.16 "GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7" status: 404 len: 111 microversion: 2.1 time: 0.076446 Oct 26 05:18:05.842009 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2145/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:05 2022] GET /compute/v2.1/servers/35a4edf8-969f-4a82-be7a-6c76cfa8d8a7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:18:05.849969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:05.854104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:05.881302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.883747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.885092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:05.886427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:05.887455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:05.888438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.120235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.137878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.139350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.160109 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93ef37b5-e018-4630-9cb9-a634b51b2f1c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.316724 Oct 26 05:18:06.188606 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2146/4221] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:05 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:06.209360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:06.222669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:06.229567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:06.230398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:06.231084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.233604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:06.234424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:06.243317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.308701 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69d76079-9751-4c34-955e-d9e318e46ae0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118197 Oct 26 05:18:06.311372 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2147/4222] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:06 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:06.345939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.365667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.367212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.370994 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c116387c-5008-494f-b782-d5becacfb8a2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.643547 Oct 26 05:18:06.374921 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2076/4223] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:05 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:06.425196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:06.426390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:06.441117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:06.441812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:06.442380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.444630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:06.445397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:06.446319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.647273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:06.649470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:06.681944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:06.684381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:06.686512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.687500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:06.694904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:06.695762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:06.918225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:06.929613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2835afd-8524-447b-9656-2cf0cb16f0b3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.508689 Oct 26 05:18:06.947247 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2148/4224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:06 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:07.197592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:07.198445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:07.218960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.224485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.225155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.231228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.232261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.234587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.235552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.246668 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc3ca878-b9e8-4c7d-ba7b-661cc31233ee tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.604013 Oct 26 05:18:07.261991 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2077/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:06 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:07.324007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:07.326935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:07.342465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.343310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.343836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.344965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.345675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.348360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.401908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10e2ee29-c408-419f-ac59-ffb88705515b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081927 Oct 26 05:18:07.406717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2078/4226] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:07 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:18:07.413871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:07.417418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:07.431275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.432795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.433521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.434547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.435210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.435830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.512753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.528960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.530948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.541964 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-466c4ac8-3cca-4f93-a17c-e5dc83209284 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.348406 Oct 26 05:18:07.542586 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2149/4227] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:07 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:07.704008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.716743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.720594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:07.726207 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f121ca7-3784-4036-abc8-540f34a9394e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.322109 Oct 26 05:18:07.727108 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2079/4228] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:07 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:07.968361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:07.970034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:07.988763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:07.989527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:07.991649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:07.992419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.000176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.000782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.009270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:08.010049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:08.019293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.019897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.020484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.021196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.021689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.026682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.658514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:08.669163 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b4c15c1-75d8-4a6f-8689-4dc2d6b5bf3e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1485 microversion: 2.1 time: 0.663761 Oct 26 05:18:08.673759 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2080/4229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:08 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1485 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:08.684926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-55b40533-5cb0-46dd-9d70-0231b16587eb req-94b222bf-c56c-45f4-9c12-0b9e14a2f776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de088b67-2832-44df-a8fa-756c18fd7892", "tag": "d85af49f-0e89-45c8-b063-ca374259b32b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:08.704944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-55b40533-5cb0-46dd-9d70-0231b16587eb req-94b222bf-c56c-45f4-9c12-0b9e14a2f776 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.710142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-55b40533-5cb0-46dd-9d70-0231b16587eb req-94b222bf-c56c-45f4-9c12-0b9e14a2f776 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.710813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-55b40533-5cb0-46dd-9d70-0231b16587eb req-94b222bf-c56c-45f4-9c12-0b9e14a2f776 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.730830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:08.734184 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-55b40533-5cb0-46dd-9d70-0231b16587eb req-94b222bf-c56c-45f4-9c12-0b9e14a2f776 service nova] Creating event network-changed:d85af49f-0e89-45c8-b063-ca374259b32b for instance de088b67-2832-44df-a8fa-756c18fd7892 on n-h2-862416-4 Oct 26 05:18:08.745288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8b1a56b1-dfda-4efa-bf43-dfc2d1605096 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.793382 Oct 26 05:18:08.746446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2150/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:07 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:08.751576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:08.752992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:08.766199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.767448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.767907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.768853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.769351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.769868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.779138 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-55b40533-5cb0-46dd-9d70-0231b16587eb req-94b222bf-c56c-45f4-9c12-0b9e14a2f776 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103861 Oct 26 05:18:08.780096 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2081/4231] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:08.786620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:08.788875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:08.813596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.814009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.814485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.815777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.816236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.816845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.896806 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0796e95d-7bc9-4059-b893-944f8f6b7c6a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115463 Oct 26 05:18:08.913666 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2082/4232] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:08 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:08.918858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:08.919512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:08.932506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.933092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.933589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:08.934367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:08.934823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:08.935262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:09.379746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:09.393997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:09.396437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:09.407342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0db342d4-21bc-4c02-9916-ad750f052ff9 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.492469 Oct 26 05:18:09.414067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2083/4233] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:08 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:09.419222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:09.426655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:09.433380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:09.434161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:09.436762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:09.437793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:09.445851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:09.446662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:09.980371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.009454 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-770c8d67-e848-4c3b-9267-8c3bc35f9a86 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 1.254416 Oct 26 05:18:10.010143 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2151/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:08 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:10.038370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:10.042200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:10.064709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:10.073030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:10.073670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:10.078298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:10.078974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:10.079590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:10.327270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.340163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.357943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.365455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27a6cb36-f082-4c14-a720-b39893ec3e1d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.948035 Oct 26 05:18:10.366194 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2084/4235] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:09 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:10.392540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:10.395516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:10.402284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:10.403023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:10.403671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:10.404566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:10.405411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:10.406027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:10.490666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02ba0315-b2b6-462c-a326-6b6b27bc0970 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121768 Oct 26 05:18:10.491815 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2085/4236] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:10 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:10.498502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:10.502067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:10.520287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:10.521084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:10.521759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:10.526358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:10.527075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:10.527759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:10.701190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.713012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.714524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.742300 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1186be0-c72a-4625-9afd-8db8435b59df tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.249153 Oct 26 05:18:10.743090 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2086/4237] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:10 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:10.773871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:10.788997 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8632adfc-0fa7-4ba3-9509-74c790d019e1 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.769635 Oct 26 05:18:10.802577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2152/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:10 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:11.036833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:11.037491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:11.048934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.050133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.050675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.051393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.051845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.052270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.396868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:11.398273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:11.414322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.418208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.421140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.424018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.427503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.432093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.759696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:11.772072 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-592d02b5-c1e5-4814-85b5-9f00edbecad0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.737906 Oct 26 05:18:11.773306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2087/4239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:11 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:11.791505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:11.802659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:11.826113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.826670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.827119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.827850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.828308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.832084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.939890 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20dead61-daf4-4bde-8d16-8d733e3fe4d3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165378 Oct 26 05:18:11.942031 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2088/4240] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:11 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:11.959116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:11.959797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:11.979183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.980421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.980952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:11.981721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:11.982174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:11.982596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:12.072459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.082474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.083838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.085047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f2428e1-0866-4dc2-9143-a5509773f5f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.693136 Oct 26 05:18:12.094697 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2153/4241] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:11 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:12.103908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:12.108540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:12.135095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:12.135841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:12.136150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:12.136856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:12.137349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:12.137793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:12.160881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.169814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.171266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.192109 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd742551-0b7b-451a-b599-56e153a7f667 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.243963 Oct 26 05:18:12.205346 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2089/4242] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:11 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:12.765513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:12.782374 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2bd6f53-6e2c-4735-ba1d-122d8d008f46 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.684641 Oct 26 05:18:12.783182 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2154/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:12 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:12.808559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:12.809485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:12.829359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:12.830231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:12.831285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:12.839029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:12.839029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:12.839029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:12.956334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:12.959121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:12.985142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:12.988068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:12.988499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:12.989269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:12.991223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:12.993738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:13.013343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:13.159230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-920c92d5-98a2-4a54-bff1-c083ce08abad tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207208 Oct 26 05:18:13.177377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2155/4244] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:12 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:13.191129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:13.191621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:13.223496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:13.223996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:13.224439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:13.232039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:13.232532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:13.232979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:13.244106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:13.257285 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4871286-d1e9-46fa-9b86-529175ab7c63 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.454585 Oct 26 05:18:13.262503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2090/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:12 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:13.269040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:13.274503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:13.298831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:13.300785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:13.301344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:13.304160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:13.304907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:13.309629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:13.736427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:13.749728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:13.759161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:13.761420 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-894e6d25-79dc-4a59-9cbe-6ce19a4d2319 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.582931 Oct 26 05:18:13.778280 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2156/4246] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:13 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:13.809396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:13.810479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:13.824186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:13.828526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:13.830499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:13.836907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:13.839764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:13.840955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.280167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:14.296074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d6b7713a-e79f-4a84-affe-bd6fc641f9e3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.490950 Oct 26 05:18:14.296678 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2157/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:13 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:14.310124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:14.313383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:14.325768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.328522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.330018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.331202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.333686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.334299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.353700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:14.373795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:14.375476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:14.388611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c64aaf62-e473-40d8-8e26-7c0b53ff658c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 1.124855 Oct 26 05:18:14.390195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2091/4248] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:13 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:14.397112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:14.397809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:14.408919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.410011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.410587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.411307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.412166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.413855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.416636 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2007bb2b-7d9b-4aca-ae03-bd78776e3d29 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118681 Oct 26 05:18:14.417778 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2158/4249] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:18:14 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:18:14.604673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:14.606235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:14.636516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.637152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.639890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.643331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.644072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.646471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.754320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:18:14.856212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:14.888518 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd6061d5-8915-4328-ac8c-d099ee66fc80 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.492743 Oct 26 05:18:14.901374 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2092/4250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:14 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:14.916714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:14.917639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:14.949773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.951372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.955342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.959090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:14.962416 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5acacd5f-e115-44cb-b3b4-98d9da01d5ff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 204 len: 0 microversion: 2.1 time: 0.371770 Oct 26 05:18:14.966179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2159/4251] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:18:14 2022] DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:18:14.966385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:14.966547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:14.987572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:14.989728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:15.005103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.005589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.006026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:15.006886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.007366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.007944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:15.743225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:15.753352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:15.765484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:15.767072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:15.770576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:15.772762 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc6795a5-e633-4ff9-8ee3-a8a3f5db8e37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.877869 Oct 26 05:18:15.785579 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2093/4252] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:14 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:15.795296 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-834bfd8b-f942-48b3-8746-1183859c881d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1683 microversion: 2.1 time: 0.820459 Oct 26 05:18:15.796759 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2160/4253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:14 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1683 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:15.804026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:15.804507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fb66819e-0caa-4f6d-b610-b27c97d01caf req-37815d2c-7765-463d-988a-1e5cb9bf6d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c70ace4-fae3-4d50-80a0-ffe193fee989", "name": "network-vif-plugged", "status": "completed", "tag": "e4528b36-80e9-4534-9bc8-4bccd0e486de"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:15.805229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:15.823647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.824491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.825174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:15.827515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.832539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.834472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:15.850025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb66819e-0caa-4f6d-b610-b27c97d01caf req-37815d2c-7765-463d-988a-1e5cb9bf6d16 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.851842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb66819e-0caa-4f6d-b610-b27c97d01caf req-37815d2c-7765-463d-988a-1e5cb9bf6d16 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.852442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb66819e-0caa-4f6d-b610-b27c97d01caf req-37815d2c-7765-463d-988a-1e5cb9bf6d16 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:15.895497 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fb66819e-0caa-4f6d-b610-b27c97d01caf req-37815d2c-7765-463d-988a-1e5cb9bf6d16 service nova] Creating event network-vif-plugged:e4528b36-80e9-4534-9bc8-4bccd0e486de for instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 on n-h2-862416-4 Oct 26 05:18:15.910847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fb66819e-0caa-4f6d-b610-b27c97d01caf req-37815d2c-7765-463d-988a-1e5cb9bf6d16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121805 Oct 26 05:18:15.912282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2094/4254] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:15.932023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:15.934671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:15.955981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.972338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.973261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:15.977806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:15.979709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:15.981134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:16.390385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:16.406171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:16.408244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:16.431162 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bdb3e55d-b1e3-4077-a37f-4cdce821cfa0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.517476 Oct 26 05:18:16.452020 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2095/4255] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:15 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:16.461755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:16.462386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:16.484060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:16.484542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:16.485003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:16.485784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:16.486852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:16.486852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:16.524422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:16.542409 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46d5fc68-82d7-4341-9995-d675d51e4931 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.742717 Oct 26 05:18:16.545352 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2161/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:15 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:16.774553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:16.795832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2526bb2f-888c-49da-b7be-99f6980535e0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.340879 Oct 26 05:18:16.796887 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2096/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:16 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:16.828176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:16.829658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:16.844363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:16.844970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:16.846425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:16.851202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:16.851202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:16.852231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:16.852343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:16.852708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:16.852865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:16.853257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:16.853514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:16.854499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:16.855006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:16.855895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:17.180054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.199435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.204408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.209905 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a98746d2-3ad4-4179-9fa4-381fa63c3cbb tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.390146 Oct 26 05:18:17.224245 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2162/4258] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:16 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:17.233791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.254135 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5630135-a381-4a20-8e80-45c300e86792 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1683 microversion: 2.1 time: 0.415468 Oct 26 05:18:17.254766 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2097/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:16 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1683 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:17.474643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:17.475387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:17.520430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:17.521366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:17.522193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:17.523184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:17.524199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:17.525132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:17.567475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:17.568094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:17.580880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:17.581417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:17.581874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:17.582669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:17.583061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:17.583496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:17.624631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.638366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.640328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.648905 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82a6bf3d-63f6-42a5-a616-836f9a089f25 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.184180 Oct 26 05:18:17.650218 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2163/4260] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:17 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:17.774191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:17.782881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72f0313e-2a85-479f-b872-d16fd7599fc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.219925 Oct 26 05:18:17.785204 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2098/4261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:17 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:17.841031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:17.842576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:17.853139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:17.854596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:17.855322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:17.856296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:17.856954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:17.857741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.114389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:18.127591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a3152a1-3b5d-4f25-bb55-1e887784fa35 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.291924 Oct 26 05:18:18.140970 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2164/4262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:17 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:18.248190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:18.249337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:18.265175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.267466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.268814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.270236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.271770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.277922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.279480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:18.280214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:18.289161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.294916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.295699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.296696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.297399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.298059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.647721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:18.672817 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c8e313f-a181-44ce-9687-548de8473378 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 200 len: 1615 microversion: 2.1 time: 0.397634 Oct 26 05:18:18.678741 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2165/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:18 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 1615 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:18.695790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1c540e69-36ff-4f8e-a2cc-cdac973b0f33 req-61b62afc-ff0a-4a31-8247-cfdf55cbf232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7", "name": "network-vif-deleted", "tag": "8cd48dda-e734-42af-b120-97cab68bef79"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:18.735449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1c540e69-36ff-4f8e-a2cc-cdac973b0f33 req-61b62afc-ff0a-4a31-8247-cfdf55cbf232 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.735958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1c540e69-36ff-4f8e-a2cc-cdac973b0f33 req-61b62afc-ff0a-4a31-8247-cfdf55cbf232 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.736868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1c540e69-36ff-4f8e-a2cc-cdac973b0f33 req-61b62afc-ff0a-4a31-8247-cfdf55cbf232 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.764261 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1c540e69-36ff-4f8e-a2cc-cdac973b0f33 req-61b62afc-ff0a-4a31-8247-cfdf55cbf232 service nova] Creating event network-vif-deleted:8cd48dda-e734-42af-b120-97cab68bef79 for instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 on n-h1-862416-4 Oct 26 05:18:18.773149 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1c540e69-36ff-4f8e-a2cc-cdac973b0f33 req-61b62afc-ff0a-4a31-8247-cfdf55cbf232 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090137 Oct 26 05:18:18.774255 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2166/4264] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:18.801908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:18.803186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:18.811098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.811763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.812357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.813564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.814176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.814753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.848643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:18.862242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:18.866666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:18.881816 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64464656-e263-4ff3-8dcf-25cd9e1bc5ee tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.641830 Oct 26 05:18:18.883175 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2099/4265] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:18 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:18.899739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:18.909849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:18.940686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.944714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.945465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.952684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:18.953109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:18.953618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:18.981002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:18.998093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:19.006447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:19.021256 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8c920c6-0aec-48f2-bc86-f340764b52c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.226764 Oct 26 05:18:19.021888 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2167/4266] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:18 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:19.155893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:19.156668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:19.187316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:19.187984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:19.188448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:19.189255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:19.189749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:19.199792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:19.228846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:19.238824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d968c5d-d150-4406-a7c6-0494679a8f3c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1509 microversion: 2.1 time: 0.350029 Oct 26 05:18:19.239804 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2100/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:18 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:19.621026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:19.629212 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7548ef2-0a60-44ae-ab59-231a7bfcc8e9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1321 microversion: 2.1 time: 0.477185 Oct 26 05:18:19.630380 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2168/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:19 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:19.706558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:19.707196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:19.723914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:19.750061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:19.751082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:19.758459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:19.759298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:19.761182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:19.815625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 HTTP/1.1 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7'} Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:18:19.817347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f26e026f-c176-43fe-aa67-4ed66fa3a324 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 404 len: 111 microversion: 2.1 time: 0.118553 Oct 26 05:18:19.820796 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2101/4269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:19 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:18:19.832986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19a9b05e-1ea9-4727-a699-cab10831e5f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '.version_select at 0x7f4709a75160>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:19.889786 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19a9b05e-1ea9-4727-a699-cab10831e5f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063902221" status: 202 len: 0 microversion: 2.1 time: 0.060626 Oct 26 05:18:19.908255 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2169/4270] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063902221 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:19.916376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:19.917048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:19.934055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:19.938562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:19.939033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:19.939791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:19.940782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:19.941285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:20.054039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:20.055194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:20.103020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:20.107562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:20.109620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:20.115627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:20.116315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:20.116844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:20.569097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:20.589553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:20.591945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:20.608384 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b85ec0bd-0ab5-474d-8d3b-5cac9d6ffda1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.558553 Oct 26 05:18:20.613237 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2170/4271] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:20 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:20.628050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:20.630895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:20.650090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:20.650626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:20.654094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:20.654980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:20.655592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:20.657806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.351390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.380184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.385277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.389673 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c34d028-8bae-42c2-b2ed-c54dd175f175 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 1.476846 Oct 26 05:18:21.396642 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2102/4272] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:19 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:21.405670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.408052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:21.415190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:21.419992 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d24c8ae-bf17-4c5c-9b3a-ea8f47a186c6 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1506 microversion: 2.1 time: 0.805335 Oct 26 05:18:21.421107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2171/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:20 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1506 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:21.421342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:21.443159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:21.446793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:21.447607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.453048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:21.453843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:21.455755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.644121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:21.644655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:21.665579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:21.666105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:21.666563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.667324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:21.667791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:21.668273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.726917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.738327 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d36f864-3f60-472c-a544-2170937516f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1513 microversion: 2.1 time: 0.334376 Oct 26 05:18:21.740017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2103/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:21 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:21.763208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:21.764250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:21.773378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:21.774106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:21.774670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.775499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:21.776234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:21.776947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:21.793579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.808527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.810341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.827504 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8daeacf3-d4ae-478c-8533-dbd40ab8ea0f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.187251 Oct 26 05:18:21.834191 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2172/4275] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:21 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:21.948796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:21.964372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-06418b48-09cb-4983-9107-54c11125233e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1511 microversion: 2.1 time: 0.205940 Oct 26 05:18:21.965383 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2104/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:21 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:21.992180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:21.994128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:22.006653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.009037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.009664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.012390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.013824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.013824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.182701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.192448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4569eb28-17a4-4795-b297-776afa6b84a0 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1512 microversion: 2.1 time: 0.208910 Oct 26 05:18:22.193295 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2173/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:21 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:22.218870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:22.227431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.228611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:22.244198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.244716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.245333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.246416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.247231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.247658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.366321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:22.426933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:22.427504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:22.456260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.457482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.459949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.460409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.463095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.463846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.473629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.473927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.474528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.474988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.664407 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc29c4f0-82f6-46df-b29a-cb4d5b121f6b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.450641 Oct 26 05:18:22.665214 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2105/4278] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 26 05:18:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:22.694260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:22.695238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:22.707595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.708239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.709851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.710781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.711339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.712000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.734186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.744885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.747279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.749234 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd4fcc8e-4274-45b6-9be7-fafb79683de4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1751 microversion: 2.20 time: 0.328902 Oct 26 05:18:22.750558 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2174/4279] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:22 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1751 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:22.777643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ab9fcd0-d94b-4c60-8ae2-71b38203a7d6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: .version_select at 0x7f4709be9b80>, body: {"keypair": {"name": "tempest-keypair-1922433295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZkRin2MDpexjhYs3kG/02/DRvHAHRvnHc3FrzgVuLOn6p/hfMhjYCLSFT9g6lpIMPQrulYHLQgy8M8H7OW7lGMZ0pYkh/bZQutnpGQJMn9d3mhpoMXasQj6nEaXnZv9Q=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:22.845603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7ab9fcd0-d94b-4c60-8ae2-71b38203a7d6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:18:22.855059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7ab9fcd0-d94b-4c60-8ae2-71b38203a7d6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:18:22.886602 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ab9fcd0-d94b-4c60-8ae2-71b38203a7d6 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134670 Oct 26 05:18:22.887505 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2175/4280] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:18:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:22.900742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:22.914109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:22.915276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-550767684', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:22.922555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.923307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.924202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:22.925843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:22.926905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:22.927549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.046231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:23.072472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:23.084016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72530afa-bb7a-439f-9309-e2791c464555 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1506 microversion: 2.1 time: 0.404995 Oct 26 05:18:23.108959 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2106/4281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:22 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:23.119062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:23.119980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:23.132238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.133089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.133876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.135920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.136581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.137457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.152245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:23.158223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:23.166186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.167323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.168149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.310249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:23.324614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:23.330267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:23.346790 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a0e5c67-a9ea-4f53-91cb-bcc32bfe1685 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.233009 Oct 26 05:18:23.350502 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2107/4282] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:23 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:23.637058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4ad6f0fb-09f8-412d-b21f-3e7b714d0a44 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-550767684" status: 200 len: 1514 microversion: 2.1 time: 0.740282 Oct 26 05:18:23.638451 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2176/4283] 10.222.0.16 () {58 vars in 1261 bytes} [Wed Oct 26 05:18:22 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-550767684 => generated 1514 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:23.669581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:23.680821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:23.681927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:23.699493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.700249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.701039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.706247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.707136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.707754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.790652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:23.797231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:23.812205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.812707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.820335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:23.821287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:23.846774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:23.848575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:24.037178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:24.177767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.185918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:24.187241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:24.187856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:24.420829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.438659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.440843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.444519 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d0c20357-22a5-422e-9ef9-63ad4c798253 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.668244 Oct 26 05:18:24.465091 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2177/4284] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:23 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:24.482718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:24.483541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:24.495636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:24.496208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:24.496784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:24.497641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:24.503510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:24.504107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:24.528416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c22bc993-b8d3-439b-b6c6-505cbee05c81 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.863720 Oct 26 05:18:24.529017 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2108/4285] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 26 05:18:23 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:24.553427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:24.553427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:24.569996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:24.572912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:24.574473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:24.578119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:24.578879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:24.582851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:24.911111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.919685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.921159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.949903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:24.951711 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a6f7b70-100c-4dd4-a98d-2ad982043afe tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.421145 Oct 26 05:18:24.952316 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2109/4286] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:24 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:24.979554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:24.985075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:24.985903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.servers [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Removing options 'limit' from query {{(pid=120585) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 05:18:24.987428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:25.003815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.008834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.011905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.013870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.015625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e64301ae-bf8d-44bc-bdc3-4326acf4fd8f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 200 len: 1449 microversion: 2.1 time: 0.549217 Oct 26 05:18:25.019656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.042017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.042573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.052082 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2178/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:24 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 1449 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:25.057121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-13a60b12-290c-4c80-880c-e48d87f5bf5f req-e993efa3-9889-4ecd-9741-2a67b15babc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bc13ba-5d74-4815-930c-2156a5bebbae", "name": "network-vif-unplugged", "status": "completed", "tag": "5d39223b-8c2b-4b8c-b628-4870bb807434"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:25.089278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-13a60b12-290c-4c80-880c-e48d87f5bf5f req-e993efa3-9889-4ecd-9741-2a67b15babc6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.089870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-13a60b12-290c-4c80-880c-e48d87f5bf5f req-e993efa3-9889-4ecd-9741-2a67b15babc6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.094137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-13a60b12-290c-4c80-880c-e48d87f5bf5f req-e993efa3-9889-4ecd-9741-2a67b15babc6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.117197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.compute.server_external_events [req-13a60b12-290c-4c80-880c-e48d87f5bf5f req-e993efa3-9889-4ecd-9741-2a67b15babc6 service nova] Unable to find a host for instance f3bc13ba-5d74-4815-930c-2156a5bebbae. Dropping event network-vif-unplugged {{(pid=120586) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 05:18:25.117357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.118403 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-13a60b12-290c-4c80-880c-e48d87f5bf5f req-e993efa3-9889-4ecd-9741-2a67b15babc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065186 Oct 26 05:18:25.120351 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2179/4288] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 05:18:25.123697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.124172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.124623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.134224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:25.151472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:25.152279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:25.167212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.174634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.175248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.176123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.176730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.177270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.312248 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac18d35f-5107-40e5-807c-c9f560053339 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.352529 Oct 26 05:18:25.314179 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2110/4289] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:18:24 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:25.345005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:25.357628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.358397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:25.376813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.377358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.377812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.379008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.380931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.381646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.454021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:25.469127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.489396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e9155be-caf6-4b1f-be4e-dd84fbe458da tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.363784 Oct 26 05:18:25.490199 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2180/4290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:25 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:25.496617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:25.497576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:25.505705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.506436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.507097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.507985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.508596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.510086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.540381 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92120dba-8bb6-43f5-ab7b-c74719344d30 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.201880 Oct 26 05:18:25.554229 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2111/4291] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:18:25 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:25.564004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:25.564551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:25.584001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.584137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.584541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.585272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.585767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.586199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.773154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.793764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.797252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.801750 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7741f0d2-3c28-4489-b77b-ab228fd5f2c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.310295 Oct 26 05:18:25.809898 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2181/4292] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:25 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:25.822710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:25.855711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:25.857582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.compute.servers [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Removing options 'limit' from query {{(pid=120586) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 05:18:25.859032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:25.874853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.876076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.876835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.879329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:25.880581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:25.882632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:25.956341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:26.016475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.027759 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0071c4bd-3be9-49fd-9382-21e3bf9284c2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.210207 Oct 26 05:18:26.029360 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2182/4293] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 26 05:18:25 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:26.040029 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-405da645-38cf-4c99-9c0f-5fb2e2f36b93 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.480019 Oct 26 05:18:26.042459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2112/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:25 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:26.044122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.045119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:26.056388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.058559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.060610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.062069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.063018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.063747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.065408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.068699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.073995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:26.085798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.086500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.086923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.087664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.088139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.088576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.144787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.155020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:26.155884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.157608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.164369 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8e47f01-8fc5-4973-99df-b46966e7726e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.128322 Oct 26 05:18:26.165382 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2183/4295] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:26.172745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.174010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:26.181489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.182418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.183046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.183926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.184587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.185191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.220204 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c091e31-0288-4ed3-9217-b6055f7cdb9e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.176618 Oct 26 05:18:26.220794 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2113/4296] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers => generated 1011 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:26.260294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.295865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.296918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:26.310962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.311727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.312345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.313222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.313866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.314521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.484446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:26.611212 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6128029-392f-4c74-bed1-419241ff84f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.354376 Oct 26 05:18:26.622806 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2114/4297] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:26.634192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.646205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.660637 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-998012f6-8c29-4670-a06a-86ce8ae071cb tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.493371 Oct 26 05:18:26.661388 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2184/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:26.673051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.673799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.servers [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Removing options 'limit' from query {{(pid=120585) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 05:18:26.674545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:26.693502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.694412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.695108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:26.697089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.697820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.698801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.702438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.703752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.711624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.712331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.714624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.715402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.715880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.724442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.780659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2b130f9-0231-4e12-a5c7-b38cdcfacf70 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.156568 Oct 26 05:18:26.791918 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2115/4299] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:26.808057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:26.814373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:26.823038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-550767684', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:26.847100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.854474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.855216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:26.856421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:26.857046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:26.857706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.101171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:27.158463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.178428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f210ebb9-3c16-401c-8bca-82b7a95d4656 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.488432 Oct 26 05:18:27.180108 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2185/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:27.220011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:27.221946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:27.242544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.244401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:27.245415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.270432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.271807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:27.272668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.282776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8dc644aa-b43e-4d52-ae4c-0e4b41efcc36 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-550767684" status: 200 len: 345 microversion: 2.1 time: 0.476356 Oct 26 05:18:27.291215 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2116/4301] 10.222.0.16 () {58 vars in 1240 bytes} [Wed Oct 26 05:18:26 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-550767684 => generated 345 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:27.301151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:27.301838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:27.309007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.309767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:27.310225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.310941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.311574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:27.312160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.472377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.493012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.499952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.520508 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02875acb-a5f1-4a59-ab41-79434635fd22 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.227446 Oct 26 05:18:27.521475 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2117/4302] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:27 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:27.542027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44051728-2552-4541-9262-04237fef46cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:27.555583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44051728-2552-4541-9262-04237fef46cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.559725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44051728-2552-4541-9262-04237fef46cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:27.563287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44051728-2552-4541-9262-04237fef46cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.643314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44051728-2552-4541-9262-04237fef46cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Going to try to stop instance {{(pid=120585) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:18:27.787508 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44051728-2552-4541-9262-04237fef46cd tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.264709 Oct 26 05:18:27.790744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2118/4303] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:18:27 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:27.796376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b46aaa6b-a719-4da8-8633-cd95140e2874 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:27.827342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b46aaa6b-a719-4da8-8633-cd95140e2874 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.831601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b46aaa6b-a719-4da8-8633-cd95140e2874 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:27.834304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b46aaa6b-a719-4da8-8633-cd95140e2874 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:27.892480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b46aaa6b-a719-4da8-8633-cd95140e2874 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Going to try to stop instance {{(pid=120585) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:18:27.894523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.908556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.910265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:27.917650 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78541bbe-4bd0-43e3-9463-57e5521cc98f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.720891 Oct 26 05:18:27.942787 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2186/4304] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:27 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:27.959549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:27.960786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:27.987139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:27.988348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:28.000427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:28.000427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:28.000427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:28.000989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:28.075479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b46aaa6b-a719-4da8-8633-cd95140e2874 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "POST /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04/action" status: 202 len: 0 microversion: 2.1 time: 0.282945 Oct 26 05:18:28.077346 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2119/4305] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:18:27 2022] POST /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:28.099816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1889674301", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dfe50ec-535f-4512-94ac-24b3da81845a"}], "security_groups": [{"name": "tempest-securitygroup--310488840"}], "key_name": "tempest-keypair-1922433295", "user_data": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:28.199004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:28.214251 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36727734-1f5a-4158-a328-bd8a8e665846 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.270034 Oct 26 05:18:28.217866 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2187/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:27 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:28.230320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:28.234974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:28.281628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:28.282530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:28.283231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:28.284382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:28.286296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:28.286905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:28.385623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] validate_networks() for [('4dfe50ec-535f-4512-94ac-24b3da81845a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:18:28.711021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:28.723031 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5997d1a-0b58-4820-abe6-f453a048ac1a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1521 microversion: 2.1 time: 0.503835 Oct 26 05:18:28.727447 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2188/4307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:28 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:28.736807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:28.740194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:28.756380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:28.759122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:28.759915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:28.760848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:28.765454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:28.766122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:28.778139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:29.003813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.016245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.027044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.033207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10c079cf-4430-43c8-a917-8938f5a4d346 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1533 microversion: 2.91 time: 0.304432 Oct 26 05:18:29.034067 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2189/4308] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:28 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1533 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:29.074192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:29.074794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:29.084954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.087030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.087679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.089327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.091113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.091728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.386692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:18:29.388395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:18:29.389171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:18:29.390206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:18:29.391502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:18:29.406566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.408280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.409092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.410361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.411826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.412667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.441674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:18:29.448967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:18:29.449286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.468852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:18:29.471963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:18:29.472737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.475261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.480380 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-13ae5060-1be4-4196-be7d-63197ac923c2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.409416 Oct 26 05:18:29.481093 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2190/4309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:29 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:29.492075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:29.495238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:29.511957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.513850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.517418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.519176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.519877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.520601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.559752 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0d32560-71c6-48f5-a8c3-eb2e5666f46f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.480809 Oct 26 05:18:29.572723 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2120/4310] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:18:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:18:29.583310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:29.585181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:29.619626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.620327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.620576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.622135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.622762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.623433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.654255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lazy-loading 'services' on Instance uuid 17f7c413-78d5-4215-b442-e6f36028b93b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:18:29.675773 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-488cbe7b-e6a1-42af-92ec-58294e96462d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1938 microversion: 2.91 time: 0.191890 Oct 26 05:18:29.677537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2191/4311] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:29 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1938 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:29.695987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ab0fb57-29de-4c8b-b462-bede4cbe8f22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:29.696851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ab0fb57-29de-4c8b-b462-bede4cbe8f22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:29.863101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ab0fb57-29de-4c8b-b462-bede4cbe8f22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:29.870495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ab0fb57-29de-4c8b-b462-bede4cbe8f22 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1242 microversion: 2.1 time: 0.191764 Oct 26 05:18:29.879709 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2192/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:29 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:29.893883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:29.894481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:29.925983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.926427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.927074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.927804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:29.928274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:29.928712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:29.974568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lazy-loading 'flavor' on Instance uuid 17f7c413-78d5-4215-b442-e6f36028b93b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:18:30.088051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:30.104702 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24fd66ed-415f-477f-aa33-b667394fa624 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.523980 Oct 26 05:18:30.108001 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2121/4313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:29 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:30.114720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:30.115640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:30.127001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.138448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.139098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.141338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.156451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.157819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.488956 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb6ed01d-eae3-48ec-ad3d-f764da368413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action" status: 202 len: 0 microversion: 2.91 time: 0.607999 Oct 26 05:18:30.489705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2193/4314] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:18:29 2022] POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:18:30.511372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:30.512837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:30.548775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.553677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.554363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.556549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.557405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.558358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.670960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:30.684843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-922119c6-e8b7-4bd2-a759-51f7e78723fd tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1521 microversion: 2.1 time: 0.571455 Oct 26 05:18:30.700709 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2122/4315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:30 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:30.707842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:30.728721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:30.730018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:30.730890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:30.731536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:30.742713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.743838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.744560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.745738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.746100 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22ddab14-42df-4d00-ba1d-5f7946435bd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.251712 Oct 26 05:18:30.746688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.747725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.761200 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2194/4316] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:30 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:30.900276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:30.900907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:30.910083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.910585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.911031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:30.911746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:30.912214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:30.912682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.097952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:31.114386 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-524f7036-721f-44bb-90a6-0dfffd5795c2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1238 microversion: 2.1 time: 0.217929 Oct 26 05:18:31.115696 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2195/4317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:30 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1238 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:31.135953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:31.137068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:31.151599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:31.168596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:31.180117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:31.182191 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88b2ddb0-a225-4119-8da5-adea404f07ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.476941 Oct 26 05:18:31.182451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:31.183312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:31.184057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.184892 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2123/4318] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:30 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:31.185898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:31.186626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:31.187280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.528203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:31.543101 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d4913889-0a73-4734-bef8-d97f5aecc1bc tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.414251 Oct 26 05:18:31.544065 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2196/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:31 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:31.712097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:31.713469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:31.736284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:31.738267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:31.739826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.743933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:31.744701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:31.745426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.778499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:31.779529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:31.806903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:31.820026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:31.825590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.830158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:31.833191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:31.833918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:31.999731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.024443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.027337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.043562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ddc2d9e1-d7d4-416f-8480-f92bb92a5d1b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.268208 Oct 26 05:18:32.047297 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2197/4320] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:31 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:32.142027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:32.144813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:32.168447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:32.169509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:32.170689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:32.172837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:32.178364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:32.179484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:32.216699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.272682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d31dc66a-4099-41ef-b49a-9a9c11892414 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1521 microversion: 2.1 time: 0.557167 Oct 26 05:18:32.293008 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2124/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:31 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:32.310143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:32.315945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:32.329610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:32.330968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:32.331594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:32.332522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:32.333343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:32.336062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:32.409778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:32.433271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.443905 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fcf88ace-9fc4-407b-936b-d7215a8524bd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1302 microversion: 2.1 time: 0.308059 Oct 26 05:18:32.459924 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2198/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:32 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1302 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:32.575954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:32.580216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:32.596832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:32.598384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:32.598863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:32.599643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:32.600197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:32.610314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:32.855858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.871651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.876230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.881510 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-801e2bb3-ed41-446b-904c-b6c8fbdd3798 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.587279 Oct 26 05:18:32.883278 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2125/4323] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:32 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:32.918250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:32.939792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-731ba41d-62dd-4a62-8d2f-ad77bff4a04a tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.370566 Oct 26 05:18:32.940527 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2199/4324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:32 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:33.081769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:33.082361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:33.097985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.098876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.099534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.100591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.101225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.101829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.203546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:33.243386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:33.248722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:33.266998 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b2b89326-2201-49e7-8862-b24611f38b15 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.189583 Oct 26 05:18:33.270606 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2126/4325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:33 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:33.301361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:33.302277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:33.316671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.318118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.319262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.321789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.323703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.324525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.480734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:33.482094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:33.504239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.504969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.507764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.508519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.508999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.511420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.927496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:33.937791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-306801a8-71e5-406c-8f5f-d60980004f79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 0.463002 Oct 26 05:18:33.943252 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2127/4326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:33 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:33.952043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:33.954772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:33.968984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.969759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.973944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:33.974890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:33.975515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:33.976208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:34.084788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.101668 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-858bb34d-3bf4-431f-b0d5-8237c506f43c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1521 microversion: 2.1 time: 0.805852 Oct 26 05:18:34.113225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2200/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:33 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1521 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:34.127951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:34.131914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:34.159208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:34.159988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:34.160642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:34.161773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:34.162447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:34.163100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:34.526520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.556564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.558097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.559326 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2346f0c5-07de-48cd-8994-cc6b9a79cfc9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1753 microversion: 2.20 time: 0.614922 Oct 26 05:18:34.566418 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2128/4328] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:33 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1753 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:34.574186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:34.574820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:34.589113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:34.590254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:34.590934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:34.593887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:34.594602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:34.596996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:34.794711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.814273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.820582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.842047 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32779209-e74c-41d3-b416-cd184bc9337c tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.274694 Oct 26 05:18:34.855036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2129/4329] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:34 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:34.961708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:34.976485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:34.978114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:34.979116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c88e2a49-3ee8-49e5-86b7-35e9ee475247 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 0.861378 Oct 26 05:18:34.984220 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2201/4330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:34 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:34.988263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:34.990576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:34.991621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:34.992350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:34.994694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:34.995325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.132521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:35.133064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:35.155407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.156372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.157173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.162242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.163028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.163628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.413194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:35.459902 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4260683c-9542-478c-999e-ed19beec9c87 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 0.460883 Oct 26 05:18:35.474187 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2130/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:34 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:35.483315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0ba68479-b0a9-4515-90f8-1a74718069f7 req-79af6bb9-4e87-4201-bd67-07540812dde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537cbd71-74b4-4d99-895f-cc873448f370", "tag": "86182bf0-4be6-409d-93fe-c8fc79a88e23"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:35.504551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ba68479-b0a9-4515-90f8-1a74718069f7 req-79af6bb9-4e87-4201-bd67-07540812dde9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.506084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ba68479-b0a9-4515-90f8-1a74718069f7 req-79af6bb9-4e87-4201-bd67-07540812dde9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.507586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ba68479-b0a9-4515-90f8-1a74718069f7 req-79af6bb9-4e87-4201-bd67-07540812dde9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.547577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0ba68479-b0a9-4515-90f8-1a74718069f7 req-79af6bb9-4e87-4201-bd67-07540812dde9 service nova] Creating event network-changed:86182bf0-4be6-409d-93fe-c8fc79a88e23 for instance 537cbd71-74b4-4d99-895f-cc873448f370 on n-h1-862416-4 Oct 26 05:18:35.560560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0ba68479-b0a9-4515-90f8-1a74718069f7 req-79af6bb9-4e87-4201-bd67-07540812dde9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084798 Oct 26 05:18:35.561623 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2131/4332] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:35.597667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:35.598372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:35.608283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.608795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.609281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.610033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.610499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.610934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.676220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:35.696087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cef0ddae-9303-458b-bac7-95a70753d49a tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1498 microversion: 2.1 time: 0.569313 Oct 26 05:18:35.703113 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2202/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:35 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1498 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:35.739225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:35.762512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:35.764396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:35.771216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.771715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.772414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.773578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:35.774204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:35.774792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:35.948914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:36.105756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-042f9806-08fa-4a74-832f-668f6566353b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.376481 Oct 26 05:18:36.106760 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2203/4334] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 26 05:18:35 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:36.118656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:36.120822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:36.137508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:36.151789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:36.156099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:36.156757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:36.157353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:36.162299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:36.162933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:36.166793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:36.167148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:36.168622 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c99eef9-e1bc-4ec4-a2a3-60d4ad26fc64 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.576217 Oct 26 05:18:36.171901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:36.172986 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2132/4335] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:35 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:36.178133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:36.188788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:36.207807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:36.215676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:36.216512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:36.217526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:36.218208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:36.218847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.289744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.319550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.327385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.350364 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de371b64-0fb8-4e33-bc1c-835873e49d97 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 1.239204 Oct 26 05:18:37.358504 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2204/4336] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:36 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:37.382069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65aaa31d-05cc-4b24-bfbe-dfa36e462c94 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:37.397662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65aaa31d-05cc-4b24-bfbe-dfa36e462c94 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:37.398441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65aaa31d-05cc-4b24-bfbe-dfa36e462c94 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:37.399199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65aaa31d-05cc-4b24-bfbe-dfa36e462c94 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.483665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.484661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65aaa31d-05cc-4b24-bfbe-dfa36e462c94 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Going to try to start instance {{(pid=120586) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 05:18:37.497506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7289eca-0cda-4cce-a384-9563cfe0f167 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1678 microversion: 2.1 time: 1.321601 Oct 26 05:18:37.498290 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2133/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:36 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1678 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:37.507976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:37.513489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:37.535047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:37.536047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:37.537305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.538319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:37.540607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:37.541906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.572519 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65aaa31d-05cc-4b24-bfbe-dfa36e462c94 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "POST /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04/action" status: 202 len: 0 microversion: 2.1 time: 0.212402 Oct 26 05:18:37.576708 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2205/4338] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:18:37 2022] POST /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:37.583486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:37.584396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:37.602835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:37.603389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:37.604717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.605685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:37.606445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:37.607092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.940753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.958819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.963413 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-604d7cc6-3c7a-46b6-b3a7-93ef10bd6a7a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 0.463207 Oct 26 05:18:37.964712 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2134/4339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:37 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:37.969262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.972736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:37.973172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:37.974220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:37.975266 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e93791b-3bc3-4c84-8d73-0d423dbfa3c6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.396985 Oct 26 05:18:37.977457 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2206/4340] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:37 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:37.993938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:37.995113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:37.997603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:37.998891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:38.000425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:38.002394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:38.388301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:38.388989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:38.399134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:38.411862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:38.415326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:38.416324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:38.417072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:38.421914 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d8103be-d35f-4109-a911-3343693b034b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1507 microversion: 2.1 time: 0.455753 Oct 26 05:18:38.422511 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2135/4341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:37 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:38.423337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:38.425654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:38.526471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:38.527748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:38.538951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:38.539925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:38.540509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:38.543303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:38.547693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:38.548363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:38.569871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:38.580869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:38.582560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:38.599460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e02f3f54-24b7-46e9-a60b-d4883b0e78dc tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.214304 Oct 26 05:18:38.600423 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2207/4342] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:38 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:38.847885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:38.860337 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab60ab8a-6b61-43a3-ba56-289bad482a47 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1655 microversion: 2.1 time: 0.337908 Oct 26 05:18:38.865955 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2136/4343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:38 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1655 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:38.889101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-737efbcd-02e7-48b2-a0ff-bd56a7a9e968 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:38.895487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-737efbcd-02e7-48b2-a0ff-bd56a7a9e968 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:38.896244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-737efbcd-02e7-48b2-a0ff-bd56a7a9e968 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:38.896883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-737efbcd-02e7-48b2-a0ff-bd56a7a9e968 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:38.932455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-737efbcd-02e7-48b2-a0ff-bd56a7a9e968 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Going to try to start instance {{(pid=120586) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 05:18:38.994656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:38.995275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:39.005515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.007381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.013943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.014907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.015606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.016394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.040638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-737efbcd-02e7-48b2-a0ff-bd56a7a9e968 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.155077 Oct 26 05:18:39.041662 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2208/4344] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:18:38 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:39.055373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:39.058086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:39.077482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.077998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.079792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.081974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.083741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.084226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.427515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=18 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:39.463147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:39.696954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:39.717888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:39.720700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:39.723028 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6528df4a-9f53-4171-9121-a37d55027bd5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.679849 Oct 26 05:18:39.723722 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2209/4345] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:39 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:39.737956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:39.739357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:39.753274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.754852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.755522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.756472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.757409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.758040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.786176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:39.800079 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef27d23c-f284-4e1c-8a7d-50dccc4fe0e2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 0.807428 Oct 26 05:18:39.802610 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2137/4346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:38 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:39.817921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:39.819025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:39.826955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.827828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.828493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.829698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:39.832067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:39.833247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:39.867940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:40.195215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:40.203476 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc2b9317-3a93-4533-aa01-76d497b7cb1b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1507 microversion: 2.1 time: 0.398809 Oct 26 05:18:40.218356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2138/4347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:39 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:40.223719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:40.227520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:40.228465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:40.235196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.235923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.236050 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-982d5f65-2b9f-498d-a844-193bc5c2a57e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1664 microversion: 2.1 time: 0.511040 Oct 26 05:18:40.237194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:40.238343 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2210/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:39 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1664 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:40.238661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.239340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.239986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:40.250344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6395eb70-bc0e-4a99-8190-706ef327b303 req-f06dfce1-a8b0-4cb8-a45d-9e91fd741570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:40.278808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6395eb70-bc0e-4a99-8190-706ef327b303 req-f06dfce1-a8b0-4cb8-a45d-9e91fd741570 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.279477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6395eb70-bc0e-4a99-8190-706ef327b303 req-f06dfce1-a8b0-4cb8-a45d-9e91fd741570 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.279930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6395eb70-bc0e-4a99-8190-706ef327b303 req-f06dfce1-a8b0-4cb8-a45d-9e91fd741570 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:40.304859 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6395eb70-bc0e-4a99-8190-706ef327b303 req-f06dfce1-a8b0-4cb8-a45d-9e91fd741570 service nova] Creating event network-changed:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h1-862416-4 Oct 26 05:18:40.315006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6395eb70-bc0e-4a99-8190-706ef327b303 req-f06dfce1-a8b0-4cb8-a45d-9e91fd741570 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075297 Oct 26 05:18:40.316004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2211/4349] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:40.329082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:40.340566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:40.342297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:40.350785 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a11ff0a-c46a-4861-8bc9-f4189e47c6ee tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.131096 Oct 26 05:18:40.351608 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2139/4350] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:40 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:40.760710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:40.763560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:40.775807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.776885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.777639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:40.779688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.780644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.781375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:40.835518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:40.836146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:40.846744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.847702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.848143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:40.848860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:40.849337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:40.849772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:41.988468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.006644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.012168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.031334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ff01ed8-154c-45ef-b1e6-77a4420de449 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 1.264355 Oct 26 05:18:42.054105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2212/4351] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:40 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:42.072785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:42.073627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:42.100787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.101757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.102541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.105730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.106852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.108134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.119721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.133642 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-076e4f99-659d-49a0-a3fe-ea509d38d66e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 1.301696 Oct 26 05:18:42.134430 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2140/4352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:40 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:42.161854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:42.162482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:42.200890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.201425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.201870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.202585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.203038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.203472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.747919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.764215 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f04c1206-cd4d-4e01-8eda-fafa984a5893 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1511 microversion: 2.1 time: 0.704393 Oct 26 05:18:42.764810 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2213/4353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:42 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1511 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:42.787233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:42.787233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:42.794381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.794897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.795337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.796126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.796583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.797011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.864013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.880853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a14fbdfe-8943-464b-899a-55261119ce6b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1664 microversion: 2.1 time: 0.733993 Oct 26 05:18:42.887033 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2141/4354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:42 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1664 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:42.899639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:42.913355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.916033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.servers [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Removing options 'limit' from query {{(pid=120585) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 26 05:18:42.917136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:42.925148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.929211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.930038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.931015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:42.931624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:42.932195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:42.938276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3150d9e7-b14f-49f9-bfc9-73c2ec68f4fa tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.049832 Oct 26 05:18:42.939473 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2142/4355] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 26 05:18:42 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:18:42.966810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.970213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:42.971842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:42.979686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.981473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:42.999481 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92adb642-34b6-4533-a106-29c481ec3528 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.227495 Oct 26 05:18:43.001742 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2214/4356] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:42 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:43.003644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:43.004955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:43.006004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:43.007702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:43.008390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:43.009029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:43.070819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:43.072055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:43.088104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:43.088908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:43.092114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:43.093194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:43.093878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:43.094464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:43.124034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:43.678281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:43.698508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:43.700522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:43.701978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ef11b6f-b894-4db4-857d-31d8eeb225ad tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.640168 Oct 26 05:18:43.703058 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2215/4357] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:43 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:43.713914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:43.714789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:43.728794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:43.733519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:43.734219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:43.735146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:43.735804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:43.736455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.028340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.045652 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef1201ce-ff9e-43f7-9560-10d32959364b tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1511 microversion: 2.1 time: 1.095538 Oct 26 05:18:44.057593 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2143/4358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:42 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1511 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:44.073238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ba998642-b424-4c49-8276-462102261d1c req-bd4b6a2f-82f1-445b-a1aa-886a688aaee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537cbd71-74b4-4d99-895f-cc873448f370", "name": "network-vif-plugged", "status": "completed", "tag": "86182bf0-4be6-409d-93fe-c8fc79a88e23"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:44.100476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ba998642-b424-4c49-8276-462102261d1c req-bd4b6a2f-82f1-445b-a1aa-886a688aaee8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.100960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ba998642-b424-4c49-8276-462102261d1c req-bd4b6a2f-82f1-445b-a1aa-886a688aaee8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.101418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ba998642-b424-4c49-8276-462102261d1c req-bd4b6a2f-82f1-445b-a1aa-886a688aaee8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.152447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ba998642-b424-4c49-8276-462102261d1c req-bd4b6a2f-82f1-445b-a1aa-886a688aaee8 service nova] Creating event network-vif-plugged:86182bf0-4be6-409d-93fe-c8fc79a88e23 for instance 537cbd71-74b4-4d99-895f-cc873448f370 on n-h1-862416-4 Oct 26 05:18:44.163580 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ba998642-b424-4c49-8276-462102261d1c req-bd4b6a2f-82f1-445b-a1aa-886a688aaee8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108725 Oct 26 05:18:44.170429 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2144/4359] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:44.183952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:44.190253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.210577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:44.214058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6cae69b-b2a8-4d5b-a5d4-016efeca00df tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 0.509686 Oct 26 05:18:44.222341 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2216/4360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:43 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:44.246712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:44.252307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.253079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.258045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.259978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:44.260367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.261012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.268340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:44.269612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.289724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.290584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.291279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.292498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.293354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.294107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.507306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.517100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.523563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.540419 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-02fcaa1c-e03a-4c15-b88b-9354b44bf9ea tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.312280 Oct 26 05:18:44.541271 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2217/4361] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:44 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:44.546922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:44.558876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:44.581786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.586249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.588722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.593574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.596931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.597594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.696092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.707921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f393ac44-7de9-40a2-aa2a-41b537a26a7e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.536005 Oct 26 05:18:44.728623 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2145/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:44 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:44.735733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:44.737768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:44.754145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:44.759029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.760131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.762447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.763552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:44.766051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:44.766887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:44.946779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:44.959172 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd028d3f-2dbe-4245-98f3-f93b725ca025 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1512 microversion: 2.1 time: 0.414401 Oct 26 05:18:44.970573 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2218/4363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:44 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:44.984704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:44.985381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:45.003047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.003558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.003997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.004711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.005171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.008679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.069786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:45.072638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.106692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.120797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.126452 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e3c61ed8-9dd0-4278-ae25-20e09d63ec19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.392506 Oct 26 05:18:45.131254 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2146/4364] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:44 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:45.143112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:45.145043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:45.158458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.161332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.163245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.164274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.165893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.167360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.336585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.351933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b23f7be-b1e5-45f3-8226-32a29d58130c tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.379022 Oct 26 05:18:45.367288 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2219/4365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:44 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:45.382155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:45.382822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:45.390181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.390909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.391491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.392365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.393403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.394071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.561793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.572250 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e490a7c-cfea-46d2-b6d9-0ad65fb85614 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1513 microversion: 2.1 time: 0.439508 Oct 26 05:18:45.576319 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2147/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:45 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:45.594393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:45.595264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:45.610487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.614030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.614694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.615596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.617095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.617940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.780470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.789858 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2baeea3e-a450-4937-8734-15c29aea98a1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1367 microversion: 2.1 time: 0.421022 Oct 26 05:18:45.794107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2220/4367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:45 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:45.820586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:45.828323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:45.850905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.852721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.856096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.857485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:45.858216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:45.861258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:45.862747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:45.942228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.965680 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16d383f3-f7d7-4f34-a586-4e5f409d4c38 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.384664 Oct 26 05:18:45.966860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2148/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:45 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:45.984449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:45.998609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:45.999560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:46.034514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:46.058788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:46.060656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:46.087831 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95654d32-c34d-4934-9634-95f202ffa5e5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.292357 Oct 26 05:18:46.091449 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2221/4369] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:45 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:46.112497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:46.115456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:46.141888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.143671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.148485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.152620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.154518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.170799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.228528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.229207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.229884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.230698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.231227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.231961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.404215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:46.568170 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6002742e-e062-452a-8469-6132dbb79a39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.599973 Oct 26 05:18:46.569076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2149/4370] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 26 05:18:45 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:46.583161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:46.583911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:46.619054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.619598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.621378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.622325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.622830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.623486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.857336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:46.873014 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-25f866c9-5347-40da-a29d-dc11c2a8dfc4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.775402 Oct 26 05:18:46.874078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2222/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:46 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:46.884710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:46.885765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:46.904696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.905210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.905700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:46.906422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:46.906889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:46.907324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:47.306991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:47.325172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:47.326749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:47.328035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be9d464d-355d-4e25-8f2f-28fa09212d46 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.757917 Oct 26 05:18:47.338571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2150/4372] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:46 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:47.353408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:47.354380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:47.360833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:47.364549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:47.365291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:47.366339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:47.368520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:47.369208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:47.676479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:47.709478 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26c36a68-e465-4176-9e7d-65a13594592e tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1511 microversion: 2.1 time: 0.829125 Oct 26 05:18:47.709999 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2223/4373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:46 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1511 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:47.724558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:47.725429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:47.759248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:47.759810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:47.760258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:47.760978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:47.761480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:47.763540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:47.876537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:47.896750 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fe00fbaf-8171-4fc0-8857-e027d81f3d25 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1557 microversion: 2.1 time: 0.556741 Oct 26 05:18:47.897405 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2151/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:47 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1557 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:47.910398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:47.911264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:47.929041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:47.934338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:47.936352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:47.937635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:47.939860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:47.940741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.108150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:48.129497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:48.131263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:48.145072 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-685df421-a6bc-4e39-bb13-69bf6baab413 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.246559 Oct 26 05:18:48.146277 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2152/4375] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:47 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:48.161303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:48.162221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:48.170332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.171046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.171663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.172526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.173144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.174534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.294662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:48.312358 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c848dd3-ac89-4cd8-b83f-404fcf7b1e26 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.601169 Oct 26 05:18:48.313260 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2224/4376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:47 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:48.318553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:48.334620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:48.364271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.365039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.365699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.366734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.367250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.367709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.689540 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-879f2c1b-0d87-4706-9914-210379db1d7c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.374675 Oct 26 05:18:48.690969 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2225/4377] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:18:48 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-interface => generated 284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:48.698040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:48.710089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:48.711059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:48.713323 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9516301e-9fa1-4cd6-ae24-47ff9e9a6c05 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1512 microversion: 2.1 time: 0.565305 Oct 26 05:18:48.714285 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2153/4378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:48 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1512 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:48.731338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:48.732181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:48.747710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.754718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.756967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.757927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.760338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.760947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.761082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.764312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.765370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.766254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:48.766717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:48.767194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:48.816909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lazy-loading 'flavor' on Instance uuid f28fd521-ae28-4e01-8fae-4cca07aee55b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:18:49.066526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f0802cf-a4ca-4a40-b4a5-4db4473c991d tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.369728 Oct 26 05:18:49.069945 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2226/4379] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:18:48 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:18:49.093728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:49.095063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:49.129261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:49.133463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:49.136482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:49.140583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:49.141017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:49.141505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:49.355403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:49.372567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:49.374736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:49.376436 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d3b4a2c-b7cc-48a0-aff7-ea5eca1a40ef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.660763 Oct 26 05:18:49.390300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2154/4380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:48 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:49.423067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:49.430180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:49.452321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:49.454212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:49.454692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:49.456084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:49.456553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:49.456990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.000283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.015596 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da37f100-571a-426a-bb00-dfbd1261f660 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1513 microversion: 2.1 time: 0.944187 Oct 26 05:18:50.018379 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2227/4381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:49 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1513 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:50.035402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:50.037194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:50.072888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.076857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.080726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.083570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.086063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.087465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.177649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.193950 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-240158e1-61cb-408a-ab46-f18720230f14 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1676 microversion: 2.1 time: 0.800517 Oct 26 05:18:50.194565 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2155/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:49 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1676 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:50.216548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:50.227921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.239931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:50.260185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.276686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.279254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.286300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.289480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.290719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.401035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.430386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.436571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.465305 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-301b101f-391f-4088-afe5-e74573cf1159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.444080 Oct 26 05:18:50.472399 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2228/4383] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:50 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:50.472966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:50.491294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:50.497886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:50.517177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.520793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.526641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.530961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.538248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.541392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:50.656937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:50.702456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:50.709177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:50.709933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:51.518761 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-581b3099-e9fd-4feb-99e4-62df1cd9b002 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 1.318051 Oct 26 05:18:51.519806 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2156/4384] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:18:50 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:51.531411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:51.532064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:51.542902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.557477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.558991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.560224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6e83b4f-eefb-4f09-ba93-7d0536ca6115 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 1.084105 Oct 26 05:18:51.563313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:51.563801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:51.564243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:51.565008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:51.565491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:51.565919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:51.577177 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2229/4385] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:50 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:51.582724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:51.583470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:51.616005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:51.616524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:51.616974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:51.617723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:51.618242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:51.618728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:51.914853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.926516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.930358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.963407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f8c0a48-3698-441d-967c-28da21188a5e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.384784 Oct 26 05:18:51.971671 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2230/4386] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:51 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:51.987098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:51.995905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:52.005592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f06b86a6-7622-419a-86c5-4df86eb54ab3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1659 microversion: 2.1 time: 0.484655 Oct 26 05:18:52.016862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:52.021978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:52.029026 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2157/4387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:51 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1659 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:52.068494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:52.070011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:52.097824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.102975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.103657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.104607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.105374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.106132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.235993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:52.262819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee3f2b7f-11fd-4878-877e-cf23fc1c907e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action" status: 202 len: 0 microversion: 2.1 time: 0.210600 Oct 26 05:18:52.273764 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2158/4388] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:18:52 2022] POST /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:18:52.285231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:52.295572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:52.315097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.315734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.316979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.318799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.319290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.319718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.320045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.320452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.320571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.320893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.321346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.321979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.702848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:52.721881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:52.737511 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a22c122-c4b4-4f9d-9007-bcb16e54ab43 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1665 microversion: 2.1 time: 0.456312 Oct 26 05:18:52.739173 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2159/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:52 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1665 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:52.766124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:52.768567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:52.812084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.812623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.813085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.813856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.824738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.829571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.839412 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6231a53e-23cb-4fa6-9dbd-89d860e45b38 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.863796 Oct 26 05:18:52.840220 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2231/4390] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 26 05:18:51 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:52.878683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:52.885473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:52.886425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:52.894232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.894955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.895540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:52.897224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:52.897893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:52.898490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.073885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:53.222929 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e4e33879-6f74-49ab-826b-3616ee1daf39 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.348583 Oct 26 05:18:53.223544 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2232/4391] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 26 05:18:52 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:53.249122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:53.249782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:53.260637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.260997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.261489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.262296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.268267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.268956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.403893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.414690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.418907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.420454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.421931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-197963a6-dcb1-4c4c-9de7-e91506add98e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.676295 Oct 26 05:18:53.423162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2160/4392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:52 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:53.429382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b76ca03d-81db-4b30-b1ff-184c1f0b32f7 req-0843fa14-c36d-42bf-a30a-d351e73c1aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537cbd71-74b4-4d99-895f-cc873448f370", "tag": "86182bf0-4be6-409d-93fe-c8fc79a88e23"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:53.435755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.437235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.448845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b76ca03d-81db-4b30-b1ff-184c1f0b32f7 req-0843fa14-c36d-42bf-a30a-d351e73c1aca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.449362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b76ca03d-81db-4b30-b1ff-184c1f0b32f7 req-0843fa14-c36d-42bf-a30a-d351e73c1aca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.449797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b76ca03d-81db-4b30-b1ff-184c1f0b32f7 req-0843fa14-c36d-42bf-a30a-d351e73c1aca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.458699 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c336bb01-4f32-4c99-a934-b70738678b50 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.233989 Oct 26 05:18:53.459360 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2233/4393] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:53 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:53.478696 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b76ca03d-81db-4b30-b1ff-184c1f0b32f7 req-0843fa14-c36d-42bf-a30a-d351e73c1aca service nova] Creating event network-changed:86182bf0-4be6-409d-93fe-c8fc79a88e23 for instance 537cbd71-74b4-4d99-895f-cc873448f370 on n-h1-862416-4 Oct 26 05:18:53.489449 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b76ca03d-81db-4b30-b1ff-184c1f0b32f7 req-0843fa14-c36d-42bf-a30a-d351e73c1aca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064162 Oct 26 05:18:53.492537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2161/4394] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:53.497142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:53.512232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.512984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:53.526676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.530017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.530523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.531318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.531870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.532335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.689431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:53.711489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:53.715785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Searching by: {'deleted': False, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:53.757016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.767872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.768534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.772937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:53.774368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:53.777077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:53.781201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:53.790009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:53.908939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:53.995711 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2952240-caad-4d63-890c-587cdbcf2474 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.323899 Oct 26 05:18:53.996318 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2162/4395] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:18:53 2022] GET /compute/v2.1/servers => generated 344 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:54.012719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:54.016269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:54.032112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.058933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.060386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:54.061616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.063986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.065878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:54.503725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:54.526655 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7abcf24-d639-4b5e-a9e5-da9400e88955 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1665 microversion: 2.1 time: 0.529257 Oct 26 05:18:54.534076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2163/4396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:53 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1665 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:54.540048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:54.553963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:54.559725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Searching by: {'deleted': False, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:54.582806 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3d568af-3093-4cb3-90e9-5ffe19ed69d9 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 1.091755 Oct 26 05:18:54.589835 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2234/4397] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Oct 26 05:18:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:54.597804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.602510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.602510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:54.602510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.611063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:54.611063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:54.611976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.611976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:54.619831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.619831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.619831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:54.619831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.619831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.620515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:54.714065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:54.790201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:54.805292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:54.806617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:54.808485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.211217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.224733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.229908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.239218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36cd3afc-ba6b-4b3e-8c45-13f792dcf88a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.644683 Oct 26 05:18:55.249346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2235/4398] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:54 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:55.257373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:55.262662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:55.288316 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a844d25-d275-4959-b7b0-228893e2649a tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.751981 Oct 26 05:18:55.289244 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2164/4399] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:18:54 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:55.293964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:55.300544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.301088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.301636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.302422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.303418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.303418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.308557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.317754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': '-550767684', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:55.323908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.324937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.325628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.326718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.327379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.328806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.467108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.486887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.489392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.508964 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8849f3c4-1d7c-4b39-ba88-7f3b5d0876dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.257039 Oct 26 05:18:55.510046 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2236/4400] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:55 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:55.515934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f84f0e6-6da4-4f98-a3da-893dd57f6ddd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:55.543248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f84f0e6-6da4-4f98-a3da-893dd57f6ddd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031657 Oct 26 05:18:55.552476 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2237/4401] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:18:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:55.601244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:55.602350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:55.617703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.618438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.619093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.619960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.621845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.622547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.625528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:55.835869 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-51c93780-a906-488a-becd-ec3348430d3f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-550767684" status: 200 len: 345 microversion: 2.1 time: 0.542142 Oct 26 05:18:55.843239 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2165/4402] 10.222.0.16 () {58 vars in 1156 bytes} [Wed Oct 26 05:18:55 2022] GET /compute/v2.1/servers?name=-550767684 => generated 345 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:55.869748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:55.886427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:55.887504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:55.917573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.918788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.920121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:55.932363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:55.933063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:55.938063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.014385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:56.065347 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-694bd0a8-3db5-4d43-8a67-3b504aa4aba0 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1665 microversion: 2.1 time: 0.463067 Oct 26 05:18:56.088272 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2238/4403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:55 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1665 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:56.100488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:56.101730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:56.122141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.125107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.125647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.127518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.128012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.128455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.184807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:56.206747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:18:56.372959 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03477d8c-2889-4c04-9a0c-c3a8c5aaa9dc tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.499921 Oct 26 05:18:56.385667 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2166/4404] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 26 05:18:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:56.390935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:56.402610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:56.420748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.421825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.423483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.426125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.426787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.427837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.435852 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb04b3d2-2c66-4b87-bc18-2245e86ff49e tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 204 len: 0 microversion: 2.1 time: 0.346079 Oct 26 05:18:56.438487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2239/4405] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:18:56 2022] DELETE /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:18:56.459292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:56.465179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:56.465997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-55076768', 'deleted': False, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:18:56.472811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.473335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.473790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.474842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.475318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.475761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.624094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:18:56.774148 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-907d4750-178f-4c65-b0f5-53cbc2af4908 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-55076768" status: 200 len: 345 microversion: 2.1 time: 0.334092 Oct 26 05:18:56.781696 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2240/4406] 10.222.0.16 () {58 vars in 1226 bytes} [Wed Oct 26 05:18:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-55076768 => generated 345 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:18:56.788089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:56.789045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:56.809232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.809823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.810344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.811082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.811556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.816430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.819606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:56.855854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:56.866892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:56.871150 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b74ae171-538c-4673-b1b5-97f959c4b657 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.484330 Oct 26 05:18:56.875129 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2167/4407] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:56 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:56.883404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:56.887449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:56.902401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.907082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.907726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:56.908651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:56.910078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:56.910701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.039602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.050611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.052506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.059093 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a334878-df3e-43e9-984d-0c0dde30b172 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.182644 Oct 26 05:18:57.059958 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2168/4408] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:56 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:57.065709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:57.066543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:57.073164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.073846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.074528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.075479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.076202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.076878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.114307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:18:57.123568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.137858 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-38c60fd7-b70b-428e-a1ca-fb44035104bd tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1610 microversion: 2.1 time: 0.359975 Oct 26 05:18:57.139093 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2241/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:56 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1610 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:57.146681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:57.147718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:57.154876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.155483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.156125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.157374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.157913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.158842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.260516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-033614ca-6329-454c-baea-ebe49ba75ca2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 204 len: 0 microversion: 2.1 time: 0.198642 Oct 26 05:18:57.262495 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2169/4410] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:18:57 2022] DELETE /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:18:57.274554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:57.275760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:57.284340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.285129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.286383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.288557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.289061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.289795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.414059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.429822 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1e8e0ca-c853-4108-8ba9-7fefe176d7c5 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.286381 Oct 26 05:18:57.441559 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2242/4411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:57 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:57.459592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:57.461072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:57.475241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.475750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.477736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.478465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.478933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.479367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.485432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.497795 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ace2e44-efce-4fcf-a6f5-2a802ac1bbbf tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1519 microversion: 2.1 time: 0.229804 Oct 26 05:18:57.497795 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2170/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:57 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:18:57.634761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:57.646088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c93f00da-3eb8-4134-8091-91a6c0e22005 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1668 microversion: 2.1 time: 0.192609 Oct 26 05:18:57.646663 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2243/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:57 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:57.670518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:57.670946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:57.677664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.678155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.678597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.679294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.679746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.680179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.708775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:18:57.717277 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.compute.api [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Working on deleting snapshot 6642290d-b6a0-4a83-9b9d-508a9fb7ce0c from shelved instance... Oct 26 05:18:57.904083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:57.904663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:57.911544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.917985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.918460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:57.919221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:57.919699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:57.920182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.108899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.123041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.124533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.125828 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3b4728d-730a-414e-bb91-b0e8f6e3b832 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.226333 Oct 26 05:18:58.126765 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2244/4414] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:57 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:18:58.131893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:58.132514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:58.144503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.145074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.145566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.146592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.147066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.147862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.234950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.245192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.247611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.268626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46c3b3c8-671c-4e96-98ad-4d1a70b97f6e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.140687 Oct 26 05:18:58.303947 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2245/4415] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:58 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:58.312485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:58.313484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:58.322700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.323234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.323684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.324454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.326151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.326974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.334162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:58.365534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Doing local delete in cell 174eed2b-b467-49bb-99a7-157ccab94f7f(cell1) {{(pid=120585) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 26 05:18:58.366814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.367630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.368231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.368817 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.compute.api [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 26 05:18:58.374334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] deallocate_for_instance() {{(pid=120585) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 26 05:18:58.588764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.603258 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a66f0aae-c4d3-4dc4-b540-9154a627cc46 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1610 microversion: 2.1 time: 0.297489 Oct 26 05:18:58.604304 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2246/4416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:58 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1610 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:58.609513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:58.610228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:58.617420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.618209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.618726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.619510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:58.620049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:58.621515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:58.966176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:58.978778 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-925ffc0e-7a61-4b8b-aa24-7cc2dce6281f tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1519 microversion: 2.1 time: 0.373151 Oct 26 05:18:58.981255 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2247/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:58 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1519 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:18:59.153577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:59.154189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:59.164034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.164544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.164989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:59.168122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.171128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.171607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:59.265710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Updating instance_info_cache with network_info: [] {{(pid=120585) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 26 05:18:59.519861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:59.530139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:59.532765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:18:59.534993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ee33cee-98ec-4145-8a12-ccb99b65966e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.385499 Oct 26 05:18:59.552025 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2248/4418] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:59 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:18:59.572561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-2abb3f9e-1eb8-40dc-a764-36c63f6a8ded req-de5285ea-006d-476e-9021-66d4a0ee5b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bc13ba-5d74-4815-930c-2156a5bebbae", "name": "network-vif-deleted", "tag": "5d39223b-8c2b-4b8c-b628-4870bb807434"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:18:59.585854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2abb3f9e-1eb8-40dc-a764-36c63f6a8ded req-de5285ea-006d-476e-9021-66d4a0ee5b5a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.586684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2abb3f9e-1eb8-40dc-a764-36c63f6a8ded req-de5285ea-006d-476e-9021-66d4a0ee5b5a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.587372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2abb3f9e-1eb8-40dc-a764-36c63f6a8ded req-de5285ea-006d-476e-9021-66d4a0ee5b5a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:59.628713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.compute.server_external_events [req-2abb3f9e-1eb8-40dc-a764-36c63f6a8ded req-de5285ea-006d-476e-9021-66d4a0ee5b5a service nova] Unable to find a host for instance f3bc13ba-5d74-4815-930c-2156a5bebbae. Dropping event network-vif-deleted {{(pid=120586) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 05:18:59.630688 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-2abb3f9e-1eb8-40dc-a764-36c63f6a8ded req-de5285ea-006d-476e-9021-66d4a0ee5b5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.077545 Oct 26 05:18:59.635511 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2249/4419] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 05:18:59.647054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:59.652682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:59.666719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.669289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.670129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:59.670977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.674858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.676038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:59.690829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:18:59.835523 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2ed893c1-22ff-407d-8cc1-e49a209a683f tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 204 len: 0 microversion: 2.1 time: 2.169115 Oct 26 05:18:59.837194 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2171/4420] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:18:57 2022] DELETE /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 0 bytes in 2171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:18:59.848443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:18:59.850756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:18:59.865379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.866302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.867620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:18:59.869944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:18:59.872985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:18:59.875423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.136738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:00.150526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:00.151651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:00.168526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f479815-bced-4d34-bf2e-ee75a61cf1e1 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.531760 Oct 26 05:19:00.181340 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2250/4421] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:18:59 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:00.185640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:00.186724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f3bc13ba-5d74-4815-930c-2156a5bebbae] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:00.197985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.198740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.199381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.200300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.201012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.214392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.232448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] HTTP exception thrown: Instance f3bc13ba-5d74-4815-930c-2156a5bebbae could not be found. Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Request method failure captured: Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae HTTP/1.1 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFERA5hFKUBC7Yk-hBJT8hf7aopZJMv4XXckSQ2n1DhHt1THbsHDCU5UeVcKK2EpLnhOIME8Ip4KOI0Xh1l6AGYmqRkDA_arSa7zxSGL7D0eE2LAWZXlchIZSrkndPq2wBVuMZvSouEbv0qoQCJx63yxYQuxDT0hs51JkMyfHGcX84 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4c2aa94263344a7eb33bcc7c6594229a Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f3bc13ba-5d74-4815-930c-2156a5bebbae could not be found. Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f3bc13ba-5d74-4815-930c-2156a5bebbae'} Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3bc13ba-5d74-4815-930c-2156a5bebbae could not be found. Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3bc13ba-5d74-4815-930c-2156a5bebbae could not be found. Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:00.234510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3bc13ba-5d74-4815-930c-2156a5bebbae could not be found. Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Returning 404 to user: Instance f3bc13ba-5d74-4815-930c-2156a5bebbae could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1515b64c-cf26-4627-badd-ee3cf9275677 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae" status: 404 len: 111 microversion: 2.1 time: 0.065431 Oct 26 05:19:00.238834 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2251/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:00 2022] GET /compute/v2.1/servers/f3bc13ba-5d74-4815-930c-2156a5bebbae => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:00.248724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:00.249558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:00.264904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.265440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.265890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.266605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.269427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.269857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.380619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:00.394528 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d5084600-cd43-4c49-8ee4-d4adb792e5f9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1610 microversion: 2.1 time: 0.554504 Oct 26 05:19:00.397501 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2172/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:18:59 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1610 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:00.406414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:00.407846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:00.448118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.449663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.454042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.476415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.480080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.480781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.547972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:00.629412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:00.650792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9f80876-f503-4acb-9361-b04245a3c7d2 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1519 microversion: 2.1 time: 0.410363 Oct 26 05:19:00.652540 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2252/4424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:00 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:00.700836 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e24be62-98b5-40bd-a6ac-dedfe4891bc3 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 204 len: 0 microversion: 2.1 time: 0.300627 Oct 26 05:19:00.702410 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2173/4425] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:19:00 2022] DELETE /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:00.715766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-510448b2-94cb-47d2-aa56-de65c745f579 req-05f477b7-2d11-48fc-b6c2-880e85dd4a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c70ace4-fae3-4d50-80a0-ffe193fee989", "name": "network-vif-deleted", "tag": "e4528b36-80e9-4534-9bc8-4bccd0e486de"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:00.721409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:00.724719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:00.740111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-510448b2-94cb-47d2-aa56-de65c745f579 req-05f477b7-2d11-48fc-b6c2-880e85dd4a78 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.744216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-510448b2-94cb-47d2-aa56-de65c745f579 req-05f477b7-2d11-48fc-b6c2-880e85dd4a78 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.744969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-510448b2-94cb-47d2-aa56-de65c745f579 req-05f477b7-2d11-48fc-b6c2-880e85dd4a78 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.757915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.763589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.770671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.772552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.775058 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-510448b2-94cb-47d2-aa56-de65c745f579 req-05f477b7-2d11-48fc-b6c2-880e85dd4a78 service nova] Creating event network-vif-deleted:e4528b36-80e9-4534-9bc8-4bccd0e486de for instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 on n-h2-862416-4 Oct 26 05:19:00.776121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.778046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.788540 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-510448b2-94cb-47d2-aa56-de65c745f579 req-05f477b7-2d11-48fc-b6c2-880e85dd4a78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084565 Oct 26 05:19:00.789548 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2174/4426] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:00.804396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:00.806535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:00.824189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.827620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.828247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:00.830376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:00.833645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:00.834268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.077129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.087266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1363b2a2-0d6a-4b78-9b39-559f50b98e01 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1466 microversion: 2.1 time: 0.292945 Oct 26 05:19:01.089202 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2175/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:00 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1466 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:01.205378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:01.207374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:01.217388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.218035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.218901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.219719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.220260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.221355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.230931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.248874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.250790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.252427 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-726beb2a-3d1f-413c-8fc6-a2852b50c518 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.598154 Oct 26 05:19:01.253629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2253/4428] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:00 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:01.328106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.337839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.340256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.347984 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-141184b6-1c89-4fac-a59d-4b1e81ff84c2 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.149284 Oct 26 05:19:01.361423 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2176/4429] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:01 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:01.420748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:01.422132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:01.432020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.433089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.434031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.434823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.435297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.435879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.540642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.568534 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07f23d80-2466-43dd-9171-ac7a9f8d896b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1542 microversion: 2.1 time: 0.152053 Oct 26 05:19:01.569991 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2254/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:01 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1542 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:01.679573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:01.680205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:01.688677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.689449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.690023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.690809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.691376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.691874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.736803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:01.737300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:01.737772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:01.738237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lazy-loading 'fault' on Instance uuid 8c70ace4-fae3-4d50-80a0-ffe193fee989 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:01.820328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:01.830781 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3c8e2a6-db98-4fa0-a1ba-09b416bcf073 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 200 len: 1311 microversion: 2.1 time: 0.154766 Oct 26 05:19:01.847005 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2177/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:01 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:02.086903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-576ec5a1-d17d-447b-9530-98abdcf88f15 req-2cceffe0-a3d7-429f-a07f-894aa55381a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de088b67-2832-44df-a8fa-756c18fd7892", "name": "network-vif-deleted", "tag": "d85af49f-0e89-45c8-b063-ca374259b32b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:02.113625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:02.114687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:02.125100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-576ec5a1-d17d-447b-9530-98abdcf88f15 req-2cceffe0-a3d7-429f-a07f-894aa55381a1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.127434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-576ec5a1-d17d-447b-9530-98abdcf88f15 req-2cceffe0-a3d7-429f-a07f-894aa55381a1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.127763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-576ec5a1-d17d-447b-9530-98abdcf88f15 req-2cceffe0-a3d7-429f-a07f-894aa55381a1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.143930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.145301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.148718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.150346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.151243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.151984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.159110 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-576ec5a1-d17d-447b-9530-98abdcf88f15 req-2cceffe0-a3d7-429f-a07f-894aa55381a1 service nova] Creating event network-vif-deleted:d85af49f-0e89-45c8-b063-ca374259b32b for instance de088b67-2832-44df-a8fa-756c18fd7892 on n-h2-862416-4 Oct 26 05:19:02.171509 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-576ec5a1-d17d-447b-9530-98abdcf88f15 req-2cceffe0-a3d7-429f-a07f-894aa55381a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091323 Oct 26 05:19:02.172159 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2255/4432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:19:02.280645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:02.281912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:02.292159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.299970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.301007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.302026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.302986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.303689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.370835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.383384 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e30493b7-6104-4e0a-b945-fc390e31dfff tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1466 microversion: 2.1 time: 0.275486 Oct 26 05:19:02.397339 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2178/4433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:02 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:02.434129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:02.435215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:02.450941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.451440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.451886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.452593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.453049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.453504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.667271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.680905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.686266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.703412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff1904a1-bf68-4601-8a73-e894f8179c86 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.317216 Oct 26 05:19:02.706894 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2179/4434] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:02 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:02.715180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:02.718097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:02.732240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:02.734485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.741703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.743808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.744689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.746952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.748094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.823163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.843424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.851081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:02.857911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62d003e5-ca92-4996-af4b-c95bdf411c34 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.582621 Oct 26 05:19:02.864816 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2256/4435] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:02 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:02.883957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:02.891580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 8c70ace4-fae3-4d50-80a0-ffe193fee989] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:02.894827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:02.923089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.932554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.933365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.938892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:02.940544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:02.941234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:02.990688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:03.002687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] HTTP exception thrown: Instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 could not be found. Oct 26 05:19:03.004082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-68a15c1a-27de-414a-9b2b-eee114ac3dad tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1253 microversion: 2.1 time: 0.292750 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Request method failure captured: Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 HTTP/1.1 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMLkP7q3Q-ecXMBzv3-_SIzwx-oZ5U_eKMl1FSoQ-9U9gVF46COCe8knMGrV0ND3TV5G11uCFVsaQB9Lfgn-AZqOQc4gkBp9B46-ORUh_Sju6zVPc6YwZFvSsu6_b55gCi3uasMiAwpdvJ9jmqrKTou_K6OhriL_wKun1JaUcVRUwYI Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e7edaaf202ca492dab914b10ca9ea94b Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e7edaaf202ca492dab914b10ca9ea94b Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ListServerFiltersTestJSON-1056107517-project Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 593f8670897a4798b22c77f5ddd40637 Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ListServerFiltersTestJSON-1056107517-project Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 could not be found. Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '8c70ace4-fae3-4d50-80a0-ffe193fee989'} Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 could not be found. Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 could not be found. Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:03.007093 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 could not be found. Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:03.010536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Returning 404 to user: Instance 8c70ace4-fae3-4d50-80a0-ffe193fee989 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:03.011673 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66442c13-0ae6-446e-aeb2-2168668020c6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989" status: 404 len: 111 microversion: 2.1 time: 0.145324 Oct 26 05:19:03.014469 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2180/4436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:02 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1253 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:03.016502 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2257/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:02 2022] GET /compute/v2.1/servers/8c70ace4-fae3-4d50-80a0-ffe193fee989 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:03.031673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:03.036828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:03.053715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.054779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.055730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.057527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.063477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.065381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.123903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:03.132890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:03.343974 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-081b364a-25b9-4fdf-afb1-d2da23614c8d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 204 len: 0 microversion: 2.1 time: 0.325193 Oct 26 05:19:03.345277 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2181/4438] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:19:03 2022] DELETE /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:03.354906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:03.355889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:03.372639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.373168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.377812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.378586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.380387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.381439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.409870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:03.410612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:03.431625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.437342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.437342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.437342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.440578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.441153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.639785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:03.648962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd5b5717-bb0c-4cf5-a134-bd42b80c8ce4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1466 microversion: 2.1 time: 0.244563 Oct 26 05:19:03.664821 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2182/4439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:03 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:03.743000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:03.743864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:03.759852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.760375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.760867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.761637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.762098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.762529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.872919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:03.881638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d0e8861-5e25-4e96-9874-7b672825c2f6 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1518 microversion: 2.1 time: 0.532255 Oct 26 05:19:03.893731 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2258/4440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:03 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1518 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:19:03.906529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:03.907174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:03.920603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.925600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:03.936251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.938032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.938816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:03.940661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:03.940825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:03.942712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:03.946713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:03.960279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c54cb713-9691-4d3b-9f08-1af3f0d61663 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.225225 Oct 26 05:19:04.005616 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2183/4441] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:03 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:04.035921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:04.036535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:04.048018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.049334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.049767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.050489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.050941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.051369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.219411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:04.241918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-25c4a74c-6023-43a8-bfe7-7cda3b78d1f0 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1253 microversion: 2.1 time: 0.210321 Oct 26 05:19:04.262560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2184/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:04 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1253 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:04.270413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b2a326d2-5e14-425b-92d1-e82705de43dd req-d5af4b73-54a2-4b65-966b-aa455b6b1733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185fb210-0f41-4d8a-b479-cb3056131016", "name": "network-vif-deleted", "tag": "2cb44100-3770-46de-9af8-c44a82a18829"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:04.290815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2a326d2-5e14-425b-92d1-e82705de43dd req-d5af4b73-54a2-4b65-966b-aa455b6b1733 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.291298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2a326d2-5e14-425b-92d1-e82705de43dd req-d5af4b73-54a2-4b65-966b-aa455b6b1733 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.291733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2a326d2-5e14-425b-92d1-e82705de43dd req-d5af4b73-54a2-4b65-966b-aa455b6b1733 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.295812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:04.307892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:04.309674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:04.310899 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9512f22-ba40-4323-a23c-b6b254d14436 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.413820 Oct 26 05:19:04.325808 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b2a326d2-5e14-425b-92d1-e82705de43dd req-d5af4b73-54a2-4b65-966b-aa455b6b1733 service nova] Creating event network-vif-deleted:2cb44100-3770-46de-9af8-c44a82a18829 for instance 185fb210-0f41-4d8a-b479-cb3056131016 on n-h2-862416-4 Oct 26 05:19:04.326459 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2259/4443] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:03 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:04.332944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b2a326d2-5e14-425b-92d1-e82705de43dd req-d5af4b73-54a2-4b65-966b-aa455b6b1733 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069103 Oct 26 05:19:04.333608 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2185/4444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:04.672551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:04.673179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:04.685252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.685995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.687694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.690604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.691296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.692001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.743675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.744182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.744630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.745104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lazy-loading 'fault' on Instance uuid 185fb210-0f41-4d8a-b479-cb3056131016 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:04.793073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:04.802959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3803b71f-878f-47b6-8b38-fe1f631dc13e tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 200 len: 1304 microversion: 2.1 time: 0.134372 Oct 26 05:19:04.803880 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2260/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:04 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:04.914340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:04.915048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:04.917227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:04.928323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.928958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.929705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.930964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:04.931436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:04.931919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:04.992306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:04.992955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:05.021490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.022425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.025762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.027662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.028180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.028636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.243809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.256496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.258265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.277529 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e571c0c8-2ff0-46d2-9f47-cce77a57ef09 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1560 microversion: 2.91 time: 0.289700 Oct 26 05:19:05.278542 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2261/4446] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:04 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1560 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:05.294409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:05.295041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:05.315800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.317855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.318340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.319951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.321805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.323024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.380249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.390221 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-04a0374d-e32b-43ca-9d35-6af77af5cdd3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1518 microversion: 2.1 time: 0.483527 Oct 26 05:19:05.395354 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2186/4447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:04 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1518 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:05.411108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:05.415123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:05.437382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.437382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.437382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.437382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.437998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.438461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.482286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.498613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0580a21-cdf7-4288-853f-3f87c33b565b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1253 microversion: 2.1 time: 0.214707 Oct 26 05:19:05.501327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2262/4448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:05 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1253 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:05.712880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.727011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.730955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:05.732388 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-778c3214-89bf-477d-b714-f46939f7742b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.335785 Oct 26 05:19:05.733359 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2187/4449] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:05 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:05.827239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:05.827871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: 185fb210-0f41-4d8a-b479-cb3056131016] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:05.840601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.841520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.843238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.848115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.851622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.852519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.871061 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] HTTP exception thrown: Instance 185fb210-0f41-4d8a-b479-cb3056131016 could not be found. Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Request method failure captured: Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 HTTP/1.1 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFERA5hFKUBC7Yk-hBJT8hf7aopZJMv4XXckSQ2n1DhHt1THbsHDCU5UeVcKK2EpLnhOIME8Ip4KOI0Xh1l6AGYmqRkDA_arSa7zxSGL7D0eE2LAWZXlchIZSrkndPq2wBVuMZvSouEbv0qoQCJx63yxYQuxDT0hs51JkMyfHGcX84 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4c2aa94263344a7eb33bcc7c6594229a Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 185fb210-0f41-4d8a-b479-cb3056131016 could not be found. Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '185fb210-0f41-4d8a-b479-cb3056131016'} Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185fb210-0f41-4d8a-b479-cb3056131016 could not be found. Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185fb210-0f41-4d8a-b479-cb3056131016 could not be found. Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:05.872641 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185fb210-0f41-4d8a-b479-cb3056131016 could not be found. Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Returning 404 to user: Instance 185fb210-0f41-4d8a-b479-cb3056131016 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9a5a8e5-e333-4406-876d-2622964b9832 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016" status: 404 len: 111 microversion: 2.1 time: 0.051659 Oct 26 05:19:05.878070 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2263/4450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:05 2022] GET /compute/v2.1/servers/185fb210-0f41-4d8a-b479-cb3056131016 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:05.885142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:05.885729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:05.899398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.899916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.900369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.901512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:05.901636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:05.905370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:05.965224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:06.015683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:06.186781 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bda4a3b3-a573-4381-85dd-af9745c10d68 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 204 len: 0 microversion: 2.1 time: 0.305471 Oct 26 05:19:06.187395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2188/4451] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:19:05 2022] DELETE /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:06.195587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:06.196235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:06.209513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.210036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.210483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.211224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.211685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.212126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.309750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:06.310728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:06.327406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.329143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.329682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.342490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.342864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.343305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.464551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.465809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.480612 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10edb89a-e328-414e-9c18-d9ea84f3b241 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1509 microversion: 2.1 time: 0.288850 Oct 26 05:19:06.487441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.502891 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2264/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:06 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:06.511677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.516721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9dbbb6a4-1604-4afe-8b51-72125fb7dad1 req-8c765409-5631-4e1c-98ef-efeebe551b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e2ce40-b981-49d3-b562-932638d5660c", "name": "network-vif-deleted", "tag": "30adc2b8-b092-4686-9c43-3497fbad487f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:06.526118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d9f2e912-ee9e-4a8b-87e9-06ec70763ebb tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.221297 Oct 26 05:19:06.529739 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2189/4453] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:06 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:06.538442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9dbbb6a4-1604-4afe-8b51-72125fb7dad1 req-8c765409-5631-4e1c-98ef-efeebe551b44 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.539193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9dbbb6a4-1604-4afe-8b51-72125fb7dad1 req-8c765409-5631-4e1c-98ef-efeebe551b44 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.539797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9dbbb6a4-1604-4afe-8b51-72125fb7dad1 req-8c765409-5631-4e1c-98ef-efeebe551b44 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.545608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:06.546425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:06.557274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.558040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.561854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.562758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.563371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.565144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.576093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:06.579553 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9dbbb6a4-1604-4afe-8b51-72125fb7dad1 req-8c765409-5631-4e1c-98ef-efeebe551b44 service nova] Creating event network-vif-deleted:30adc2b8-b092-4686-9c43-3497fbad487f for instance 05e2ce40-b981-49d3-b562-932638d5660c on n-h2-862416-4 Oct 26 05:19:06.586853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9dbbb6a4-1604-4afe-8b51-72125fb7dad1 req-8c765409-5631-4e1c-98ef-efeebe551b44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082406 Oct 26 05:19:06.588027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2265/4454] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:06.595738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:06.596564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:06.603274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.603773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.604213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.604919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.605412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.605908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.699839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.712069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b6c537d-9f32-42b8-a862-af2a8ca8de21 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1476 microversion: 2.1 time: 0.180986 Oct 26 05:19:06.712660 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2190/4455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:06 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:06.755570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.768866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ac8cbd5-f2c4-4161-b221-e6169ede1f02 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1253 microversion: 2.1 time: 0.179322 Oct 26 05:19:06.771867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:06.772528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:06.778001 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2266/4456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:06 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1253 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:06.788616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.789116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.789586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.790409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:06.790971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:06.791399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:06.985845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:06.998458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:07.000183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:07.001929 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15f70a6d-8e52-48e3-bfa4-1fd6d0933c0e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.234828 Oct 26 05:19:07.003950 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2191/4457] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:06 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:07.513578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:07.514589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:07.522406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.523097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.524312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.525523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.526200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.526833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.559668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:07.560962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:07.573049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.576906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.580912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.581990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.582927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.583570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.789676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:07.811338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:07.812808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:07.837493 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09a59db0-6275-432c-b141-c23b2ba6e674 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.279014 Oct 26 05:19:07.838502 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2192/4458] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:07 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:07.883438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:07.883986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:07.896620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.897122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.901069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.902012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.902501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.908284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.971691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:07.972462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:07.973304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:07.974141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lazy-loading 'fault' on Instance uuid 05e2ce40-b981-49d3-b562-932638d5660c {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:08.628793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:08.639294 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4bbb966-e60a-43e8-9faf-b675cccdee1c tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 200 len: 1311 microversion: 2.1 time: 0.787405 Oct 26 05:19:08.641183 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2193/4459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:07 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 1311 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:08.646635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:08.654453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:08.665350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:08.669931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:08.673715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:08.674827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:08.675192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:08.675633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:08.708864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:08.725391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e508d33a-6768-465e-b088-7e1fb7da0b69 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1509 microversion: 2.1 time: 1.215821 Oct 26 05:19:08.725986 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2267/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:07 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1509 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:08.756429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:08.757693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:08.770386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:08.770890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:08.772658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:08.774143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:08.775758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:08.777289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:08.823538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:08.835134 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15f30eba-c2bf-4632-aa7f-6e3668e5fe6b tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1253 microversion: 2.1 time: 0.192701 Oct 26 05:19:08.837724 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2194/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:08 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1253 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:08.885481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:08.886173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:08.909577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:08.910375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:08.910850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:08.911549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:08.912018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:08.912794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:08.971539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:09.111714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:09.130949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:09.135904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:09.151900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2450bc68-d6f6-4f52-853c-a7899d26a789 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.270501 Oct 26 05:19:09.167880 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2195/4462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:08 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:09.364714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:09.378613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:09.387619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:09.392500 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a7fca9d-bb63-4594-bd13-49ef5b494f51 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.659362 Oct 26 05:19:09.397920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2268/4463] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:08 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:09.627179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-30ae1b45-5dac-4563-a4be-63348838df95 req-f33655eb-4f23-4a5e-a6da-497564de12cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "name": "network-vif-plugged", "status": "completed", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:09.647021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-aa765efc-12c7-48f7-add7-e706355247d2 req-ae3c815e-889e-401a-88b7-898322f99280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af56f892-cb85-4dca-8cb2-fedb9604f881", "name": "network-vif-deleted", "tag": "d8d3cc79-a546-4b67-81fd-8b7a433f044e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:09.659191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aa765efc-12c7-48f7-add7-e706355247d2 req-ae3c815e-889e-401a-88b7-898322f99280 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.660139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aa765efc-12c7-48f7-add7-e706355247d2 req-ae3c815e-889e-401a-88b7-898322f99280 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.660756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aa765efc-12c7-48f7-add7-e706355247d2 req-ae3c815e-889e-401a-88b7-898322f99280 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.669572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-30ae1b45-5dac-4563-a4be-63348838df95 req-f33655eb-4f23-4a5e-a6da-497564de12cc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.674371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-30ae1b45-5dac-4563-a4be-63348838df95 req-f33655eb-4f23-4a5e-a6da-497564de12cc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.675355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-30ae1b45-5dac-4563-a4be-63348838df95 req-f33655eb-4f23-4a5e-a6da-497564de12cc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.678079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-aa765efc-12c7-48f7-add7-e706355247d2 req-ae3c815e-889e-401a-88b7-898322f99280 service nova] Creating event network-vif-deleted:d8d3cc79-a546-4b67-81fd-8b7a433f044e for instance af56f892-cb85-4dca-8cb2-fedb9604f881 on n-h2-862416-4 Oct 26 05:19:09.685306 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-aa765efc-12c7-48f7-add7-e706355247d2 req-ae3c815e-889e-401a-88b7-898322f99280 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042939 Oct 26 05:19:09.709395 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2269/4464] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:19:09.719574 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-30ae1b45-5dac-4563-a4be-63348838df95 req-f33655eb-4f23-4a5e-a6da-497564de12cc service nova] Creating event network-vif-plugged:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h1-862416-4 Oct 26 05:19:09.727195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:09.729003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 05e2ce40-b981-49d3-b562-932638d5660c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:09.734106 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-30ae1b45-5dac-4563-a4be-63348838df95 req-f33655eb-4f23-4a5e-a6da-497564de12cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111103 Oct 26 05:19:09.737470 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2196/4465] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:09.739440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.741112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.758365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.758839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:09.759586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:09.760982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.761849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.762558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.773555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.774108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.775857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.777205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.780660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.781369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.802746 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] HTTP exception thrown: Instance 05e2ce40-b981-49d3-b562-932638d5660c could not be found. Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Request method failure captured: Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c HTTP/1.1 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMLkP7q3Q-ecXMBzv3-_SIzwx-oZ5U_eKMl1FSoQ-9U9gVF46COCe8knMGrV0ND3TV5G11uCFVsaQB9Lfgn-AZqOQc4gkBp9B46-ORUh_Sju6zVPc6YwZFvSsu6_b55gCi3uasMiAwpdvJ9jmqrKTou_K6OhriL_wKun1JaUcVRUwYI Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: e7edaaf202ca492dab914b10ca9ea94b Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: e7edaaf202ca492dab914b10ca9ea94b Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ListServerFiltersTestJSON-1056107517-project Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 593f8670897a4798b22c77f5ddd40637 Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ListServerFiltersTestJSON-1056107517-project Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 05e2ce40-b981-49d3-b562-932638d5660c could not be found. Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '05e2ce40-b981-49d3-b562-932638d5660c'} Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e2ce40-b981-49d3-b562-932638d5660c could not be found. Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e2ce40-b981-49d3-b562-932638d5660c could not be found. Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:09.805372 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e2ce40-b981-49d3-b562-932638d5660c could not be found. Oct 26 05:19:09.809248 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:09.813133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Returning 404 to user: Instance 05e2ce40-b981-49d3-b562-932638d5660c could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:09.815277 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0876633d-44c9-47be-8f9c-0e9b193fe7ba tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c" status: 404 len: 111 microversion: 2.1 time: 0.100137 Oct 26 05:19:09.816591 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2270/4466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:09 2022] GET /compute/v2.1/servers/05e2ce40-b981-49d3-b562-932638d5660c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:09.829401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:09.830264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:09.839001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.839820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.840568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.841570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:09.842253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:09.843520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:09.850610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:09.898093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:10.000050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:10.016606 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a6380f16-7e32-437c-8fa2-be93aba9a9c9 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 200 len: 1300 microversion: 2.1 time: 0.264761 Oct 26 05:19:10.025399 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2197/4467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:09 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 1300 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:19:10.046564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:10.047685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:10.059103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.060029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.061996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.063007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.063688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.065156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.122606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.123741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.124536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.125482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lazy-loading 'fault' on Instance uuid de088b67-2832-44df-a8fa-756c18fd7892 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:10.218135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4becac669f840d6a026ac76705d804e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb400dc73bf4e7a86cacf67e28e1218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:10.237384 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d79a0466-3c4d-473c-8445-c1efdf4fe213 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 204 len: 0 microversion: 2.1 time: 0.409128 Oct 26 05:19:10.240763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-910d8c29-7a3a-4657-97bc-75cf96d82194 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 200 len: 1258 microversion: 2.1 time: 0.196973 Oct 26 05:19:10.243073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2198/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:10 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:10.259634 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2271/4469] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:19:09 2022] DELETE /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:10.269068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:10.273031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:10.274866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:10.280638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:10.295665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.302844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.303691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.304165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.304920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.305422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.305743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.305887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.306650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.308045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.313663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.314612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.660365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:10.669557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:10.675688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:10.688670 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc31e8e4-ee91-4049-8a31-9ea65e606940 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.438862 Oct 26 05:19:10.695402 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2199/4470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:10 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:10.713152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:10.722792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:10.723668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:10.729212 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4a924be5-1fa6-4c48-9536-77fa9bf82d6d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1517 microversion: 2.1 time: 0.464660 Oct 26 05:19:10.730058 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2272/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:10 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1517 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:10.731360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.732013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.732603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:10.733518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:10.734116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:10.734684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.014251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:11.031214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:11.043182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:11.045757 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1a11560-8723-4e62-bb07-4d0eb95fdff7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.349027 Oct 26 05:19:11.046356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2200/4472] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:10 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:11.050529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.051166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: af56f892-cb85-4dca-8cb2-fedb9604f881] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:11.062010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.062512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.062956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.063666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.064162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.064595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.101412 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] HTTP exception thrown: Instance af56f892-cb85-4dca-8cb2-fedb9604f881 could not be found. Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Request method failure captured: Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 HTTP/1.1 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMFERA5hFKUBC7Yk-hBJT8hf7aopZJMv4XXckSQ2n1DhHt1THbsHDCU5UeVcKK2EpLnhOIME8Ip4KOI0Xh1l6AGYmqRkDA_arSa7zxSGL7D0eE2LAWZXlchIZSrkndPq2wBVuMZvSouEbv0qoQCJx63yxYQuxDT0hs51JkMyfHGcX84 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4c2aa94263344a7eb33bcc7c6594229a Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance af56f892-cb85-4dca-8cb2-fedb9604f881 could not be found. Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'af56f892-cb85-4dca-8cb2-fedb9604f881'} Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af56f892-cb85-4dca-8cb2-fedb9604f881 could not be found. Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af56f892-cb85-4dca-8cb2-fedb9604f881 could not be found. Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:11.103241 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af56f892-cb85-4dca-8cb2-fedb9604f881 could not be found. Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Returning 404 to user: Instance af56f892-cb85-4dca-8cb2-fedb9604f881 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:11.106983 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8de1dc05-820a-40d6-92ae-a4131c2f7629 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881" status: 404 len: 111 microversion: 2.1 time: 0.060847 Oct 26 05:19:11.109177 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2273/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:11 2022] GET /compute/v2.1/servers/af56f892-cb85-4dca-8cb2-fedb9604f881 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:19:11.115474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.116020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:11.131397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.131910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.132346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.133051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.133699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.134298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.166409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:11.276313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.277470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] [instance: de088b67-2832-44df-a8fa-756c18fd7892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:11.302256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.304087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.311642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.313171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.317905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.318909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.380477 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] HTTP exception thrown: Instance de088b67-2832-44df-a8fa-756c18fd7892 could not be found. Oct 26 05:19:11.385363 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72c410d5-b72e-4716-8ab7-a1bf07b5ebe4 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 204 len: 0 microversion: 2.1 time: 0.271715 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Request method failure captured: Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 HTTP/1.1 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMLE_b3ZMo6-cNze3m-4HcMCIIqHnRTQRLhG5gNLKjH6ODNVa_wUEyphyomU3pJNmj-7qEhRzq4zZ1skzKOJc_wTBTjxDeaR98FB0Afv28sFeoL3LlNuGHfU1Tc5dt-YPuDxUA5oCTrp3mmkVY72ay7l1JMlZWDe1BRxiObfRp44_XI Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3eb400dc73bf4e7a86cacf67e28e1218 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestBootFromVolume-116999426 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3eb400dc73bf4e7a86cacf67e28e1218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3eb400dc73bf4e7a86cacf67e28e1218"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3eb400dc73bf4e7a86cacf67e28e1218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3eb400dc73bf4e7a86cacf67e28e1218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestBootFromVolume-116999426 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3eb400dc73bf4e7a86cacf67e28e1218 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestBootFromVolume-116999426 Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestBootFromVolume-116999426-project Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: f4becac669f840d6a026ac76705d804e Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestBootFromVolume-116999426-project Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance de088b67-2832-44df-a8fa-756c18fd7892 could not be found. Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'de088b67-2832-44df-a8fa-756c18fd7892'} Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de088b67-2832-44df-a8fa-756c18fd7892 could not be found. Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de088b67-2832-44df-a8fa-756c18fd7892 could not be found. Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:11.388425 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de088b67-2832-44df-a8fa-756c18fd7892 could not be found. Oct 26 05:19:11.393843 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:11.394968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2201/4474] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:19:11 2022] DELETE /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:11.405476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Returning 404 to user: Instance de088b67-2832-44df-a8fa-756c18fd7892 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:11.406579 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65576e37-d015-4154-8089-c58d271f4cc9 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892" status: 404 len: 111 microversion: 2.1 time: 0.136894 Oct 26 05:19:11.407169 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2274/4475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:11 2022] GET /compute/v2.1/servers/de088b67-2832-44df-a8fa-756c18fd7892 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:11.411758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.412980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:11.418283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22ee789b-ee96-4f20-b71e-90a3b706f1d2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] Calling method '.version_select at 0x7f4709b4aa60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.432833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.434480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.435891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.438200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.439057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.441138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.478069 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22ee789b-ee96-4f20-b71e-90a3b706f1d2 tempest-ServersTestBootFromVolume-116999426 tempest-ServersTestBootFromVolume-116999426-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075158436" status: 202 len: 0 microversion: 2.1 time: 0.064966 Oct 26 05:19:11.478675 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2275/4476] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075158436 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:19:11.745450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.751057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:11.804533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.805348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.806084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.808031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.817961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.822004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.956735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:11.974124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1549f736-85cb-4c5b-a010-5b33db02b305 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1495 microversion: 2.1 time: 0.572681 Oct 26 05:19:11.976156 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2202/4477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:11 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1495 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:11.982529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:11.983140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:11.993021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.993555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.994127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:11.994946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:11.995315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:11.995731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:12.092254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.105578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.125003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.146487 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ee2a9e57-caa9-4e4a-9f3c-a1c5594d39e4 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.423614 Oct 26 05:19:12.172858 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2276/4478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:11 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:12.182104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:12.184133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:12.196955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:12.198000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:12.199947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:12.201525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:12.203198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:12.203801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:12.414384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.423062 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf1c8f36-e99f-456a-8491-171aa99b1445 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1517 microversion: 2.1 time: 0.445337 Oct 26 05:19:12.433716 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2203/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:11 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1517 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:12.561603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.580338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.582782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:12.584241 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-87fdacec-00e7-4bf0-bcf6-4da5464e9047 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.410009 Oct 26 05:19:12.584973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2277/4480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:12 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:13.005263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:13.005970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:13.024242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.024749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.025210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.025948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.026407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.026831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.181282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:13.182589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:13.194944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.195714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.196333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.197225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.210349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.211177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.498913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:13.516401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:13.524586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aeb6873e-e885-4455-be14-d4121b226bd7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1495 microversion: 2.1 time: 0.525974 Oct 26 05:19:13.525199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2204/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:12 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1495 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:13.526619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:13.528377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:13.543814 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f191a20-8a53-4d7f-8d63-938587d1e6fd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.365713 Oct 26 05:19:13.551728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:13.557759 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2278/4482] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:13 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:13.558661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:13.571613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.572340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.572963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.576348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.576998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.577630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.617132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:13.617951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:13.629121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.629874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.630497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.631384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:13.635788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:13.636427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:13.996707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.005451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0e696bb-c929-4469-9d29-6d4b1cebf141 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1517 microversion: 2.1 time: 0.458589 Oct 26 05:19:14.006016 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2205/4483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:13 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1517 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:14.039126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.068829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.076254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.099218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-485325cb-98a9-402c-93a4-47d7b28d8b06 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1809 microversion: 2.20 time: 0.473371 Oct 26 05:19:14.103575 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2279/4484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:13 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1809 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:14.550214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:14.551058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:14.572915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:14.573708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:14.574304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:14.575166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:14.583146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:14.584346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:14.586531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:14.587232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:14.604204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:14.610728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:14.611557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:14.612486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:14.613916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:14.622075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:14.825787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.840036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.846177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:14.872731 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dda2a815-5980-4096-abfa-1fd045f6de67 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.294348 Oct 26 05:19:14.874027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2280/4485] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:14 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:15.025191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:15.033757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:15.034531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:15.037359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6816f54e-06d5-4132-a2b4-249537f47949 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1495 microversion: 2.1 time: 0.491169 Oct 26 05:19:15.049431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2206/4486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:14 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1495 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:15.052663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:15.052663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:15.059239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:15.060036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:15.060524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:15.068142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:15.132716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:15.133608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:15.167060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:15.167826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:15.168439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:15.169379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:15.170040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:15.177951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:15.625039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:15.647238 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-daa92e54-4353-4ebf-8740-aa1f561f2678 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1517 microversion: 2.1 time: 0.616567 Oct 26 05:19:15.670124 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2281/4487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:15 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1517 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:19:15.720936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:15.731144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:15.737669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:15.740854 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-127b1acc-32d6-4f1c-bea0-e8a8d744132c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1796 microversion: 2.20 time: 0.612107 Oct 26 05:19:15.743247 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2207/4488] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:15 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1796 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:15.923035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:15.926891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:15.980782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:15.989979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:15.990453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:15.995804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:15.996385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:16.003688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:16.076141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:16.076768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:16.108181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:16.109015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:16.117602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:16.118537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:16.119041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:16.119496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:16.505130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:16.529194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:16.552821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:16.560411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:16.591213 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6d4ca7c-a212-4593-82e4-ee048a81d120 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1495 microversion: 2.1 time: 0.519240 Oct 26 05:19:16.592558 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2208/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:16 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1495 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:16.604457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0e241383-da77-4f22-8db3-38ec40c82f34 req-604b8951-7be0-4e53-8af4-79d2f167acb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92788f46-2da5-4d2d-8c1d-5d47eebb0d04", "name": "network-vif-deleted", "tag": "3caed5c7-479c-4f71-bde3-c2a03e82b2cc"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:16.624613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0e241383-da77-4f22-8db3-38ec40c82f34 req-604b8951-7be0-4e53-8af4-79d2f167acb7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:16.625673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0e241383-da77-4f22-8db3-38ec40c82f34 req-604b8951-7be0-4e53-8af4-79d2f167acb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:16.632657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2d5d431-c0ec-498e-abb2-6959e3cf1f5d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.725878 Oct 26 05:19:16.637195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0e241383-da77-4f22-8db3-38ec40c82f34 req-604b8951-7be0-4e53-8af4-79d2f167acb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:16.639536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2282/4490] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:15 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:16.667537 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0e241383-da77-4f22-8db3-38ec40c82f34 req-604b8951-7be0-4e53-8af4-79d2f167acb7 service nova] Creating event network-vif-deleted:3caed5c7-479c-4f71-bde3-c2a03e82b2cc for instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 on n-h1-862416-4 Oct 26 05:19:16.682353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:16.682788 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0e241383-da77-4f22-8db3-38ec40c82f34 req-604b8951-7be0-4e53-8af4-79d2f167acb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085388 Oct 26 05:19:16.683527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:16.685243 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2209/4491] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:16.701078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:16.710298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:16.714780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:16.715004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:16.715422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:16.716227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:17.039382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:17.066973 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d362fba-7383-478a-b96c-e70f676fa13d tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1305 microversion: 2.1 time: 0.385963 Oct 26 05:19:17.071362 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2283/4492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:16 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1305 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:17.632197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:17.632943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:17.651889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:17.652386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:17.652995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:17.653697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:17.654137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:17.661798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:17.671475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:17.672250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:17.696328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:17.703852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:17.705284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:17.708740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:17.709429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:17.710400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:17.759662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:17.760747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:17.769376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:17.770239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lazy-loading 'fault' on Instance uuid f5e83a75-8a2f-49d2-b779-f606722d5153 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:17.968482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:17.983143 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3887689e-1959-4e95-b6a2-4be449abc669 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 200 len: 1304 microversion: 2.1 time: 0.354984 Oct 26 05:19:17.990347 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2210/4493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:17 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 1304 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:18.065165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:18.084243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:18.090185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:18.095509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:18.096335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:18.108522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f54c9aeb-18f2-4599-9a4c-87b1cc192a44 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.440920 Oct 26 05:19:18.111404 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2284/4494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:17 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:18.132016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:18.132658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:18.133147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:18.150279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:18.150791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:18.151271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:18.218649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:18.269949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:18.274039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:18.274862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:18.275541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lazy-loading 'fault' on Instance uuid 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:18.551987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f8670897a4798b22c77f5ddd40637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7edaaf202ca492dab914b10ca9ea94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:18.565535 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-623362ab-b5fe-49e9-aeb0-daa68ad41fd7 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 200 len: 1310 microversion: 2.1 time: 0.476976 Oct 26 05:19:18.570198 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2211/4495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:18 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 1310 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:18.723233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6fe4200d-1391-4446-a693-6fa9252036d3 req-7f53aeb3-8614-4ca7-9e52-90ae88309d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e83a75-8a2f-49d2-b779-f606722d5153", "name": "network-vif-deleted", "tag": "752e6978-f7ec-4e01-9171-f52413dafacd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:18.745252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6fe4200d-1391-4446-a693-6fa9252036d3 req-7f53aeb3-8614-4ca7-9e52-90ae88309d57 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:18.748964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6fe4200d-1391-4446-a693-6fa9252036d3 req-7f53aeb3-8614-4ca7-9e52-90ae88309d57 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:18.749811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6fe4200d-1391-4446-a693-6fa9252036d3 req-7f53aeb3-8614-4ca7-9e52-90ae88309d57 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:18.794267 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6fe4200d-1391-4446-a693-6fa9252036d3 req-7f53aeb3-8614-4ca7-9e52-90ae88309d57 service nova] Creating event network-vif-deleted:752e6978-f7ec-4e01-9171-f52413dafacd for instance f5e83a75-8a2f-49d2-b779-f606722d5153 on n-h1-862416-4 Oct 26 05:19:18.805526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6fe4200d-1391-4446-a693-6fa9252036d3 req-7f53aeb3-8614-4ca7-9e52-90ae88309d57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086817 Oct 26 05:19:18.815221 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2285/4496] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:19.015599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:19.016219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f5e83a75-8a2f-49d2-b779-f606722d5153] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:19.024841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:19.028488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.035819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.036438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.039120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.043776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.048148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.108171 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] HTTP exception thrown: Instance f5e83a75-8a2f-49d2-b779-f606722d5153 could not be found. Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Request method failure captured: Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 HTTP/1.1 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFERA5hFKUBC7Yk-hBJT8hf7aopZJMv4XXckSQ2n1DhHt1THbsHDCU5UeVcKK2EpLnhOIME8Ip4KOI0Xh1l6AGYmqRkDA_arSa7zxSGL7D0eE2LAWZXlchIZSrkndPq2wBVuMZvSouEbv0qoQCJx63yxYQuxDT0hs51JkMyfHGcX84 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 4c2aa94263344a7eb33bcc7c6594229a Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f5e83a75-8a2f-49d2-b779-f606722d5153 could not be found. Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f5e83a75-8a2f-49d2-b779-f606722d5153'} Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e83a75-8a2f-49d2-b779-f606722d5153 could not be found. Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e83a75-8a2f-49d2-b779-f606722d5153 could not be found. Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:19.114449 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e83a75-8a2f-49d2-b779-f606722d5153 could not be found. Oct 26 05:19:19.118679 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:19.123127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Returning 404 to user: Instance f5e83a75-8a2f-49d2-b779-f606722d5153 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:19.124222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfa9cb1e-dac3-4509-ac84-ee9cee1f3ee7 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153" status: 404 len: 111 microversion: 2.1 time: 0.112578 Oct 26 05:19:19.131289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2212/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:19 2022] GET /compute/v2.1/servers/f5e83a75-8a2f-49d2-b779-f606722d5153 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:19.139680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:19.140523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:19.146778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:19.147723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:19.159667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.159872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.160397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.160853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.162592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.163916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.166493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.169168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.169858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.172223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.172746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.173259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.262701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:19.544302 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef72bec3-3052-4253-be3c-af8e1c26df77 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 204 len: 0 microversion: 2.1 time: 0.408561 Oct 26 05:19:19.549390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2286/4498] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:19:19 2022] DELETE /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:19.572253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:19.573440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:19.598591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.599126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.599583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.600310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:19.600782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:19.601223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:19.632247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:20.144500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:20.160112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:20.165913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:20.182219 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09e3ce93-84a7-4664-b1c8-cb7125bdfff7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 1.038950 Oct 26 05:19:20.195212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2213/4499] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:19 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:20.236629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:20.237718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] [instance: 92788f46-2da5-4d2d-8c1d-5d47eebb0d04] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:20.255659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:20.257513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:20.258786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:20.261626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:20.262366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:20.264117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:20.289683 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] HTTP exception thrown: Instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 could not be found. Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Request method failure captured: Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 HTTP/1.1 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMLkP7q3Q-ecXMBzv3-_SIzwx-oZ5U_eKMl1FSoQ-9U9gVF46COCe8knMGrV0ND3TV5G11uCFVsaQB9Lfgn-AZqOQc4gkBp9B46-ORUh_Sju6zVPc6YwZFvSsu6_b55gCi3uasMiAwpdvJ9jmqrKTou_K6OhriL_wKun1JaUcVRUwYI Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: e7edaaf202ca492dab914b10ca9ea94b Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7edaaf202ca492dab914b10ca9ea94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: e7edaaf202ca492dab914b10ca9ea94b Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1056107517 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ListServerFiltersTestJSON-1056107517-project Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 593f8670897a4798b22c77f5ddd40637 Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ListServerFiltersTestJSON-1056107517-project Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 could not be found. Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '92788f46-2da5-4d2d-8c1d-5d47eebb0d04'} Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 could not be found. Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 could not be found. Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:20.291579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 could not be found. Oct 26 05:19:20.295358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:20.300336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] Returning 404 to user: Instance 92788f46-2da5-4d2d-8c1d-5d47eebb0d04 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:20.301473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-044d23d6-f1af-42e0-a869-a6f003897aa3 tempest-ListServerFiltersTestJSON-1056107517 tempest-ListServerFiltersTestJSON-1056107517-project] 10.222.0.16 "GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04" status: 404 len: 111 microversion: 2.1 time: 0.083891 Oct 26 05:19:20.305795 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2214/4500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:20 2022] GET /compute/v2.1/servers/92788f46-2da5-4d2d-8c1d-5d47eebb0d04 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:20.312435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:20.331070 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-573200da-3fa5-4aec-9db4-f671f00d3a02 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1674 microversion: 2.1 time: 0.776783 Oct 26 05:19:20.331596 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2287/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:19 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1674 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:21.218292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:21.218912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:21.231450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:21.233363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:21.234096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:21.235504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:21.239011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:21.243710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:21.357991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:21.358620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:21.380395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:21.380768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:21.381876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:21.382605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:21.383082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:21.383525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:21.499408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:21.514439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:21.515925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:21.540133 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1858b3ae-47c0-485c-b3df-28c0e5215dde tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.325344 Oct 26 05:19:21.554075 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2215/4502] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:21 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:22.010820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:22.019652 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b3cee01-cf6a-4c25-83c8-da09d004504b tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1674 microversion: 2.1 time: 0.665470 Oct 26 05:19:22.023837 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2288/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:21 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1674 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:19:22.573473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:22.574905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:22.619848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:22.621137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:22.622289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:22.623703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:22.624313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:22.624889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:22.922644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-933d0b67-2067-4c31-a8a2-bdc63d0775d9 req-206dcc3a-9660-4a27-820a-20ab71949410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28fd521-ae28-4e01-8fae-4cca07aee55b", "name": "network-vif-deleted", "tag": "2f054fd0-ba08-488b-8a20-84b777104390"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:22.943853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-933d0b67-2067-4c31-a8a2-bdc63d0775d9 req-206dcc3a-9660-4a27-820a-20ab71949410 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:22.947897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-933d0b67-2067-4c31-a8a2-bdc63d0775d9 req-206dcc3a-9660-4a27-820a-20ab71949410 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:22.948677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-933d0b67-2067-4c31-a8a2-bdc63d0775d9 req-206dcc3a-9660-4a27-820a-20ab71949410 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:22.972494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-933d0b67-2067-4c31-a8a2-bdc63d0775d9 req-206dcc3a-9660-4a27-820a-20ab71949410 service nova] Creating event network-vif-deleted:2f054fd0-ba08-488b-8a20-84b777104390 for instance f28fd521-ae28-4e01-8fae-4cca07aee55b on n-h1-862416-4 Oct 26 05:19:22.984073 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-933d0b67-2067-4c31-a8a2-bdc63d0775d9 req-206dcc3a-9660-4a27-820a-20ab71949410 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065142 Oct 26 05:19:22.995640 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2289/4504] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:19:23.053499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:23.054633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:23.068980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:23.072034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:23.072613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:23.075136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:23.075777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:23.076457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:23.138888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:23.139395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:23.139845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:23.140320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lazy-loading 'fault' on Instance uuid f28fd521-ae28-4e01-8fae-4cca07aee55b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:23.331137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:23.332226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aa94263344a7eb33bcc7c6594229a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d8dd20e0fa4ea6bef886dce13eeffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:23.344023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:23.346106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:23.364031 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24ccdacd-517f-4d47-b677-cef49c2f8745 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.796741 Oct 26 05:19:23.367262 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2540d740-4448-4d4d-9188-46a127669093 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 200 len: 1327 microversion: 2.1 time: 0.312773 Oct 26 05:19:23.369248 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2216/4505] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:22 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:23.373176 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2290/4506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:23 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 1327 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:24.402207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:24.406609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] [instance: f28fd521-ae28-4e01-8fae-4cca07aee55b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:24.420637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:24.426136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:24.434436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:24.437609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:24.442574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:24.460539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:24.467447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:24.471351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:24.482400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:24.486234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:24.487079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:24.489518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:24.490098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:24.491166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:24.541819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] HTTP exception thrown: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b could not be found. Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Request method failure captured: Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b HTTP/1.1 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMFERA5hFKUBC7Yk-hBJT8hf7aopZJMv4XXckSQ2n1DhHt1THbsHDCU5UeVcKK2EpLnhOIME8Ip4KOI0Xh1l6AGYmqRkDA_arSa7zxSGL7D0eE2LAWZXlchIZSrkndPq2wBVuMZvSouEbv0qoQCJx63yxYQuxDT0hs51JkMyfHGcX84 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70d8dd20e0fa4ea6bef886dce13eeffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 70d8dd20e0fa4ea6bef886dce13eeffc Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-387462898 Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 4c2aa94263344a7eb33bcc7c6594229a Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-387462898-project Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b could not be found. Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f28fd521-ae28-4e01-8fae-4cca07aee55b'} Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b could not be found. Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b could not be found. Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:24.543731 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b could not be found. Oct 26 05:19:24.547795 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:19:24.553852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Returning 404 to user: Instance f28fd521-ae28-4e01-8fae-4cca07aee55b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:24.556085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a99c9d3-7cb9-4791-a5a7-692116946996 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b" status: 404 len: 111 microversion: 2.1 time: 0.160200 Oct 26 05:19:24.562515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2217/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:24 2022] GET /compute/v2.1/servers/f28fd521-ae28-4e01-8fae-4cca07aee55b => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:19:24.581492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2f742fe0-2339-47f4-a179-a8d765b5b499 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] Calling method '.version_select at 0x7f470ea58310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:24.647540 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2f742fe0-2339-47f4-a179-a8d765b5b499 tempest-ServerActionsTestJSON-387462898 tempest-ServerActionsTestJSON-387462898-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-41330578" status: 202 len: 0 microversion: 2.1 time: 0.079906 Oct 26 05:19:24.654817 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2218/4508] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 26 05:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-41330578 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:19:24.741583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:24.768918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:24.772944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:24.780318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:24.793147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49da9e3f-bf22-4749-b660-da874c53e145 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.389274 Oct 26 05:19:24.795443 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2291/4509] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:24 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:25.833030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:25.833865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:25.862357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:25.862961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:25.863415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:25.864168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:25.864626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:25.865062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:26.230598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:26.231819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:26.247206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:26.248970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:26.249738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:26.252385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:26.254114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:26.257046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:26.259625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:26.280703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:26.292366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:26.315393 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28788306-ed13-4e0b-8b97-b879e1b10086 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.487830 Oct 26 05:19:26.323096 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2219/4510] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:25 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:26.367331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dad6c704-4b2c-497d-a74c-18a39d4957f3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/ips" status: 200 len: 149 microversion: 2.1 time: 0.141712 Oct 26 05:19:26.369782 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2292/4511] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:19:26 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/ips => generated 149 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:27.355874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:27.356586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:27.380984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:27.381696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:27.382131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:27.382861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:27.383356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:27.383794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:27.501054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-740575476", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:27.649264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:19:27.649828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:19:27.650426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:19:27.652664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:19:27.653286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:19:27.682282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:27.685867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:27.686612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:27.687534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:27.690138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:27.691699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:27.740379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Getting quotas for project be76e37a16cf4dd1b6138cd28ba21021. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:19:27.750522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Getting quotas for user c86b69f7b88548f8a8f8c6d2fcbc4e60 and project be76e37a16cf4dd1b6138cd28ba21021. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:19:27.813295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:19:27.826042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:19:27.997717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6fd3078f-d357-4742-a28a-6b1e887d44ac tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.090686 Oct 26 05:19:28.012495 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2220/4512] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:19:28.018413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:28.026543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd2d9eb6-2511-473a-9ffc-a410b7bf9187 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:28.027563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd2d9eb6-2511-473a-9ffc-a410b7bf9187 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:28.032149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:28.034479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:28.050218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e592c2c-a2d8-461a-ac61-94d91f506ca6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.698160 Oct 26 05:19:28.078435 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2293/4513] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:27 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:28.213447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd2d9eb6-2511-473a-9ffc-a410b7bf9187 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:28.221892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd2d9eb6-2511-473a-9ffc-a410b7bf9187 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:28.233503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd2d9eb6-2511-473a-9ffc-a410b7bf9187 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:28.233503 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd2d9eb6-2511-473a-9ffc-a410b7bf9187 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1280 microversion: 2.47 time: 0.209855 Oct 26 05:19:28.233503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2221/4514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:28 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:29.086451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:29.087382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:29.103076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:29.103872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:29.104550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:29.105790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:29.106473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:29.107066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:29.266482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:29.268736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:29.281454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:29.284750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:29.285483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:29.286486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:29.288937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:29.289667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:29.509072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:29.524448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:29.527441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:29.543206 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df7a0f59-4426-4778-b9dd-a10a7c41f4de tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.461391 Oct 26 05:19:29.545801 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2294/4515] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:29 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:29.605159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fb46146-962c-42e2-96c4-1ac52953bf96"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:29.609148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:29.624882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:29.625743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:29.627659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:29.635533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:29.636358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:29.637063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:29.639117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:29.651718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:29.653425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:29.654724 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2b16b31-1df7-4676-bae2-15d4442fa295 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1284 microversion: 2.47 time: 0.392843 Oct 26 05:19:29.655310 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2222/4516] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:29 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1284 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:30.307149 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8d5d4a9-e8f8-4d19-bc3f-003c83b18c0e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707111 Oct 26 05:19:30.309707 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2295/4517] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:19:29 2022] POST /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:30.585197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:30.585982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:30.604474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:30.609723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:30.611290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:30.615006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:30.615862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:30.618657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:30.695352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:30.696481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:30.720534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:30.726333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:30.730279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:30.732636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:30.734239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:30.736118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:31.084198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:31.100033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:31.103579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:31.106774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2bd3db74-28d9-480c-b418-70fb0885a5ee tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1350 microversion: 2.47 time: 0.419315 Oct 26 05:19:31.107859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2296/4518] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:30 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1350 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:31.164885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:31.178956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:31.180607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:31.199461 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7cfc7db-a15d-4576-b05e-ae1a22d27e4e tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.618373 Oct 26 05:19:31.203709 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2223/4519] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:30 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:32.140921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:32.141720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:32.166784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:32.169225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:32.171238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:32.172243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:32.177586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:32.180520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:32.236824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:32.237717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:32.250861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:32.252208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:32.252773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:32.263390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:32.264077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:32.264547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:32.830034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:32.846454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:32.856110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:32.887448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:32.888048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:32.890284 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5253d925-5784-492e-9122-2c593003d277 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1338 microversion: 2.47 time: 0.754147 Oct 26 05:19:32.894463 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2297/4520] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:32 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1338 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:32.896889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:32.933757 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2f57cc1a-e532-470b-9df4-cd6cf97642e7 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.701171 Oct 26 05:19:32.938860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2224/4521] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:32 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:33.928880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:33.929568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:33.943168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:33.943682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:33.944146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:33.944877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:33.965416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:33.973730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:33.974176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:33.979164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:33.999668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:34.000176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:34.000633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:34.001573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:34.012368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:34.012827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:34.290928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:34.302315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:34.311413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:34.312898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:34.319133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:34.320591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:34.332424 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f36e1ef-e54c-4ccf-9e81-72944c331a2f tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1338 microversion: 2.47 time: 0.413166 Oct 26 05:19:34.333056 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2298/4522] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:33 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1338 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:34.347972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7d9129de-df2f-467d-851d-448924e0148d tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.380601 Oct 26 05:19:34.354475 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2225/4523] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:33 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:35.365559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:35.368108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:35.381360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:35.382116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:35.395092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:35.395990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:35.396820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:35.398107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:35.398893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:35.399776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:35.406620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:35.408709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:35.412225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:35.418199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:35.424808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:35.429132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:36.403255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:36.421817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:36.426482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:36.447148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2e000aba-189c-4137-a375-57e1a70411c0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 1.071265 Oct 26 05:19:36.455516 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2226/4524] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:35 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:36.516695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:36.533918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:36.535487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:36.547094 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ac7a73e-48b5-472f-aaf9-2ad390a91126 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1359 microversion: 2.47 time: 1.188093 Oct 26 05:19:36.559705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2299/4525] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:35 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1359 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:36.590307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1052803095"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:36.597671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:36.612229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:36.618521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:36.619086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:36.619846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:36.620311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:36.620919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.169354 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88c47495-0c25-497a-b170-f36ec5e902c2 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "POST /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095/action" status: 202 len: 52 microversion: 2.47 time: 0.584771 Oct 26 05:19:37.171320 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2227/4526] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:19:36 2022] POST /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095/action => generated 52 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:19:37.190860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:37.192918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:37.229751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:37.231884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:37.234962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.237572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:37.239908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:37.241299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.308474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:19:37.487533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:37.488964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:37.505432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:37.505926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:37.508235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.514559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:37.515834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:37.517043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.518795 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f9e748f-f7f5-4e5d-ab45-bfd37a933647 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 204 len: 0 microversion: 2.47 time: 0.338772 Oct 26 05:19:37.520277 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2300/4527] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:19:37 2022] DELETE /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:19:37.528778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:37.533512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:37.547799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:37.549193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:37.550131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.551070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:37.556773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:37.557250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:37.716171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:37.815459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:37.826727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:37.828214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:37.859850 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9bfe2a9b-1700-4d8b-a764-0d0530d9abd6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.378145 Oct 26 05:19:37.861951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2228/4528] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:37 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:37.920524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:37.924836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:37.935227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:37.944640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:37.945926 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1528b606-7431-43bd-90bf-599f5429e19e tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1365 microversion: 2.47 time: 0.421394 Oct 26 05:19:37.947731 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2301/4529] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:37 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:38.892548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:38.893226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:38.909543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:38.918519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:38.927895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:38.928743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:38.935273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:38.936662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:38.940518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:38.981553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:38.983712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:39.029061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:39.031080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:39.036275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:39.037272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:39.041216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:39.047450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:39.352652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:39.377077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:39.379908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:39.388181 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-442fa854-3683-4a46-b802-84cac6e4d071 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1365 microversion: 2.47 time: 0.413931 Oct 26 05:19:39.401376 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2302/4530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:38 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:39.420790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:39.457148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:39.459992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:39.472970 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a985f673-68e9-48e2-b1c1-cf549da1a83f tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.584717 Oct 26 05:19:39.475337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2229/4531] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:38 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:40.427987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:40.429511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:40.470974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:40.471938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:40.472652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:40.474268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:40.475033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:40.475869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:40.507587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:40.508901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:40.525792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:40.530158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:40.534869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:40.535858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:40.542461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:40.543411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:40.684055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:40.699269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:40.702894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:40.707134 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2ff3a82-af6b-4a3e-93dd-4f04406ce72c tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1365 microversion: 2.47 time: 0.285359 Oct 26 05:19:40.709483 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2303/4532] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:40 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:40.755174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:40.759050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:40.764991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:40.773330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:40.784875 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1528a8a5-9e23-4881-9df1-01cb111ff159 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.280998 Oct 26 05:19:40.794425 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2230/4533] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:40 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:19:41.738757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:41.739375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:41.763364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:41.763874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:41.764323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:41.765040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:41.789610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:41.790656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:41.831761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:41.832988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:41.867927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:41.868429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:41.869078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:41.875324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:41.876150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:41.877014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:42.149805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:42.162574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:42.164060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:42.187008 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e842b62-1388-4f4c-a21f-3fb5739694cf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1555 microversion: 2.91 time: 0.359854 Oct 26 05:19:42.188185 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2231/4534] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:41 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:42.456579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:42.466238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:42.475127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:42.481204 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8fdd5b0b-7e5f-4f93-8be4-e60875176053 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1365 microversion: 2.47 time: 0.745384 Oct 26 05:19:42.487550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2304/4535] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:41 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1365 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:43.225390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:43.226759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:43.248424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:43.252194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:43.253589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:43.254590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:43.258861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:43.259760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:43.300973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a11b7107-8394-445a-be3b-99a11c4b1b0c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Action: 'create', calling method: .version_select at 0x7f4709e3d8b0>, body: {"keypair": {"name": "tempest-keypair-685005895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTQfVe+prNQMCacnqqS5KOAjpFt7Rpg54WWmsoCsGg2F8ydnYZaVYSSIVNGq+ue0/tYzUxyxuHuQQVx4/sE7bPrlXzWoYjIC1FeriTH5q/Utx77gXcWc4qyggvdlWiufQ=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:43.384560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a11b7107-8394-445a-be3b-99a11c4b1b0c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Getting quotas for project bc62f1394b0845ea895ba6bbd995d6b7. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:19:43.421761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a11b7107-8394-445a-be3b-99a11c4b1b0c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Getting quotas for user f3b41dcc17d84bb3a8d03749c0e3ab7a and project bc62f1394b0845ea895ba6bbd995d6b7. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:19:43.503084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a11b7107-8394-445a-be3b-99a11c4b1b0c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.208561 Oct 26 05:19:43.510021 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2305/4536] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:19:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:19:43.519900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:43.521669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:43.539473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:43.540144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:43.540605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:43.543564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:43.545262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:43.546991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:43.652405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:43.685435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:43.692067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:43.705765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:43.707698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:43.708680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:43.714717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-01c001e3-76cb-4342-8fdd-7a9157dde438 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1537 microversion: 2.91 time: 0.489296 Oct 26 05:19:43.720820 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2232/4537] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:43 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1537 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:43.724132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lazy-loading 'fault' on Instance uuid 88a8df37-df24-45d0-8113-b14aea7ec095 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:44.207054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:44.218763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:44.229725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c86b69f7b88548f8a8f8c6d2fcbc4e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be76e37a16cf4dd1b6138cd28ba21021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:44.231092 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-40865a92-acc0-4c67-8653-b32f63584603 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 200 len: 1370 microversion: 2.47 time: 0.718853 Oct 26 05:19:44.232153 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2306/4538] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:43 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 1370 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:44.747702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:44.749938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:44.766312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:44.768349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:44.769597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:44.770635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:44.771342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:44.772348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:44.898556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:44.925369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:44.929876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:44.945613 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f440371-60da-4922-99a0-b819972de7b0 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1537 microversion: 2.91 time: 0.202523 Oct 26 05:19:44.947803 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2233/4539] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:44 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:45.276224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:45.277456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] [instance: 88a8df37-df24-45d0-8113-b14aea7ec095] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:45.292236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:45.293472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:45.294163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:45.296931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:45.297746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:45.297924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:45.331825 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] HTTP exception thrown: Instance 88a8df37-df24-45d0-8113-b14aea7ec095 could not be found. Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Request method failure captured: Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 HTTP/1.1 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMNetsVXxhFap1lkhZRGTmRQKiV_qZy4IEyAAh6aW7LVKr1NzeiRQIWRdi1ReBWalYugZheQGFNwYXgWkzuruKPeMcs_gE7j3yIOHgRbTpDQfFJeulnVeH9NE23YusQkrh0bVcu8aHl4Wla0gCXhUfbotQimry3dRvVNxXoH2dTecBE Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.47 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: be76e37a16cf4dd1b6138cd28ba21021 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAaction247Test-1304806769 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be76e37a16cf4dd1b6138cd28ba21021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be76e37a16cf4dd1b6138cd28ba21021"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be76e37a16cf4dd1b6138cd28ba21021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be76e37a16cf4dd1b6138cd28ba21021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAaction247Test-1304806769 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: be76e37a16cf4dd1b6138cd28ba21021 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAaction247Test-1304806769 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAaction247Test-1304806769-project Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c86b69f7b88548f8a8f8c6d2fcbc4e60 Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAaction247Test-1304806769-project Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 88a8df37-df24-45d0-8113-b14aea7ec095 could not be found. Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '88a8df37-df24-45d0-8113-b14aea7ec095'} Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a8df37-df24-45d0-8113-b14aea7ec095 could not be found. Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a8df37-df24-45d0-8113-b14aea7ec095 could not be found. Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:45.334196 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a8df37-df24-45d0-8113-b14aea7ec095 could not be found. Oct 26 05:19:45.339025 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:45.344058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] Returning 404 to user: Instance 88a8df37-df24-45d0-8113-b14aea7ec095 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:45.348341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-812d14b7-82ee-44eb-944c-b05b92e24cf3 tempest-ServersAaction247Test-1304806769 tempest-ServersAaction247Test-1304806769-project] 10.222.0.16 "GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095" status: 404 len: 111 microversion: 2.47 time: 0.076267 Oct 26 05:19:45.349963 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2307/4540] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:45 2022] GET /compute/v2.1/servers/88a8df37-df24-45d0-8113-b14aea7ec095 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:19:45.998791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:45.999574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:46.023213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:46.025467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:46.026111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:46.027049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:46.029009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:46.036333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:46.344032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:46.410411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:46.412783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:46.466340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0bd978f4-7fab-45b6-8a99-91cf1ca5e5ab tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1540 microversion: 2.91 time: 0.473830 Oct 26 05:19:46.466970 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2234/4541] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:45 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1540 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:46.524015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:46.526995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:46.541207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1739626815", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "43084933-f8d3-440f-94dd-35c6833f6615"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:46.560439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:46.561913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:46.565060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:46.566464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:46.566947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:46.567390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:46.693818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] validate_networks() for [('43084933-f8d3-440f-94dd-35c6833f6615', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:19:46.705298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862416-4". {{(pid=120585) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 05:19:46.856590 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b54e816-2e87-43aa-a455-55bdd86671e8 tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action" status: 202 len: 0 microversion: 2.91 time: 0.337194 Oct 26 05:19:46.866037 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2235/4542] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:19:46 2022] POST /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:19:46.878068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:46.878687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:46.898450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:46.900846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:46.901716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:46.902430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:46.903047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:46.904018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:46.910627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:47.074834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:47.121837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:47.128029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:47.166049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95888653-a0a1-4312-b04b-107a53cb8899 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1488 microversion: 2.91 time: 0.295133 Oct 26 05:19:47.168636 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2236/4543] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:46 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1488 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:48.199412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:48.200276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:48.222160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.226036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.231491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.232500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.236035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.239585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.338651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:19:48.339233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:19:48.339762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:19:48.340180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:19:48.340598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:19:48.361681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.362181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.362956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.376525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.379544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.381871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.493183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Getting quotas for project 8292f66cb6fb47caa2de5ebfbaa576a2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:19:48.509148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Getting quotas for user 2f409f28786e40b3a230b0e38a9d71c8 and project 8292f66cb6fb47caa2de5ebfbaa576a2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:19:48.530361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:48.543199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:48.552932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:48.570982 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4dc9ac20-048c-4d99-9491-ec0150ce1325 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1488 microversion: 2.91 time: 0.376667 Oct 26 05:19:48.575314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:19:48.585528 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2237/4544] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:48 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1488 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:48.588862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:19:48.604967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:48.605815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:48.618072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.618868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.619470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.622968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.624508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.625123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.713266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-980ca380-9939-49d4-beaa-fb156a1393f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments/8ba8d76b-3760-474d-9c25-d1ce12039d06" status: 200 len: 194 microversion: 2.20 time: 0.118951 Oct 26 05:19:48.713916 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2238/4545] 10.222.0.16 () {60 vars in 1454 bytes} [Wed Oct 26 05:19:48 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments/8ba8d76b-3760-474d-9c25-d1ce12039d06 => generated 194 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:19:48.739756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-614eff6a-1d14-495c-960c-645b598b9934 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.593598 Oct 26 05:19:48.752600 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2308/4546] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:19:48.764175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be0aced9-5b53-4cfd-bff6-cf00cfaa0c58 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:48.765333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be0aced9-5b53-4cfd-bff6-cf00cfaa0c58 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:48.900683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:48.901634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:48.912968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.913504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.913947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:48.914667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:48.915124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:48.933658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:49.241879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lazy-loading 'services' on Instance uuid 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:49.471494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eaa9168a-8f75-43b2-b583-ef23094e02cc tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments/8ba8d76b-3760-474d-9c25-d1ce12039d06" status: 202 len: 0 microversion: 2.20 time: 0.574504 Oct 26 05:19:49.477706 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2309/4547] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 26 05:19:48 2022] DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments/8ba8d76b-3760-474d-9c25-d1ce12039d06 => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:19:49.497684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:49.506860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:49.540335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:49.554274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:49.555273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:49.560986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:49.564547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:49.565910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:49.596473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be0aced9-5b53-4cfd-bff6-cf00cfaa0c58 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:49.614666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be0aced9-5b53-4cfd-bff6-cf00cfaa0c58 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1217 microversion: 2.1 time: 0.858816 Oct 26 05:19:49.637723 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2239/4548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:48 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1217 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:49.664722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:49.667795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:49.684894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:49.685710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:49.687799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:49.689229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:49.689952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:49.690542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:49.762465 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d565907-0f01-4305-96ec-ba6af863d9c7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.281114 Oct 26 05:19:49.774074 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2310/4549] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:19:49 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 197 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:19:49.885426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:49.897228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:49.907972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:49.932442 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-054f8a08-44a1-4bbc-967c-b7c887234cd5 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.293085 Oct 26 05:19:49.933041 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2240/4550] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:49 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:50.092172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fb46146-962c-42e2-96c4-1ac52953bf96"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:50.096617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:50.127493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.129135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.133571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.140458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.155618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.158825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.477363 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Invalid volume: volume 2fb46146-962c-42e2-96c4-1ac52953bf96 is already attached to instances: 537cbd71-74b4-4d99-895f-cc873448f370 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments HTTP/1.1 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 74 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: {"volumeAttachment": {"volumeId": "2fb46146-962c-42e2-96c4-1ac52953bf96"}} Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid volume: volume 2fb46146-962c-42e2-96c4-1ac52953bf96 is already attached to instances: 537cbd71-74b4-4d99-895f-cc873448f370 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '537cbd71-74b4-4d99-895f-cc873448f370', 'body': {'volumeAttachment': {'volumeId': '2fb46146-962c-42e2-96c4-1ac52953bf96'}}} Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2fb46146-962c-42e2-96c4-1ac52953bf96 is already attached to instances: 537cbd71-74b4-4d99-895f-cc873448f370 Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:19:50.491273 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2fb46146-962c-42e2-96c4-1ac52953bf96 is already attached to instances: 537cbd71-74b4-4d99-895f-cc873448f370 Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2fb46146-962c-42e2-96c4-1ac52953bf96 is already attached to instances: 537cbd71-74b4-4d99-895f-cc873448f370 Oct 26 05:19:50.496490 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:19:50.501125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 400 to user: Invalid volume: volume 2fb46146-962c-42e2-96c4-1ac52953bf96 is already attached to instances: 537cbd71-74b4-4d99-895f-cc873448f370 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:19:50.502288 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-effaae44-d4a1-4b36-849e-6ba6b8c77bb8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.415650 Oct 26 05:19:50.503126 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2311/4551] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:19:50 2022] POST /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 174 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:19:50.667840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:50.669172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:50.678964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:50.679640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:50.706815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.712484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.713345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.713978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.715280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.715991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.717885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.718637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.720004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.725044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.725596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.726043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.923237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:50.941485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c01771ac-703e-43d9-a588-be5b0be0ab22 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1269 microversion: 2.1 time: 0.274151 Oct 26 05:19:50.942393 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2241/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:50 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1269 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:50.958438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:50.962101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:50.991866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.992617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.994053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:50.997388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:50.998004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:50.999072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:51.055096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lazy-loading 'services' on Instance uuid 537cbd71-74b4-4d99-895f-cc873448f370 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:19:51.122521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-040abbc4-4709-4071-85c3-b0a6fcbea484 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.178241 Oct 26 05:19:51.126582 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2242/4553] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:19:50 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:19:51.132728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:51.140458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:51.162991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:51.163592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:51.164814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:51.172512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:51.175748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:51.176433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:51.280284 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01ecd087-6bf8-40f3-9934-1ec51ccb4575 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments/2fb46146-962c-42e2-96c4-1ac52953bf96" status: 202 len: 0 microversion: 2.1 time: 0.606324 Oct 26 05:19:51.287612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2312/4554] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:19:50 2022] DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments/2fb46146-962c-42e2-96c4-1ac52953bf96 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:19:51.297045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:51.305766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:51.341985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:51.342963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:51.343532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:51.345026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:51.350247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:51.350862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:51.450089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f824323f-07eb-4d01-a360-72708181eb09 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157908 Oct 26 05:19:51.462459 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2313/4555] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:19:51 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:19:51.544718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:51.560060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:51.567757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:51.573800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-650e123d-819b-4e23-92dd-bade9f21ac03 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.444779 Oct 26 05:19:51.580930 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2243/4556] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:51 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:51.971578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:51.972929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:51.986807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:51.988847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:51.991739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:51.993088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:51.997923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:51.998490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:52.139208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:52.142221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:52.160107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:52.161969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:52.162441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:52.163169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:52.163623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:52.166036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:52.189362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:52.198089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f08ab16-39f8-4d25-80ff-207b8570032f tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1275 microversion: 2.1 time: 0.231272 Oct 26 05:19:52.207296 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2314/4557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:51 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:52.226885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1602060167", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "607b390a-4be3-4c34-862e-193c00180186"}, {"port": "bbbbad34-c9b5-4cc0-9e13-aa9e00494405", "tag": "port-1"}, {"port": "4fddf85f-a296-4afa-b733-f473ffa50c68", "tag": "port-2"}, {"uuid": "f7692e23-c6cb-4d72-b1d6-2f2abec7e3eb", "tag": "net-1"}, {"uuid": "f7692e23-c6cb-4d72-b1d6-2f2abec7e3eb"}, {"uuid": "8772a9a1-32ac-4ccb-bb6e-89193ed97ee6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8772a9a1-32ac-4ccb-bb6e-89193ed97ee6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7046d08e-df16-4414-acd2-b39fedb3a361", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fe2f4c37-af9c-4791-9643-7dd3c4bbc340", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5de3c20b-86b8-4ed7-9503-011be9af1e41", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1483280735"}], "key_name": "tempest-keypair-685005895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:52.227819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d6592cf5-5f66-4b2b-a631-015c5c6cfd24 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091338 Oct 26 05:19:52.230914 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2244/4558] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:19:52 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:19:52.474588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:52.478265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:52.491335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:52.492134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:52.495851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:52.496812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:52.498079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:52.498680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:52.619112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61f78cf7-ebca-4ffa-86f9-c864c465bba8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144087 Oct 26 05:19:52.620236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2245/4559] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:19:52 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:52.630721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:52.634258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:52.710721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:52.717125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:52.721211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:52.726228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] validate_networks() for [('607b390a-4be3-4c34-862e-193c00180186', None, None, None, None, None), (None, None, 'bbbbad34-c9b5-4cc0-9e13-aa9e00494405', None, None, None), (None, None, '4fddf85f-a296-4afa-b733-f473ffa50c68', None, None, None), ('f7692e23-c6cb-4d72-b1d6-2f2abec7e3eb', None, None, None, None, None), ('f7692e23-c6cb-4d72-b1d6-2f2abec7e3eb', None, None, None, None, None), ('8772a9a1-32ac-4ccb-bb6e-89193ed97ee6', '10.2.2.100', None, None, None, None), ('8772a9a1-32ac-4ccb-bb6e-89193ed97ee6', '10.2.2.200', None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:19:52.727673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:52.733065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:52.736918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:53.124799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:53.150784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:53.152489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:53.185041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc18f425-1ee9-43ae-8fc0-50caddd9a0c6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.562632 Oct 26 05:19:53.187621 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2246/4560] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:52 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:53.238020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:53.238898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:53.249692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:53.251296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:53.264777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:53.265768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:53.266949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:53.269462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:53.351045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:53.691790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:53.707989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46a37115-ef94-46a2-a24e-b207e6ebc385 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1275 microversion: 2.1 time: 0.476912 Oct 26 05:19:53.709360 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2247/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:53 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1275 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:53.729965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:53.742272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:53.765729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:53.772689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:53.775673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:53.779248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:53.782515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:53.783712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:53.925289 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c09b3829-08e0-47e2-8a62-258b24ecd6ce tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.214010 Oct 26 05:19:53.934220 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2248/4562] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:19:53 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:19:53.948054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:53.952554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:53.960526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:53.961277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:53.961915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:53.963238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:53.964886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:53.965644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:54.029114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c72f1be1-5c23-4a11-806f-5377542285b1 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093507 Oct 26 05:19:54.033551 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2249/4563] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:19:53 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:54.220642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:54.220642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:54.234515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:54.236074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:54.237608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:54.241800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:54.243737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:54.245813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:54.655782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:54.680533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:54.687458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:54.702507 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-de90869d-899c-4b3b-b046-430395832853 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.488519 Oct 26 05:19:54.710057 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2250/4564] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:54 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:54.731914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:54.732780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:54.747440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:54.748184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:54.748782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:54.755639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:54.756385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:54.756989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:56.415931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:56.435466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-556ea9ea-69fc-4f93-994a-96ceb56d3214 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1317 microversion: 2.1 time: 1.707291 Oct 26 05:19:56.436305 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2251/4565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:54 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1317 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:19:56.456512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:56.458979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:56.474980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:56.476823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:56.482109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:56.484059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:56.485933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:56.486632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:56.562139 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8b5968f2-2880-4be5-9c98-8544a2f7ac37 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124476 Oct 26 05:19:56.566207 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2252/4566] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:19:56 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:19:56.576673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:56.580886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:56.611707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:56.612132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:56.612582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:56.613297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:56.613790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:56.619181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:56.728165 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-65940aa7-5050-4472-b0f6-95d7296261f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160455 Oct 26 05:19:56.733659 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2253/4567] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:19:56 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:56.742088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:56.742712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:56.767662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:56.768251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:56.773659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:56.774478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:56.774955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:56.775398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:57.016947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:57.037917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:57.040418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:57.047148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-172017c8-289e-4989-8964-1821026e7370 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.312252 Oct 26 05:19:57.050381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2254/4568] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:56 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:19:57.061537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fad183b7-eb20-498a-93b8-e7975e758359 req-279adbe0-b6bf-4176-863a-5e8da6a8f75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4e4da1-4e55-430e-9bfc-e0fff3765a72", "tag": "97f77a05-87f8-49bc-92b9-453bcf2cbdce"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:19:57.085215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fad183b7-eb20-498a-93b8-e7975e758359 req-279adbe0-b6bf-4176-863a-5e8da6a8f75a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:57.086181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fad183b7-eb20-498a-93b8-e7975e758359 req-279adbe0-b6bf-4176-863a-5e8da6a8f75a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:57.087094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fad183b7-eb20-498a-93b8-e7975e758359 req-279adbe0-b6bf-4176-863a-5e8da6a8f75a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:57.114371 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fad183b7-eb20-498a-93b8-e7975e758359 req-279adbe0-b6bf-4176-863a-5e8da6a8f75a service nova] Creating event network-changed:97f77a05-87f8-49bc-92b9-453bcf2cbdce for instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 on n-h2-862416-4 Oct 26 05:19:57.130996 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fad183b7-eb20-498a-93b8-e7975e758359 req-279adbe0-b6bf-4176-863a-5e8da6a8f75a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073374 Oct 26 05:19:57.135743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2255/4569] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:57.460586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:57.461422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:57.474187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:57.477990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:57.497742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:57.497742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:57.497742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:57.497742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:58.422385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:58.559337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:19:59.222091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:19:59.249026 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9199230-6fbf-4ed5-9ec7-95099b223b31 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1317 microversion: 2.1 time: 1.793164 Oct 26 05:19:59.253670 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2256/4570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:19:57 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1317 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:19:59.260336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:59.267240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:59.286324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:59.290920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:59.291633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:59.295397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:59.296075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:59.298512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:59.420691 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff72b7d9-074e-4216-aab9-af9b34353c72 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165260 Oct 26 05:19:59.421742 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2257/4571] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:19:59 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:19:59.427888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:59.450252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:59.458469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:59.458989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:59.470644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:59.471620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:59.472255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:59.472857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:59.548188 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1f703da-9f82-4dda-ab4c-caf6fcbc65d8 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124569 Oct 26 05:19:59.552743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2258/4572] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:19:59 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:19:59.558040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:19:59.566187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:19:59.580792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:59.581776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:59.582394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:59.583298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:19:59.585886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:19:59.586813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:19:59.631199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:00.066160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:00.082169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:00.083670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:00.106335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e934ac48-c3e8-4172-ba90-c6a3dafc6833 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.552145 Oct 26 05:20:00.106941 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2259/4573] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:19:59 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:00.273863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:00.274470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:00.280979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:00.283202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:00.283986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:00.290824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:00.291501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:00.292106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:01.311678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:01.327076 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e44f77c9-12da-4e20-a5c9-fcf3564ecdda tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1317 microversion: 2.1 time: 1.054352 Oct 26 05:20:01.341403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2260/4574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:00 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1317 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:20:01.349535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:01.359029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:01.377867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:01.382412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:01.383104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:01.383952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:01.384772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:01.386927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:01.484635 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f922b092-7283-4ed4-a5d9-b10b2a9dcf2f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.148492 Oct 26 05:20:01.492507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2261/4575] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:20:01 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:01.505332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:01.507796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:01.515469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:01.519245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:01.520024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:01.526903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:01.527649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:01.528416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:01.627682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b64c3c9c-2848-43ef-8d12-4c43c43afe67 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133829 Oct 26 05:20:01.630778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2262/4576] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:20:01 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:01.645947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:01.646867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:01.660303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:01.660983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:01.662339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:01.663871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:01.665243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:01.667375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:02.038395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:02.051882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:02.066537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:02.076077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29992222-1894-46dc-83a6-31f03c685b01 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.442533 Oct 26 05:20:02.093665 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2263/4577] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:01 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:02.098684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:02.099191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:02.122767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:02.128788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:02.128788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:02.130150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:02.130150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:02.130757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:02.174374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:02.197138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:02.197956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:20:02.365676 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e6b855cc-f7af-4bfe-8913-0d292f784969 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 204 len: 0 microversion: 2.20 time: 0.269414 Oct 26 05:20:02.366717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2264/4578] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:02 2022] DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:02.382451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:02.383784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:02.400344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:02.401254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:02.403129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:02.404122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:02.407812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:02.409664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:02.980219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:02.988637 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-07c9a7dc-64ed-495d-b0f1-76821f94d962 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1317 microversion: 2.1 time: 0.617525 Oct 26 05:20:02.989246 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2265/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:02 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:03.008175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:03.008802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:03.025079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:03.025636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:03.026111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:03.026910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:03.027573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:03.028204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:04.167711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:04.200647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:04.202035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:04.203255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24b3fddc-4922-4b0c-8b7c-715425d6288c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1724 microversion: 2.20 time: 1.213046 Oct 26 05:20:04.209965 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2266/4580] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:02 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1724 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:04.216791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:04.228123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:04.242504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:04.242997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:04.243449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:04.244179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:04.244662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:04.245073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:04.316283 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cd3caca-9315-493c-97e5-ed36950438c9 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104827 Oct 26 05:20:04.317467 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2267/4581] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:20:04 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:04.322469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:04.323847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:04.333188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:04.333946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:04.334560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:04.335459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:04.336067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:04.336662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:04.847519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:04.864742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:04.866369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:04.880744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-487ebf3d-97eb-4fa5-b098-b8a100fbde58 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.560872 Oct 26 05:20:04.884267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2268/4582] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:04 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:04.892812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:04.896138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:04.911862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:04.914833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:04.915569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:04.916541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:04.920158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:04.922013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:05.947103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:06.006086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:06.022847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce092171-2df5-4820-be32-c82544109b1e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1317 microversion: 2.1 time: 1.137050 Oct 26 05:20:06.023611 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2269/4583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:04 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1317 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:06.048872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-25323919-dc42-48c0-8176-485e5355102c req-c9eb0b69-353e-474c-b8f8-a890f90be5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e4da1-4e55-430e-9bfc-e0fff3765a72", "name": "network-vif-plugged", "status": "completed", "tag": "97f77a05-87f8-49bc-92b9-453bcf2cbdce"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:06.101202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25323919-dc42-48c0-8176-485e5355102c req-c9eb0b69-353e-474c-b8f8-a890f90be5fb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.105407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25323919-dc42-48c0-8176-485e5355102c req-c9eb0b69-353e-474c-b8f8-a890f90be5fb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.108343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25323919-dc42-48c0-8176-485e5355102c req-c9eb0b69-353e-474c-b8f8-a890f90be5fb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.157485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-25323919-dc42-48c0-8176-485e5355102c req-c9eb0b69-353e-474c-b8f8-a890f90be5fb service nova] Creating event network-vif-plugged:97f77a05-87f8-49bc-92b9-453bcf2cbdce for instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 on n-h2-862416-4 Oct 26 05:20:06.185121 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-25323919-dc42-48c0-8176-485e5355102c req-c9eb0b69-353e-474c-b8f8-a890f90be5fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154334 Oct 26 05:20:06.189028 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2270/4584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:06.219289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:06.222274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:06.257609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.260167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.260771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.264466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.267782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.268265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.562095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:06.585075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:20:06.586099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:20:06.587057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:20:06.588246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:20:06.589147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:20:06.591451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:06.598868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:06.602729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30838062-e6b8-4fab-b7ce-2c7f97098eaa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 200 len: 1656 microversion: 2.20 time: 0.412140 Oct 26 05:20:06.611707 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2271/4585] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:06 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 1656 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:06.628258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:06.632756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.637707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.638768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.642403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.647585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.652695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.658388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:06.686567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:06.691611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.693651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.695787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.696691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.698885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.699435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.740148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Getting quotas for project bc62f1394b0845ea895ba6bbd995d6b7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:06.773721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Getting quotas for user f3b41dcc17d84bb3a8d03749c0e3ab7a and project bc62f1394b0845ea895ba6bbd995d6b7. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:06.824198 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0e5c5ade-c278-44db-a73f-f22e91d4a26b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208676 Oct 26 05:20:06.827415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2272/4586] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:20:06 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:06.850188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:06.850885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:06.874961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.875608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.876061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:06.876797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:06.877260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:06.878246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:07.105019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:07.115718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:20:07.120232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7046d08e-df16-4414-acd2-b39fedb3a361',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fe2f4c37-af9c-4791-9643-7dd3c4bbc340',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5de3c20b-86b8-4ed7-9503-011be9af1e41',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:20:07.124379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:07.131967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:07.153206 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b668a47a-f661-4a00-99c8-4493e42d9953 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.324678 Oct 26 05:20:07.155300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2273/4587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:06 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:07.439597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1638842527", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d8341a41-92a8-4ab5-9e46-412d4e1abee8"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:07.567004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] validate_networks() for [('d8341a41-92a8-4ab5-9e46-412d4e1abee8', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:20:07.897402 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d90837cb-d80f-42a1-b430-5b04468ec4d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.682640 Oct 26 05:20:07.898085 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2315/4588] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Oct 26 05:19:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 15684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:20:07.911558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1a27841e-5b16-4bec-a1a0-d61857899c07 req-0ddb7536-b9b8-490b-b7f8-eb4fc1d58b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9", "name": "network-vif-deleted", "tag": "1c0fef33-8605-48ac-9ba4-640c02d8e172"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:07.931551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1a27841e-5b16-4bec-a1a0-d61857899c07 req-0ddb7536-b9b8-490b-b7f8-eb4fc1d58b76 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:07.932049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1a27841e-5b16-4bec-a1a0-d61857899c07 req-0ddb7536-b9b8-490b-b7f8-eb4fc1d58b76 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:07.932486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1a27841e-5b16-4bec-a1a0-d61857899c07 req-0ddb7536-b9b8-490b-b7f8-eb4fc1d58b76 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:07.982739 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1a27841e-5b16-4bec-a1a0-d61857899c07 req-0ddb7536-b9b8-490b-b7f8-eb4fc1d58b76 service nova] Creating event network-vif-deleted:1c0fef33-8605-48ac-9ba4-640c02d8e172 for instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 on n-h1-862416-4 Oct 26 05:20:08.002664 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1a27841e-5b16-4bec-a1a0-d61857899c07 req-0ddb7536-b9b8-490b-b7f8-eb4fc1d58b76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092107 Oct 26 05:20:08.004488 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2316/4589] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:08.010730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:08.011449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:08.041800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:08.047019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:08.047892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:08.052533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:08.054971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:08.055637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.127790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:20:09.129010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:20:09.129741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:20:09.130385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:20:09.131104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:20:09.165733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.166276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.166791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.167583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.168045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.168472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.272196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Getting quotas for project 1d0eae96f36044af9df89fbfae4f5139. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:09.285254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Getting quotas for user ef625b2ad18d4dac857503dff97a9b6c and project 1d0eae96f36044af9df89fbfae4f5139. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:09.314642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:20:09.332350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:20:09.422137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:09.434548 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a127d175-523c-4efd-9981-3ebb68c15d2b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1317 microversion: 2.1 time: 1.428244 Oct 26 05:20:09.435737 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2317/4590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:08 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1317 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:09.459400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:09.460494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:09.477065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.477730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.478828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.480620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.481869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.483250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.504863 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] HTTP exception thrown: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Request method failure captured: Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 HTTP/1.1 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMJXpET6wgIgCMUoE659hcitHIb8B2Rwz0CbQOocAtWaYJrdEYAy_axwmp1oSXjzOZxl5AC9mgZw8kE2g8qKr8KifS3_5M6uxKfDaAzS0ZY20KyFS28MTEQUpXDaHMDkr1rcJzTu2X5dN00KnYlsvz8rjU1DFYtM8ccmjzPeuF4xha8 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: fba70f93f3fc434eac4137621494d0e3 Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9'} Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:09.508667 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:20:09.512648 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:09.515210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Returning 404 to user: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:20:09.516453 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba4d6f91-c1f2-4fb9-bb43-8f5bc435effe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 404 len: 111 microversion: 2.20 time: 0.065076 Oct 26 05:20:09.517270 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2318/4591] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:09 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:20:09.523685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:09.526507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:09.531535 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a25de88a-3e30-41f6-b4a2-109c6f8ca6f6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.374405 Oct 26 05:20:09.533542 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2274/4592] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:20:09.542779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.543395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.544048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.545019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.545732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.546382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.551573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eaa46f05-5a91-405e-b381-eee3e67dd9f1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:09.552201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eaa46f05-5a91-405e-b381-eee3e67dd9f1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:09.585051 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7553adf-65b1-4df2-b3e4-6a3676ff287d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066227 Oct 26 05:20:09.586435 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2319/4593] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:20:09 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:09.597906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:09.598885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:09.608426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.609150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.610100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.611148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:09.611834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:09.612618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:09.700034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaa46f05-5a91-405e-b381-eee3e67dd9f1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:09.713519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaa46f05-5a91-405e-b381-eee3e67dd9f1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:09.726061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eaa46f05-5a91-405e-b381-eee3e67dd9f1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:09.727906 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eaa46f05-5a91-405e-b381-eee3e67dd9f1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1285 microversion: 2.42 time: 0.193323 Oct 26 05:20:09.755592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2275/4594] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:09 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:09.764086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5885dadd-1ac6-424c-bed9-115721f68cea tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '.version_select at 0x7f470a8bbca0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:09.824192 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5885dadd-1ac6-424c-bed9-115721f68cea tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429347002" status: 204 len: 0 microversion: 2.20 time: 0.067158 Oct 26 05:20:09.824729 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2276/4595] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 26 05:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429347002 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:09.837106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a297f207-911b-4192-8d95-12fb6a9cf1fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:09.848672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a297f207-911b-4192-8d95-12fb6a9cf1fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:10.178621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:10.201773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:10.210155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a297f207-911b-4192-8d95-12fb6a9cf1fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:10.218192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a297f207-911b-4192-8d95-12fb6a9cf1fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:10.220204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:10.230421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a297f207-911b-4192-8d95-12fb6a9cf1fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:10.231625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a297f207-911b-4192-8d95-12fb6a9cf1fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1262 microversion: 2.26 time: 0.398354 Oct 26 05:20:10.232189 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2277/4596] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:09 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1262 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:10.247118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8765c1a7-8368-4d63-b961-8fa02dd533dd tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1546 microversion: 2.91 time: 0.659274 Oct 26 05:20:10.248024 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2320/4597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:09 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1546 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:10.461496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:10.462116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:10.468866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:10.484777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:10.485564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:10.486341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:10.486847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:10.487245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:10.599022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:10.603292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:10.632139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:10.640454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:10.642471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:10.643369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:10.643885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:10.644300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:10.815930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-699b038c-5037-466e-abb0-17b080fa17a3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211354 Oct 26 05:20:10.828939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2321/4598] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:20:10 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:10.864854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:10.869798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:10.895506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:10.900600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:10.902521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:10.906249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:10.920987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:10.922863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.254275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.279739 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a12751f0-b865-4427-84e7-98fd53a4cca9 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1505 microversion: 2.1 time: 0.821580 Oct 26 05:20:11.281417 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2278/4599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:10 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:11.291662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:11.294677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:11.307824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.308556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.309162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.310070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.311415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.312405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.565193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.565531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.599126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.602163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.606999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.610731 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81073583-beb4-4376-8630-5e88ed09766f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1266 microversion: 2.26 time: 0.327185 Oct 26 05:20:11.615537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.616624 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2279/4600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:11 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:11.639850 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b11955ee-9721-4886-a724-043fa59d0b91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1527 microversion: 2.42 time: 0.805192 Oct 26 05:20:11.643127 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2322/4601] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:10 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1527 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:11.652226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:11.654025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:11.658817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:11.661740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:11.672780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.674973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.675755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.684501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.686502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.689057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.701460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.702261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.704886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.705978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.708278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.709075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.812619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:11.816477 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-269edaa4-7092-45ef-9299-0b39f5d17f97 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72/os-instance-actions/req-614eff6a-1d14-495c-960c-645b598b9934" status: 200 len: 313 microversion: 2.1 time: 0.170758 Oct 26 05:20:11.819064 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2323/4602] 10.222.0.16 () {58 vars in 1419 bytes} [Wed Oct 26 05:20:11 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72/os-instance-actions/req-614eff6a-1d14-495c-960c-645b598b9934 => generated 313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:11.841143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:11.847871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:11.865843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.874495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.879745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:11.882087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:11.882731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:11.883442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.014886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:12.036817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:12.050734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:12.075547 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b62fe30-5a5a-4435-a1c9-e1f0d509c457 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1533 microversion: 2.91 time: 0.457280 Oct 26 05:20:12.076873 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2280/4603] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:11 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1533 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:12.093039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:12.096964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:12.135910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.136761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.137471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.138442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.146897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.147607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.179981 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7dd33346-b164-4ccc-81d7-8096a645f054 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "POST /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72/action" status: 202 len: 0 microversion: 2.1 time: 0.342387 Oct 26 05:20:12.188756 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2324/4604] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:20:11 2022] POST /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:20:12.206932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:12.210541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:12.239063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.246402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.247323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.248253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.248934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.249549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.259353 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b92e405-0309-4f70-991e-461aee255b06 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176639 Oct 26 05:20:12.264678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2281/4605] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:20:12 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:12.275123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8984a0e3-b170-46e1-9220-649b54275aab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'create', calling method: .version_select at 0x7f470a79e9d0>, body: {"keypair": {"name": "tempest-keypair-332493794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoVwH4o0T+Bm3XfI0aGYJ/1yYrNpv9hoIr1fZ7jJ/PY6tMH4OLAge6vj7hmRqIvI8w8aUmvqtuOdjToJTYIdB8L72qUTlwrapa+KjSSIGYjeY2GYBiWfEJTpKqc8f+3dw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:12.317905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8984a0e3-b170-46e1-9220-649b54275aab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:12.329066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8984a0e3-b170-46e1-9220-649b54275aab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for user fba70f93f3fc434eac4137621494d0e3 and project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:12.384579 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8984a0e3-b170-46e1-9220-649b54275aab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.118337 Oct 26 05:20:12.385721 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2282/4606] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:20:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:20:12.400627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:12.404041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:12.420444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.421362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.422095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.423563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.424268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.425341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.821293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] Lazy-loading 'services' on Instance uuid 17f7c413-78d5-4215-b442-e6f36028b93b {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:12.874598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1586424c-9e00-4efc-abea-02cfeeb16d2d tempest-UnshelveToHostMultiNodesTest-543701739 tempest-UnshelveToHostMultiNodesTest-543701739-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1938 microversion: 2.91 time: 0.682192 Oct 26 05:20:12.875443 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2325/4607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:12 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1938 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:12.894823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:12.895934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:12.941783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.943539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.948157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:12.949111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:12.950937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:12.951897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.025476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:20:13.191225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.202916 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb4a6404-3df2-4df6-88d5-8f7a97515007 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1507 microversion: 2.1 time: 0.815745 Oct 26 05:20:13.207068 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2283/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:12 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1507 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:13.239375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:13.240027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:13.262902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.263743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.266822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.267629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.271038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.284007 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fbb4b16e-6572-4658-bc60-8d4ef4fca87a tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 204 len: 0 microversion: 2.1 time: 0.406734 Oct 26 05:20:13.285406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2326/4609] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:20:12 2022] DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:20:13.298768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:13.302885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:13.305023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.317671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.320496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.322456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.323528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.326718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.327413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.496598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.518411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.524438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.527017 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d0bb60a9-b61b-4322-afdd-275464dac432 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1593 microversion: 2.42 time: 0.237806 Oct 26 05:20:13.552395 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2327/4610] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:13 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1593 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:13.552812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.552812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:13.556019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:13.556751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.561230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:13.561779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.566364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05835e1b-af1a-46c3-881c-e683a33259a3 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1314 microversion: 2.26 time: 0.353181 Oct 26 05:20:13.570742 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2284/4611] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:13 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:13.578247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.579623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.580420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.581395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.582016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.582606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.595680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:13.597178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:13.615268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.621231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.621940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.622877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:13.623756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:13.624300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:13.633763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:20:13.709614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:13.787780 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f77a259-9182-4fa9-9bfa-1132a2c9f7bf tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 204 len: 0 microversion: 2.91 time: 0.254489 Oct 26 05:20:13.791408 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2328/4612] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:13 2022] DELETE /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:13.948157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:13.949121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1410417935", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "19f4e8b4-562e-48be-a8d9-0dec346b9391"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:13.959651 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5765d0ec-510f-487d-9ca0-82eba289e4bb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1681 microversion: 2.1 time: 0.387583 Oct 26 05:20:13.960582 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2285/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:13 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1681 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:13.997564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:14.003942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:14.019885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:14.020825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:14.029072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:14.030131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:14.031004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:14.032106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:14.061680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] validate_networks() for [('19f4e8b4-562e-48be-a8d9-0dec346b9391', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:20:14.275354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:14.288237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:14.291354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:14.297841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0fc8641b-337f-41c1-8ad0-1fce165017f6 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.306580 Oct 26 05:20:14.314771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2286/4614] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:13 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:14.327687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:14.329498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:14.350000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:14.350881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:14.351487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:14.352399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:14.353012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:14.353740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:14.816204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:14.829703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cae37e57-3607-4af5-8a1c-fc9c7ae1a62e tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1507 microversion: 2.1 time: 0.508358 Oct 26 05:20:14.830740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2287/4615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:14 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:14.847453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:14.848085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:14.868154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:14.868656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:14.869106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:14.869859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:14.870325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:14.870760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.083726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.097393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.103388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.113099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3131f7e6-d1a3-4a6f-a715-665af7b4ab87 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1593 microversion: 2.42 time: 0.281040 Oct 26 05:20:15.113781 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2288/4616] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:14 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1593 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:15.129784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:15.130413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:15.153696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.156859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.158550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.159320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.164116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.164589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.279000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:20:15.280156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:20:15.280863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:20:15.282264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:20:15.283154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:20:15.304085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.304963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.305699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.306696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.307392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.308050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.350797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.355707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Getting quotas for project 826cc023f57b4d629db66327e31e1620. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:15.359205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.360937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.362136 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f98a46a-5ded-4ea9-be57-b8d654af9c3b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1320 microversion: 2.26 time: 0.247392 Oct 26 05:20:15.363638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Getting quotas for user 0786a7c2a62d4f618ef7bdb373977183 and project 826cc023f57b4d629db66327e31e1620. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:15.369899 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2289/4617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:15 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:15.383105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:20:15.384652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:15.385291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:15.386476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:20:15.397785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.398281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.402490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.403346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.403828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.404268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.503296 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a1e37c41-85d5-455a-991f-85a681c0a8a3 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712863 Oct 26 05:20:15.518228 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2329/4618] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:20:15.526333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:15.527185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:15.534646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.554169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.554962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.555913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:15.558469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:15.559179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:15.819140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.837961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.845450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:15.868353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f776f482-c766-4a30-b846-79487269e28b tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.348632 Oct 26 05:20:15.868961 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2330/4619] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:15 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:15.884641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07c79441-3c78-4573-81d3-d5ee44d51920 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:15.890699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07c79441-3c78-4573-81d3-d5ee44d51920 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:16.010821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:16.028345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11e9010e-0b70-4a57-831f-566d402789d2 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1681 microversion: 2.1 time: 0.655022 Oct 26 05:20:16.030101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2290/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:15 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1681 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:16.040931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:16.044217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:16.060687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.061202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.063902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.066066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.066554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.068926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.152756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07c79441-3c78-4573-81d3-d5ee44d51920 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:16.165001 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07c79441-3c78-4573-81d3-d5ee44d51920 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1217 microversion: 2.1 time: 0.286345 Oct 26 05:20:16.166270 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2331/4621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:15 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1217 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:16.194379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:16.194950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:16.206522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.206923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.207432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.208419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.209451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.210223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.435219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:16.453830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:16.455773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:16.458545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9dfd44b-84f6-446b-a63e-8ac1f506efad tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1593 microversion: 2.42 time: 0.272739 Oct 26 05:20:16.463784 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2332/4622] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:16 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1593 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:16.476551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:16.477397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:16.490862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.491596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.493859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.494762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.502027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.502734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.664215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:16.680796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c305a56-f467-4767-936d-922efac93370 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1505 microversion: 2.1 time: 0.649497 Oct 26 05:20:16.685691 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2291/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:16 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1505 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:16.710460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '.version_select at 0x7f4709bfeee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:16.711448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:16.728594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.745142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.746020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.746967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.748670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.749828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.856503 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b0996381-7399-4ee9-9cd7-59e00bfb90fb tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.149108 Oct 26 05:20:16.868656 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2292/4624] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 26 05:20:16 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72/os-instance-actions => generated 611 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:20:16.880607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:16.883218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:16.900493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.901078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.902587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:16.903585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:16.916794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:16.917627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.053695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:20:17.112677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.136861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.141163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.149053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37e7d7ff-ce76-4e90-9d08-cd68d56d79db tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1320 microversion: 2.26 time: 0.683867 Oct 26 05:20:17.160654 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2333/4625] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:16 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1320 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:17.198953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:17.202939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:17.219514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.221272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.222116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.223798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.228717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.229555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.347878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e2b3f46-64a1-4eb1-8ab0-bfe8fef7455b tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 204 len: 0 microversion: 2.1 time: 0.474746 Oct 26 05:20:17.349210 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2293/4626] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:20:16 2022] DELETE /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:20:17.367439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:17.368226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:17.385549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.386047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.393614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.398768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.399258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.399702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.510395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.535328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.540708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8736c83fce1403bac00ae7d0a01a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248f23e7e5db4d13b008a504c22dc0ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.555563 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0697f358-a6b7-481d-acda-618a02ec16ac tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 200 len: 1539 microversion: 2.91 time: 0.379257 Oct 26 05:20:17.556872 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2334/4627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:17 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 1539 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:17.572354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:17.576211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:17.590278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.591029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.591634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.592515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.593136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.593776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.912193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:17.928598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a6386d7-90f3-41be-8e80-7e1a63797123 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1269 microversion: 2.1 time: 0.366485 Oct 26 05:20:17.929239 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2335/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:17 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1269 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:17.953502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:17.954151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:17.973737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.979428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.980087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:17.981669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:17.982385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:17.985245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:18.356424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:18.376894 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9fd838df-c488-42a5-8dad-06ddfebd54b3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1681 microversion: 2.1 time: 1.026345 Oct 26 05:20:18.378190 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2294/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:17 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1681 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:18.383274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:18.384130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:18.401276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:18.402089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:18.403788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:18.404701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:18.405992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:18.409514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:19.207688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:19.548773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:19.585780 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41701db2-0154-4dea-b8a5-5708d51a6034 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1511 microversion: 2.1 time: 1.653106 Oct 26 05:20:19.595243 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2336/4630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:17 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1511 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:19.623438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:19.627286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:19.672759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:19.673279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:19.673779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:19.674514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:19.675259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:19.675699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.127919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.150955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.161533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.165662 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea1e0891-5a5b-44a2-bccf-21127ce20524 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1661 microversion: 2.42 time: 1.786378 Oct 26 05:20:20.166270 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2295/4631] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:18 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1661 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:20.172680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:20.175059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] [instance: 17f7c413-78d5-4215-b442-e6f36028b93b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:20.202845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.209402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.211449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.213557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.214303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.217556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.250872 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] HTTP exception thrown: Instance 17f7c413-78d5-4215-b442-e6f36028b93b could not be found. Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Request method failure captured: Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b HTTP/1.1 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMKgQlN7lJxIWYw7SuXyh8lcwGrzKuJNIocVR1Tv0FURlFbB_jREitBYCmMzaJGIdIGvrExg4FFIZsX04zFroha7vuypsjcEJY5RIGaNHSjnSH8O3mVNy2p2vPZpFzX2VC95Nd0lDGPdX4N80cCoc09Y7K1XPehZd14Pdfg1ZHfJyJo Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.91 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 248f23e7e5db4d13b008a504c22dc0ab Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-780210272 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_248f23e7e5db4d13b008a504c22dc0ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/248f23e7e5db4d13b008a504c22dc0ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/248f23e7e5db4d13b008a504c22dc0ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/248f23e7e5db4d13b008a504c22dc0ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-780210272 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 248f23e7e5db4d13b008a504c22dc0ab Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-780210272 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-UnshelveToHostMultiNodesTest-780210272-project Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f8736c83fce1403bac00ae7d0a01a3b5 Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-780210272-project Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 17f7c413-78d5-4215-b442-e6f36028b93b could not be found. Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '17f7c413-78d5-4215-b442-e6f36028b93b'} Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f7c413-78d5-4215-b442-e6f36028b93b could not be found. Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f7c413-78d5-4215-b442-e6f36028b93b could not be found. Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:20.252878 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f7c413-78d5-4215-b442-e6f36028b93b could not be found. Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:20.257819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] Returning 404 to user: Instance 17f7c413-78d5-4215-b442-e6f36028b93b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:20:20.259140 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7fdbb255-a95c-48ac-bf11-610e162de149 tempest-UnshelveToHostMultiNodesTest-780210272 tempest-UnshelveToHostMultiNodesTest-780210272-project] 10.222.0.16 "GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b" status: 404 len: 111 microversion: 2.91 time: 0.091347 Oct 26 05:20:20.259788 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2296/4632] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:20 2022] GET /compute/v2.1/servers/17f7c413-78d5-4215-b442-e6f36028b93b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:20:20.285269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:20.288395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:20.307783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.310733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.312246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.314524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.315832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.317050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.412077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.422806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.427866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.429456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5bf2e141-0bf6-4837-9dc4-54e1bb9d17d7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.833042 Oct 26 05:20:20.430610 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2337/4633] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:19 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:20.438056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:20.439008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:20.445574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.446375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.447185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.448194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.448884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.449582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.491692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.512205 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59183171-3437-4517-b612-3fd1a99cb901 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1275 microversion: 2.1 time: 0.251163 Oct 26 05:20:20.525756 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2297/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:20 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:20.548460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1349800235", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750735e9-b3b5-47b8-9394-1c0c5714587a"}], "security_groups": [{"name": "tempest-securitygroup--1758746468"}], "key_name": "tempest-keypair-332493794", "user_data": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:20.614762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:20.636287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc83b625-3291-4dfc-a4c9-e90f1f269dff tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 200 len: 1614 microversion: 2.1 time: 0.203656 Oct 26 05:20:20.636892 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2338/4635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:20 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 1614 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:20.650074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:20.655166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:20.678033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.682243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.686066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.689455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:20.690237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:20.692148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:20.926663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] validate_networks() for [('750735e9-b3b5-47b8-9394-1c0c5714587a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:20:21.254606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:21.266500 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5d22e59-3439-4c13-a929-261989e37948 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1511 microversion: 2.1 time: 0.626946 Oct 26 05:20:21.267388 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2339/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:20 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:21.277674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0959adbc-e4e9-41e4-acc1-d2962dcc2b9d req-d99e2898-69a4-422e-8a52-cc14d2c95e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537cbd71-74b4-4d99-895f-cc873448f370", "name": "network-vif-deleted", "tag": "86182bf0-4be6-409d-93fe-c8fc79a88e23"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:21.288907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:21.310406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0959adbc-e4e9-41e4-acc1-d2962dcc2b9d req-d99e2898-69a4-422e-8a52-cc14d2c95e67 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:21.311083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0959adbc-e4e9-41e4-acc1-d2962dcc2b9d req-d99e2898-69a4-422e-8a52-cc14d2c95e67 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:21.318431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0959adbc-e4e9-41e4-acc1-d2962dcc2b9d req-d99e2898-69a4-422e-8a52-cc14d2c95e67 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:21.342444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0959adbc-e4e9-41e4-acc1-d2962dcc2b9d req-d99e2898-69a4-422e-8a52-cc14d2c95e67 service nova] Creating event network-vif-deleted:86182bf0-4be6-409d-93fe-c8fc79a88e23 for instance 537cbd71-74b4-4d99-895f-cc873448f370 on n-h1-862416-4 Oct 26 05:20:21.353805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0959adbc-e4e9-41e4-acc1-d2962dcc2b9d req-d99e2898-69a4-422e-8a52-cc14d2c95e67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084954 Oct 26 05:20:21.356670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2340/4637] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:21.377742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:21.377742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:21.386497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:21.398185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:21.398660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:21.399418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:21.400057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:21.400668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:22.224066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:22.264163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:22.279273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:22.285712 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b3d4f631-9b42-451e-bcb8-61c50ad90b61 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1661 microversion: 2.42 time: 0.922267 Oct 26 05:20:22.286582 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2341/4638] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:21 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1661 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:22.295753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:22.296586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:22.306378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:22.307145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:22.307786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:22.308960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:22.309639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:22.311368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:22.350241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=14 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:22.566941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:20:22.567362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:20:22.568793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:20:22.569857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:20:22.570328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:20:22.587930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:22.590184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:22.593498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:22.594706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:22.595521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:22.596782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:22.654948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:22.673548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:22.697901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Getting quotas for user fba70f93f3fc434eac4137621494d0e3 and project dab3d6d7b2504435b8cbad3ea0782e34. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:22.743920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:20:22.747213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:20:22.982229 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4aa9458e-15bf-4ece-8b8c-d115a929c40f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.436649 Oct 26 05:20:22.982938 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2298/4639] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:20:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:20:22.994592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:22.997304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:23.037968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.038551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.042564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.043372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.043905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.044304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.110942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.125684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.127169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.128357 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f40c33da-5f55-47c4-aa6d-7aa60c0fa36b tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.837254 Oct 26 05:20:23.149557 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2342/4640] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:22 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:23.152465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:23.153123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:23.178740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.179258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.179709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.180432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.186902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.187908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.221419 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 HTTP/1.1 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '537cbd71-74b4-4d99-895f-cc873448f370'} Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:23.223150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-472b4a46-386f-4832-b66f-d9e93fb46881 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 404 len: 111 microversion: 2.1 time: 0.079283 Oct 26 05:20:23.231792 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2343/4641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:23 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:20:23.241996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:23.242640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:23.251969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.252481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.252936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.253684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.261098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.261676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.344677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.345502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.346114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.346749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lazy-loading 'fault' on Instance uuid ff4e4da1-4e55-430e-9bfc-e0fff3765a72 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:23.581528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f409f28786e40b3a230b0e38a9d71c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8292f66cb6fb47caa2de5ebfbaa576a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.607451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a910c547-beee-4c95-805a-139fde840e81 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 200 len: 1307 microversion: 2.1 time: 0.376131 Oct 26 05:20:23.608725 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2344/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:23 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:23.620480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f488b2a-4c64-4055-a607-19b57b306b2a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:23.629076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f488b2a-4c64-4055-a607-19b57b306b2a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:23.745545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.760350 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b94cdca1-4bb7-4735-be53-948548795c1d tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.776297 Oct 26 05:20:23.761992 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2299/4643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:22 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:23.770718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15b0bc15-fd05-4160-b8d6-2776b4a826f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '.version_select at 0x7f4709bb5f70>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:23.802399 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15b0bc15-fd05-4160-b8d6-2776b4a826f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922433295" status: 202 len: 0 microversion: 2.1 time: 0.035353 Oct 26 05:20:23.804641 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2300/4644] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922433295 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:20:23.815900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:23.816802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:23.824801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.825832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.827217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.836739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.838958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.839656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.843714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f488b2a-4c64-4055-a607-19b57b306b2a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.858491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f488b2a-4c64-4055-a607-19b57b306b2a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.864189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f488b2a-4c64-4055-a607-19b57b306b2a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:23.866874 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f488b2a-4c64-4055-a607-19b57b306b2a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1281 microversion: 2.20 time: 0.255032 Oct 26 05:20:23.874889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2345/4645] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:23 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1281 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:23.894334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f658ff7f-13fc-4b2b-92a2-e0f3f8762d49 req-0a1cc742-09e5-495b-8b03-6acec811ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e4da1-4e55-430e-9bfc-e0fff3765a72", "name": "network-vif-deleted", "tag": "97f77a05-87f8-49bc-92b9-453bcf2cbdce"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:23.917079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f658ff7f-13fc-4b2b-92a2-e0f3f8762d49 req-0a1cc742-09e5-495b-8b03-6acec811ea5d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:23.922802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f658ff7f-13fc-4b2b-92a2-e0f3f8762d49 req-0a1cc742-09e5-495b-8b03-6acec811ea5d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:23.923599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f658ff7f-13fc-4b2b-92a2-e0f3f8762d49 req-0a1cc742-09e5-495b-8b03-6acec811ea5d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:23.951273 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f658ff7f-13fc-4b2b-92a2-e0f3f8762d49 req-0a1cc742-09e5-495b-8b03-6acec811ea5d service nova] Creating event network-vif-deleted:97f77a05-87f8-49bc-92b9-453bcf2cbdce for instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 on n-h2-862416-4 Oct 26 05:20:23.959469 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f658ff7f-13fc-4b2b-92a2-e0f3f8762d49 req-0a1cc742-09e5-495b-8b03-6acec811ea5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076652 Oct 26 05:20:23.960485 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2346/4646] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:24.160102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:24.161495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:24.181975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:24.184705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:24.186481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:24.190004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:24.192845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:24.195844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:24.477235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:24.492683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:24.495383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:24.498610 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3a23146-112c-483c-961c-038f998aa1ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1708 microversion: 2.42 time: 0.692243 Oct 26 05:20:24.513487 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2301/4647] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:23 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1708 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:24.636598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:24.637704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] [instance: ff4e4da1-4e55-430e-9bfc-e0fff3765a72] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:24.653670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:24.657854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:24.660465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:24.662897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:24.663650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:24.666208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:24.677805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:24.706421 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] HTTP exception thrown: Instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 could not be found. Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Request method failure captured: Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 HTTP/1.1 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMNxCmlH8jR-NCas5ObRQst2sB8YyeEymowSvzqVGI_usgM6nFDHTRwJcalg4KhLfink_pagRDS_l08zMs3YTuzmKomYvXpKTk8jJV0boyrt-xdSfI1rn55sVh7Www6Ie0GoUejffJJDaf7ne_jmKtSaw-49zr1ewDziiqGOKrfZq3g Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8292f66cb6fb47caa2de5ebfbaa576a2 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-InstanceActionsTestJSON-192153749 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8292f66cb6fb47caa2de5ebfbaa576a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8292f66cb6fb47caa2de5ebfbaa576a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8292f66cb6fb47caa2de5ebfbaa576a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8292f66cb6fb47caa2de5ebfbaa576a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-InstanceActionsTestJSON-192153749 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8292f66cb6fb47caa2de5ebfbaa576a2 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-InstanceActionsTestJSON-192153749 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-InstanceActionsTestJSON-192153749-project Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2f409f28786e40b3a230b0e38a9d71c8 Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-InstanceActionsTestJSON-192153749-project Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 could not be found. Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'ff4e4da1-4e55-430e-9bfc-e0fff3765a72'} Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 could not be found. Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 could not be found. Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:24.708268 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 could not be found. Oct 26 05:20:24.712511 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:20:24.718407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] Returning 404 to user: Instance ff4e4da1-4e55-430e-9bfc-e0fff3765a72 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:20:24.723108 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ac0c0e6-6c52-461f-acdf-8a11d2f97138 tempest-InstanceActionsTestJSON-192153749 tempest-InstanceActionsTestJSON-192153749-project] 10.222.0.16 "GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72" status: 404 len: 111 microversion: 2.1 time: 0.091211 Oct 26 05:20:24.723916 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2302/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:24 2022] GET /compute/v2.1/servers/ff4e4da1-4e55-430e-9bfc-e0fff3765a72 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:20:24.792695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:24.795834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:24.826225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:24.828036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:24.830448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:24.834367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:24.836401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:24.836874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:25.102120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.117697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.120438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.121691 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3b09b1c8-55d7-44d5-ad5f-d9dfa86e737f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.967475 Oct 26 05:20:25.149616 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2347/4649] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:24 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:25.157709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:25.158650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:25.165813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:25.166620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:25.167292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:25.168182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:25.168862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:25.169507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:25.318239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:25.451220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.465775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.467283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.468113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:25.468452 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd558e3e-8418-4f37-8603-7dd919d52e19 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1341 microversion: 2.20 time: 0.317385 Oct 26 05:20:25.476132 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2348/4650] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:25 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1341 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:25.478413 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6773f3cb-9d2d-4592-92b0-101e3192bb95 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.697873 Oct 26 05:20:25.479407 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2303/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:24 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:20:25.527322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:25.528102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:25.536822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:25.538497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:25.539836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:25.541538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:25.545146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:25.549330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.036080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-820a5d21-601f-41b5-84c6-abbfece635c0 req-586d83cd-f151-4f41-995e-9c8d92f6d93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "002d3284-215a-4a21-aa66-80c0097c15fa", "tag": "d0ad6e2d-7cb5-4733-8325-31e178f0ed4e"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:26.050487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:26.054183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:26.067232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:26.068916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:26.070979 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3e9400a-55b9-4da1-9159-d751f535fd56 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1708 microversion: 2.42 time: 0.547710 Oct 26 05:20:26.073553 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2349/4652] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:25 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1708 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:26.078972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-820a5d21-601f-41b5-84c6-abbfece635c0 req-586d83cd-f151-4f41-995e-9c8d92f6d93c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.079489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-820a5d21-601f-41b5-84c6-abbfece635c0 req-586d83cd-f151-4f41-995e-9c8d92f6d93c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.080812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-820a5d21-601f-41b5-84c6-abbfece635c0 req-586d83cd-f151-4f41-995e-9c8d92f6d93c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.118850 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-820a5d21-601f-41b5-84c6-abbfece635c0 req-586d83cd-f151-4f41-995e-9c8d92f6d93c service nova] Creating event network-changed:d0ad6e2d-7cb5-4733-8325-31e178f0ed4e for instance 002d3284-215a-4a21-aa66-80c0097c15fa on n-h1-862416-4 Oct 26 05:20:26.135972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-820a5d21-601f-41b5-84c6-abbfece635c0 req-586d83cd-f151-4f41-995e-9c8d92f6d93c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105740 Oct 26 05:20:26.136582 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2304/4653] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:20:26.157356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:26.158621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:26.177814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.178574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.179205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.180098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.180567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.181002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.503992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:26.504973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:26.513178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.513963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.514587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.515460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.517369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.517982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.688106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:26.700003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:26.702659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:26.704474 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91a2bb56-d09b-45c8-bb98-ed618ed90c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1339 microversion: 2.20 time: 0.205877 Oct 26 05:20:26.707223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2305/4654] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:26 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1339 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:26.713509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:26.714479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:26.727531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.728839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.731021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:26.732182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:26.740854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:26.742286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:27.113757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.129041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.132418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.138464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d403b68c-ac87-4911-86e8-a53be9820b79 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.429689 Oct 26 05:20:27.143238 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2306/4655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:26 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:27.148386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.151761 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e643c1e-f852-483e-a062-aca6f07c4c68 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.998945 Oct 26 05:20:27.153572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:27.153941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:27.167335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2350/4656] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:26 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:27.173141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:27.173715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:27.174163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:27.177170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:27.178404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:27.179650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:27.534002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3a8ee1af-8152-4bdb-bf59-b407644ddaa8 req-73e3198a-9473-43c7-b499-0062c12b5689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58802ec-cf16-4d55-b953-aa9b695454f8", "tag": "0e922909-f90d-4a0a-ab10-ad3e3e4c8280"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:27.553688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3a8ee1af-8152-4bdb-bf59-b407644ddaa8 req-73e3198a-9473-43c7-b499-0062c12b5689 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:27.555793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3a8ee1af-8152-4bdb-bf59-b407644ddaa8 req-73e3198a-9473-43c7-b499-0062c12b5689 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:27.557527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3a8ee1af-8152-4bdb-bf59-b407644ddaa8 req-73e3198a-9473-43c7-b499-0062c12b5689 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:27.625832 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3a8ee1af-8152-4bdb-bf59-b407644ddaa8 req-73e3198a-9473-43c7-b499-0062c12b5689 service nova] Creating event network-changed:0e922909-f90d-4a0a-ab10-ad3e3e4c8280 for instance c58802ec-cf16-4d55-b953-aa9b695454f8 on n-h2-862416-4 Oct 26 05:20:27.645081 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3a8ee1af-8152-4bdb-bf59-b407644ddaa8 req-73e3198a-9473-43c7-b499-0062c12b5689 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111299 Oct 26 05:20:27.654397 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2351/4657] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:20:27.740800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:27.742371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:27.749547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:27.750690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:27.751336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:27.752963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:27.753803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:27.754403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:27.826606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.846121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.849678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.852628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9520ac50-f2b5-41f8-b6db-a107a39c060b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1755 microversion: 2.42 time: 0.708793 Oct 26 05:20:27.853767 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2307/4658] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:27 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1755 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:27.908252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.935127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.946060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d581cc24-4ef9-4c98-ae0a-1dac54443de3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: .version_select at 0x7f4709ab8b80>, body: {"keypair": {"name": "tempest-keypair-634954275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn7qF9FBqWqfSUBapGLsjEUjRpTIa0hbC+Wue+jO0ok30HLksfD7j34SDpP3YxNxYy9eHb2nJeZJMe6FRNPBq16IdceM391Igum1243qjRNyZS25oqiXDxyrCb5/gXm6Q=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:27.950397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:27.959117 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e1ca6ac-4183-46fc-9215-db277014ab0d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1339 microversion: 2.20 time: 0.223112 Oct 26 05:20:27.974158 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2352/4659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:27 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:20:28.014256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-d581cc24-4ef9-4c98-ae0a-1dac54443de3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:28.030127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-d581cc24-4ef9-4c98-ae0a-1dac54443de3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:28.102647 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d581cc24-4ef9-4c98-ae0a-1dac54443de3 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164197 Oct 26 05:20:28.111743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2308/4660] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:20:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:28.166377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:28.168069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:28.192760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:28.194303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:28.198597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:28.202105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:28.202598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:28.207986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:28.210127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:28.211116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:28.215449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:28.218624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:28.221132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:28.222747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:28.224974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:28.225610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:28.804112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:28.822055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:28.834080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:28.836469 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cd02637-6918-432f-a6b6-9412d073ada6 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.650166 Oct 26 05:20:28.837787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:28.838973 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2309/4661] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:28 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:28.860851 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-169c5693-61cc-43af-a765-868a090d2063 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.696520 Oct 26 05:20:28.863644 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2353/4662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:28 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:28.887173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:28.888905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:28.902200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:28.902965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:28.903531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:28.906965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:28.908705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:28.910811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:28.997088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:28.997758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:29.011969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:29.012507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:29.023774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:29.027824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:29.029169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:29.032305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:29.610899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:29.618318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:29.634050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:29.641561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:29.644897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:29.647169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:29.648049 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc062748-393c-4e26-8c52-e990ef1cfeab tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.657211 Oct 26 05:20:29.649999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-18787f84-aef2-4d90-b89c-03e9e965a383 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1755 microversion: 2.42 time: 0.772392 Oct 26 05:20:29.665564 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2310/4663] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:28 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1755 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:29.665677 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2354/4664] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:28 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:29.865699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:29.866702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:29.880833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:29.881380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:29.882963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:29.885103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:29.885689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:29.886311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:29.889693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:29.890437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:29.910123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:29.910648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:29.911105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:29.911901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:29.918558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:29.919122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:30.415802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:30.431993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:30.432238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:30.434202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:30.438677 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b0f7f5bc-5f03-4b8a-8719-c22e98b82c51 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.576965 Oct 26 05:20:30.446306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2311/4665] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:29 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:30.458358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4927b635-4d54-4d1e-a0a5-ffb71d73aad5 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f4709ab89d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:30.465117 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e4d32f1d-f106-4c11-ba35-6373c1a153d1 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.580282 Oct 26 05:20:30.482663 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2355/4666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:29 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:30.539312 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4927b635-4d54-4d1e-a0a5-ffb71d73aad5 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392" status: 200 len: 637 microversion: 2.1 time: 0.091808 Oct 26 05:20:30.539908 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2312/4667] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 26 05:20:30 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392 => generated 637 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:30.555300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69c556b3-76fb-4781-8137-1288d3a23ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f470acae5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:30.639962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=17 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:30.649101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-69c556b3-76fb-4781-8137-1288d3a23ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:30.665362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-69c556b3-76fb-4781-8137-1288d3a23ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:30.680066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:30.681662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:30.690209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:30.692520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:30.694089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:30.696106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:30.697768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:30.698375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:31.134179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69c556b3-76fb-4781-8137-1288d3a23ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.582307 Oct 26 05:20:31.134879 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2356/4668] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:30 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:31.145255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:31.164879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:31.165587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:31.173433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:31.182705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:31.186940 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0572acb-ec7a-4c18-8ad7-e4e1c908c245 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.508482 Oct 26 05:20:31.188111 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2313/4669] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:30 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:31.190351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:31.193035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:31.193569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:31.194337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:31.194836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:31.200617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:31.205986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63d294bc-8c81-4fdd-a72f-bab348457a8c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f4709ab8700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:31.692250 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63d294bc-8c81-4fdd-a72f-bab348457a8c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "DELETE /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.495733 Oct 26 05:20:31.694680 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2314/4670] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 26 05:20:31 2022] DELETE /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata/os_version => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:20:31.700790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:31.704149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:31.726430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:31.727336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:31.728335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:31.729565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:31.730201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:31.730633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:31.762410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:31.783986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:31.792959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:31.801454 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-15fa5dcd-ff08-4adf-9022-3f1f31b89e6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1802 microversion: 2.42 time: 0.658761 Oct 26 05:20:31.819622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2357/4671] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:31 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1802 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:31.834615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:31.839325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:31.855218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:31.858694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:31.859799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:31.863700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:31.864637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:31.866254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:32.463229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:32.478467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e29ba14d-68c9-4447-aa2f-f16a8b6fb3aa tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.653490 Oct 26 05:20:32.479018 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2358/4672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:31 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:32.483640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76121735-b1e1-4de8-be3d-4854c6cf647c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f470a79b8b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:32.523968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:32.540005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:32.541501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:32.545630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f6be882-8924-4e95-a4d5-5197e8abadb7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.848853 Oct 26 05:20:32.554059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2315/4673] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:31 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:32.559033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:32.563280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:32.577217 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-76121735-b1e1-4de8-be3d-4854c6cf647c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 37 microversion: 2.1 time: 0.097121 Oct 26 05:20:32.577850 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2359/4674] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:20:32 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 37 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:32.587036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5d6e7c98-61bd-4579-aeb6-f5aa8fd12716 req-f586fcad-13c7-4bbe-8b25-746550172317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002d3284-215a-4a21-aa66-80c0097c15fa", "name": "network-vif-plugged", "status": "completed", "tag": "d0ad6e2d-7cb5-4733-8325-31e178f0ed4e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:32.591227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:32.591743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:32.592196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:32.592919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:32.593403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:32.594377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:32.614315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5d6e7c98-61bd-4579-aeb6-f5aa8fd12716 req-f586fcad-13c7-4bbe-8b25-746550172317 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:32.614819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5d6e7c98-61bd-4579-aeb6-f5aa8fd12716 req-f586fcad-13c7-4bbe-8b25-746550172317 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:32.615267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5d6e7c98-61bd-4579-aeb6-f5aa8fd12716 req-f586fcad-13c7-4bbe-8b25-746550172317 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:32.636234 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5d6e7c98-61bd-4579-aeb6-f5aa8fd12716 req-f586fcad-13c7-4bbe-8b25-746550172317 service nova] Creating event network-vif-plugged:d0ad6e2d-7cb5-4733-8325-31e178f0ed4e for instance 002d3284-215a-4a21-aa66-80c0097c15fa on n-h1-862416-4 Oct 26 05:20:32.637673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:32.652289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5d6e7c98-61bd-4579-aeb6-f5aa8fd12716 req-f586fcad-13c7-4bbe-8b25-746550172317 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073157 Oct 26 05:20:32.656087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2360/4675] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:32.671211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34f8bcf6-1042-4f9a-a26c-98d11f45688c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f470abc2040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:32.753349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-34f8bcf6-1042-4f9a-a26c-98d11f45688c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:32.763123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-34f8bcf6-1042-4f9a-a26c-98d11f45688c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:33.258200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.268254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.281444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.282677 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a1cbf3ed-32b8-4e75-a364-1d42f67cac40 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.727402 Oct 26 05:20:33.283296 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2316/4676] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:32 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:33.315437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:33.319237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:33.334847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:33.335676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:33.337070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:33.338661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:33.340396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:33.341152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:33.442116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34f8bcf6-1042-4f9a-a26c-98d11f45688c tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.783727 Oct 26 05:20:33.449486 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2361/4677] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:32 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:33.459491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-824480c9-16dd-4e45-a237-d168c1a09ed3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f470a827d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:33.526551 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-824480c9-16dd-4e45-a237-d168c1a09ed3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.073155 Oct 26 05:20:33.536652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2362/4678] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Oct 26 05:20:33 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata/os_distro => generated 33 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:33.543238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:33.544315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:33.558728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:33.559249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:33.559702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:33.561325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:33.561838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:33.562286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:33.819300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.857179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.859822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.861597 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1da0c710-7a85-4be6-aa5c-7b1df647e23d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1802 microversion: 2.42 time: 0.557591 Oct 26 05:20:33.862258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2317/4679] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:33 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1802 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:33.884223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bfe0628-01d9-4859-8c02-56556b4f16ff tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f4709ab88b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:33.944216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:33.958713 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ddccdc31-2a3b-4c0a-aa0b-ddf662f82cee tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.420607 Oct 26 05:20:33.959948 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2363/4680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:33 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:33.976879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6bfe0628-01d9-4859-8c02-56556b4f16ff tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:33.979124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:33.980095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:33.982884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6bfe0628-01d9-4859-8c02-56556b4f16ff tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:33.991682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:33.992487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:33.993886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:33.998882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:33.999647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:34.000411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:34.237940 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bfe0628-01d9-4859-8c02-56556b4f16ff tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.374163 Oct 26 05:20:34.238575 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2318/4681] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:33 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:34.243745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2107932576", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dfe50ec-535f-4512-94ac-24b3da81845a"}], "security_groups": [{"name": "tempest-securitygroup--1089507531"}], "key_name": "tempest-keypair-634954275", "user_data": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:34.344456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:34.357343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:34.365750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:34.367168 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c4250f8-83cf-4dec-9bd4-2b5b4bb839fd tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1362 microversion: 2.26 time: 0.405773 Oct 26 05:20:34.372762 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2364/4682] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:33 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:34.394951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-393a5d4a-ad80-47c9-9229-2927e73d60c6 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f470a899310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:34.504510 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-393a5d4a-ad80-47c9-9229-2927e73d60c6 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.127564 Oct 26 05:20:34.505488 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2365/4683] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:20:34 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:34.516556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:34.518562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:34.527387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] validate_networks() for [('4dfe50ec-535f-4512-94ac-24b3da81845a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:20:34.538144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:34.543355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:34.545529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:34.546426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:34.548502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:34.552516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.232012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:35.247265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:35.252550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:35.254197 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a71bfd6b-cfa4-4f46-8b84-bc2565e2a2a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.747528 Oct 26 05:20:35.265405 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2366/4684] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:34 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:35.265405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c204b843-6e00-418e-9818-2634326a949b tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f4709e3da60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:35.341017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c204b843-6e00-418e-9818-2634326a949b tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:35.347919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c204b843-6e00-418e-9818-2634326a949b tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:35.462563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:20:35.463440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:20:35.464533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:20:35.465234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:20:35.465886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:20:35.495409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.496570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.497598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.499412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.501099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.505894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.547629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:35.555993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Getting quotas for user 26c244ca4ef34828a356a07af0d74302 and project 7133cf27e350423c8cad75a57ee47ca2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:35.605872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:20:35.612275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:20:35.626406 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c204b843-6e00-418e-9818-2634326a949b tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.368639 Oct 26 05:20:35.627826 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2367/4685] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:35 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:35.636431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-2e4c52be-ac54-4265-b9af-21517ee51653 req-70958bbb-b765-41c2-a61c-1650b93ee745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:35.653848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2e4c52be-ac54-4265-b9af-21517ee51653 req-70958bbb-b765-41c2-a61c-1650b93ee745 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.657352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2e4c52be-ac54-4265-b9af-21517ee51653 req-70958bbb-b765-41c2-a61c-1650b93ee745 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.657803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2e4c52be-ac54-4265-b9af-21517ee51653 req-70958bbb-b765-41c2-a61c-1650b93ee745 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.672875 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-77a7b9aa-6753-46bc-9cae-93828d58f0e0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.433192 Oct 26 05:20:35.676716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-2e4c52be-ac54-4265-b9af-21517ee51653 req-70958bbb-b765-41c2-a61c-1650b93ee745 service nova] Creating event network-changed:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:20:35.677958 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2319/4686] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:20:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:20:35.681596 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-2e4c52be-ac54-4265-b9af-21517ee51653 req-70958bbb-b765-41c2-a61c-1650b93ee745 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052326 Oct 26 05:20:35.682397 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2368/4687] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:35.688853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:35.690283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:35.690425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:35.691103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:35.697975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.698687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.698811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.699266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.699421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.700021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.700152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.700554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.701102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:35.701508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:35.702132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:35.702723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:36.786056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:36.806696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:36.808363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:36.814223 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f304d409-a9a1-4ce7-bebe-2acb2f098296 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1849 microversion: 2.42 time: 1.128842 Oct 26 05:20:36.814914 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2320/4688] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:35 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1849 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:36.830553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:36.831272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:36.852424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:36.853014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:36.853588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:36.854386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:36.854930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:36.855555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:36.885804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:36.897558 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-72b9d048-e0a7-4449-a4ee-d17428848b77 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 1.211349 Oct 26 05:20:36.898462 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2369/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:35 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:36.908794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c19e1b6d-5930-42ea-a4b2-cd9475ed1ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f4709f85e50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:37.022240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c19e1b6d-5930-42ea-a4b2-cd9475ed1ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:37.038321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c19e1b6d-5930-42ea-a4b2-cd9475ed1ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:37.058302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.068279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.071058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.072359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-930ec216-fc1c-45dd-8ebd-65a4183fb63a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1546 microversion: 2.26 time: 0.256400 Oct 26 05:20:37.074181 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2321/4690] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:36 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1546 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:37.079279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:37.079898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:37.087044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.087677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.088125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.089148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.089637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.090071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.201126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.231833 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc84ae07-fd11-4e6c-b1bd-0c1271a7137c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1237 microversion: 2.1 time: 0.156430 Oct 26 05:20:37.234271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2322/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:37 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:37.245026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:37.246703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:37.261081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.262246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.263345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.264807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.265998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.267537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.617776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.628597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.631596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:37.633511 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2e8effa5-58dd-4de0-8036-d901347b0457 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.397508 Oct 26 05:20:37.645349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2323/4692] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:37 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:37.655332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8e39a175-5456-4790-8ba4-b0c980cbd537 req-2274485c-23f9-4cc5-bf15-98976728b488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58802ec-cf16-4d55-b953-aa9b695454f8", "name": "network-vif-plugged", "status": "completed", "tag": "0e922909-f90d-4a0a-ab10-ad3e3e4c8280"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:37.661879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8e39a175-5456-4790-8ba4-b0c980cbd537 req-2274485c-23f9-4cc5-bf15-98976728b488 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.662370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8e39a175-5456-4790-8ba4-b0c980cbd537 req-2274485c-23f9-4cc5-bf15-98976728b488 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.662806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8e39a175-5456-4790-8ba4-b0c980cbd537 req-2274485c-23f9-4cc5-bf15-98976728b488 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.676238 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8e39a175-5456-4790-8ba4-b0c980cbd537 req-2274485c-23f9-4cc5-bf15-98976728b488 service nova] Creating event network-vif-plugged:0e922909-f90d-4a0a-ab10-ad3e3e4c8280 for instance c58802ec-cf16-4d55-b953-aa9b695454f8 on n-h2-862416-4 Oct 26 05:20:37.682068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8e39a175-5456-4790-8ba4-b0c980cbd537 req-2274485c-23f9-4cc5-bf15-98976728b488 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043772 Oct 26 05:20:37.682743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2324/4693] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:37.688654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470a79e9d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:37.700003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.700517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.701072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.701741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:37.708639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.709426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.709914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.710612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.711068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.711496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.735140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:37.748030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.748532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.749348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.787623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.795474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.796276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.802129 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c19e1b6d-5930-42ea-a4b2-cd9475ed1ce3 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 64 microversion: 2.1 time: 0.901590 Oct 26 05:20:37.802752 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2370/4694] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:36 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 64 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:37.818381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2ce4fae-1586-405e-b9ee-49080c208cc5 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f470a8e1d30>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:37.847519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:37.881659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2ce4fae-1586-405e-b9ee-49080c208cc5 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 64 microversion: 2.1 time: 0.073108 Oct 26 05:20:37.883933 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2371/4695] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:20:37 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 64 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:37.887163 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-01054ec6-f396-4fe8-9977-91bef45e5091 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-1342389005" status: 201 len: 0 microversion: 2.26 time: 0.203213 Oct 26 05:20:37.888681 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2325/4696] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 26 05:20:37 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-1342389005 => generated 0 bytes in 205 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 26 05:20:37.894180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d74fafbe-107e-402b-9e5e-1b9702b4cde8 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f470eb01d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:37.901597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:37.903254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:37.915602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.916505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.917615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.918741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:37.919710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:37.921869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:37.992859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-d74fafbe-107e-402b-9e5e-1b9702b4cde8 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:37.998870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:38.001282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-d74fafbe-107e-402b-9e5e-1b9702b4cde8 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:38.277333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:38.289415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:38.293348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:38.295783 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f21077fb-d17e-4cc9-a94d-d81cbdf58170 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1849 microversion: 2.42 time: 0.409400 Oct 26 05:20:38.297358 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2372/4697] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:37 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1849 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:38.313982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12a8ca3a-8c8b-4fd5-b10f-49f8d42fe74a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470a899310>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:38.337260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12a8ca3a-8c8b-4fd5-b10f-49f8d42fe74a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.337792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12a8ca3a-8c8b-4fd5-b10f-49f8d42fe74a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.338242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12a8ca3a-8c8b-4fd5-b10f-49f8d42fe74a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.365754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-12a8ca3a-8c8b-4fd5-b10f-49f8d42fe74a tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-1342389005" status: 204 len: 0 microversion: 2.26 time: 0.066629 Oct 26 05:20:38.367595 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2373/4698] 10.222.0.16 () {60 vars in 1361 bytes} [Wed Oct 26 05:20:38 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-1342389005 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:38.374241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:38.377697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:38.397264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.397934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.398321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.399052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.399766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.399975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.553952 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d74fafbe-107e-402b-9e5e-1b9702b4cde8 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.663839 Oct 26 05:20:38.554976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2326/4699] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:37 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:38.563297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-df284400-33b0-4250-99af-37c65ffd3a7e req-5275f971-2914-4cb9-9880-5902c1c86b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "0b48ce7f-88c2-4c95-a5bf-164fed997c95"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:38.585272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:38.598712 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95c93b78-c899-4115-a731-9dad6059e766 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.228980 Oct 26 05:20:38.599410 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2374/4700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:38 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:38.608874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-df284400-33b0-4250-99af-37c65ffd3a7e req-5275f971-2914-4cb9-9880-5902c1c86b90 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.617721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-df284400-33b0-4250-99af-37c65ffd3a7e req-5275f971-2914-4cb9-9880-5902c1c86b90 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.618374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:38.618673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-df284400-33b0-4250-99af-37c65ffd3a7e req-5275f971-2914-4cb9-9880-5902c1c86b90 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.619002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:38.627118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.627572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.628016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.628875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.629186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.636311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.643151 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-df284400-33b0-4250-99af-37c65ffd3a7e req-5275f971-2914-4cb9-9880-5902c1c86b90 service nova] Creating event network-changed:0b48ce7f-88c2-4c95-a5bf-164fed997c95 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:38.648422 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-df284400-33b0-4250-99af-37c65ffd3a7e req-5275f971-2914-4cb9-9880-5902c1c86b90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092167 Oct 26 05:20:38.649700 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2327/4701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:38.659740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470a1b20d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:38.681059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.687169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.692813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.693755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:38.708257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.709606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.710999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.713168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.715044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.717922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.763342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:38.774703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.774989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f6f6e6a-e4e5-4076-b2c3-01940f6513db tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1237 microversion: 2.1 time: 0.174501 Oct 26 05:20:38.778104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.778716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.782487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2375/4702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:38 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1237 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:38.799764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66db1ffc-1b11-40fc-aff7-2ea3504ac6bb tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update', calling method: .version_select at 0x7f470abc2d30>, body: {"meta": {"os_version": "alt"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:38.822688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:38.858681 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e2616d9-1698-43da-a0c9-f4be76f50995 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 204 len: 0 microversion: 2.26 time: 0.207583 Oct 26 05:20:38.864840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2328/4703] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 26 05:20:38 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:38.879532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:38.880162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:38.913746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.915290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.915486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-66db1ffc-1b11-40fc-aff7-2ea3504ac6bb tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:38.915994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.917985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:38.919685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:38.923953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:38.945266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-66db1ffc-1b11-40fc-aff7-2ea3504ac6bb tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:39.395093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:39.406829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:39.408026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:39.409172 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21acbfd7-6005-43f0-b32e-1419cb3b9e49 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.543077 Oct 26 05:20:39.429534 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2329/4704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:38 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:39.457988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21e3e632-fd52-4fe8-8663-babe5fdf041c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709ab83a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:39.479255 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66db1ffc-1b11-40fc-aff7-2ea3504ac6bb tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.695418 Oct 26 05:20:39.484062 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2376/4705] 10.222.0.16 () {60 vars in 1313 bytes} [Wed Oct 26 05:20:38 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata/os_version => generated 31 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:39.486097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:39.486724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:39.493500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:39.495142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.495638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.496080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.496794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.497256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.497719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.511918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21e3e632-fd52-4fe8-8663-babe5fdf041c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.512789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21e3e632-fd52-4fe8-8663-babe5fdf041c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.513494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21e3e632-fd52-4fe8-8663-babe5fdf041c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.538894 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21e3e632-fd52-4fe8-8663-babe5fdf041c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 200 len: 12 microversion: 2.26 time: 0.106617 Oct 26 05:20:39.548058 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2330/4706] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 05:20:39 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 12 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:39.562879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e7edc53-56e1-4921-b9f5-32b76384e60e tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f4709378dc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:39.662591 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e7edc53-56e1-4921-b9f5-32b76384e60e tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 58 microversion: 2.1 time: 0.112712 Oct 26 05:20:39.663427 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2331/4707] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:20:39 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 58 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:39.676533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f47093ba280>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:39.718582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.720582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.730276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.731287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:39.741883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.742713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.744876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.752351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.753139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.753818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.818569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.825771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.826358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.865798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.867118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.867582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.904659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:39.935536 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb29473c-5c57-4c18-ac3c-3255e91eac59 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-439878036" status: 201 len: 0 microversion: 2.26 time: 0.264080 Oct 26 05:20:39.937409 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2332/4708] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 26 05:20:39 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-439878036 => generated 0 bytes in 266 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 05:20:39.943359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:39.944504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:39.959982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.961586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.962239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:39.963724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:39.964714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:39.965993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:40.481265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:40.495253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:40.501295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:40.506852 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0797516b-c0b6-4f31-b056-87c82daeac82 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1849 microversion: 2.42 time: 1.022735 Oct 26 05:20:40.507678 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2377/4709] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:39 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1849 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:40.522287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73959e0e-a026-4291-865e-36ad0e229192 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'update_all', calling method: .version_select at 0x7f4709e9bee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:40.604098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-73959e0e-a026-4291-865e-36ad0e229192 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:40.632022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-73959e0e-a026-4291-865e-36ad0e229192 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:40.792112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:40.806442 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc3f42dd-a826-4964-a5d7-e0c671399136 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1317 microversion: 2.1 time: 0.866440 Oct 26 05:20:40.808509 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2333/4710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:39 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:40.839277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:40.839824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:40.901532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:40.902468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:40.903112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:40.904044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:40.908787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:40.909485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:41.212754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73959e0e-a026-4291-865e-36ad0e229192 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 61 microversion: 2.1 time: 0.702666 Oct 26 05:20:41.213964 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2378/4711] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:40 2022] PUT /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 61 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:41.219373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a46f24f3-a2c4-4a51-9de0-116ddf8c4cfa tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709eea9d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:41.240931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a46f24f3-a2c4-4a51-9de0-116ddf8c4cfa tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:41.246126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a46f24f3-a2c4-4a51-9de0-116ddf8c4cfa tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:41.246814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a46f24f3-a2c4-4a51-9de0-116ddf8c4cfa tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:41.253425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:41.274722 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a46f24f3-a2c4-4a51-9de0-116ddf8c4cfa tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 200 len: 35 microversion: 2.26 time: 0.058557 Oct 26 05:20:41.278747 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2379/4712] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 05:20:41 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 35 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:41.289347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:41.290338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:41.297898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:41.298962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:41.299632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:41.300818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:41.301555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:41.302231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:41.913578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:41.921848 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6576900-d70d-4429-a904-94580cc3c412 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1299 microversion: 2.1 time: 1.097921 Oct 26 05:20:41.922454 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2334/4713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:40 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1299 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:41.942206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0ecd9835-8a32-4d6d-a1cb-f4fe33ab8b78 req-a6f8e905-2fa0-49e7-8861-15b3807bd970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "bbbbad34-c9b5-4cc0-9e13-aa9e00494405"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:41.957727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ecd9835-8a32-4d6d-a1cb-f4fe33ab8b78 req-a6f8e905-2fa0-49e7-8861-15b3807bd970 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:41.958221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ecd9835-8a32-4d6d-a1cb-f4fe33ab8b78 req-a6f8e905-2fa0-49e7-8861-15b3807bd970 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:41.958664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ecd9835-8a32-4d6d-a1cb-f4fe33ab8b78 req-a6f8e905-2fa0-49e7-8861-15b3807bd970 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:41.989771 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0ecd9835-8a32-4d6d-a1cb-f4fe33ab8b78 req-a6f8e905-2fa0-49e7-8861-15b3807bd970 service nova] Creating event network-changed:bbbbad34-c9b5-4cc0-9e13-aa9e00494405 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:42.004390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0ecd9835-8a32-4d6d-a1cb-f4fe33ab8b78 req-a6f8e905-2fa0-49e7-8861-15b3807bd970 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080659 Oct 26 05:20:42.005265 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2335/4714] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:42.010844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2c0a7c8-b385-4bf7-a8a6-86dbf329179e tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Action: 'create', calling method: .version_select at 0x7f4709377f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:42.121183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-f2c0a7c8-b385-4bf7-a8a6-86dbf329179e tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:20:42.128097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-f2c0a7c8-b385-4bf7-a8a6-86dbf329179e tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Getting quotas for user ed680a4ac2154c2e8ebf338e825c6c74 and project 8fcdaa5c5ec44965a2df67bd66456d37. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:20:42.786378 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2c0a7c8-b385-4bf7-a8a6-86dbf329179e tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "POST /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 85 microversion: 2.1 time: 0.779371 Oct 26 05:20:42.787431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2336/4715] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 26 05:20:42 2022] POST /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 85 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:42.792966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709ab8310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:42.801178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:42.814864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:42.823598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:42.829187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:42.831340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:42.832214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:42.837415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:42.838628 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0800856c-bc4f-4c1c-95e0-1afab084d722 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 1.556751 Oct 26 05:20:42.839229 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2380/4716] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:41 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:42.872902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:42.874278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:42.875924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:42.876574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:42.877368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:42.878363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:42.880794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:42.881613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:42.909860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:42.910370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:42.910823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:42.915421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:42.915921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:42.916376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:42.942238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:42.943413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:42.944081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.012107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:43.052819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c98d0232-b464-4d7f-8acf-98a10762e263 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-439878036" status: 204 len: 0 microversion: 2.26 time: 0.263962 Oct 26 05:20:43.057679 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2337/4717] 10.222.0.16 () {60 vars in 1361 bytes} [Wed Oct 26 05:20:42 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-439878036 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:43.070689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:43.072224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:43.090902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.091809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.095078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.096435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.098109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.098797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.411811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:43.423765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d7459e6-efb8-4580-8321-f065ae2a540c tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1505 microversion: 2.1 time: 0.364595 Oct 26 05:20:43.424363 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2338/4718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:43 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:43.434247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e04932db-3671-45a7-915a-26bfd551ce42 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] Calling method '.version_select at 0x7f4709ab88b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:43.507704 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e04932db-3671-45a7-915a-26bfd551ce42 tempest-ImagesMetadataTestJSON-1237332962 tempest-ImagesMetadataTestJSON-1237332962-project] 10.222.0.16 "GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata" status: 200 len: 85 microversion: 2.1 time: 0.082213 Oct 26 05:20:43.514098 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2339/4719] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 26 05:20:43 2022] GET /compute/v2.1/images/ce46efe3-bbe6-43b1-8046-7ea442649392/metadata => generated 85 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:43.514098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:43.514098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:43.528590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.532278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.533026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.533947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.534416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.534858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.810171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:43.824561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:43.831467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:43.834806 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ca3adb6-8013-4fb3-8902-906722eee050 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1891 microversion: 2.42 time: 0.962782 Oct 26 05:20:43.837276 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2381/4720] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:42 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1891 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:43.851808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37f9f634-1305-4136-8d81-fce027c885d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709a75280>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:43.872918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37f9f634-1305-4136-8d81-fce027c885d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.875713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37f9f634-1305-4136-8d81-fce027c885d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.876849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37f9f634-1305-4136-8d81-fce027c885d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.892058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37f9f634-1305-4136-8d81-fce027c885d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 200 len: 12 microversion: 2.26 time: 0.053274 Oct 26 05:20:43.900005 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2382/4721] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 05:20:43 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 12 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:43.912518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:43.918913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:43.931377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.933947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.940708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:43.941875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:43.942612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:43.943285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.011175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80ff86dc-58e1-45f1-a4c3-4a628ecc600b tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8/ips" status: 200 len: 108 microversion: 2.1 time: 0.109628 Oct 26 05:20:44.021167 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2383/4722] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:20:43 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8/ips => generated 108 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:44.025173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:44.026622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:44.034930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.035662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.045976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.046977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.047644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.047884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.368177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:44.386358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a3d1b058-4e1b-4cb3-8591-dcb254cc058c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 0.869815 Oct 26 05:20:44.386997 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2340/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:43 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:44.398073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709383ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:44.429066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.438398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.439087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.443166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:44.454248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.461824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.466235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.467412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.468076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.468592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.551726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.557069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.558078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.572073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:44.594839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa8b2271-0504-428b-a007-3fba83496eba tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 204 len: 0 microversion: 2.26 time: 0.200687 Oct 26 05:20:44.595858 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2341/4724] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 26 05:20:44 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:44.603645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:44.604483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:44.611342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.612024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.612602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.613664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.615220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.616020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.634277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:44.649683 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d6577002-dbe2-43a1-9f9b-decf06c25100 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8/ips" status: 200 len: 108 microversion: 2.1 time: 0.052452 Oct 26 05:20:44.652059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2342/4725] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:20:44 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8/ips => generated 108 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:44.658431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-925e61e1-a92e-4f57-8192-db926ad6f768 req-dbe01e8f-940a-48a6-bac3-04f8a5c214c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "4fddf85f-a296-4afa-b733-f473ffa50c68"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:44.672466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-925e61e1-a92e-4f57-8192-db926ad6f768 req-dbe01e8f-940a-48a6-bac3-04f8a5c214c4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.673453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-925e61e1-a92e-4f57-8192-db926ad6f768 req-dbe01e8f-940a-48a6-bac3-04f8a5c214c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.674201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-925e61e1-a92e-4f57-8192-db926ad6f768 req-dbe01e8f-940a-48a6-bac3-04f8a5c214c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.694660 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-925e61e1-a92e-4f57-8192-db926ad6f768 req-dbe01e8f-940a-48a6-bac3-04f8a5c214c4 service nova] Creating event network-changed:4fddf85f-a296-4afa-b733-f473ffa50c68 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:44.700047 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-925e61e1-a92e-4f57-8192-db926ad6f768 req-dbe01e8f-940a-48a6-bac3-04f8a5c214c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046573 Oct 26 05:20:44.701524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2343/4726] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:44.707946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2b1b5e4b-2d6b-4fa2-bb4c-9da75cb6427c req-457dcc3a-a9ae-4538-bac8-4314d4f01fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "name": "network-vif-plugged", "status": "completed", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:44.740593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2b1b5e4b-2d6b-4fa2-bb4c-9da75cb6427c req-457dcc3a-a9ae-4538-bac8-4314d4f01fcc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.741506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2b1b5e4b-2d6b-4fa2-bb4c-9da75cb6427c req-457dcc3a-a9ae-4538-bac8-4314d4f01fcc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.742223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2b1b5e4b-2d6b-4fa2-bb4c-9da75cb6427c req-457dcc3a-a9ae-4538-bac8-4314d4f01fcc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.766290 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2b1b5e4b-2d6b-4fa2-bb4c-9da75cb6427c req-457dcc3a-a9ae-4538-bac8-4314d4f01fcc service nova] Creating event network-vif-plugged:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:20:44.767256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:44.773446 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2b1b5e4b-2d6b-4fa2-bb4c-9da75cb6427c req-457dcc3a-a9ae-4538-bac8-4314d4f01fcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069901 Oct 26 05:20:44.774226 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2344/4727] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:44.785539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:44.793045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470938db80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:44.793984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:44.795474 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90b3840c-646f-4ec8-9002-f3c161d604e5 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.779670 Oct 26 05:20:44.796488 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2384/4728] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:44 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:44.806851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:44.808085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:44.825731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.827108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.828673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.830015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.830770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.833558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.837351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.837854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.838297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.838952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:44.852476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.853123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.853659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.854415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.854872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.855291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.897201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-154af132-0a6f-46e7-a7f4-68585728cc96 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8/ips/tempest-ServerAddressesTestJSON-254679161-network" status: 200 len: 93 microversion: 2.1 time: 0.098670 Oct 26 05:20:44.901627 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2385/4729] 10.222.0.16 () {58 vars in 1398 bytes} [Wed Oct 26 05:20:44 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8/ips/tempest-ServerAddressesTestJSON-254679161-network => generated 93 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:20:44.913019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:44.918648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:44.923572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.924293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.924754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.937175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.938381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.938912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.939772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.940514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.941028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:44.948472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:44.949040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:44.949516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.000881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:45.041779 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95a9c4a2-4911-4db1-b73b-48a39ae99ec7 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-196209802" status: 201 len: 0 microversion: 2.26 time: 0.266129 Oct 26 05:20:45.044268 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2345/4730] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 26 05:20:44 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-196209802 => generated 0 bytes in 269 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 05:20:45.053933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:45.058607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:45.073730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.075600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.076323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.077412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.078289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.079677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.127179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:20:45.245995 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b1e40ff-cd60-4d0e-ad4f-146816aa1ce4 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 204 len: 0 microversion: 2.1 time: 0.196154 Oct 26 05:20:45.247767 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2346/4731] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:20:45 2022] DELETE /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:20:45.256532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709ab8310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:45.260539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:45.269286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.270085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.270556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:45.270907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.272114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:45.279515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.280785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.282421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.283180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:45.283630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.284253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.284427 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-523b2388-763e-438b-b9d0-6ad893960267 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1891 microversion: 2.42 time: 0.379647 Oct 26 05:20:45.284985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.297712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2386/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:44 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1891 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:45.309682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:45.310231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:45.316995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.317554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.317996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.318893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.319514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.320106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.331461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.332547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.333008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.347151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.347651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.348146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.386654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:45.413526 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f075f01f-f525-40f2-9631-d2ae6593f4c4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-1470283109" status: 201 len: 0 microversion: 2.26 time: 0.163864 Oct 26 05:20:45.414708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2347/4733] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 26 05:20:45 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-1470283109 => generated 0 bytes in 166 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 26 05:20:45.422564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:45.423308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:45.433741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.434875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.435398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.436252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.436827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.437895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.536881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:45.610319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:45.623152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f9140261-b6be-4536-b6e5-d82b729d1b66 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1511 microversion: 2.1 time: 0.324200 Oct 26 05:20:45.623753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2387/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:45 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:45.650258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470aac83a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:45.668953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.669649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.670249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.671717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:45.686897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.687965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.689269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.691190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.692932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.693566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.767809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.774253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.775055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.824949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:45.857407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a407a8b4-5725-4d4f-bc9b-70eb4445c3d5 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 204 len: 0 microversion: 2.26 time: 0.218003 Oct 26 05:20:45.858873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2388/4735] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 26 05:20:45 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:45.875178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:45.878291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:45.892349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.893015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.896063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:45.896982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:45.900840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:45.901482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.048699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:46.070178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cb0fce1-898c-45b2-8331-812f377eebdb tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 0.651190 Oct 26 05:20:46.070824 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2348/4736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:45 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:46.086689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4bb7f38d-6ad4-408a-8a2f-0c6bdb705b32 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470938d160>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:46.105906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bb7f38d-6ad4-408a-8a2f-0c6bdb705b32 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.106237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bb7f38d-6ad4-408a-8a2f-0c6bdb705b32 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.106759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bb7f38d-6ad4-408a-8a2f-0c6bdb705b32 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.118210 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4bb7f38d-6ad4-408a-8a2f-0c6bdb705b32 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 200 len: 12 microversion: 2.26 time: 0.046061 Oct 26 05:20:46.119243 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2349/4737] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 05:20:46 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:46.134677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f47093ba820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:46.161399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.162144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.163796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.164488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:46.182847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.189076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.189819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.192576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.193275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.195039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.271471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.272161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.272939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.331820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:46.373733 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4514e21f-988c-447f-b486-bab78978241c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 204 len: 0 microversion: 2.26 time: 0.244711 Oct 26 05:20:46.379851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2350/4738] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 26 05:20:46 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:46.385690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:46.386418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:46.399605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.400512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.401172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.402301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.404160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.404693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.801219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:46.811588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:46.821631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:46.823375 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5c19638-9792-486d-8a94-77800fdbd916 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1407 microversion: 2.20 time: 0.959423 Oct 26 05:20:46.827148 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2389/4739] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:45 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1407 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:46.852328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f4709fbf550>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:46.866875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.867589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.868012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.868622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:46.876635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.877647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.878939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.880998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.881698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.882332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.914170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.915080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.915781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.927956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:46.928844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:46.929537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:46.973938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:46.996138 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a14ba1c0-7518-4ba4-a10b-28d8860ceecc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-730601663" status: 201 len: 0 microversion: 2.26 time: 0.152575 Oct 26 05:20:46.996984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2390/4740] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 26 05:20:46 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-730601663 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 05:20:47.005568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:47.006910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:47.015502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.017374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.018396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.019367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.020073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.020876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.644462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:47.658158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:47.661785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:47.663013 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed01617c-8934-4fc5-be80-24d32de7183d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1891 microversion: 2.42 time: 1.281943 Oct 26 05:20:47.663798 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2351/4741] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:46 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1891 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:47.672406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e95a87e7-2318-414c-9700-dbf158ae8a34 req-e319235e-935a-43aa-b2b6-7055d3d177f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "34e7a88d-8eed-44ca-8f5b-7a13e098a31f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:47.704250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e95a87e7-2318-414c-9700-dbf158ae8a34 req-e319235e-935a-43aa-b2b6-7055d3d177f9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.704808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e95a87e7-2318-414c-9700-dbf158ae8a34 req-e319235e-935a-43aa-b2b6-7055d3d177f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.705324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e95a87e7-2318-414c-9700-dbf158ae8a34 req-e319235e-935a-43aa-b2b6-7055d3d177f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.723485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e95a87e7-2318-414c-9700-dbf158ae8a34 req-e319235e-935a-43aa-b2b6-7055d3d177f9 service nova] Creating event network-changed:34e7a88d-8eed-44ca-8f5b-7a13e098a31f for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:47.729104 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e95a87e7-2318-414c-9700-dbf158ae8a34 req-e319235e-935a-43aa-b2b6-7055d3d177f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060086 Oct 26 05:20:47.730738 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2352/4742] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:47.753552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f47093ba550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:47.791481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.791981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.792521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.793021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:47.805811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.806375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.806874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.807581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.808026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.808581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.898856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.899348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.899786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:47.967346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:47.967924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:47.968552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.039264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:48.086341 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0548ec0-5b98-4456-a7bf-89206031070c tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-521208030" status: 201 len: 0 microversion: 2.26 time: 0.354646 Oct 26 05:20:48.087223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2353/4743] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 26 05:20:47 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags/tempest-tag-521208030 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 26 05:20:48.099539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:48.100892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:48.121149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.121923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.122572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.123501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.124076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.124797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.162419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:48.190251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:48.201879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0d1a26a-20de-49ed-bae6-83dc5f1c3afb tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1511 microversion: 2.1 time: 1.203389 Oct 26 05:20:48.225515 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2391/4744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:46 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1511 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:48.231250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9a1e7a3f-ebab-4ef9-b699-bc9ee94cda26 req-e27550e9-162c-4389-8d59-aaed0d1ab9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e822d940-00cf-4781-a19a-0b94b133e357", "tag": "3ce9206c-cb78-42a0-bb38-3b85449b919a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:48.250569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9a1e7a3f-ebab-4ef9-b699-bc9ee94cda26 req-e27550e9-162c-4389-8d59-aaed0d1ab9ac service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.251315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9a1e7a3f-ebab-4ef9-b699-bc9ee94cda26 req-e27550e9-162c-4389-8d59-aaed0d1ab9ac service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.251926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9a1e7a3f-ebab-4ef9-b699-bc9ee94cda26 req-e27550e9-162c-4389-8d59-aaed0d1ab9ac service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.268673 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9a1e7a3f-ebab-4ef9-b699-bc9ee94cda26 req-e27550e9-162c-4389-8d59-aaed0d1ab9ac service nova] Creating event network-changed:3ce9206c-cb78-42a0-bb38-3b85449b919a for instance e822d940-00cf-4781-a19a-0b94b133e357 on n-h2-862416-4 Oct 26 05:20:48.274578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9a1e7a3f-ebab-4ef9-b699-bc9ee94cda26 req-e27550e9-162c-4389-8d59-aaed0d1ab9ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046897 Oct 26 05:20:48.276672 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2392/4745] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:48.286494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:48.287556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:48.297408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.298811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.299481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.301046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.306740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.307574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.862594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:48.874918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-875a38c5-e96a-43c1-abbe-73619f19d2d4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 0.785977 Oct 26 05:20:48.875497 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2354/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:48 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:48.889759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:48.904495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Action: 'update_all', calling method: .version_select at 0x7f470ea0ce50>, body: {"tags": ["tempest-tag-1970387347", "tempest-tag-1598647162"]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:48.905494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:48.917545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:48.920976 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8c8c032-0f90-4ab6-9f62-8327d1be7662 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1599 microversion: 2.20 time: 0.641494 Oct 26 05:20:48.922310 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2393/4747] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:48 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1599 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:48.933685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.934466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.936184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.937903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:48.946590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.948018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:48.948890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:48.950399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.951147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.952242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.953481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.954127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.973712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.974297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.974808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.975569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.976037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.976478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:48.987490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:48.989356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:48.991205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.018966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:49.052732 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b7b370a-e8d4-467c-bb98-d3ccdbbd1faf tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 200 len: 62 microversion: 2.26 time: 0.176163 Oct 26 05:20:49.059683 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2355/4748] 10.222.0.16 () {62 vars in 1312 bytes} [Wed Oct 26 05:20:48 2022] PUT /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 62 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:49.066049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:49.067243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:49.074129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.074867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.075465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.076329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.076982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.077656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.474720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:49.497492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:49.499305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:49.500901 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88b19a88-9652-4fe2-8e7a-490b488903b4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.574506 Oct 26 05:20:49.513558 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2394/4749] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:48 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:49.521684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f09646d7-846d-4d9a-aed1-d35044b1abdc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470a79c5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:49.538973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09646d7-846d-4d9a-aed1-d35044b1abdc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.539958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09646d7-846d-4d9a-aed1-d35044b1abdc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.542729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09646d7-846d-4d9a-aed1-d35044b1abdc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.574663 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f09646d7-846d-4d9a-aed1-d35044b1abdc tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 200 len: 62 microversion: 2.26 time: 0.059554 Oct 26 05:20:49.576133 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2395/4750] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 26 05:20:49 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 62 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:49.586226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:49.587275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:49.625208 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b32818f0-40cb-4078-9e7e-4114aa6a6f6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.563809 Oct 26 05:20:49.626204 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2356/4751] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:20:49 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-interface => generated 284 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:20:49.631283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '.version_select at 0x7f470938d8b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:49.647861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.648534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.648960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.649828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.650179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.651232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.651724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:49.652071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.652806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.654874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.670752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.671160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.672790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.673571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.675833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.676826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.711293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:49.723390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.723883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.726601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.742638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.743516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.744177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.744893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lazy-loading 'fault' on Instance uuid c58802ec-cf16-4d55-b953-aa9b695454f8 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:49.755878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lazy-loading 'flavor' on Instance uuid 002d3284-215a-4a21-aa66-80c0097c15fa {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:49.787586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c3b4dd9f-db39-47fc-adf6-a9769d3bc1e4 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags" status: 204 len: 0 microversion: 2.26 time: 0.158491 Oct 26 05:20:49.797124 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2357/4752] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 26 05:20:49 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:49.812154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:49.813537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:49.824580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.825085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.825554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.826256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:49.826707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:49.827128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:49.871229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:20:49.997799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:50.018699 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bfa29121-7968-4ece-84b5-1fcd315270b5 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1307 microversion: 2.1 time: 0.439172 Oct 26 05:20:50.021345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2396/4753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:49 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:50.036026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e"}, {"server_uuid": "c58802ec-cf16-4d55-b953-aa9b695454f8", "name": "network-vif-deleted", "tag": "0e922909-f90d-4a0a-ab10-ad3e3e4c8280"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:50.073177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:50.078345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.079204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.080311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:50.082890 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ef127ae-392c-4e43-8cea-ab280d19e65f tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 204 len: 0 microversion: 2.26 time: 0.283252 Oct 26 05:20:50.084060 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2358/4754] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:20:49 2022] DELETE /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:20:50.097708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:50.100574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:50.110521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.111407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.112266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:50.114596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.115550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.116287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:50.116848 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] Creating event network-changed:6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:50.117427 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] Creating event network-vif-deleted:0e922909-f90d-4a0a-ab10-ad3e3e4c8280 for instance c58802ec-cf16-4d55-b953-aa9b695454f8 on n-h2-862416-4 Oct 26 05:20:50.165218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-528143a5-6050-4b4f-9a7c-6e7f318388be req-22abd69c-4c19-4bd1-b6eb-cd3f4d4c5c69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139418 Oct 26 05:20:50.167530 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2397/4755] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:50.186126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:50.187363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:50.212804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.213492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.214496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:50.215321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.216193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.217090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:50.678954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=23 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:50.947382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:50.958066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c25790e5-ab68-4f56-b12d-c033687f9443 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 0.871417 Oct 26 05:20:50.959386 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2359/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:50 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:50.964762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:50.965784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:50.974553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.975254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.975956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:50.977993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:50.978658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:50.979338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:51.270782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.279742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.282296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.283728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98f72268-a99c-49dd-909b-72b9bd89d490 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1552 microversion: 2.26 time: 1.114733 Oct 26 05:20:51.284608 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2398/4757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:50 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1552 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:51.291509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:51.292355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:51.304304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:51.305043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:51.307894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:51.308800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:51.309506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:51.310103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:51.389873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:51.392530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:51.393383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:51.395194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lazy-loading 'fault' on Instance uuid c58802ec-cf16-4d55-b953-aa9b695454f8 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:20:51.595155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0786a7c2a62d4f618ef7bdb373977183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826cc023f57b4d629db66327e31e1620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.604594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16d1d8a4-d2ae-4604-b222-34577bac7782 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 200 len: 1307 microversion: 2.1 time: 0.318136 Oct 26 05:20:51.605520 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2399/4758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:51 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:51.885453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.897036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.898573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:51.899912 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df92b12c-028c-42c9-ad8f-7f662ef26c11 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.939212 Oct 26 05:20:51.912453 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2360/4759] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:50 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:51.988314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:51.989699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:51.996190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:51.996940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:51.997629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:51.998796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:51.999534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.000788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.207134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04"}, {"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "29394b68-b95f-441f-9916-74f55e138b57"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:52.213868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=28 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:20:52.222119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.222612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.223053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.236284 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] Creating event network-changed:a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:52.236805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] Creating event network-changed:29394b68-b95f-441f-9916-74f55e138b57 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:20:52.241787 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b8fc6526-bc2c-4dd7-95f8-36fbf05e0476 req-79628e9e-9e87-4ff1-b4ee-4aa062aa9282 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039361 Oct 26 05:20:52.242757 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2361/4760] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:20:52.319573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:52.320609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:52.327164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.328252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.328966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.329852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.330570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.331231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.582960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:52.604084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a445307-1c3d-4caa-a62a-ee26587b67dd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 0.620227 Oct 26 05:20:52.606523 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2400/4761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:51 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:52.628153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:52.629129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] [instance: c58802ec-cf16-4d55-b953-aa9b695454f8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:52.641652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.642511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.644085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.645528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.647977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.649813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.679248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] HTTP exception thrown: Instance c58802ec-cf16-4d55-b953-aa9b695454f8 could not be found. Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Request method failure captured: Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 HTTP/1.1 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMONzPGs6EhTn0HE2gJROs1jHlYWkg-qceBbqX4sPn0jCT-AeOf26F10j7StQC9239GLlD6U5uqg7MspKbwQ3ZAvlioZ4xDNcFNenO2DfdRYRSwGm-pjLNRM_WZpomob39id3I4pE2aXrriI_VF3HengBrzVYEYmk8e6Iido22LYzLA Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 826cc023f57b4d629db66327e31e1620 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerAddressesTestJSON-41135703 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_826cc023f57b4d629db66327e31e1620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/826cc023f57b4d629db66327e31e1620"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/826cc023f57b4d629db66327e31e1620"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/826cc023f57b4d629db66327e31e1620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerAddressesTestJSON-41135703 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 826cc023f57b4d629db66327e31e1620 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerAddressesTestJSON-41135703 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerAddressesTestJSON-41135703-project Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 0786a7c2a62d4f618ef7bdb373977183 Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerAddressesTestJSON-41135703-project Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance c58802ec-cf16-4d55-b953-aa9b695454f8 could not be found. Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c58802ec-cf16-4d55-b953-aa9b695454f8'} Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c58802ec-cf16-4d55-b953-aa9b695454f8 could not be found. Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c58802ec-cf16-4d55-b953-aa9b695454f8 could not be found. Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:52.681486 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c58802ec-cf16-4d55-b953-aa9b695454f8 could not be found. Oct 26 05:20:52.685625 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:52.687824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] Returning 404 to user: Instance c58802ec-cf16-4d55-b953-aa9b695454f8 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:20:52.689047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-29551498-3437-431d-9449-9f4952b90a42 tempest-ServerAddressesTestJSON-41135703 tempest-ServerAddressesTestJSON-41135703-project] 10.222.0.16 "GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8" status: 404 len: 111 microversion: 2.1 time: 0.065021 Oct 26 05:20:52.698063 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2401/4762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:52 2022] GET /compute/v2.1/servers/c58802ec-cf16-4d55-b953-aa9b695454f8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:20:52.927009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:52.927920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:52.935409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.935916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.936368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:52.937807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:52.938373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:52.938816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:53.191725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:53.202168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:53.204243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef625b2ad18d4dac857503dff97a9b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0eae96f36044af9df89fbfae4f5139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:53.210957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a5ea357-4765-4176-a636-153857b7e4ab tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 200 len: 1552 microversion: 2.26 time: 0.890223 Oct 26 05:20:53.212875 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2362/4763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:52 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 1552 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:20:53.632169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:53.633104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:53.642437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:53.643214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:53.643707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:53.644487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:53.644947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:53.645419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:54.481350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:54.502503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:54.506703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:54.508055 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c817ca71-f2fa-497c-a631-4107d68bc4d8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.585472 Oct 26 05:20:54.540905 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2402/4764] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:52 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:20:54.551216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:54.551897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] [instance: 002d3284-215a-4a21-aa66-80c0097c15fa] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:54.560911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:54.561757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:54.563066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:54.564270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:54.564944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:54.565883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:54.592816 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] HTTP exception thrown: Instance 002d3284-215a-4a21-aa66-80c0097c15fa could not be found. Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Request method failure captured: Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa HTTP/1.1 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMOGHhkmHKUMdflzRQ7gMb8xK3RQZ9RlGnId-QTiSEFCowDNASXbD_kHmTyTZyoalNXAupK6dJEt8NpNOjXLdLcnWko2BmB2qBZ9JDBpqXKbUv9X8X6LSI8quyJ-zmtTj9goGRt2EgfBuXziZjntYSiJQLEwA9Ocd-VMp9oWrWaUUCE Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.26 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 1d0eae96f36044af9df89fbfae4f5139 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerTagsTestJSON-1849388267 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d0eae96f36044af9df89fbfae4f5139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d0eae96f36044af9df89fbfae4f5139"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d0eae96f36044af9df89fbfae4f5139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d0eae96f36044af9df89fbfae4f5139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerTagsTestJSON-1849388267 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 1d0eae96f36044af9df89fbfae4f5139 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerTagsTestJSON-1849388267 Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerTagsTestJSON-1849388267-project Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: ef625b2ad18d4dac857503dff97a9b6c Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerTagsTestJSON-1849388267-project Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 002d3284-215a-4a21-aa66-80c0097c15fa could not be found. Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '002d3284-215a-4a21-aa66-80c0097c15fa'} Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002d3284-215a-4a21-aa66-80c0097c15fa could not be found. Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002d3284-215a-4a21-aa66-80c0097c15fa could not be found. Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:20:54.593038 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002d3284-215a-4a21-aa66-80c0097c15fa could not be found. Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] Returning 404 to user: Instance 002d3284-215a-4a21-aa66-80c0097c15fa could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b8e3c4d6-9dc8-421c-8011-fd82b1fa11e0 tempest-ServerTagsTestJSON-1849388267 tempest-ServerTagsTestJSON-1849388267-project] 10.222.0.16 "GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa" status: 404 len: 111 microversion: 2.26 time: 0.052083 Oct 26 05:20:54.597969 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2403/4765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:54 2022] GET /compute/v2.1/servers/002d3284-215a-4a21-aa66-80c0097c15fa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:20:54.601434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0a4b1d52-e873-4898-9dda-e561a2e81b2a req-7356b9cd-b194-44ff-b6bd-5c7a49f61523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002d3284-215a-4a21-aa66-80c0097c15fa", "name": "network-vif-deleted", "tag": "d0ad6e2d-7cb5-4733-8325-31e178f0ed4e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:54.612315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0a4b1d52-e873-4898-9dda-e561a2e81b2a req-7356b9cd-b194-44ff-b6bd-5c7a49f61523 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:54.612797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0a4b1d52-e873-4898-9dda-e561a2e81b2a req-7356b9cd-b194-44ff-b6bd-5c7a49f61523 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:54.613232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0a4b1d52-e873-4898-9dda-e561a2e81b2a req-7356b9cd-b194-44ff-b6bd-5c7a49f61523 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:54.625212 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0a4b1d52-e873-4898-9dda-e561a2e81b2a req-7356b9cd-b194-44ff-b6bd-5c7a49f61523 service nova] Creating event network-vif-deleted:d0ad6e2d-7cb5-4733-8325-31e178f0ed4e for instance 002d3284-215a-4a21-aa66-80c0097c15fa on n-h1-862416-4 Oct 26 05:20:54.630781 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0a4b1d52-e873-4898-9dda-e561a2e81b2a req-7356b9cd-b194-44ff-b6bd-5c7a49f61523 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Oct 26 05:20:54.631454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2404/4766] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:54.871241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:54.881145 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36e9282a-3188-4fc2-8ecb-11c9625e9e75 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 1.251964 Oct 26 05:20:54.886028 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2363/4767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:53 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:20:55.502495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-badfac9a-6a58-4f22-9187-bf13603387bb req-e212b586-557b-4bf1-9946-1a234486f139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:55.526500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-badfac9a-6a58-4f22-9187-bf13603387bb req-e212b586-557b-4bf1-9946-1a234486f139 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:55.527273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-badfac9a-6a58-4f22-9187-bf13603387bb req-e212b586-557b-4bf1-9946-1a234486f139 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:55.527864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-badfac9a-6a58-4f22-9187-bf13603387bb req-e212b586-557b-4bf1-9946-1a234486f139 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:55.543066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:55.543989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:55.560366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:55.566246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:55.566933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:55.567823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:55.568432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:55.569039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:55.573703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-badfac9a-6a58-4f22-9187-bf13603387bb req-e212b586-557b-4bf1-9946-1a234486f139 service nova] Creating event network-changed:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:20:55.592808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-badfac9a-6a58-4f22-9187-bf13603387bb req-e212b586-557b-4bf1-9946-1a234486f139 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096810 Oct 26 05:20:55.594941 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2405/4768] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:55.914763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:55.915630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:55.927134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:55.927636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:55.930827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:55.933411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:55.934081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:55.935917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:56.833350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:56.847334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:56.854932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:56.856432 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a0019ef1-0fe1-4e1d-aa65-57fdd1d0b0db tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.317713 Oct 26 05:20:56.857510 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2364/4769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:55 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:20:56.953228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:56.963379 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f024a284-3ed4-41c1-87f7-d15e3f1b904e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 1.053217 Oct 26 05:20:56.966860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2406/4770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:55 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:20:57.372479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c71aea37-7c3b-4b37-9a89-885466582eea req-090093f5-89d3-42cf-9d5f-0e6bd799c396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e822d940-00cf-4781-a19a-0b94b133e357", "name": "network-vif-plugged", "status": "completed", "tag": "3ce9206c-cb78-42a0-bb38-3b85449b919a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:20:57.393646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c71aea37-7c3b-4b37-9a89-885466582eea req-090093f5-89d3-42cf-9d5f-0e6bd799c396 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:57.394294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c71aea37-7c3b-4b37-9a89-885466582eea req-090093f5-89d3-42cf-9d5f-0e6bd799c396 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:57.394844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c71aea37-7c3b-4b37-9a89-885466582eea req-090093f5-89d3-42cf-9d5f-0e6bd799c396 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:57.428546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c71aea37-7c3b-4b37-9a89-885466582eea req-090093f5-89d3-42cf-9d5f-0e6bd799c396 service nova] Creating event network-vif-plugged:3ce9206c-cb78-42a0-bb38-3b85449b919a for instance e822d940-00cf-4781-a19a-0b94b133e357 on n-h2-862416-4 Oct 26 05:20:57.435092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c71aea37-7c3b-4b37-9a89-885466582eea req-090093f5-89d3-42cf-9d5f-0e6bd799c396 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066319 Oct 26 05:20:57.438550 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2365/4771] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:20:57.887907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:57.889001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:57.902079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:57.904089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:57.905139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:57.917394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:57.922439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:57.926110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:57.991353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:20:57.993215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:20:58.005979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:58.009077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:58.009827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:58.013746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:20:58.014665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:20:58.015880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:20:59.745256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:59.757944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:59.778729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d188ac5-8cc0-440d-b27d-ad42e5957e0f tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 1.791224 Oct 26 05:20:59.780067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:59.783912 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2366/4772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:20:57 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:20:59.785587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:20:59.787949 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e22ac525-4351-43fb-9d72-0b94f3cbdb5b tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.904626 Oct 26 05:20:59.801337 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2407/4773] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:20:57 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:00.804364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:00.805059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:00.819671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:00.820365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:00.836084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:00.836912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:00.838824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:00.839517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:00.841713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:00.842858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:00.843015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:00.847269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:00.847735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:00.848001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:00.849166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:00.849712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:02.052669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:02.085931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:02.103525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:02.114750 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d7a8506-4837-4553-8cb7-bd6641d4f77c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.290125 Oct 26 05:21:02.144819 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2408/4774] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:00 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:02.167440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:02.179525 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ad4dabe-c411-439f-b8cd-f41335561ac0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1367 microversion: 2.1 time: 1.379994 Oct 26 05:21:02.190266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2367/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:00 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1367 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:03.154776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:03.155716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:03.174762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:03.176864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:03.178213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:03.180718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:03.184077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:03.185638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:03.218313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:03.219576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:03.237710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:03.249951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:03.250452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:03.251231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:03.251713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:03.252153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:04.021560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:04.035617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:04.037684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:04.038953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ba7951a-e29f-43a7-86bb-184f0af8269d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.891692 Oct 26 05:21:04.066726 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2409/4776] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:03 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:04.253669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:04.279848 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7eb5a65f-3c10-483d-a245-1bd9c99e7e26 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1557 microversion: 2.1 time: 1.066264 Oct 26 05:21:04.301150 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2368/4777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:03 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1557 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:04.307503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:04.308626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:04.324290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:04.325355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:04.326031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:04.327427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:04.328495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:04.329135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:04.689998 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01a1c02f-8f1e-46dc-be2c-5c202d97e503 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.384936 Oct 26 05:21:04.691204 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2410/4778] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:21:04 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-interface => generated 284 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:05.073519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:05.074342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:05.096525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:05.099149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:05.099797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:05.102895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:05.103607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:05.107977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:05.188288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:06.366098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1655917062", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "74eea396-374c-4d74-9be7-40bafb85f94b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:06.485293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] validate_networks() for [('74eea396-374c-4d74-9be7-40bafb85f94b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:21:06.899349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:06.908946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:06.923274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:06.924447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-756f2a3c-74bc-4592-9366-00b0a5dd58a8 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.855164 Oct 26 05:21:06.925674 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2369/4779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:05 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:07.966953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:07.967625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:07.977558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:07.978337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:07.979354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:07.980257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:07.980883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:07.981852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:09.154133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:21:09.154663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:21:09.155018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:21:09.155510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:21:09.156581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:21:09.167962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:09.168467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:09.169016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:09.169791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:09.171552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:09.172720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:09.206811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Getting quotas for project 3c7ce43c6f1042d59ffd21119d7be69d. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:09.214187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Getting quotas for user dc34b61591f544fd9f3b422d78d481ff and project 3c7ce43c6f1042d59ffd21119d7be69d. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:09.230136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Going to run 2 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:21:09.232996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:09.241458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:09.256371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:09.257771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:09.258955 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a30aea8-7f37-410b-9f0d-86fc39484c80 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.299232 Oct 26 05:21:09.266236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2370/4780] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:07 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:09.293724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=ade48fe3-e437-4306-8cf7-6841f4509b32,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:09.342097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:09.417021 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec32fa81-bf88-4d56-9d3d-a337f15fdd18 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.326471 Oct 26 05:21:09.419485 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2411/4781] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:21:09.438495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:09.457977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:09.458801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Searching by: {'deleted': False, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:21:09.493017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:09.498380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:09.498942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:09.508849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:09.509567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:09.510201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:09.566861 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47393dbd-7354-4122-ad7f-0d3ea727ba20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.135968 Oct 26 05:21:09.574707 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2371/4782] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:21:09 2022] GET /compute/v2.1/servers => generated 677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:09.595308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8e768730-2d0c-409b-8686-7e92c4defd4a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:09.598347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8e768730-2d0c-409b-8686-7e92c4defd4a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:09.716709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8dfd8f46-35d5-4db2-b8ce-1052c905456a req-7c0f807a-97db-41c0-be83-a29a7890e448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e822d940-00cf-4781-a19a-0b94b133e357", "tag": "3ce9206c-cb78-42a0-bb38-3b85449b919a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:09.754326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8dfd8f46-35d5-4db2-b8ce-1052c905456a req-7c0f807a-97db-41c0-be83-a29a7890e448 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:09.774801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8dfd8f46-35d5-4db2-b8ce-1052c905456a req-7c0f807a-97db-41c0-be83-a29a7890e448 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:09.775390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8dfd8f46-35d5-4db2-b8ce-1052c905456a req-7c0f807a-97db-41c0-be83-a29a7890e448 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:09.798506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8e768730-2d0c-409b-8686-7e92c4defd4a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:09.800965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8dfd8f46-35d5-4db2-b8ce-1052c905456a req-7c0f807a-97db-41c0-be83-a29a7890e448 service nova] Creating event network-changed:3ce9206c-cb78-42a0-bb38-3b85449b919a for instance e822d940-00cf-4781-a19a-0b94b133e357 on n-h2-862416-4 Oct 26 05:21:09.806016 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8e768730-2d0c-409b-8686-7e92c4defd4a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1220 microversion: 2.1 time: 0.221652 Oct 26 05:21:09.806609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2412/4783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:09 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1220 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:09.810203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8dfd8f46-35d5-4db2-b8ce-1052c905456a req-7c0f807a-97db-41c0-be83-a29a7890e448 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097529 Oct 26 05:21:09.861203 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2372/4784] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:21:10.292277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:10.293902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:10.322449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:10.322972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:10.324363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:10.325975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:10.325975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:10.331641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:10.834424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ad059e6-0765-4b21-96b0-0467c4e1d12d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:10.835814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ad059e6-0765-4b21-96b0-0467c4e1d12d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:11.083742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3ad059e6-0765-4b21-96b0-0467c4e1d12d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:11.097285 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ad059e6-0765-4b21-96b0-0467c4e1d12d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1220 microversion: 2.1 time: 0.266981 Oct 26 05:21:11.104824 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2373/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:10 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1220 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:11.657941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:11.692733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:11.707568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:11.708829 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8bff9d1-403f-4cf3-8141-918cb3e7e340 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.420538 Oct 26 05:21:11.725878 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2413/4786] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:10 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:12.006704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c399eb5-6fae-45ac-8555-cf7e9f1de602 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Action: 'create', calling method: .version_select at 0x7f47092f2790>, body: {"keypair": {"name": "tempest-keypair-589150838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4OKEH9B9tWaPxbdZuXj6OiKUEtE1TFj5aecVwOKBKFL9PBLQJMAB7V/Kvphvw0L+yisViqrrash9r4ZzLLXU/by0fr0+PPZ1ycri/DQOQD8a1ds1JF8UuAzZRRU9MSDw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:12.062468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8c399eb5-6fae-45ac-8555-cf7e9f1de602 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Getting quotas for project 54179a76863244dd9be07786911525a6. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:12.071474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8c399eb5-6fae-45ac-8555-cf7e9f1de602 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Getting quotas for user e20f383418e34f04bdba95a692ffefd9 and project 54179a76863244dd9be07786911525a6. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:12.125325 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c399eb5-6fae-45ac-8555-cf7e9f1de602 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.800717 Oct 26 05:21:12.136672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:12.136672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:12.142844 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2374/4787] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:21:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:12.146279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:12.147047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:12.147672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:12.148556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:12.152990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:12.153656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:12.609162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:12.626618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77264ace-28ea-400b-9538-8747b69f2fc1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1272 microversion: 2.1 time: 0.498595 Oct 26 05:21:12.642022 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2414/4788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:12 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1272 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:12.747223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:12.748166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:12.758397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:12.759324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:12.760012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:12.761232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:12.763797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:12.764539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:13.360934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:13.372355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:13.374203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:13.376872 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05dcb3a3-4ca2-44bf-b5ba-9eb398431332 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.635453 Oct 26 05:21:13.377722 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2375/4789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:12 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:13.656320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:13.656964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:13.677138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:13.677671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:13.678119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:13.678836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:13.679307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:13.679744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:13.933044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:13.945709 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-282593ac-66ae-4b04-9c6c-6aa03c7c8dd9 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1278 microversion: 2.1 time: 0.289434 Oct 26 05:21:13.946895 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2415/4790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:13 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:14.405916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:14.406526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:14.424157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:14.429180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:14.430509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:14.450509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:14.451369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:14.453003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:14.973251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:14.974609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:14.984587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:14.985395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:14.986224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:14.987309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:14.987902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:14.988581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:15.770234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:15.785600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:15.787335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:15.788556 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d533ad97-4f14-4d91-b38f-67f70810ece5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.388260 Oct 26 05:21:15.794957 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2376/4791] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:14 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:15.923754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:15.940450 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6cd20bd-8fba-49c6-ad27-ff8fc1414b98 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.972791 Oct 26 05:21:15.943182 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2416/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:14 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:16.819626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:16.820247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:16.827206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:16.827918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:16.828563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:16.829638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:16.830261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:16.830847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:16.970943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:16.972247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:16.994083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:16.994982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:16.995610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:16.996513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:16.997717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:16.998866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:17.037818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:17.651217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:17.678082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:17.680414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:17.680602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:17.682096 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57552c8f-6520-4157-b7d7-7fbb644dd0ed tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.866392 Oct 26 05:21:17.687772 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2377/4793] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:16 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:17.689572 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51372a31-5249-4758-91a8-035789f8e1d5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.723796 Oct 26 05:21:17.702561 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2417/4794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:16 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:17.704716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1c5dc43b-d002-41fd-a8ad-895892e26a26 req-53feecdd-fc0a-4786-a86b-39cc248f4cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade48fe3-e437-4306-8cf7-6841f4509b32", "tag": "46f96043-5890-4a17-b2e8-719c5a595b89"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:17.722483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1c5dc43b-d002-41fd-a8ad-895892e26a26 req-53feecdd-fc0a-4786-a86b-39cc248f4cf4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:17.725820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1c5dc43b-d002-41fd-a8ad-895892e26a26 req-53feecdd-fc0a-4786-a86b-39cc248f4cf4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:17.729831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1c5dc43b-d002-41fd-a8ad-895892e26a26 req-53feecdd-fc0a-4786-a86b-39cc248f4cf4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:17.761715 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1c5dc43b-d002-41fd-a8ad-895892e26a26 req-53feecdd-fc0a-4786-a86b-39cc248f4cf4 service nova] Creating event network-changed:46f96043-5890-4a17-b2e8-719c5a595b89 for instance ade48fe3-e437-4306-8cf7-6841f4509b32 on n-h1-862416-4 Oct 26 05:21:17.767815 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1c5dc43b-d002-41fd-a8ad-895892e26a26 req-53feecdd-fc0a-4786-a86b-39cc248f4cf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078784 Oct 26 05:21:17.769299 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2378/4795] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:17.942905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-69d9802e-8111-4349-ac1b-d881a970e4b8 req-c13fe2d7-69b8-415f-bd34-ba0ca885eed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94", "tag": "090d6761-c4fe-4844-9519-ed7a5331deab"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:17.954995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-69d9802e-8111-4349-ac1b-d881a970e4b8 req-c13fe2d7-69b8-415f-bd34-ba0ca885eed9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:17.955560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-69d9802e-8111-4349-ac1b-d881a970e4b8 req-c13fe2d7-69b8-415f-bd34-ba0ca885eed9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:17.956230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-69d9802e-8111-4349-ac1b-d881a970e4b8 req-c13fe2d7-69b8-415f-bd34-ba0ca885eed9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:17.969658 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-69d9802e-8111-4349-ac1b-d881a970e4b8 req-c13fe2d7-69b8-415f-bd34-ba0ca885eed9 service nova] Creating event network-changed:090d6761-c4fe-4844-9519-ed7a5331deab for instance 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 on n-h2-862416-4 Oct 26 05:21:17.976270 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-69d9802e-8111-4349-ac1b-d881a970e4b8 req-c13fe2d7-69b8-415f-bd34-ba0ca885eed9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272106 Oct 26 05:21:17.977122 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2418/4796] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:18.010701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-547689297", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b1893d02-0016-4975-87e6-7a6bd70206be"}], "security_groups": [{"name": "tempest-securitygroup--1110559440"}], "key_name": "tempest-keypair-589150838", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:18.508396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] validate_networks() for [('b1893d02-0016-4975-87e6-7a6bd70206be', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:21:18.730083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:18.731081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:18.743111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:18.743797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:18.744495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:18.745959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:18.746847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:18.747567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:19.183094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:19.325841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:19.343877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:19.347117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:19.348983 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36e85517-e239-4f6a-9886-afbcbdeff2ae tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.625374 Oct 26 05:21:19.358392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2419/4797] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:18 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:19.365372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:19.366505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:19.374694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:19.375836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:19.376990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:19.377824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:19.378569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:19.379088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:19.532895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:19.804760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:19.884032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:19.900657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e4e901b2-73ad-4c49-bc5f-213e635722bf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.539872 Oct 26 05:21:19.901260 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2420/4798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:19 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:20.017723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Getting quotas for project 54179a76863244dd9be07786911525a6. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:20.026643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Getting quotas for user e20f383418e34f04bdba95a692ffefd9 and project 54179a76863244dd9be07786911525a6. Resources: dict_keys(['metadata_items']) {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:20.079164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:21:20.080077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:21:20.080774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:21:20.081381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:21:20.081962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:21:20.102048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:20.102764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:20.103383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:20.104310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:20.104933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:20.105558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:20.144808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Getting quotas for project 54179a76863244dd9be07786911525a6. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:20.158362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:20.160010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Getting quotas for user e20f383418e34f04bdba95a692ffefd9 and project 54179a76863244dd9be07786911525a6. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:20.193825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:21:20.196802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:20.315517 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a99de4f6-759c-495f-a131-7ff637255ea2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.315895 Oct 26 05:21:20.317395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2379/4799] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:21:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:21:20.330005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce952dcd-01b1-429e-b250-f161c88e503e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:20.330615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ce952dcd-01b1-429e-b250-f161c88e503e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:20.377160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:20.377800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:20.386754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:20.387713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:20.388349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:20.389234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:20.389926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:20.390544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:20.522917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ce952dcd-01b1-429e-b250-f161c88e503e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:20.531863 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce952dcd-01b1-429e-b250-f161c88e503e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1276 microversion: 2.1 time: 0.207670 Oct 26 05:21:20.534107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2421/4800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:20 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:20.727388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:20.741058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:20.742633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:20.743759 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79d3fea2-ad06-487e-990b-733a289b211a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.371596 Oct 26 05:21:20.753067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2380/4801] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:20 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:20.932682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:20.933540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:20.958389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:20.960290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:20.964314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:20.967221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:20.968918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:20.970443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:21.558165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-618cd62e-65ff-4aee-84d6-ab8b2d4c82dc tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:21.558801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-618cd62e-65ff-4aee-84d6-ab8b2d4c82dc tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:21.714155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-618cd62e-65ff-4aee-84d6-ab8b2d4c82dc tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:21.722093 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-618cd62e-65ff-4aee-84d6-ab8b2d4c82dc tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1276 microversion: 2.1 time: 0.167901 Oct 26 05:21:21.723945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2381/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:21 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:21.780091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:21.781670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:21.793637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:21.794436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:21.795110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:21.803643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:21.804346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:21.805066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:21.935225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:21.945799 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8832628f-a795-42d3-847e-6c28a1d112ee tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 1.018891 Oct 26 05:21:21.946638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2422/4803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:20 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:22.385138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:22.395900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:22.403326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:22.411889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-546c46b2-c0ef-4b4a-b63f-4e8636df525a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.628737 Oct 26 05:21:22.412868 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2382/4804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:21 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:22.751610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:22.752563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:22.799775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:22.801668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:22.803409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:22.805538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:22.806859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:22.809163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:22.931046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1330889064", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:23.113170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] validate_networks() for [('5955e382-19ae-44ea-9718-3d03e34144a3', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:21:23.215350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:23.227171 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b7f4cd8-bad1-4a54-af58-734b668df69c tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1336 microversion: 2.1 time: 0.480120 Oct 26 05:21:23.228536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2423/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:22 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1336 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:23.246177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:23.247234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:23.264545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:23.265660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:23.266517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:23.267512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:23.268194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:23.268846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:23.900241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:23.911330 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01ebd2d2-6614-44bb-9c14-110aac7515ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.670069 Oct 26 05:21:23.913762 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2424/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:23 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:23.930212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:23.930837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:23.952839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:23.953565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:23.954018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:23.954743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:23.955207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:23.955639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:24.373292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:24.386645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:24.388393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:24.390872 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca67d498-02f6-4627-a64b-e2719d6a3509 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.475415 Oct 26 05:21:24.392002 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2425/4807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:23 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:24.412140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:24.413030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:24.425634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:24.426394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:24.427992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:24.434418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:24.435147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:24.435817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:24.562764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:21:24.563814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:21:24.564505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:21:24.565075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:21:24.565671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:21:24.577112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:24.586303 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f529acd-e6b3-4039-a7d2-294171d9daca tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1334 microversion: 2.1 time: 0.193005 Oct 26 05:21:24.590566 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2426/4808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:24 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1334 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:24.592400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:24.593976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:24.594589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:24.595493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:24.596144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:24.596724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:24.617279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Getting quotas for project 945d499d0daa4ad196f3f99a9f48c1bd. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:24.623660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Getting quotas for user 65ac46030b2744868d7235c5badf4cf2 and project 945d499d0daa4ad196f3f99a9f48c1bd. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:24.641144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:21:24.643775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:24.704359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b5663103-283d-4818-8cf2-3dfedd60b4cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.899025 Oct 26 05:21:24.705655 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2383/4809] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:21:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:21:24.716983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-809260e9-331f-4b6b-821a-12f68139f9a9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:24.718407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-809260e9-331f-4b6b-821a-12f68139f9a9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:24.803053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-809260e9-331f-4b6b-821a-12f68139f9a9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:24.823289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-809260e9-331f-4b6b-821a-12f68139f9a9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1214 microversion: 2.1 time: 0.110382 Oct 26 05:21:24.825664 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2427/4810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:24 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:24.941706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:24.942830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:24.956479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:24.962018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:24.962654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:24.963627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:24.964164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:24.973515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:25.266721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:25.275967 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bedd38b7-d7ca-40c7-8f03-f9eac0bc5c08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.341098 Oct 26 05:21:25.289778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2384/4811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:24 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:25.418172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:25.418798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:25.434201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:25.434691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:25.435121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:25.435834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:25.440094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:25.440766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:25.617573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:25.618178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:25.633968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:25.634477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:25.634919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:25.635634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:25.636087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:25.636506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:25.786961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:25.801099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4d66ced-4118-4b18-a78e-abd6eb133127 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1334 microversion: 2.1 time: 0.186145 Oct 26 05:21:25.803863 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2385/4812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:25 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:25.843110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:25.849132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:25.850207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:25.867412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:25.869251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:25.870528 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff0801ee-247d-4a5a-9220-9eae0ac33a90 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.456399 Oct 26 05:21:25.871296 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2428/4813] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:25 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:25.871750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:25.874993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:25.875472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:25.878975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:25.879508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:25.879964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:26.074032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:26.094228 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-358762a1-801b-4ac5-b61d-bddba46ffc5b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1266 microversion: 2.1 time: 0.249756 Oct 26 05:21:26.096248 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2386/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:25 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:26.303638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:26.304302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:26.314593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:26.316180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:26.325379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:26.326713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:26.327940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:26.328312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:26.558166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:26.570669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6fdd38e7-1f9f-4d4b-a5fe-273b534deb9f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.271150 Oct 26 05:21:26.585369 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2429/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:26 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:26.828804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:26.829573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:26.848611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:26.849202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:26.854276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:26.855131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:26.855594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:26.856031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:26.902299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:26.902953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:26.911075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:26.911802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:26.916530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:26.917546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:26.918193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:26.918782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:27.207204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:27.229255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e78c9f17-9664-4142-844f-d41335dbb171 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.404888 Oct 26 05:21:27.230788 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2387/4816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:26 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:27.245512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:27.246392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:27.269227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:27.271993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:27.273498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:27.275117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:27.276263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:27.276872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:27.301985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:27.327244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:27.329153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:27.330602 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57400b10-5294-4f0f-8f31-cc0caf76d762 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.432414 Oct 26 05:21:27.333727 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2430/4817] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:26 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:27.457093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:27.477350 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fe01591e-0dce-4d17-bf06-e75b367ce844 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1272 microversion: 2.1 time: 0.244246 Oct 26 05:21:27.478273 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2388/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:27 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:27.595937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:27.596492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:27.603119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:27.603864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:27.604476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:27.605395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:27.606024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:27.606624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:27.850360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:27.859380 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97c71dc4-3619-4ba0-a18f-b529feadc2de tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.267962 Oct 26 05:21:27.865619 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2431/4819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:27 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:28.257096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:28.257791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:28.269134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:28.270332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:28.271079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:28.272055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:28.272744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:28.274549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:28.361648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:28.362281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:28.378758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:28.379892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:28.380725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:28.382529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:28.383797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:28.385679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:28.794758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:28.808120 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fb268e5-7bb9-4cbb-ac6d-d0e9a6c95648 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.554863 Oct 26 05:21:28.808733 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2389/4820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:28 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:28.815666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:28.821282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:28.838071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:28.838721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:28.839242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:28.840157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:28.840646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:28.841151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:28.989516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:29.010463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:29.014627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:29.020799 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf179c8a-5269-4c1a-8c0b-759baab90c7f tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.663080 Oct 26 05:21:29.041518 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2432/4821] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:28 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:29.046904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:29.047865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:29.055172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:29.056091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:29.056735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:29.059256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:29.059969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:29.060831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:29.743810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:29.752272 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-279f6a16-f35a-4c47-bda5-f239e7841d20 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.709312 Oct 26 05:21:29.766022 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2433/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:29 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:29.794014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:29.804749 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-86c1409f-e55d-45eb-8ad8-3d3c4e38b03c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.994108 Oct 26 05:21:29.822230 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2390/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:28 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:29.829306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-97625566-ef72-4ff3-894e-d6bcef030009 req-c96e07e4-0672-41e5-9b4c-c6e01240df0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6435db53-d471-4b69-9d80-cc3858aa36b2", "tag": "bb513202-3230-4dff-895a-cbecab25f743"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:29.842352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-97625566-ef72-4ff3-894e-d6bcef030009 req-c96e07e4-0672-41e5-9b4c-c6e01240df0d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:29.843184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-97625566-ef72-4ff3-894e-d6bcef030009 req-c96e07e4-0672-41e5-9b4c-c6e01240df0d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:29.844329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-97625566-ef72-4ff3-894e-d6bcef030009 req-c96e07e4-0672-41e5-9b4c-c6e01240df0d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:29.857716 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-97625566-ef72-4ff3-894e-d6bcef030009 req-c96e07e4-0672-41e5-9b4c-c6e01240df0d service nova] Creating event network-changed:bb513202-3230-4dff-895a-cbecab25f743 for instance 6435db53-d471-4b69-9d80-cc3858aa36b2 on n-h1-862416-4 Oct 26 05:21:29.864241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-97625566-ef72-4ff3-894e-d6bcef030009 req-c96e07e4-0672-41e5-9b4c-c6e01240df0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040049 Oct 26 05:21:29.865448 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2391/4824] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:29.871496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:29.872447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:29.882496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:29.883374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:29.884131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:29.885044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:29.885761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:29.886570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:29.918545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-65a49255-269a-455e-9d46-78353c07c10a req-f64f3340-e400-4ba8-8369-0e25e84c77db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94", "name": "network-vif-plugged", "status": "completed", "tag": "090d6761-c4fe-4844-9519-ed7a5331deab"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:29.931774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-65a49255-269a-455e-9d46-78353c07c10a req-f64f3340-e400-4ba8-8369-0e25e84c77db service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:29.932573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-65a49255-269a-455e-9d46-78353c07c10a req-f64f3340-e400-4ba8-8369-0e25e84c77db service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:29.933227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-65a49255-269a-455e-9d46-78353c07c10a req-f64f3340-e400-4ba8-8369-0e25e84c77db service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:29.948315 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-65a49255-269a-455e-9d46-78353c07c10a req-f64f3340-e400-4ba8-8369-0e25e84c77db service nova] Creating event network-vif-plugged:090d6761-c4fe-4844-9519-ed7a5331deab for instance 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 on n-h2-862416-4 Oct 26 05:21:29.955840 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-65a49255-269a-455e-9d46-78353c07c10a req-f64f3340-e400-4ba8-8369-0e25e84c77db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188239 Oct 26 05:21:29.956776 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2434/4825] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:30.049223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:30.050941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:30.058298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:30.058995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:30.059663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:30.060654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:30.061346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:30.062253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:30.513276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:30.528642 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a0c39ad-705c-499e-b549-85b6b6d042a2 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.661066 Oct 26 05:21:30.529747 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2392/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:29 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:30.592659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:30.611537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:30.613683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:30.615136 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64a8ae6f-1330-4c74-879c-a5232a219caa tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.570685 Oct 26 05:21:30.615938 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2435/4827] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:30 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:30.781012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:30.782093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:30.808052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:30.809777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:30.812022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:30.813130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:30.813871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:30.815161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:30.828950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:30.830024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:30.830736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:30.848730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:30.849539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:30.850187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:30.851113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:30.851774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:30.852427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:31.353994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:31.365485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c39b8105-4ee6-4728-965b-6c7caea43bec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1320 microversion: 2.1 time: 0.589101 Oct 26 05:21:31.366078 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2393/4828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:30 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:31.370503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e633e440-f2f4-417e-be80-249fb9f9031f req-d50e7ed8-1978-4259-9b58-a50301f75697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fba0a6a-bc0d-40a6-8554-fe9cf373778f", "tag": "31c450a0-2b83-4ee8-8e0c-23c61a4e3206"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:31.401780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e633e440-f2f4-417e-be80-249fb9f9031f req-d50e7ed8-1978-4259-9b58-a50301f75697 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:31.402593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e633e440-f2f4-417e-be80-249fb9f9031f req-d50e7ed8-1978-4259-9b58-a50301f75697 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:31.403093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e633e440-f2f4-417e-be80-249fb9f9031f req-d50e7ed8-1978-4259-9b58-a50301f75697 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:31.433063 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e633e440-f2f4-417e-be80-249fb9f9031f req-d50e7ed8-1978-4259-9b58-a50301f75697 service nova] Creating event network-changed:31c450a0-2b83-4ee8-8e0c-23c61a4e3206 for instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f on n-h2-862416-4 Oct 26 05:21:31.459057 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e633e440-f2f4-417e-be80-249fb9f9031f req-d50e7ed8-1978-4259-9b58-a50301f75697 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086287 Oct 26 05:21:31.459855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2394/4829] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:31.541763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:31.557375 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ced0ce1-ca5a-4777-8842-51736db60c7a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.732902 Oct 26 05:21:31.558779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:31.559581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:31.574069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:31.583377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2436/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:30 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:31.584419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:31.584912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:31.585713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:31.586162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:31.586597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:31.644814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:31.645456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:31.655748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:31.659730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:31.660409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:31.663917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:31.664690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:31.665423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:31.718025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:32.265468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:32.278941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:32.290612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:32.293894 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88bb4b10-a61f-4129-901f-15afd258a269 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.744911 Oct 26 05:21:32.294973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:32.296978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92f0a0f3-27e6-4b37-9425-793dacc013a7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.657331 Oct 26 05:21:32.297427 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2395/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:31 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:32.316188 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2437/4832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:31 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:32.394536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:32.395442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:32.406402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:32.408119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:32.409147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:32.412307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:32.413158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:32.415336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:32.588201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:32.589777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:32.636749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:32.640255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:32.641914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:32.644398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:32.646475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:32.647469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:33.015576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:33.025342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2178a47b-438b-4526-bd6a-50643871fd1d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.441008 Oct 26 05:21:33.055531 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2438/4833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:32 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:33.056175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:33.056294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4470aaea-a231-4c4c-aef2-feaeae3fd0d7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'create', calling method: .version_select at 0x7f470a923b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1383705386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqx5jd/Xe3Ja3VEcC13KymYo2AZQ3BTWcHLOFGJEfsuZiVESMFL5wy6FS8UXBaFhZDVPuHHxCogDsu2T75ZX2vG6N3B+SWKFhUW48tVVr3w1qO4dPsY1m3wkA7MUHuNhw=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:33.068840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fb984ce-0536-4985-9ac1-33f690f69ef2 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 200 len: 1506 microversion: 2.1 time: 0.678364 Oct 26 05:21:33.070442 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2396/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:32 2022] GET /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:33.079938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-4470aaea-a231-4c4c-aef2-feaeae3fd0d7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for project 227e01c08a304cb1b59273127d4ad575. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:33.095742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:33.096624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:33.102868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:33.103369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:33.103987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:33.105033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:33.105723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:33.106315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:33.108943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-4470aaea-a231-4c4c-aef2-feaeae3fd0d7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for user 91321abeaa5248beaadc6edf76c96886 and project 227e01c08a304cb1b59273127d4ad575. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:33.145406 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4470aaea-a231-4c4c-aef2-feaeae3fd0d7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.098002 Oct 26 05:21:33.146207 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2439/4835] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:21:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:33.321099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:33.322555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:33.344020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:33.344799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:33.346273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:33.350576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:33.351218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:33.351825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:33.740070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:33.748441 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d0634577-4186-4c42-83e9-a752d1c27640 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1320 microversion: 2.1 time: 0.656654 Oct 26 05:21:33.749919 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2397/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:33 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1320 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:33.775372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:33.776333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:33.783784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:33.784622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:33.785326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:33.786275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:33.790741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:33.791558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:34.395346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:34.404131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b860632-53b0-4969-86aa-1421d70f9dd6 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 1.089167 Oct 26 05:21:34.404721 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2440/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:33 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:34.417876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:34.423199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:34.431705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:34.455102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:34.461013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:34.463915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:34.464669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:34.465422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:34.607351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:34.619954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:34.636407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:34.641851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:34.647346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cc95ed2-ec39-47ff-a7f8-13b28d95b63e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.884191 Oct 26 05:21:34.649289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2398/4838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:33 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:34.777084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:34.777719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:34.779670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=24 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:34.799511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:34.806243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:34.806746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:34.807188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:34.807898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:34.808352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:34.808936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:34.811492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-964e71a4-de5a-4814-94c1-cd1acd17f09d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.397710 Oct 26 05:21:34.812096 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2441/4839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:34 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:35.188899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:35.199670 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a0335ca-f8ba-428e-8e1c-1d8ddc1cd61d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1320 microversion: 2.1 time: 0.425029 Oct 26 05:21:35.200536 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2399/4840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:34 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:35.432339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:35.433650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:35.447019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:35.447713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:35.449512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:35.450567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:35.453773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:35.454628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:35.680304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:35.681177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:35.689932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:35.690524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:35.690970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:35.691869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:35.692332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:35.692762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:35.973155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:36.006193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f4883f9-658f-4e82-9ce9-e39eb38ced38 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.577696 Oct 26 05:21:36.007208 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2442/4841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:35 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:36.025845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-233717944", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "a34e7011-1fc3-41d1-9d75-ba7d6d5e1be0"}], "key_name": "tempest-TestNetworkBasicOps-1383705386", "security_groups": [{"name": "tempest-secgroup-smoke-756106839"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:36.245199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:36.265835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:36.268680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:36.270897 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-550c766e-cf83-4897-95e9-232dacbbea15 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.595243 Oct 26 05:21:36.273581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2400/4842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:35 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:36.279707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:36.281557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:36.293034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:36.307582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:36.309873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:36.310835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:36.313997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:36.314535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:36.333398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] validate_networks() for [('a34e7011-1fc3-41d1-9d75-ba7d6d5e1be0', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:21:36.640336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:36.654296 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-00f3a77e-e692-4c11-af96-c8f9e4077534 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.379035 Oct 26 05:21:36.661999 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2401/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:36 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:36.667287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:36.668196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:36.674848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:36.676090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:36.676786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:36.677769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:36.679065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:36.679747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:37.485806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:37.496373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f4af917-31f8-467e-8634-9d51163b0c2a tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1320 microversion: 2.1 time: 0.833110 Oct 26 05:21:37.497877 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2402/4844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:36 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1320 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:37.503752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:37.504601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:37.512052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:37.513720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:37.514923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:37.516582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:37.517483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:37.518094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:37.773510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:21:37.774749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:21:37.775416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:21:37.775986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:21:37.776748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:21:37.788458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:37.789054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:37.789794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:37.790696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:37.791312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:37.792025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:37.832547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for project 227e01c08a304cb1b59273127d4ad575. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:37.840802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for user 91321abeaa5248beaadc6edf76c96886 and project 227e01c08a304cb1b59273127d4ad575. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:37.864393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:37.879203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c611740c-503d-4cf8-9e3b-d92c76aba14a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.379653 Oct 26 05:21:37.880420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:21:37.884216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:37.885133 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2403/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:37 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:37.898892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:37.902550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:37.922092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:37.925819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:37.926981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:37.927897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:37.929757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:37.930978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.027583 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-823e9003-8f67-4c40-8201-d8b509590a4e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.018864 Oct 26 05:21:38.028261 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2443/4846] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:21:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:21:38.039707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:38.041183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:38.069814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.075707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.076430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.078388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.079153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.079812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.570239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:38.586623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a257a7e-f8b7-41b9-9ed3-926a01a9ed80 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.557273 Oct 26 05:21:38.608042 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2444/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:38 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:38.615381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63698f65-081d-4bfe-b9e6-bce8676281e0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:38.616315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63698f65-081d-4bfe-b9e6-bce8676281e0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:38.625656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:38.667996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:38.680215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:38.686601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:38.697830 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c2383d59-c7c5-4847-8cbb-d53671e3e2fc tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.811003 Oct 26 05:21:38.698980 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2404/4848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:37 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:38.704130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-244cdea9-0b93-4429-b0ea-a19a210a3f9d req-94a795ee-8234-4266-ae2e-3fcf9e576324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "bbbbad34-c9b5-4cc0-9e13-aa9e00494405"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:38.731481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-244cdea9-0b93-4429-b0ea-a19a210a3f9d req-94a795ee-8234-4266-ae2e-3fcf9e576324 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.732555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-244cdea9-0b93-4429-b0ea-a19a210a3f9d req-94a795ee-8234-4266-ae2e-3fcf9e576324 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.734553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-244cdea9-0b93-4429-b0ea-a19a210a3f9d req-94a795ee-8234-4266-ae2e-3fcf9e576324 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.739287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63698f65-081d-4bfe-b9e6-bce8676281e0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:38.750090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63698f65-081d-4bfe-b9e6-bce8676281e0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1248 microversion: 2.1 time: 0.138089 Oct 26 05:21:38.752729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-244cdea9-0b93-4429-b0ea-a19a210a3f9d req-94a795ee-8234-4266-ae2e-3fcf9e576324 service nova] Creating event network-vif-plugged:bbbbad34-c9b5-4cc0-9e13-aa9e00494405 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:38.763942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-244cdea9-0b93-4429-b0ea-a19a210a3f9d req-94a795ee-8234-4266-ae2e-3fcf9e576324 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063272 Oct 26 05:21:38.766637 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2405/4849] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:38.767685 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2445/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:38 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1248 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:38.773525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:38.774211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:38.792676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.793276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.793761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.798971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.799789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.800671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.927018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:38.928147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:38.936183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.938887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.939537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:38.940551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:38.941026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:38.941538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:39.143069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:39.178471 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3237ca0d-a309-4d50-99ca-1b9dd4999d78 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1320 microversion: 2.1 time: 0.410106 Oct 26 05:21:39.180530 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2406/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:38 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:39.280606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:39.301711 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abaad96b-68e9-416c-ad7e-ac9d11f48ef8 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.389112 Oct 26 05:21:39.304631 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2446/4852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:38 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:39.616955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:39.617607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:39.625953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:39.626771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:39.627426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:39.628442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:39.629747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:39.630408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:39.726632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:39.728156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:39.736078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:39.736929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:39.737723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:39.738823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:39.739507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:39.740145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:39.840682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:39.852900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4321f468-c936-44be-b4a7-775d4c51d21e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.241044 Oct 26 05:21:39.866210 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2407/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:39 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:39.886778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:39.891279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:39.903644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:39.904346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:39.905189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:39.906256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:39.907147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:39.907822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.114305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:40.140500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d1f6424-5f45-4efa-95af-cdfec9caea76 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1318 microversion: 2.1 time: 0.272594 Oct 26 05:21:40.156731 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2408/4854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:39 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:40.210894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:40.212067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:40.221248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.222888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.223684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.225419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.226315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.227384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.265119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:40.298719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:40.304951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:40.316959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8fe56dcf-abde-44b5-8c60-0448ad9c4c6d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.591367 Oct 26 05:21:40.321117 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2447/4855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:39 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:40.338354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:40.340379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:40.352225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.353960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.355482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.356659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.357234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.374157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.611282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:40.621261 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e9344e0-cf2b-4b9a-8a11-db38ff6c9d0d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1320 microversion: 2.1 time: 0.420557 Oct 26 05:21:40.623755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2409/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:40 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:40.667816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:40.685006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8468ffdd-57ae-47c8-ab5d-0ad3cd587e1f tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.358895 Oct 26 05:21:40.685919 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2448/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:40 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:40.804641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "4fddf85f-a296-4afa-b733-f473ffa50c68"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e"}, {"server_uuid": "ade48fe3-e437-4306-8cf7-6841f4509b32", "name": "network-vif-plugged", "status": "completed", "tag": "46f96043-5890-4a17-b2e8-719c5a595b89"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:40.859159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.860411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.861061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.879077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:40.879750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:40.903464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.906230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.906893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.910645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Creating event network-vif-plugged:4fddf85f-a296-4afa-b733-f473ffa50c68 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:40.910992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:40.911654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:40.911801 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Creating event network-vif-plugged:6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:40.912383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:40.912763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] Creating event network-vif-plugged:46f96043-5890-4a17-b2e8-719c5a595b89 for instance ade48fe3-e437-4306-8cf7-6841f4509b32 on n-h1-862416-4 Oct 26 05:21:40.927569 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2d3c475d-ff83-4664-9008-6813af2d0321 req-7d16160d-c0a5-49e7-b6ad-cc6a957d4d14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.128276 Oct 26 05:21:40.948024 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2410/4858] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:41.189728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:41.190726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:41.200913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:41.202319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:41.202937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:41.203981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:41.204657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:41.207243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:41.792122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:41.812663 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f00b1ed0-5424-412a-b7d2-4155e549e80b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.936077 Oct 26 05:21:41.815080 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2449/4859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:40 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:41.839643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:41.843562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:41.860310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:41.861166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:41.861764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:41.862498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:41.864120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:41.864576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.127891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:42.130417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:42.141354 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-939f375c-bf49-48d2-8f40-0274a42db188 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1373 microversion: 2.1 time: 0.966466 Oct 26 05:21:42.141871 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2411/4860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:41 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1373 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:42.151428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:42.156000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:42.171434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:42.177962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:42.178594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.179532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:42.180145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:42.180879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.314518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:42.343616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:42.353660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:42.360338 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ae56303-47aa-45a7-ab0f-18322426b7e2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.539324 Oct 26 05:21:42.362872 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2450/4861] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:41 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:42.371704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:42.373328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:42.396996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:42.398889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:42.399578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.400972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:42.402091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:42.402790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.459060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:42.473735 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08662fc3-8b38-4ae6-aa23-88066734de8d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1320 microversion: 2.1 time: 0.330102 Oct 26 05:21:42.474354 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2412/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:42 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:42.705204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:42.714207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-db4e9494-2e55-436b-a830-d4b209403b75 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.350061 Oct 26 05:21:42.715550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2451/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:42 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:42.841492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:42.842382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:42.854347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:42.855024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:42.855563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.856560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:42.857121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:42.857665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:42.883495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1636010979", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "5967e27f-a92f-44f5-8c99-ced0032521ab"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:42.957819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] validate_networks() for [('5967e27f-a92f-44f5-8c99-ced0032521ab', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:21:43.161301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:43.190887 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2424d870-36b0-4d60-a31c-86cf5cfbcaa7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.354294 Oct 26 05:21:43.192889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2452/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:42 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:43.206197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-034ef04d-d9c9-45bf-8d3f-7231ef6d80f5 req-23696da1-5be4-4d8a-b032-38ee6bfdcee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b541231-8d6a-40d6-9c01-0ae06c0e8f5c", "tag": "fe7d4e3f-8fa7-40f7-97fa-f783e80262ba"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:43.256786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-034ef04d-d9c9-45bf-8d3f-7231ef6d80f5 req-23696da1-5be4-4d8a-b032-38ee6bfdcee4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.257281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-034ef04d-d9c9-45bf-8d3f-7231ef6d80f5 req-23696da1-5be4-4d8a-b032-38ee6bfdcee4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.261349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-034ef04d-d9c9-45bf-8d3f-7231ef6d80f5 req-23696da1-5be4-4d8a-b032-38ee6bfdcee4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.290342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-034ef04d-d9c9-45bf-8d3f-7231ef6d80f5 req-23696da1-5be4-4d8a-b032-38ee6bfdcee4 service nova] Creating event network-changed:fe7d4e3f-8fa7-40f7-97fa-f783e80262ba for instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c on n-h1-862416-4 Oct 26 05:21:43.296327 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-034ef04d-d9c9-45bf-8d3f-7231ef6d80f5 req-23696da1-5be4-4d8a-b032-38ee6bfdcee4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099275 Oct 26 05:21:43.297522 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2453/4865] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:43.303317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "29394b68-b95f-441f-9916-74f55e138b57"}, {"server_uuid": "0fba0a6a-bc0d-40a6-8554-fe9cf373778f", "name": "network-vif-plugged", "status": "completed", "tag": "31c450a0-2b83-4ee8-8e0c-23c61a4e3206"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "0b48ce7f-88c2-4c95-a5bf-164fed997c95"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:43.316122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.316733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.317503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.337569 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Creating event network-vif-plugged:29394b68-b95f-441f-9916-74f55e138b57 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:43.338311 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Creating event network-vif-plugged:31c450a0-2b83-4ee8-8e0c-23c61a4e3206 for instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f on n-h2-862416-4 Oct 26 05:21:43.338979 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Creating event network-vif-plugged:a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:43.339643 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] Creating event network-vif-plugged:0b48ce7f-88c2-4c95-a5bf-164fed997c95 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:43.351259 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a0e30d86-4392-47e4-9881-90291fad89e4 req-cb8594cd-b53a-4571-8e01-a33289e0872f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.052215 Oct 26 05:21:43.355422 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2454/4866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:43.361442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:43.362627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:43.374814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.375684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.376297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.377461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.378189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.378781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.739204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:43.748144 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8c0a8b0-ee47-4b7f-b54f-5f4e0caf5841 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1373 microversion: 2.1 time: 0.391189 Oct 26 05:21:43.756166 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2455/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:43 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1373 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:43.756166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:43.756166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:43.761850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.762352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.762795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.763519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.763978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.764941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.774842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:21:43.775321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:21:43.775737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:21:43.776149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:21:43.776562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:21:43.787048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.787542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.787990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.788724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.789181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.789641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.808646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Getting quotas for project 15dca088aadb4ae8a86cfa4ea5c77ca1. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:43.815516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Getting quotas for user 9553bf2925af436293d8f198de2e882d and project 15dca088aadb4ae8a86cfa4ea5c77ca1. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:43.817426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:43.832981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:21:43.835526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:43.898227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9180c4d5-12fb-4a00-93ec-2d4c17834e78 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264836 Oct 26 05:21:43.898887 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2413/4868] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:21:43.907181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:43.907801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:43.915619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.916410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.917271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:43.918419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:43.920078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:43.921482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.340658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.350405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.352131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.353538 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf45ef1a-027e-414d-97ee-c112710c3fa5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.602787 Oct 26 05:21:44.354106 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2456/4869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:43 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:44.378162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:44.378792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:44.381408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.385007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.385536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.385973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.386672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.387129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.387563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.390483 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d1a3aea-417d-4e35-a48b-2d8fd3a8fade tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 200 len: 1506 microversion: 2.1 time: 0.490373 Oct 26 05:21:44.391148 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2414/4870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:43 2022] GET /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:44.395893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:44.396510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:44.402348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.403018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.403468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.404169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.404655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.405094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.490038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.498097 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-711008a0-4224-49b1-94c6-d0132c0c2feb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1232 microversion: 2.1 time: 0.105774 Oct 26 05:21:44.499390 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2415/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:44 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1232 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:44.504488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:44.505087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:44.511085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.511567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.512010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.512814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.513272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.513719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.572512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.584562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-369cd98f-8fec-4f8b-973f-9f55cc6f4157 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.213544 Oct 26 05:21:44.589490 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2457/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:44 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:44.595407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:44.596623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:44.603009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.604000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.604521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.605351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.606449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.607108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.612800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:44.640225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: ade48fe3-e437-4306-8cf7-6841f4509b32] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:21:44.684434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.694813 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-667de70c-2bad-498e-8e33-53f7643bbff5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.193579 Oct 26 05:21:44.696185 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2416/4873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:44 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:44.775359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:44.776034 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35c6f0eb-2921-4739-9a40-20e870c6798c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32" status: 204 len: 0 microversion: 2.1 time: 0.184545 Oct 26 05:21:44.776144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:44.776564 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2458/4874] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:21:44 2022] DELETE /compute/v2.1/servers/ade48fe3-e437-4306-8cf7-6841f4509b32 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:21:44.787405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:44.788305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:44.795401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.796116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.796570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.797194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.797652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.797794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.798753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.799382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.800203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.801008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:44.802328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:44.803918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:44.832265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:21:44.927533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1e17b84e-3973-4790-a952-e65f96cc4527 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94" status: 204 len: 0 microversion: 2.1 time: 0.145597 Oct 26 05:21:44.928278 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2459/4875] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:21:44 2022] DELETE /compute/v2.1/servers/0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:21:44.976091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:44.984129 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20b8b990-7520-46df-a207-9517d8e2bab1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1373 microversion: 2.1 time: 0.215153 Oct 26 05:21:44.985011 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2417/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:44 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:45.038210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-570346775", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "74eea396-374c-4d74-9be7-40bafb85f94b"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:45.091177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] validate_networks() for [('74eea396-374c-4d74-9be7-40bafb85f94b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:21:45.384798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:45.385460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:45.392989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.393517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.393968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.394704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.395164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.395773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.579736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:21:45.580296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:21:45.580801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:21:45.581285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:21:45.581765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:21:45.592065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.593399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.594058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.594810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.595268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.595704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.615365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Getting quotas for project 3c7ce43c6f1042d59ffd21119d7be69d. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:21:45.621185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Getting quotas for user dc34b61591f544fd9f3b422d78d481ff and project 3c7ce43c6f1042d59ffd21119d7be69d. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:21:45.629161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:45.639989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Going to run 2 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:21:45.640467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:45.642045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:45.642568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:45.643216 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d99e60d-d3f5-4a9c-84eb-5f0be8d06531 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 0.263073 Oct 26 05:21:45.643778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2418/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:45 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:21:45.649212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-plugged", "status": "completed", "tag": "34e7a88d-8eed-44ca-8f5b-7a13e098a31f"}, {"server_uuid": "6435db53-d471-4b69-9d80-cc3858aa36b2", "name": "network-vif-plugged", "status": "completed", "tag": "bb513202-3230-4dff-895a-cbecab25f743"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:45.661868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.662596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.663027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.677778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] Creating event network-vif-plugged:34e7a88d-8eed-44ca-8f5b-7a13e098a31f for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:45.678580 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] Creating event network-vif-plugged:bb513202-3230-4dff-895a-cbecab25f743 for instance 6435db53-d471-4b69-9d80-cc3858aa36b2 on n-h1-862416-4 Oct 26 05:21:45.689771 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6d1f735f-e756-4959-a19c-538afbedf4bd req-f5894324-5036-44a3-89a8-829d5ba30925 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044262 Oct 26 05:21:45.689980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=6cdfc5c3-6228-4f21-ba6c-985707f235b4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:21:45.691118 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2419/4878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:45.696612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:45.697546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:45.705795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.706585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.707210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.708130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.708742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.709358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.748625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df2bc2b0-f1f8-44a5-839f-8875aab0525b tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.714566 Oct 26 05:21:45.749868 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2460/4879] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:21:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 26 05:21:45.754948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:45.755567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:45.761742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.762235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.762689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.763379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.763839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.764859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.822483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:45.834613 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d134d8a3-1ed3-43e8-8efb-11aa9d132cdb tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1280 microversion: 2.1 time: 0.141862 Oct 26 05:21:45.837512 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2420/4880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:45 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:45.845016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:45.846758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:45.860112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.860623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.861078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.861848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:45.862385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:45.863423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:45.979653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:45.998534 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1eafc791-adaf-4036-a26b-d4ecbfaf6a1e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.247271 Oct 26 05:21:46.015802 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2461/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:45 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:46.025139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:46.033114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:46.034061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Searching by: {'deleted': False, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:21:46.054668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.055947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.057876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.062284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:46.066476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.067020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.067474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.070693 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3fa96f92-bdcf-49ca-a9f8-a74eea6ab4f8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1314 microversion: 2.1 time: 0.229671 Oct 26 05:21:46.071926 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2421/4882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:45 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:46.116245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:46.116871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:46.118293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:21:46.148335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.148850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.149302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.150050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.150518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.150957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.180685 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f6747d49-cb92-42ce-9137-13c0719826ec tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.163360 Oct 26 05:21:46.181962 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2462/4883] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:21:46 2022] GET /compute/v2.1/servers => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:46.201402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d0856ef-fadf-4807-82d4-d75ee4fa4203 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:46.202751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d0856ef-fadf-4807-82d4-d75ee4fa4203 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:46.301890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d0856ef-fadf-4807-82d4-d75ee4fa4203 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:46.328177 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d0856ef-fadf-4807-82d4-d75ee4fa4203 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1217 microversion: 2.1 time: 0.129596 Oct 26 05:21:46.334242 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2463/4884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:46 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:46.495593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:46.506496 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1808ff61-5925-4ac2-8394-d34d91a5e959 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1373 microversion: 2.1 time: 0.423362 Oct 26 05:21:46.522351 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2422/4885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:46 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1373 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:46.669840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:46.670505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:46.677677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.678231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.678680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.679391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.686424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.687063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.872503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:46.873302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:46.895755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.896806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.897491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:46.898317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:46.899090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:46.899889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:47.063220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:47.076262 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-585a2cf0-64ce-4f48-b82d-9ad01e392c2d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1280 microversion: 2.1 time: 0.220604 Oct 26 05:21:47.080390 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2423/4886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:46 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:47.094147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:47.103847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:47.123186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:47.124028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:47.124641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:47.125574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:47.126195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:47.126793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:47.776151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:47.791265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:47.792975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:47.800209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6be6b20e-c161-49e3-849f-236087ead9f4 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.134371 Oct 26 05:21:47.801295 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2464/4887] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:46 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:47.822824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:47.822824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:47.837723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:47.838673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:47.839290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:47.840185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:47.841003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:47.841617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:47.918361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:47.928071 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50f7b506-f142-4342-9af1-b4c6ad0efe95 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1402 microversion: 2.1 time: 0.846240 Oct 26 05:21:47.940332 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2424/4888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:47 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1402 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:47.957556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:47.959254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:47.974308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:47.975007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:47.976192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:47.977089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:47.977751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:47.978347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.141305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:48.157414 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d03a772-b03e-4ed5-b93f-57cd388808e1 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1269 microversion: 2.1 time: 0.211011 Oct 26 05:21:48.161169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2425/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:47 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:48.178492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:48.179542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:48.194282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.194804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.195302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.196026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.199338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.202713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.372923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:48.384268 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cac689d-553f-47bf-b595-8c23abdb9f0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1500 microversion: 2.1 time: 0.573667 Oct 26 05:21:48.406480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2465/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:47 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1500 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:48.411923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0d5c8d9b-7fbc-4f39-8521-1a44d62777fa req-18fd35e4-2705-4182-b1a4-8f6c0fa94a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade48fe3-e437-4306-8cf7-6841f4509b32", "name": "network-vif-deleted", "tag": "46f96043-5890-4a17-b2e8-719c5a595b89"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:48.421793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0d5c8d9b-7fbc-4f39-8521-1a44d62777fa req-18fd35e4-2705-4182-b1a4-8f6c0fa94a4f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.422546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0d5c8d9b-7fbc-4f39-8521-1a44d62777fa req-18fd35e4-2705-4182-b1a4-8f6c0fa94a4f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.423136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0d5c8d9b-7fbc-4f39-8521-1a44d62777fa req-18fd35e4-2705-4182-b1a4-8f6c0fa94a4f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.477749 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0d5c8d9b-7fbc-4f39-8521-1a44d62777fa req-18fd35e4-2705-4182-b1a4-8f6c0fa94a4f service nova] Creating event network-vif-deleted:46f96043-5890-4a17-b2e8-719c5a595b89 for instance ade48fe3-e437-4306-8cf7-6841f4509b32 on n-h1-862416-4 Oct 26 05:21:48.495599 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0d5c8d9b-7fbc-4f39-8521-1a44d62777fa req-18fd35e4-2705-4182-b1a4-8f6c0fa94a4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087505 Oct 26 05:21:48.496754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2466/4891] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:48.502526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6ef3ad44-60e3-4979-955f-9c8184d10456 req-001ba366-29ee-447a-b562-45811007faf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b541231-8d6a-40d6-9c01-0ae06c0e8f5c", "name": "network-vif-plugged", "status": "completed", "tag": "fe7d4e3f-8fa7-40f7-97fa-f783e80262ba"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:48.530538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6ef3ad44-60e3-4979-955f-9c8184d10456 req-001ba366-29ee-447a-b562-45811007faf5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.531212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6ef3ad44-60e3-4979-955f-9c8184d10456 req-001ba366-29ee-447a-b562-45811007faf5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.532097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6ef3ad44-60e3-4979-955f-9c8184d10456 req-001ba366-29ee-447a-b562-45811007faf5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.546803 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6ef3ad44-60e3-4979-955f-9c8184d10456 req-001ba366-29ee-447a-b562-45811007faf5 service nova] Creating event network-vif-plugged:fe7d4e3f-8fa7-40f7-97fa-f783e80262ba for instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c on n-h1-862416-4 Oct 26 05:21:48.554403 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6ef3ad44-60e3-4979-955f-9c8184d10456 req-001ba366-29ee-447a-b562-45811007faf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055329 Oct 26 05:21:48.555357 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2467/4892] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:48.565967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:48.567770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:48.576484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.577601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.578438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.579406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.580085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.580731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.726866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:48.759608 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6c54e64-577f-4976-94c3-758edb8a04a1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1286 microversion: 2.1 time: 0.202407 Oct 26 05:21:48.760262 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2468/4893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:48 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:48.766223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:48.769723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:48.771550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:48.779037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.780500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.781196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.782300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.782992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.784265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.808673 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2816e74-90a0-4f7b-af89-a89a4c752a1a tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1373 microversion: 2.1 time: 0.646102 Oct 26 05:21:48.810939 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2426/4894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:48 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1373 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:48.845778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:48.846503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:48.855239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lazy-loading 'flavor' on Instance uuid 0fba0a6a-bc0d-40a6-8554-fe9cf373778f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:21:48.879321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.880400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.881603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:48.886085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:48.886918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:48.887721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:49.004958 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a806da7-188a-4461-a4b1-8d44df999352 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "POST /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f/action" status: 200 len: 32 microversion: 2.1 time: 0.242776 Oct 26 05:21:49.006266 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2469/4895] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:21:48 2022] POST /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:21:49.013483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a287dbe4-56ea-43d8-ac1e-e663dc6177fb req-c764ac94-df07-4fe5-ae65-6980e8bf377e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94", "name": "network-vif-deleted", "tag": "090d6761-c4fe-4844-9519-ed7a5331deab"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:49.025667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a287dbe4-56ea-43d8-ac1e-e663dc6177fb req-c764ac94-df07-4fe5-ae65-6980e8bf377e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:49.026403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a287dbe4-56ea-43d8-ac1e-e663dc6177fb req-c764ac94-df07-4fe5-ae65-6980e8bf377e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:49.027048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a287dbe4-56ea-43d8-ac1e-e663dc6177fb req-c764ac94-df07-4fe5-ae65-6980e8bf377e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:49.052673 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a287dbe4-56ea-43d8-ac1e-e663dc6177fb req-c764ac94-df07-4fe5-ae65-6980e8bf377e service nova] Creating event network-vif-deleted:090d6761-c4fe-4844-9519-ed7a5331deab for instance 0dc55bb8-a8bf-45bc-9f6f-be7fd7003c94 on n-h2-862416-4 Oct 26 05:21:49.072421 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a287dbe4-56ea-43d8-ac1e-e663dc6177fb req-c764ac94-df07-4fe5-ae65-6980e8bf377e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064385 Oct 26 05:21:49.073382 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2470/4896] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:49.085095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:49.085892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:49.101220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:49.101748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:49.102195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:49.102911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:49.103368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:49.111161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:49.968423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:49.979772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:49.991735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:49.994030 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5892f303-bbb7-4c4e-be3f-77a3c5f8e1d9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1590 microversion: 2.1 time: 0.919451 Oct 26 05:21:49.994611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:49.996458 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5aeafd09-edad-42fe-8c90-40564aa8eb28 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1879 microversion: 2.42 time: 1.166425 Oct 26 05:21:50.006191 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2471/4897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:49 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1590 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:50.016722 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2427/4898] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:48 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1879 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:50.022937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:50.023981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:50.025368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:50.027507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:50.032516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.033459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.034256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.035756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.037557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.038164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.044572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.045287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.051081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.052628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.053478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.054106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.485347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:50.488904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:50.513054 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e160102b-a80f-461f-8e9c-19168d1aaa4d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.505318 Oct 26 05:21:50.515758 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2472/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:50 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:50.534810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:50.535648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:50.542926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.543421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.543861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.545929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.545929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.546332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.581034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:50.594909 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39c703d4-df0e-436c-b3ca-69e2df9d18cb tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.576868 Oct 26 05:21:50.596910 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2428/4900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:50 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:50.602781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:50.603606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:50.610495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.611396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.612005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.612916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.613407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.613911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.915985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:50.926951 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55e78448-9950-45f5-8d81-7740d0adb245 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.409843 Oct 26 05:21:50.928357 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2473/4901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:50 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:50.933344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:50.934098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:50.941125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.941794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.942463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:50.943161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:50.943624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:50.944115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:51.129263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:51.133869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:51.151229 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-778f430f-2def-4db4-8b7a-32161273f6fd tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221710 Oct 26 05:21:51.152632 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-321e340b-c590-4a70-8c88-96fc7f3c48f1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1373 microversion: 2.1 time: 0.554333 Oct 26 05:21:51.154386 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2429/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:50 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1373 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:51.160812 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2474/4903] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:21:50 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:51.171641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:51.172686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:51.190180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:51.190717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:51.191360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:51.192246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:51.192705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:51.193138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:51.536757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:51.537598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:51.552005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:51.552503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:51.553123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:51.553856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:51.554500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:51.555143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.146267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:52.162106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:52.164485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:52.165972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9e307a4-d82b-4b0b-a976-231e51d5f41e tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2836 microversion: 2.42 time: 1.008071 Oct 26 05:21:52.166698 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2430/4904] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:21:51 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2836 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:52.172561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:52.173386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:52.198238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.199006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.200602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.203029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.203668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.204255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.274971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:52.285011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b933ea95-c49a-42c0-8ad5-f5defb1f0812 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.752108 Oct 26 05:21:52.286850 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2475/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:51 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:52.292860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:52.294583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:52.303509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.304566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.305253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.306221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.307041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.307590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.663820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:52.679155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3308c48-5057-49d2-86d0-5f3054238800 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.510066 Oct 26 05:21:52.680363 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2431/4906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:52 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:52.690770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:52.691727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:52.703296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.704086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.705534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.707885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.709359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.712231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.736124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:52.745370 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c76cf0b-f241-49c9-a5aa-f4d4303474cc tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.457063 Oct 26 05:21:52.756045 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2476/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:52 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:52.761128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:52.761848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:52.772328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.772840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.773297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.774035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:52.777671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:52.778247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:52.996237 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8b26cf5-641a-459b-8210-1779b919e4d7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.238883 Oct 26 05:21:52.997071 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2477/4908] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:21:52 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892/os-interface => generated 1830 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:21:53.003070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9b18dc31-3138-47c8-898d-f1397c031f79 req-9a5423cc-db11-4916-a297-a747dead4c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1107d896-e11d-48de-a12c-37a33530d0c6", "tag": "7318ec2e-df37-445b-a6a2-ac58a72f0eea"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:53.011111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:53.017468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9b18dc31-3138-47c8-898d-f1397c031f79 req-9a5423cc-db11-4916-a297-a747dead4c65 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.017961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9b18dc31-3138-47c8-898d-f1397c031f79 req-9a5423cc-db11-4916-a297-a747dead4c65 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.018807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9b18dc31-3138-47c8-898d-f1397c031f79 req-9a5423cc-db11-4916-a297-a747dead4c65 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.036588 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9b18dc31-3138-47c8-898d-f1397c031f79 req-9a5423cc-db11-4916-a297-a747dead4c65 service nova] Creating event network-changed:7318ec2e-df37-445b-a6a2-ac58a72f0eea for instance 1107d896-e11d-48de-a12c-37a33530d0c6 on n-h2-862416-4 Oct 26 05:21:53.043948 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9b18dc31-3138-47c8-898d-f1397c031f79 req-9a5423cc-db11-4916-a297-a747dead4c65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045332 Oct 26 05:21:53.044869 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2478/4909] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:53.153894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:53.165438 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b8f6403-9d3f-458a-9961-f3c5ff92e036 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1546 microversion: 2.1 time: 0.483068 Oct 26 05:21:53.166027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2432/4910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:52 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1546 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:53.190134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:53.191088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:53.198651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.199509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.200170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.201125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.202160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.202819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.315534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:53.316541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:53.325623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.337179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.338277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.339235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.340579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.341117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.631559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:53.641866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-28e4f03a-d30a-4ed2-ae23-0cf86fc80562 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1546 microversion: 2.1 time: 0.456760 Oct 26 05:21:53.658571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2479/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:53 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1546 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:53.667476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-df952a12-d91c-460b-9b80-9ee1119580c2 req-47a2c310-e2e4-40dc-8907-fbd79355b2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95f70dc-8db0-4569-9e07-2027e17b4871", "tag": "6d89fc4c-e8ca-4b1f-922f-476112b0b62b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:53.677840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-df952a12-d91c-460b-9b80-9ee1119580c2 req-47a2c310-e2e4-40dc-8907-fbd79355b2ce service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.678428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-df952a12-d91c-460b-9b80-9ee1119580c2 req-47a2c310-e2e4-40dc-8907-fbd79355b2ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.678964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-df952a12-d91c-460b-9b80-9ee1119580c2 req-47a2c310-e2e4-40dc-8907-fbd79355b2ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.690941 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-df952a12-d91c-460b-9b80-9ee1119580c2 req-47a2c310-e2e4-40dc-8907-fbd79355b2ce service nova] Creating event network-changed:6d89fc4c-e8ca-4b1f-922f-476112b0b62b for instance a95f70dc-8db0-4569-9e07-2027e17b4871 on n-h2-862416-4 Oct 26 05:21:53.696688 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-df952a12-d91c-460b-9b80-9ee1119580c2 req-47a2c310-e2e4-40dc-8907-fbd79355b2ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036515 Oct 26 05:21:53.697788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2480/4912] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:53.701936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:53.711013 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2cdf0a28-9418-4808-8db0-b28259465c33 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.402101 Oct 26 05:21:53.715177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:53.716275 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2433/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:53 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:53.733483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:53.740580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.741221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.741790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.742574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.743191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.743690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.780982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:53.781889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:53.792051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.792882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.793576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.794788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:53.801583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:53.802163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:53.802776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:53.826710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:54.130467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:54.139612 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-762296e2-2871-478e-9a19-bc43a668871d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.432791 Oct 26 05:21:54.154197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:54.166139 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02141643-7ee0-44c5-9d2c-75bbfe59f96d tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.388341 Oct 26 05:21:54.176750 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2481/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:53 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:54.182279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:54.183030 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2434/4915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:53 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:54.183526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:54.195889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:54.196738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:54.197430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:54.198424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:54.199104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:54.199749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:54.472442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:54.481278 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c15dab6e-68db-4f55-96c6-59e409a519a9 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1590 microversion: 2.1 time: 0.302779 Oct 26 05:21:54.482174 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2482/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:54 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1590 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:54.740432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:54.741358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:54.748885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:54.749780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:54.750386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:54.751284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:54.751911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:54.752346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.087225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cdfc5c3-6228-4f21-ba6c-985707f235b4", "tag": "0f5cce9d-3c66-4014-8cee-84347640d1af"}, {"name": "network-changed", "server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "tag": "0b48ce7f-88c2-4c95-a5bf-164fed997c95"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:55.104884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:55.105521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:55.109773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.126244 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] Creating event network-changed:0f5cce9d-3c66-4014-8cee-84347640d1af for instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 on n-h1-862416-4 Oct 26 05:21:55.126769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] Creating event network-changed:0b48ce7f-88c2-4c95-a5bf-164fed997c95 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:21:55.136027 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-933bbd63-7cd3-4b47-8f38-79cf021a4eda req-ac76fa4d-8120-462f-9470-0711dcd96553 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052409 Oct 26 05:21:55.137994 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2483/4917] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:21:55.175062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:55.177134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:55.186263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:55.187140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:55.187820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.188640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:55.189849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:55.190524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.428220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:55.470331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c748115-ddbc-4102-801f-983e83662a0c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.734120 Oct 26 05:21:55.475491 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2435/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:54 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:55.494513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:55.495206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:55.508879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:55.510976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:55.512555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.516256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:55.516832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:55.517437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.596361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:55.605267 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-553f4b6c-5dca-4cd9-b4bd-a936d4046e9c tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.444165 Oct 26 05:21:55.606663 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2484/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:55 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:55.718708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6f2bc3b8-6b2a-4b2a-b637-53ba394e6805 req-e3e94a93-c976-416d-abdf-fd761f022869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6435db53-d471-4b69-9d80-cc3858aa36b2", "tag": "bb513202-3230-4dff-895a-cbecab25f743"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:55.731329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f2bc3b8-6b2a-4b2a-b637-53ba394e6805 req-e3e94a93-c976-416d-abdf-fd761f022869 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:55.732074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f2bc3b8-6b2a-4b2a-b637-53ba394e6805 req-e3e94a93-c976-416d-abdf-fd761f022869 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:55.733772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f2bc3b8-6b2a-4b2a-b637-53ba394e6805 req-e3e94a93-c976-416d-abdf-fd761f022869 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:55.749395 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6f2bc3b8-6b2a-4b2a-b637-53ba394e6805 req-e3e94a93-c976-416d-abdf-fd761f022869 service nova] Creating event network-changed:bb513202-3230-4dff-895a-cbecab25f743 for instance 6435db53-d471-4b69-9d80-cc3858aa36b2 on n-h1-862416-4 Oct 26 05:21:55.755710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:55.756458 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6f2bc3b8-6b2a-4b2a-b637-53ba394e6805 req-e3e94a93-c976-416d-abdf-fd761f022869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042999 Oct 26 05:21:55.757082 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2485/4920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:55.783827 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11845212-31f8-4ae2-8694-f0475ced44b3 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.306577 Oct 26 05:21:55.785726 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2436/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:55 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:56.502203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:56.504737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:56.507626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:56.509473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=24 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:21:56.517510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:56.518280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:56.518982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:56.519774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:56.520401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:56.520981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:56.629655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:56.630285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:56.636217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:56.636715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:56.637159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:56.638105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:56.638791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:56.639502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:56.807976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:56.824726 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-631153a3-ce91-4445-a867-fac6236dab9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.327083 Oct 26 05:21:56.834805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2486/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:56 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:56.834805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:56.834805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:56.844407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:56.845053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:56.845922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:56.846762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:56.847482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:56.848267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:56.970769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:56.983148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-604c40e9-cc56-4463-94d4-66e1f6417e38 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.357148 Oct 26 05:21:57.002065 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2437/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:56 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:57.104349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:57.116323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ab00c08-8769-439e-926f-ecb506a0b5ad tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.288056 Oct 26 05:21:57.116925 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2487/4924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:56 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:57.773171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-babaab25-2cef-4d9d-be3b-24f541dd8eff req-fc1c966a-4d21-49bd-8db4-e2bedebea99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b541231-8d6a-40d6-9c01-0ae06c0e8f5c", "tag": "fe7d4e3f-8fa7-40f7-97fa-f783e80262ba"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:57.788450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-babaab25-2cef-4d9d-be3b-24f541dd8eff req-fc1c966a-4d21-49bd-8db4-e2bedebea99e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:57.789073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-babaab25-2cef-4d9d-be3b-24f541dd8eff req-fc1c966a-4d21-49bd-8db4-e2bedebea99e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:57.789894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-babaab25-2cef-4d9d-be3b-24f541dd8eff req-fc1c966a-4d21-49bd-8db4-e2bedebea99e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:57.804156 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-babaab25-2cef-4d9d-be3b-24f541dd8eff req-fc1c966a-4d21-49bd-8db4-e2bedebea99e service nova] Creating event network-changed:fe7d4e3f-8fa7-40f7-97fa-f783e80262ba for instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c on n-h1-862416-4 Oct 26 05:21:57.813483 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-babaab25-2cef-4d9d-be3b-24f541dd8eff req-fc1c966a-4d21-49bd-8db4-e2bedebea99e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045156 Oct 26 05:21:57.814889 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2438/4925] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:57.851414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:57.852855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:57.862706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:57.862951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:57.863593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:57.865376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:57.866227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:57.866680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:58.008459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:58.009945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:58.021015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:58.022521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:58.023207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:58.024226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:58.024949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:58.026225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:58.036416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:58.046623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d433147-cdb5-40db-940e-4e055dc725f9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.201944 Oct 26 05:21:58.052281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2488/4926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:57 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:58.141721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:58.143387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:58.151653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:58.152442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:58.153112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:58.154070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:58.155335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:58.155965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:58.174587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:58.184546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cbeac6b1-d1fa-4146-a3b6-1cbf4c0fcb08 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.180347 Oct 26 05:21:58.185905 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2439/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:58 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:21:58.349429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:58.361768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3fdcbc6-eb76-48c0-955c-488d6218d1db tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.226388 Oct 26 05:21:58.362569 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2489/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:58 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:59.078002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:59.080397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:59.093878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.094805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.095465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.096483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.097143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.098004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.209452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:59.212083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:59.224723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.226787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.227553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.228648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.229986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.230741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.387208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:59.411334 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-398a837c-d403-4976-b8d6-dd24c2541875 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.328682 Oct 26 05:21:59.426906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2440/4929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:59 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:59.426906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6d2cc1ee-857c-43f5-a4a1-4cd5444d4f3a req-fea6d881-922f-4617-a03a-386603544f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1107d896-e11d-48de-a12c-37a33530d0c6", "name": "network-vif-plugged", "status": "completed", "tag": "7318ec2e-df37-445b-a6a2-ac58a72f0eea"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:21:59.442395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6d2cc1ee-857c-43f5-a4a1-4cd5444d4f3a req-fea6d881-922f-4617-a03a-386603544f8b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.442907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6d2cc1ee-857c-43f5-a4a1-4cd5444d4f3a req-fea6d881-922f-4617-a03a-386603544f8b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.443338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6d2cc1ee-857c-43f5-a4a1-4cd5444d4f3a req-fea6d881-922f-4617-a03a-386603544f8b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.462964 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6d2cc1ee-857c-43f5-a4a1-4cd5444d4f3a req-fea6d881-922f-4617-a03a-386603544f8b service nova] Creating event network-vif-plugged:7318ec2e-df37-445b-a6a2-ac58a72f0eea for instance 1107d896-e11d-48de-a12c-37a33530d0c6 on n-h2-862416-4 Oct 26 05:21:59.468939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6d2cc1ee-857c-43f5-a4a1-4cd5444d4f3a req-fea6d881-922f-4617-a03a-386603544f8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053415 Oct 26 05:21:59.469834 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2441/4930] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:21:59.475691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:21:59.476825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:21:59.484140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.485010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.485658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.486571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:21:59.487189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:21:59.487782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:21:59.508078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:59.524159 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa1aa4cb-6d7e-4e68-9403-e18013d83ed5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.319302 Oct 26 05:21:59.530480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2490/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:59 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:21:59.721395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:21:59.730915 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c64fad3d-3a75-418c-b0ce-0049c56568f1 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.259709 Oct 26 05:21:59.731507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2442/4932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:21:59 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:00.439533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:00.440200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:00.450128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:00.451278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:00.453193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:00.454263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:00.454968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:00.455521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:00.548205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:00.548860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:00.556822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:00.557344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:00.557827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:00.558564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:00.559047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:00.559484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:00.598212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:00.608068 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c74b1a6b-0bb2-41b8-96c3-c66642858611 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.171527 Oct 26 05:22:00.608068 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2491/4933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:00 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:00.698578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:00.707420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16bbfabf-9035-438e-8e48-0b59ce4cf25f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1317 microversion: 2.1 time: 0.163230 Oct 26 05:22:00.707993 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2443/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:00 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:00.753573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:00.754195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:00.760228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:00.760725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:00.761173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:00.761914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:00.762385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:00.762818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:00.901925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:00.906093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:00.911826 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-53a3bef1-e773-4ac8-be3e-e89e00c08b24 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.162042 Oct 26 05:22:00.913009 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2492/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:00 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:01.487572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cdfc5c3-6228-4f21-ba6c-985707f235b4", "name": "network-vif-plugged", "status": "completed", "tag": "0f5cce9d-3c66-4014-8cee-84347640d1af"}, {"server_uuid": "a95f70dc-8db0-4569-9e07-2027e17b4871", "name": "network-vif-plugged", "status": "completed", "tag": "6d89fc4c-e8ca-4b1f-922f-476112b0b62b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:01.498722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.499335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.499781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.514994 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] Creating event network-vif-plugged:0f5cce9d-3c66-4014-8cee-84347640d1af for instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 on n-h1-862416-4 Oct 26 05:22:01.515509 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] Creating event network-vif-plugged:6d89fc4c-e8ca-4b1f-922f-476112b0b62b for instance a95f70dc-8db0-4569-9e07-2027e17b4871 on n-h2-862416-4 Oct 26 05:22:01.523649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ef15ae2c-1948-4cdb-bad2-4076e5341029 req-80c7b71c-e478-489f-89b4-f6e1e82acbd4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039782 Oct 26 05:22:01.524690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2444/4936] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:01.629397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:01.630049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:01.637841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.638360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.638853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.639569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.640032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.640471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.733773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:01.734429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:01.740711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.741204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.741674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.742379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.742838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.743270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.830155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:01.837815 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a3d6c35-f405-4fb9-aeb3-229f45eed4dd tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.212459 Oct 26 05:22:01.838407 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2493/4937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:01 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:01.895095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:01.902803 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c93f263-5936-4e83-bebd-5d9eb2aeaf7d tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1503 microversion: 2.1 time: 0.174789 Oct 26 05:22:01.903380 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2445/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:01 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:01.924900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:01.925805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:01.931777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.932276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.932721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.933451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.933934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.934367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.935179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:01.936293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:01.942250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.942739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.943182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:01.943876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:01.944334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:01.944763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:02.125825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:02.132839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:02.133619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3235e9b7-08e4-47c9-be45-5408f6acc069 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 200 len: 1317 microversion: 2.1 time: 0.212496 Oct 26 05:22:02.134217 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2494/4939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:01 2022] GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:02.141598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5b5f493-03cb-4e88-820f-b1a397e3cd0b tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.210081 Oct 26 05:22:02.142170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2446/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:01 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:02.862021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:02.862679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:02.870439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:02.870937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:02.871387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:02.872090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:02.872559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:02.873501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.015206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:03.023170 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c79b349-2252-4b24-8ad1-8a014b6a6c32 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.165751 Oct 26 05:22:03.023770 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2495/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:02 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:03.156171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:03.156694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:03.163650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.163793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:03.164140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.164392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:03.164585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.165285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.165773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.166207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.171321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.171804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.172243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.172938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.173435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.173871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.373458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:03.376705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:03.381275 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7f55509-1ab6-4c1d-9ac8-4a08162431ca tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 200 len: 1503 microversion: 2.1 time: 0.229075 Oct 26 05:22:03.381889 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2447/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:03 2022] GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:03.384625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-814301aa-b7f5-4c03-8014-c19968a2f3b2 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1328 microversion: 2.1 time: 0.224622 Oct 26 05:22:03.385279 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2496/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:03 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:03.405712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:03.406311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:03.412206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.412692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.413137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.413851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.414311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.414739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.430385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:03.441801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:22:03.525893 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-486f4a8b-9781-49f2-abba-99b7aec200ef tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 204 len: 0 microversion: 2.1 time: 0.124012 Oct 26 05:22:03.526719 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2448/4944] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:03 2022] DELETE /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:22:03.535499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:03.536000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:03.542024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.542512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.542952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.543640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.544098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.544529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.570327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:22:03.649784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1161483f-5882-4404-91fa-a7c8d8219c8f tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 204 len: 0 microversion: 2.1 time: 0.117684 Oct 26 05:22:03.650509 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2497/4945] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:03 2022] DELETE /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:22:03.659502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:03.660158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:03.666067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.666554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.666998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.667686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:03.668170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:03.668630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:03.802179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:03.810057 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7486389a-e88e-42df-9ffd-4f75bdb88577 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 200 len: 1509 microversion: 2.1 time: 0.155030 Oct 26 05:22:03.810755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2449/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:03 2022] GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:04.046894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:04.047631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:04.054742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.055236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.055685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.056383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.056850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.057287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.188027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:04.195716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a27ef5d-cd9a-4142-9208-29b69a44f22a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.153202 Oct 26 05:22:04.196291 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2498/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:04 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:04.407358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:04.407890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:04.415400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.415950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.416394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.417136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.417621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.418052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.552764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:04.561840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9bd6d8f1-c224-4240-ba04-80d93557cb98 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1529 microversion: 2.1 time: 0.158077 Oct 26 05:22:04.562421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2450/4948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:04 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1529 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:04.584939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:04.585583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:04.591589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.592124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.592566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.593257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.593742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.594171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.730291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:04.738213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01cae5ae-544d-4a5b-a69a-00b3160ba155 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1529 microversion: 2.1 time: 0.157146 Oct 26 05:22:04.738788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2499/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:04 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1529 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:04.805521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:04.806026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:04.812614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.813099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.813577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.814270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.814726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.815154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.828837 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] HTTP exception thrown: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Request method failure captured: Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 HTTP/1.1 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPmkczo58r0jOu21aXks2OxIx7BuRpmAJja9UNqee9ExQcO2sSDk55Sw-j6xnAQDdO9e7WlI9sDFoJ4N_nA7EJjmQiABe8hKqod12Co93bmrS2r9AZU5saYZM3Mgbx4LH58_K8EZQz56-n3cL1FPs4nTPS7bntT68T1r2Izk5j5uEA Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 4071eccb53b748faa7e1c145ad797e4d Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1474257145 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1474257145 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 4071eccb53b748faa7e1c145ad797e4d Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1474257145 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1474257145-project Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: bc333039bfd34c7b92aeba355479e076 Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1474257145-project Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a95f70dc-8db0-4569-9e07-2027e17b4871'} Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:04.830543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Returning 404 to user: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1dd7bd3d-2118-4200-aacd-c71b834a3155 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 404 len: 111 microversion: 2.1 time: 0.075491 Oct 26 05:22:04.835162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2451/4950] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:04 2022] DELETE /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:22:04.836023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:04.836023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:04.840302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.840801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.841250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.841494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:04.842151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.842287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:04.842717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.843160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.848146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.849028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.849157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:04.849879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:04.850228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:04.850664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.043445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:05.047769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:05.052931 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eee298aa-3862-411d-bef2-ea85626c6aa5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 200 len: 1509 microversion: 2.1 time: 0.223306 Oct 26 05:22:05.053863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2500/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:04 2022] GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:05.055739 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f15fb0fb-2b75-4749-b4a5-a2818feaed1e tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1529 microversion: 2.1 time: 0.217809 Oct 26 05:22:05.056304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2452/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:04 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1529 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:05.079512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Action: 'update', calling method: >, body: {"server": {"name": "a95f70dc-8db0-4569-9e07-2027e17b4871_new"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:05.082187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:05.088501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.088992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.089468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.090624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.091089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.091522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.106937 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] HTTP exception thrown: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Request method failure captured: Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: request: PUT /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 HTTP/1.1 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 64 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMPmkczo58r0jOu21aXks2OxIx7BuRpmAJja9UNqee9ExQcO2sSDk55Sw-j6xnAQDdO9e7WlI9sDFoJ4N_nA7EJjmQiABe8hKqod12Co93bmrS2r9AZU5saYZM3Mgbx4LH58_K8EZQz56-n3cL1FPs4nTPS7bntT68T1r2Izk5j5uEA Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4071eccb53b748faa7e1c145ad797e4d Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1474257145 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4071eccb53b748faa7e1c145ad797e4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1474257145 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4071eccb53b748faa7e1c145ad797e4d Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1474257145 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1474257145-project Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: bc333039bfd34c7b92aeba355479e076 Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1474257145-project Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "a95f70dc-8db0-4569-9e07-2027e17b4871_new"}} Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'a95f70dc-8db0-4569-9e07-2027e17b4871', 'body': {'server': {'name': 'a95f70dc-8db0-4569-9e07-2027e17b4871_new'}}} Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:22:05.109262 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] Returning 404 to user: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-109ebf42-b23e-45b0-9895-1e2ec9cae8b2 tempest-ServersNegativeTestMultiTenantJSON-1474257145 tempest-ServersNegativeTestMultiTenantJSON-1474257145-project] 10.222.0.16 "PUT /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 404 len: 111 microversion: 2.1 time: 0.035370 Oct 26 05:22:05.113027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2501/4953] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:22:05 2022] PUT /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:22:05.120361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:05.120875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:05.127424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.127923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.128373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.129077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.129571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.130004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.158473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:22:05.220307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:05.221046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:05.231020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.232060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.234256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.235695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.236387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.237865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.259389 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf21187f-932f-45cb-9eaf-1da1cf099d09 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 204 len: 0 microversion: 2.1 time: 0.142629 Oct 26 05:22:05.264339 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2453/4954] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:05 2022] DELETE /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:22:05.272881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:05.273898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:05.276113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:05.282314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.282314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.283261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.284229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.285465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.285465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.580467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:05.591271 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bb62a8f0-24bc-48c3-b99b-2e0a073265ba tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1535 microversion: 2.1 time: 0.325996 Oct 26 05:22:05.592289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2454/4955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:05 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1535 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:05.598535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:05.619971 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97fc9ed8-cfdf-4589-b83a-1b9d8f79b3fa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.404387 Oct 26 05:22:05.620786 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2502/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:05 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:05.640991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-853792a2-d573-420b-9680-0b0b67e2dc70 req-1ff413cf-73eb-4648-88ea-c465e9673ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cdfc5c3-6228-4f21-ba6c-985707f235b4", "name": "network-vif-deleted", "tag": "0f5cce9d-3c66-4014-8cee-84347640d1af"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:05.654962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-853792a2-d573-420b-9680-0b0b67e2dc70 req-1ff413cf-73eb-4648-88ea-c465e9673ca1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.655458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-853792a2-d573-420b-9680-0b0b67e2dc70 req-1ff413cf-73eb-4648-88ea-c465e9673ca1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.658052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-853792a2-d573-420b-9680-0b0b67e2dc70 req-1ff413cf-73eb-4648-88ea-c465e9673ca1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.677542 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-853792a2-d573-420b-9680-0b0b67e2dc70 req-1ff413cf-73eb-4648-88ea-c465e9673ca1 service nova] Creating event network-vif-deleted:0f5cce9d-3c66-4014-8cee-84347640d1af for instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 on n-h1-862416-4 Oct 26 05:22:05.687077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-853792a2-d573-420b-9680-0b0b67e2dc70 req-1ff413cf-73eb-4648-88ea-c465e9673ca1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049758 Oct 26 05:22:05.687864 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2455/4957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:05.846364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9d9ee0fa-fad8-4dd0-aaf0-c347aa32089f req-532f7e71-9e38-4ea9-81d3-5c5971844257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1107d896-e11d-48de-a12c-37a33530d0c6", "name": "network-vif-deleted", "tag": "7318ec2e-df37-445b-a6a2-ac58a72f0eea"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:05.859930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9d9ee0fa-fad8-4dd0-aaf0-c347aa32089f req-532f7e71-9e38-4ea9-81d3-5c5971844257 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:05.860446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9d9ee0fa-fad8-4dd0-aaf0-c347aa32089f req-532f7e71-9e38-4ea9-81d3-5c5971844257 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:05.861212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9d9ee0fa-fad8-4dd0-aaf0-c347aa32089f req-532f7e71-9e38-4ea9-81d3-5c5971844257 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:05.875594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9d9ee0fa-fad8-4dd0-aaf0-c347aa32089f req-532f7e71-9e38-4ea9-81d3-5c5971844257 service nova] Creating event network-vif-deleted:7318ec2e-df37-445b-a6a2-ac58a72f0eea for instance 1107d896-e11d-48de-a12c-37a33530d0c6 on n-h2-862416-4 Oct 26 05:22:05.880756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9d9ee0fa-fad8-4dd0-aaf0-c347aa32089f req-532f7e71-9e38-4ea9-81d3-5c5971844257 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038851 Oct 26 05:22:05.881687 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2503/4958] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:06.079114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:06.079817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:06.085962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.086440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.086888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:06.087574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.088028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.088457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:06.120920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.121428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.121867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:06.122313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lazy-loading 'fault' on Instance uuid 6cdfc5c3-6228-4f21-ba6c-985707f235b4 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:06.163478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:06.172052 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-391b9c58-e6fd-489d-95c2-d95bb200bda5 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 200 len: 1307 microversion: 2.1 time: 0.097573 Oct 26 05:22:06.172637 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2456/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:06 2022] GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:06.615843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:06.616609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:06.622967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.624152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.624599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:06.625343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.625817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.626247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:06.647825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:06.648438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:06.655201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.655685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.656133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:06.656831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:06.657289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:06.657807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.227440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:07.235318 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7fadcbf6-cafa-4d86-b056-a0bf2ff378c6 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1535 microversion: 2.1 time: 0.624704 Oct 26 05:22:07.235909 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2504/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:06 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1535 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:07.236856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:07.240617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:07.241410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 6cdfc5c3-6228-4f21-ba6c-985707f235b4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:07.247677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:07.248180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:07.248840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.249746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:07.250394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:07.251111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.255347 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d28d7f4f-d215-4b27-8362-2e4b126331f2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.611286 Oct 26 05:22:07.256394 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2457/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:06 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:07.283279 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] HTTP exception thrown: Instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 could not be found. Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Request method failure captured: Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 HTTP/1.1 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMPB8aBvqnz_O1UkGQjgZbIqkTFa-DThTdwOb-rjLMr4-ySPvO6Sef2MWdHhihDoeECwQVOGusm0x_A59PwFLJp48xowNTh-YK7wYyrBVIb5iLJgJViJ1XWoJ24HqKYdifDGpVqjRLfGrYQCsuPA1uJpMU1fimmbgP1rCQFD3ugMORQ Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3c7ce43c6f1042d59ffd21119d7be69d Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-MultipleCreateTestJSON-1914419306 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-MultipleCreateTestJSON-1914419306 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3c7ce43c6f1042d59ffd21119d7be69d Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1914419306 Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-MultipleCreateTestJSON-1914419306-project Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dc34b61591f544fd9f3b422d78d481ff Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-MultipleCreateTestJSON-1914419306-project Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 could not be found. Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '6cdfc5c3-6228-4f21-ba6c-985707f235b4'} Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 could not be found. Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 could not be found. Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:07.284971 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 could not be found. Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Returning 404 to user: Instance 6cdfc5c3-6228-4f21-ba6c-985707f235b4 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-385f19d7-304f-4f53-a021-db1b24c47a2e tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4" status: 404 len: 111 microversion: 2.1 time: 0.049981 Oct 26 05:22:07.289048 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2505/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:07 2022] GET /compute/v2.1/servers/6cdfc5c3-6228-4f21-ba6c-985707f235b4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:22:07.296052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:07.296674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:07.303520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:07.304016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:07.304459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.305161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:07.305659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:07.306115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.338256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:07.338520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:07.338789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.339237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lazy-loading 'fault' on Instance uuid 1107d896-e11d-48de-a12c-37a33530d0c6 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:07.384444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:07.392682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-909a32d2-ab7f-43d7-85b7-4b26d79ff1cf tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1307 microversion: 2.1 time: 0.100574 Oct 26 05:22:07.393260 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2458/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:07 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:07.896257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3f60a7c6-fd0f-49b3-bcf6-b612c5f3d743 req-6aa6df59-c30c-48dd-8123-94bc41cf6284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95f70dc-8db0-4569-9e07-2027e17b4871", "name": "network-vif-deleted", "tag": "6d89fc4c-e8ca-4b1f-922f-476112b0b62b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:07.907069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3f60a7c6-fd0f-49b3-bcf6-b612c5f3d743 req-6aa6df59-c30c-48dd-8123-94bc41cf6284 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:07.907549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3f60a7c6-fd0f-49b3-bcf6-b612c5f3d743 req-6aa6df59-c30c-48dd-8123-94bc41cf6284 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:07.907984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3f60a7c6-fd0f-49b3-bcf6-b612c5f3d743 req-6aa6df59-c30c-48dd-8123-94bc41cf6284 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:07.918980 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3f60a7c6-fd0f-49b3-bcf6-b612c5f3d743 req-6aa6df59-c30c-48dd-8123-94bc41cf6284 service nova] Creating event network-vif-deleted:6d89fc4c-e8ca-4b1f-922f-476112b0b62b for instance a95f70dc-8db0-4569-9e07-2027e17b4871 on n-h2-862416-4 Oct 26 05:22:07.924553 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3f60a7c6-fd0f-49b3-bcf6-b612c5f3d743 req-6aa6df59-c30c-48dd-8123-94bc41cf6284 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Oct 26 05:22:07.925117 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2506/4964] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:08.259373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:08.259921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:08.267436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.267924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.268364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.269060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.269548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.269978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.281234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:08.281995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:08.288201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.288692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.289161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.289867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.290336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.290772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.340602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9553bf2925af436293d8f198de2e882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15dca088aadb4ae8a86cfa4ea5c77ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:08.351097 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aca8a2b2-940c-4639-8eba-5fc96bd8736c tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 200 len: 1493 microversion: 2.1 time: 0.095465 Oct 26 05:22:08.351701 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2459/4965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:08 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 1493 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:08.416772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:08.417638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:08.426279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.427261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.428037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.429168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.429794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.430673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.478817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.479305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.479943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.480548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lazy-loading 'fault' on Instance uuid 1107d896-e11d-48de-a12c-37a33530d0c6 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:08.484926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:08.498974 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2705c6ff-5d1f-42f5-ad06-694742cd81c2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.223032 Oct 26 05:22:08.499945 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2507/4966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:08 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:08.522823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:08.523770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:08.531441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.532323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.533212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.534279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:08.534829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:08.535299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:08.546879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc34b61591f544fd9f3b422d78d481ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7ce43c6f1042d59ffd21119d7be69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:08.556670 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5429f8f0-fd8f-4845-9826-f2c0fddfd876 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 200 len: 1307 microversion: 2.1 time: 0.144000 Oct 26 05:22:08.558957 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2460/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:08 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:08.564861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0758358-f979-493c-a2ae-a20a7ff9b76d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/ips" status: 200 len: 152 microversion: 2.20 time: 0.046375 Oct 26 05:22:08.565708 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2508/4968] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 26 05:22:08 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:22:09.375760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:09.376485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] [instance: a95f70dc-8db0-4569-9e07-2027e17b4871] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:09.383492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:09.383985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:09.384420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:09.385123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:09.385612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:09.386041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:09.401729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] HTTP exception thrown: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Request method failure captured: Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 HTTP/1.1 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPacnE-w_Va-QCwZV99UhdL5-ifj_JhKb4eivBXtoiZJegZSOY8EaGFq4Bb1TAnwlcInFLmgGhTuW_HcT_52-idrryyuKLhkETqfZZb1jpPAmRvh1sJCwd9VG3_w_dcKp0JTaPaoj5Eac761_yeZXXy2zON5EJ_CPz4KDa5TDrRASc Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 15dca088aadb4ae8a86cfa4ea5c77ca1 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1946178155 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15dca088aadb4ae8a86cfa4ea5c77ca1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15dca088aadb4ae8a86cfa4ea5c77ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15dca088aadb4ae8a86cfa4ea5c77ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15dca088aadb4ae8a86cfa4ea5c77ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1946178155 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 15dca088aadb4ae8a86cfa4ea5c77ca1 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1946178155 Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1946178155-project Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9553bf2925af436293d8f198de2e882d Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1946178155-project Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a95f70dc-8db0-4569-9e07-2027e17b4871'} Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:09.403616 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] Returning 404 to user: Instance a95f70dc-8db0-4569-9e07-2027e17b4871 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-caed79c5-6e9f-45ff-aafc-584a45967a31 tempest-ServersNegativeTestMultiTenantJSON-1946178155 tempest-ServersNegativeTestMultiTenantJSON-1946178155-project] 10.222.0.16 "GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871" status: 404 len: 111 microversion: 2.1 time: 0.033687 Oct 26 05:22:09.408945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2461/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:09 2022] GET /compute/v2.1/servers/a95f70dc-8db0-4569-9e07-2027e17b4871 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:22:09.525262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:09.526199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:09.534064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:09.534842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:09.535575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:09.536970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:09.537748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:09.538344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:09.582389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:09.583221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] [instance: 1107d896-e11d-48de-a12c-37a33530d0c6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:09.591744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:09.592463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:09.593167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:09.594095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:09.594743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:09.595335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:09.615820 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] HTTP exception thrown: Instance 1107d896-e11d-48de-a12c-37a33530d0c6 could not be found. Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Request method failure captured: Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 HTTP/1.1 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPB8aBvqnz_O1UkGQjgZbIqkTFa-DThTdwOb-rjLMr4-ySPvO6Sef2MWdHhihDoeECwQVOGusm0x_A59PwFLJp48xowNTh-YK7wYyrBVIb5iLJgJViJ1XWoJ24HqKYdifDGpVqjRLfGrYQCsuPA1uJpMU1fimmbgP1rCQFD3ugMORQ Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3c7ce43c6f1042d59ffd21119d7be69d Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-MultipleCreateTestJSON-1914419306 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c7ce43c6f1042d59ffd21119d7be69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-MultipleCreateTestJSON-1914419306 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3c7ce43c6f1042d59ffd21119d7be69d Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1914419306 Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-MultipleCreateTestJSON-1914419306-project Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dc34b61591f544fd9f3b422d78d481ff Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-MultipleCreateTestJSON-1914419306-project Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1107d896-e11d-48de-a12c-37a33530d0c6 could not be found. Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1107d896-e11d-48de-a12c-37a33530d0c6'} Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1107d896-e11d-48de-a12c-37a33530d0c6 could not be found. Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1107d896-e11d-48de-a12c-37a33530d0c6 could not be found. Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:09.619446 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1107d896-e11d-48de-a12c-37a33530d0c6 could not be found. Oct 26 05:22:09.624994 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:09.626456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] Returning 404 to user: Instance 1107d896-e11d-48de-a12c-37a33530d0c6 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:09.627556 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1879bdb0-bf12-47f7-9152-2435a9099fe7 tempest-MultipleCreateTestJSON-1914419306 tempest-MultipleCreateTestJSON-1914419306-project] 10.222.0.16 "GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6" status: 404 len: 111 microversion: 2.1 time: 0.049514 Oct 26 05:22:09.628678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2462/4970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:09 2022] GET /compute/v2.1/servers/1107d896-e11d-48de-a12c-37a33530d0c6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:22:09.823964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:09.832546 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-567e97dc-1927-4ce6-8259-6f4d0f1c1afb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1506 microversion: 2.1 time: 0.312194 Oct 26 05:22:09.833325 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2509/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:09 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:10.465367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:10.465961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:10.473171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:10.473963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:10.474592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:10.475489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:10.476112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:10.476707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:10.492874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:10.508181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lazy-loading 'flavor' on Instance uuid 91f53604-8fda-4485-bcee-5e4e794cd058 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:10.759833 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85624e67-b947-4ef8-9084-356199970d8b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/action" status: 202 len: 0 microversion: 2.20 time: 0.299204 Oct 26 05:22:10.765252 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2463/4972] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:22:10 2022] POST /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:22:10.778594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:10.780768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:10.796433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:10.797506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:10.798219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:10.799698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:10.804250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:10.805212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:10.858075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:10.859464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:10.868162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:10.868572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:10.869151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:10.869921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:10.870723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:10.871214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:11.110260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:11.114109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:11.122271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:11.131192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:11.132799 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d082510b-fa99-4e1f-b614-48de9368b962 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.364023 Oct 26 05:22:11.133842 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2510/4973] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:10 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:11.143224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:11.151109 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ab781d7-f477-447b-be9e-a514de46a15e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1486 microversion: 2.1 time: 0.298254 Oct 26 05:22:11.155942 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2464/4974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:10 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1486 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:11.309885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-79694555", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:11.424161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] validate_networks() for [('5955e382-19ae-44ea-9718-3d03e34144a3', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:22:12.159820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:12.161056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:12.168595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:12.169099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:12.169760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:12.170998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:12.171709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:12.172377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:12.458950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:22:12.460035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:22:12.461646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:22:12.462192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:22:12.463059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:22:12.483568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:12.484496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:12.485171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:12.486146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:12.486838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:12.487632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:12.519866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Getting quotas for project 945d499d0daa4ad196f3f99a9f48c1bd. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:22:12.527010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Getting quotas for user 65ac46030b2744868d7235c5badf4cf2 and project 945d499d0daa4ad196f3f99a9f48c1bd. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:22:12.546595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:22:12.549734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:22:12.580341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:12.595811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:12.600855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:12.604358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d13e2141-5857-4300-b8d6-47b425016293 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.448931 Oct 26 05:22:12.617341 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2465/4975] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:12 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:22:12.638349 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f47b793d-ff4c-4bff-a312-f8b0c898faa8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.333151 Oct 26 05:22:12.640998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2511/4976] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:22:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:22:12.655242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80a1535d-bd13-4218-a0bb-8529966af929 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:12.655897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80a1535d-bd13-4218-a0bb-8529966af929 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:12.788835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-80a1535d-bd13-4218-a0bb-8529966af929 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:12.799043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80a1535d-bd13-4218-a0bb-8529966af929 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1212 microversion: 2.1 time: 0.150705 Oct 26 05:22:12.800162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2466/4977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:12 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:13.642877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:13.644498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:13.652850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:13.656605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:13.656605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:13.656605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:13.657068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:13.657537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:13.825448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:13.827499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:13.853961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:13.854575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:13.855902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:13.860734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:13.861254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:13.861748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:14.339024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:14.354839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b56c6289-be0f-4536-b28c-e65b93c57ca7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1264 microversion: 2.1 time: 0.532719 Oct 26 05:22:14.381367 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2467/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:13 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1264 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:14.601667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:14.636362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:14.638248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:14.639862 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-172e7e18-7105-4f3a-8664-32e8bdbb0df1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 1.003699 Oct 26 05:22:14.640609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2512/4979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:13 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:15.400360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:15.402014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:15.410234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:15.411115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:15.411909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:15.413099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:15.413787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:15.414951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:15.666250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:15.667697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:15.677398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:15.678184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:15.679137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:15.680099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:15.680777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:15.681442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:15.754823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:15.774705 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a37e583-7573-40ab-b2ab-e66ab5c2eec5 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.373121 Oct 26 05:22:15.778690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2468/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:15 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:15.920976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:15.932642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:15.934686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:15.936760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d654c516-c033-4750-b90c-dbe7514c2665 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.274263 Oct 26 05:22:15.937785 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2513/4981] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:15 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:22:16.431165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cc70bad8-40f6-48be-b131-8ae9fef171e5 req-efe421ea-b2aa-4f70-8d5d-a54ca2f11a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c", "tag": "96185633-d091-4579-8072-65eecf07dee0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:16.456811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cc70bad8-40f6-48be-b131-8ae9fef171e5 req-efe421ea-b2aa-4f70-8d5d-a54ca2f11a75 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:16.457672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cc70bad8-40f6-48be-b131-8ae9fef171e5 req-efe421ea-b2aa-4f70-8d5d-a54ca2f11a75 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:16.458331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cc70bad8-40f6-48be-b131-8ae9fef171e5 req-efe421ea-b2aa-4f70-8d5d-a54ca2f11a75 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:16.473027 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cc70bad8-40f6-48be-b131-8ae9fef171e5 req-efe421ea-b2aa-4f70-8d5d-a54ca2f11a75 service nova] Creating event network-changed:96185633-d091-4579-8072-65eecf07dee0 for instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c on n-h2-862416-4 Oct 26 05:22:16.478627 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cc70bad8-40f6-48be-b131-8ae9fef171e5 req-efe421ea-b2aa-4f70-8d5d-a54ca2f11a75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055362 Oct 26 05:22:16.479840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2469/4982] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:16.805753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:16.806591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:16.819620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:16.822810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:16.823385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:16.824225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:16.825559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:16.826936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:16.969221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:16.970477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:16.991775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:16.992278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:16.992727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:16.998550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:16.999069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:16.999520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:17.067689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:17.108880 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5305fafc-cd4d-435f-8fb3-4a53fbbc599b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.305717 Oct 26 05:22:17.112633 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2514/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:16 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:17.580274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:17.582663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:17.599522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:17.605124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:17.607182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:17.611039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:17.612752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:17.613246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:17.617068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:17.628769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:17.632110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:17.633367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-deeddbb5-430a-49dc-8449-3850291b4ad2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.670065 Oct 26 05:22:17.633949 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2470/4984] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:16 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:22:17.710840 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7fa9cca2-6e8e-46af-a48a-9bd0b10adad0 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c/action" status: 200 len: 24572 microversion: 2.1 time: 0.135016 Oct 26 05:22:17.712981 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2515/4985] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:22:17 2022] POST /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c/action => generated 24572 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:22:18.138885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:18.139807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:18.145767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:18.146268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:18.146733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:18.147498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:18.147962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:18.148400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:18.317009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:18.327282 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49d58095-4606-4d8a-9a05-e4e5d46a7e68 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.192500 Oct 26 05:22:18.337342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2471/4986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:18 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:18.671493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:18.673069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:18.682341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:18.683341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:18.684133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:18.685164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:18.686040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:18.686991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:18.971499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:18.987689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:18.989591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:18.991369 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a3846a8-1fe1-4ef5-ae4e-cfa71216b536 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.329619 Oct 26 05:22:18.992546 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2516/4987] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:18 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:19.354044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:19.355094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:19.364100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:19.365230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:19.366089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:19.367082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:19.367785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:19.368509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:19.641478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:19.655886 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88c20ffd-945a-4f52-8bfd-5b1e592dcb51 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.307573 Oct 26 05:22:19.672661 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2472/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:19 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:20.024692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:20.026430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:20.036869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:20.038384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:20.039042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:20.040101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:20.040912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:20.042264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:20.363007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:20.374748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:20.376363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:20.377637 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c31e896-0793-4a3d-a228-2abfbff25ee9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.359079 Oct 26 05:22:20.378592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2517/4989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:20 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:20.452657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:20.453947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:20.461531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:20.462801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:20.463435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:20.464393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:20.464825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:20.465464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:20.500039 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a538dab3-3ba9-435b-8f30-93eef2d07b84 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/ips" status: 200 len: 150 microversion: 2.1 time: 0.058266 Oct 26 05:22:20.508804 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2473/4990] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:22:20 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:20.680216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:20.680902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:20.687982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:20.689906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:20.690540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:20.691478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:20.692511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:20.693599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:20.694227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:21.007842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:21.023594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2739771a-ec23-41e0-b270-bc1feff089a4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.346931 Oct 26 05:22:21.027005 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2518/4991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:20 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:21.417009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:21.418076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:21.433435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:21.434627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:21.435864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:21.442593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:21.443466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:21.444151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:21.940894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:21.958517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:21.974341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:21.981791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a116162-b441-4392-8369-37e37a29f00d tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.573751 Oct 26 05:22:21.991076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2474/4992] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:21 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:22.055637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:22.057011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:22.066158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:22.067099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:22.067940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:22.069189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:22.069903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:22.070596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:22.284420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:22.299041 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cf8003c-b59f-48a1-92a2-eb64ab78d894 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.250162 Oct 26 05:22:22.299853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2519/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:22 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:23.027466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:23.028107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:23.031270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:23.037083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:23.037987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:23.039077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:23.039975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:23.040606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:23.041206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:23.121232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93061030-c3b7-4f1e-9699-62308caa18a4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:23.124519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:23.126741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:23.131767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:23.144522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:23.146183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:23.146880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:23.147845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:23.149650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:23.150347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:23.339115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:23.350014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:23.351805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:23.353350 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4179d35-d0d0-4467-a509-cf89c4097b4c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.330693 Oct 26 05:22:23.354236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2475/4994] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:23 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:23.360338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:23.361021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:23.369537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:23.370445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:23.371232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:23.373280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:23.387094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:23.393985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:23.583666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6280f06a-a15f-434d-9934-d9beba6dcb6d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "POST /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466430 Oct 26 05:22:23.595828 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2520/4995] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:22:23 2022] POST /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:23.981294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:23.992802 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee9f67fc-83cb-4c21-a6e4-194ea8aeda50 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.637124 Oct 26 05:22:23.995776 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2476/4996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:23 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:24.070320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e580187e-0bb6-46e9-8b9d-b967ba83fc25 req-bb5ec89a-4978-4688-b8a9-4d946cc1fae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c", "name": "network-vif-plugged", "status": "completed", "tag": "96185633-d091-4579-8072-65eecf07dee0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:24.094096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e580187e-0bb6-46e9-8b9d-b967ba83fc25 req-bb5ec89a-4978-4688-b8a9-4d946cc1fae5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:24.094911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e580187e-0bb6-46e9-8b9d-b967ba83fc25 req-bb5ec89a-4978-4688-b8a9-4d946cc1fae5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:24.095516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e580187e-0bb6-46e9-8b9d-b967ba83fc25 req-bb5ec89a-4978-4688-b8a9-4d946cc1fae5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:24.128194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e580187e-0bb6-46e9-8b9d-b967ba83fc25 req-bb5ec89a-4978-4688-b8a9-4d946cc1fae5 service nova] Creating event network-vif-plugged:96185633-d091-4579-8072-65eecf07dee0 for instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c on n-h2-862416-4 Oct 26 05:22:24.148986 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e580187e-0bb6-46e9-8b9d-b967ba83fc25 req-bb5ec89a-4978-4688-b8a9-4d946cc1fae5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078350 Oct 26 05:22:24.150116 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2521/4997] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:24.383043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:24.384308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:24.404925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:24.405897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:24.407095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:24.410006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:24.411582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:24.414157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:24.783170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:24.797716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:24.806641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:24.808281 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b521300-e9cf-4dc9-9091-f33efc4cd8c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.431284 Oct 26 05:22:24.822376 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2477/4998] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:24 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:25.019950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:25.020584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:25.031227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:25.031738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:25.036913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:25.042069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:25.042768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:25.043290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:25.319553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:25.334474 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef5c60c0-3aaa-4460-aa50-56cea4dc6ff7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1312 microversion: 2.1 time: 0.319079 Oct 26 05:22:25.338147 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2522/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:25 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:25.358991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-507043061", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "8bcf8a1a-89cc-4457-9e6e-b3e13ee09c1c"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:25.443483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] validate_networks() for [('8bcf8a1a-89cc-4457-9e6e-b3e13ee09c1c', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:22:25.840219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:25.842095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:25.859215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:25.859743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:25.860204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:25.860943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:25.861442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:25.861883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.272110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:26.290359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:26.292201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:26.293111 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bea1252-c803-461c-8c45-da6e37545c04 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.457271 Oct 26 05:22:26.322701 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2523/5000] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:25 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:22:26.350693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:22:26.351822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:22:26.352853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:22:26.358789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:22:26.359702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:22:26.364109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:26.366427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:26.399187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:26.400529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:26.401260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.402897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:26.403179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:26.405491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:26.407276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:26.407688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.408241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.410027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:26.413102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:26.413734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.492363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Getting quotas for project a63b5fd786034e97a05e85cfbe842122. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:22:26.511372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Getting quotas for user c5aa5f1203a741acb729f50babdec5cc and project a63b5fd786034e97a05e85cfbe842122. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:22:26.548670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:22:26.556045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:22:26.688565 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64e7b48c-e97a-409f-8771-2b72700f7fce tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.559129 Oct 26 05:22:26.691513 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2478/5001] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:22:26.704963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e16c9d57-fbcb-4b5c-9e47-04937a50d91b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:26.707564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e16c9d57-fbcb-4b5c-9e47-04937a50d91b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:26.738008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:26.747619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af078c9e-4ed2-4862-b4bb-8e67b745d9f0 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1499 microversion: 2.1 time: 0.392676 Oct 26 05:22:26.748876 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2524/5002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:26 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1499 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:26.780021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:26.793900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:26.820994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:26.823835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:26.825115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.828343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:26.828843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:26.829294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:26.853516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e16c9d57-fbcb-4b5c-9e47-04937a50d91b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:26.882411 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e16c9d57-fbcb-4b5c-9e47-04937a50d91b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1224 microversion: 2.1 time: 0.184833 Oct 26 05:22:26.885976 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2479/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:26 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:26.917516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lazy-loading 'flavor' on Instance uuid 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:27.086842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:27.110448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ea3040e4-3a13-4cbd-8640-204a1e8a0759 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "POST /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c/action" status: 200 len: 32 microversion: 2.1 time: 0.338398 Oct 26 05:22:27.120268 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2525/5004] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:22:26 2022] POST /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c/action => generated 32 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:22:27.144329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:27.145246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:27.172010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:27.174547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:27.176688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:27.180461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:27.181787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:27.184716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:27.336454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:27.338461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:27.369905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:27.373075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:27.377810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:27.378654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:27.379146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:27.379586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:28.146960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:28.169942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:28.184887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:28.197493 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-faa1ba80-de5e-442f-b7c2-896377cc2a6e tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1745 microversion: 2.20 time: 0.868544 Oct 26 05:22:28.203363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2526/5005] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:27 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1745 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:28.228474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:28.241959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:28.280205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:28.281161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:28.283765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:28.286245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:28.289151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:28.292295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:28.407638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:28.439021 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7d8895b6-958c-4928-8360-4e90e4db9ae4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 1.317222 Oct 26 05:22:28.440280 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2480/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:27 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:28.525041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:28.541785 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-db1c2a87-ef45-487d-bc58-303f6c768446 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1220 microversion: 2.1 time: 0.328037 Oct 26 05:22:28.542392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2527/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:28 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1220 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:28.837090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:28.850328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:28.856103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Searching by: {'deleted': False, 'project_id': '54179a76863244dd9be07786911525a6'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:22:28.871531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:28.873131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:28.874752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:28.877211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:28.878918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:28.879587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:28.971366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:22:28.984898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:29.087477 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-122ecf45-2680-4457-ae33-379c29ffbb5a tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.254008 Oct 26 05:22:29.089199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2481/5008] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 05:22:28 2022] GET /compute/v2.1/servers => generated 339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:29.111035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:29.123533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:29.130011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Searching by: {'deleted': False, 'project_id': '54179a76863244dd9be07786911525a6'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 05:22:29.155701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.156428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.162839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.164087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.166274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.168282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.238151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:29.241951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:29.262473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 05:22:29.272118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.274222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.281225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.282720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.297813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.300283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.402136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:29.424682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.429781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.430491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.842794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d508629-87e9-47d7-a094-980b7625d49e tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.742733 Oct 26 05:22:29.843772 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2528/5009] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:22:29 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:29.850031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:29.850781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:29.870826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.871593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.875185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.876496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.879654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.880522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.908468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:29.923893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:29.927738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:29.930674 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3f432ef-e9f4-4e2c-900a-78dd6c555510 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1745 microversion: 2.20 time: 0.702982 Oct 26 05:22:29.945597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2482/5010] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:29 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1745 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:29.948390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:29.949668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:29.967610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.968917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.979242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:29.980576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:29.981201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:29.981741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:30.182267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:30.216101 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82c0f797-0b87-44e8-a59b-1490bf0b0039 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1282 microversion: 2.1 time: 0.279070 Oct 26 05:22:30.226341 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2483/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:29 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1282 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:30.240221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea2eb2e8-1459-487f-8acc-d1016e044e2d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:30.256621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea2eb2e8-1459-487f-8acc-d1016e044e2d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028022 Oct 26 05:22:30.259437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:30.260297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2484/5012] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:22:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:30.286920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d8dd05e-2647-410f-a09a-83771cf655c8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.441920 Oct 26 05:22:30.288008 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2529/5013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:29 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:30.461708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-52ffd585-cf2e-496e-9581-ec2c59072be8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: .version_select at 0x7f470a8d04c0>, body: {"keypair": {"name": "tempest-keypair-2046718712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIe02o3OMP0xYrrF7nI+AhYw6/btJXx1mV/h4k7cSjQ9gmk13a8d1hgeW2MudLvU6F9Kbz/BOtJP6HlFp05XdbmeYfElJ6mM5Juq3cbJq+mzNmkPSe+Gmi2O/FOCpNyQw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:30.492750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-52ffd585-cf2e-496e-9581-ec2c59072be8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for project bd4061413c95466b9bc8c80b8791be6a. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:22:30.501170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-52ffd585-cf2e-496e-9581-ec2c59072be8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for user b095e3b8ee8c4fdca403334607c79df2 and project bd4061413c95466b9bc8c80b8791be6a. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:22:30.560590 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-52ffd585-cf2e-496e-9581-ec2c59072be8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182266 Oct 26 05:22:30.579547 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2485/5014] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:22:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:30.589034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:30.590022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:30.603375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:30.606153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:30.608305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:30.610092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:30.610820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:30.613061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:30.682052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:22:30.818095 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d40b027a-4143-41f4-82cb-d422cfb52bde tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 204 len: 0 microversion: 2.1 time: 0.233225 Oct 26 05:22:30.819243 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2530/5015] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:30 2022] DELETE /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:22:30.829476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:30.830103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:30.837297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:30.838077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:30.838736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:30.839741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:30.840677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:30.841944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:30.970481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:30.973124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:30.982713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:30.983752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:30.984492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:30.985629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:30.986342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:30.987022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:31.120638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:31.129465 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e5fe473-f7dd-4102-8b4a-f056a0724bb4 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1715 microversion: 2.1 time: 0.305235 Oct 26 05:22:31.130330 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2486/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:30 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1715 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:31.251207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:31.252388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:31.256374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:31.262740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:31.263692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:31.264475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:31.265474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:31.266053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:31.266596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:31.329660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:31.338413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:31.339870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:31.341263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e981c9d-5dc5-4f43-a2e3-3e52a052fa5f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1745 microversion: 2.20 time: 0.380765 Oct 26 05:22:31.358450 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2531/5017] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:30 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1745 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:31.377564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:31.377922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:31.389651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:31.390083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:31.390514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:31.391272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:31.391733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:31.392163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:32.772037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:32.789203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e20d1a0c-4377-4a99-854e-f6145444df76 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 1.543649 Oct 26 05:22:32.809756 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2487/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:31 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:32.832193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cea6e9d1-7fff-4ccc-a5cf-bb74a2e585f4 req-6f51773e-564b-45ab-aa95-2645681f7f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "name": "network-vif-plugged", "status": "completed", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:32.853178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cea6e9d1-7fff-4ccc-a5cf-bb74a2e585f4 req-6f51773e-564b-45ab-aa95-2645681f7f9c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:32.853688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cea6e9d1-7fff-4ccc-a5cf-bb74a2e585f4 req-6f51773e-564b-45ab-aa95-2645681f7f9c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:32.854123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cea6e9d1-7fff-4ccc-a5cf-bb74a2e585f4 req-6f51773e-564b-45ab-aa95-2645681f7f9c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:32.890001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:32.914844 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0155e367-2cd8-455e-a393-ad3d939ba023 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 1.555530 Oct 26 05:22:32.930404 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2532/5019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:31 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:32.939252 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cea6e9d1-7fff-4ccc-a5cf-bb74a2e585f4 req-6f51773e-564b-45ab-aa95-2645681f7f9c service nova] Creating event network-vif-plugged:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:22:32.960661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:32.963751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:32.970552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cea6e9d1-7fff-4ccc-a5cf-bb74a2e585f4 req-6f51773e-564b-45ab-aa95-2645681f7f9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150054 Oct 26 05:22:32.974258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2488/5020] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:33.001652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.002674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.006095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:33.006921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.009095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.009760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:33.010643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.013525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.030603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.033663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.034371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.038489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.039421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.041806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.395793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:33.407876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b80e51ac-dbd4-4a91-a99d-8aed80cf2a24 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1715 microversion: 2.1 time: 0.470802 Oct 26 05:22:33.430946 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2533/5021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:32 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1715 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:33.717461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:33.733638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:33.735940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:33.741136 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a97bd5d-67fc-4741-a171-658e07abd0b2 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1745 microversion: 2.20 time: 0.756244 Oct 26 05:22:33.744109 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2489/5022] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:32 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1745 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:33.823975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:33.824589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:33.840177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.841181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.841655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.846007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.846475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.848407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.910098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5d32f5af-dc24-4680-9e5a-ece353659a74 req-692ea924-9892-4be9-a610-d2f97063ec16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df018771-9727-484c-a409-29d9119c1c45", "tag": "6c6028b3-d3ba-42c3-842b-48d7055f8fe6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:33.943233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5d32f5af-dc24-4680-9e5a-ece353659a74 req-692ea924-9892-4be9-a610-d2f97063ec16 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:33.943748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5d32f5af-dc24-4680-9e5a-ece353659a74 req-692ea924-9892-4be9-a610-d2f97063ec16 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:33.948604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5d32f5af-dc24-4680-9e5a-ece353659a74 req-692ea924-9892-4be9-a610-d2f97063ec16 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:33.998552 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5d32f5af-dc24-4680-9e5a-ece353659a74 req-692ea924-9892-4be9-a610-d2f97063ec16 service nova] Creating event network-changed:6c6028b3-d3ba-42c3-842b-48d7055f8fe6 for instance df018771-9727-484c-a409-29d9119c1c45 on n-h2-862416-4 Oct 26 05:22:34.022451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5d32f5af-dc24-4680-9e5a-ece353659a74 req-692ea924-9892-4be9-a610-d2f97063ec16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116011 Oct 26 05:22:34.025770 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2490/5023] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:34.051634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:34.053258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:34.062744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:34.063370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:34.063826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:34.064569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:34.065037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:34.065729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:34.391266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:34.402133 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-efdc2b97-07ec-4ea9-9131-b0cac360f693 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.582662 Oct 26 05:22:34.404456 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2534/5024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:33 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:34.440916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:34.442113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:34.454728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:34.455477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:34.458489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:34.463072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:34.464971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:34.467362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:34.586436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:34.596611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-153ff8be-9775-4712-a884-2059c073929f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.569031 Oct 26 05:22:34.597149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2491/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:34 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:34.656760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:34.667868 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b66323a-30e1-424b-adce-f111a9facc6d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1647 microversion: 2.1 time: 0.233159 Oct 26 05:22:34.671061 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2535/5026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:34 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1647 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:34.776697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:34.777336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:34.799376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:34.799917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:34.803453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:34.804283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:34.810500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:34.811973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:35.429821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:35.430446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:35.449404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:35.454188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:35.456627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:35.459612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:35.460778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:35.464470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:35.491940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:35.523545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:35.528136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:35.530898 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4050fab4-6143-4b18-89c4-807c5a0841db tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.758418 Oct 26 05:22:35.558385 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2492/5027] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:34 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:35.623639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:35.624518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:35.634642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:35.635420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:35.637164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:35.638336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:35.641750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:35.642436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.397131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:36.406199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:36.411464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2e822bd0-3ed1-4471-b314-8e466acd1507 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.789371 Oct 26 05:22:36.412853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2493/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:35 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:36.415483 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b0b98220-16f8-466c-8040-364e47b1a152 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.990240 Oct 26 05:22:36.422506 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2536/5029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:35 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:36.452379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:36.457918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:36.486069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:36.488950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:36.490457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.492727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:36.494766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:36.497021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.597366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:36.600318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:36.605791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.606541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lazy-loading 'fault' on Instance uuid 6435db53-d471-4b69-9d80-cc3858aa36b2 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:36.618294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-66d81ed9-49f4-40c1-8d05-ab9a005d6061 req-230481b6-a32a-4e11-a842-48c04d4392b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6435db53-d471-4b69-9d80-cc3858aa36b2", "name": "network-vif-deleted", "tag": "bb513202-3230-4dff-895a-cbecab25f743"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:36.634379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66d81ed9-49f4-40c1-8d05-ab9a005d6061 req-230481b6-a32a-4e11-a842-48c04d4392b0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:36.641792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66d81ed9-49f4-40c1-8d05-ab9a005d6061 req-230481b6-a32a-4e11-a842-48c04d4392b0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:36.647193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66d81ed9-49f4-40c1-8d05-ab9a005d6061 req-230481b6-a32a-4e11-a842-48c04d4392b0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.679823 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-66d81ed9-49f4-40c1-8d05-ab9a005d6061 req-230481b6-a32a-4e11-a842-48c04d4392b0 service nova] Creating event network-vif-deleted:bb513202-3230-4dff-895a-cbecab25f743 for instance 6435db53-d471-4b69-9d80-cc3858aa36b2 on n-h1-862416-4 Oct 26 05:22:36.686388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e20f383418e34f04bdba95a692ffefd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54179a76863244dd9be07786911525a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:36.690452 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-66d81ed9-49f4-40c1-8d05-ab9a005d6061 req-230481b6-a32a-4e11-a842-48c04d4392b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254982 Oct 26 05:22:36.693264 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2537/5030] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:36.707473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:36.710644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:36.726831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e48c1892-2219-4876-adac-f620c43ba8af tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 200 len: 1366 microversion: 2.1 time: 0.303784 Oct 26 05:22:36.737363 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2494/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:36 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:36.737598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:36.737598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:36.737598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.737598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:36.737598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:36.737598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:36.807528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da8b05d5-5ff3-46b6-9275-6b261d63fe2b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'create', calling method: .version_select at 0x7f470a1e80d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2033597239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3hI2CpzviqoGO70uengEls7BjeU/tF1VL5vsR6i90dCn68c33ZuLteJI0SoKmrswq4OvcqYfpvm9ypYxeKBZWjrfU6Ta6fHTL/0pH+mvOqWgnC1cr11FftXI/2QOxxRQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:36.884655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-da8b05d5-5ff3-46b6-9275-6b261d63fe2b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for project 227e01c08a304cb1b59273127d4ad575. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:22:36.894555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-da8b05d5-5ff3-46b6-9275-6b261d63fe2b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for user 91321abeaa5248beaadc6edf76c96886 and project 227e01c08a304cb1b59273127d4ad575. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:22:36.943200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da8b05d5-5ff3-46b6-9275-6b261d63fe2b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.164083 Oct 26 05:22:36.944131 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2495/5032] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:22:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:37.428076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:37.449226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:37.456437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:37.461153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:37.461823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:37.462472 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd9651b4-1f9e-4644-a5fc-29364f1032d6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.765403 Oct 26 05:22:37.476624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:37.477147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:37.477637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:37.478378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:37.478636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2538/5033] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:36 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:37.483932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:37.484472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:37.500494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:37.501134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:37.516743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:37.522183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:37.523286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:37.524683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:37.525944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:37.527187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:37.818697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:37.828284 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4035a155-45ef-4312-9b3e-d12921cb4098 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.339489 Oct 26 05:22:37.834061 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2539/5034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:37 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:37.846348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-678971818", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "331a04fc-76a7-446e-beb4-ceb20eaaf2d7"}], "security_groups": [{"name": "tempest-securitygroup--691068977"}], "key_name": "tempest-keypair-2046718712", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:38.014445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:38.026883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95ee18ea-34a5-495b-845b-bdef392a6b25 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.582803 Oct 26 05:22:38.029856 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2496/5035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:37 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:38.051221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:38.052069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] [instance: 6435db53-d471-4b69-9d80-cc3858aa36b2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:38.058480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:38.059543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:38.060200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:38.061204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:38.061865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:38.062457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:38.078782 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] HTTP exception thrown: Instance 6435db53-d471-4b69-9d80-cc3858aa36b2 could not be found. Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Request method failure captured: Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 HTTP/1.1 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPHsG3AZMeL-lP9NO6ugsYKlRFe25Ef_69BltqW5xbwQunn85aJnk4FhpZzV0x_3eLemGJ-ibZwKLLC2WG9_fyo1Yh60NsGoL11mI7gjCu2Wsc68cUWmO6p0ufEWatoaztwfYcnHel_iWYvrUMKwzqcHU1kutIpmiOxRAhjZXgVI44 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 54179a76863244dd9be07786911525a6 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestManualDisk-2007507493 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54179a76863244dd9be07786911525a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54179a76863244dd9be07786911525a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54179a76863244dd9be07786911525a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54179a76863244dd9be07786911525a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestManualDisk-2007507493 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 54179a76863244dd9be07786911525a6 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestManualDisk-2007507493 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestManualDisk-2007507493-project Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e20f383418e34f04bdba95a692ffefd9 Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestManualDisk-2007507493-project Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 6435db53-d471-4b69-9d80-cc3858aa36b2 could not be found. Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '6435db53-d471-4b69-9d80-cc3858aa36b2'} Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6435db53-d471-4b69-9d80-cc3858aa36b2 could not be found. Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6435db53-d471-4b69-9d80-cc3858aa36b2 could not be found. Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:38.080913 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6435db53-d471-4b69-9d80-cc3858aa36b2 could not be found. Oct 26 05:22:38.086065 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:38.087391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Returning 404 to user: Instance 6435db53-d471-4b69-9d80-cc3858aa36b2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:38.088460 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a6383a2-1619-405e-971f-e8553194835d tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2" status: 404 len: 111 microversion: 2.1 time: 0.043016 Oct 26 05:22:38.089232 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2497/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:38 2022] GET /compute/v2.1/servers/6435db53-d471-4b69-9d80-cc3858aa36b2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:22:38.098225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54af3721-fe04-412b-bfe0-ca764aa39ae5 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] Calling method '.version_select at 0x7f470a976040>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:38.129840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54af3721-fe04-412b-bfe0-ca764aa39ae5 tempest-ServersTestManualDisk-2007507493 tempest-ServersTestManualDisk-2007507493-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589150838" status: 202 len: 0 microversion: 2.1 time: 0.035731 Oct 26 05:22:38.134652 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2498/5037] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589150838 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:22:38.161852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] validate_networks() for [('331a04fc-76a7-446e-beb4-ceb20eaaf2d7', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:22:38.502465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:38.503388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:38.535906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:38.536570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:38.537205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:38.538364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:38.538987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:38.565284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:38.927968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:39.229619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:39.394463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:39.606119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:39.626965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:39.630317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:39.631798 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4fe3d762-3e8f-4932-9dbd-ded49ae30869 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 1.135759 Oct 26 05:22:39.655792 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2499/5038] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:38 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:22:39.664644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:39.665263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:39.684878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:39.686496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:39.688469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:39.700108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:39.701338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:39.702693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.234844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:40.256086 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1baf141-9d0e-42c7-89d1-60c94ce08c71 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.598534 Oct 26 05:22:40.260228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:22:40.261202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:22:40.261889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:22:40.262461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:22:40.263741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:22:40.276056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:40.276885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:40.278080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.279921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:40.281649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:40.282438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.285620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2500/5039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:39 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:40.294806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:40.296005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:40.311127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for project bd4061413c95466b9bc8c80b8791be6a. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:22:40.317812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for user b095e3b8ee8c4fdca403334607c79df2 and project bd4061413c95466b9bc8c80b8791be6a. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:22:40.331671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:40.337515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:22:40.339448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:40.339877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:22:40.340365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.343112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:40.343789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:40.344406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.484948 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8368adaa-a88d-41b4-842a-bd30bbecc884 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.648798 Oct 26 05:22:40.486871 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2540/5040] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:22:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:22:40.494975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:40.495781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:40.506679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:40.507743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:40.509120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.514838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:40.515526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:40.518032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:40.625345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:40.793665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lazy-loading 'services' on Instance uuid e822d940-00cf-4781-a19a-0b94b133e357 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:22:41.002960 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1592e9cd-51e8-4b38-bde0-32e55e130440 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments/93061030-c3b7-4f1e-9699-62308caa18a4" status: 202 len: 0 microversion: 2.1 time: 0.514482 Oct 26 05:22:41.019598 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2541/5041] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:22:40 2022] DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments/93061030-c3b7-4f1e-9699-62308caa18a4 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:22:41.046461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:41.046962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b944cf16-3a42-4e08-9b75-13879c14cee2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:41.050365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b944cf16-3a42-4e08-9b75-13879c14cee2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:41.059038 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0579bc93-4a4d-42fb-9d03-c11e47afc34c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.771940 Oct 26 05:22:41.071070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2501/5042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:40 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:41.083463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:41.084574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:41.100179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:41.101144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:41.102038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:41.103220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:41.103979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:41.104582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:41.232041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b944cf16-3a42-4e08-9b75-13879c14cee2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:41.255298 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b944cf16-3a42-4e08-9b75-13879c14cee2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1237 microversion: 2.1 time: 0.223880 Oct 26 05:22:41.259793 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2542/5043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:41 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1237 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:41.276021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-122979030", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "98f8ab97-c2d2-4e08-b534-d2f935094c3c"}], "key_name": "tempest-TestNetworkBasicOps-2033597239", "security_groups": [{"name": "tempest-secgroup-smoke-430641539"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:41.550641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:41.565828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:41.570713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:41.572321 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8fcbc2f5-1a60-41f6-b196-5b0e9b07cf31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.500208 Oct 26 05:22:41.586771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2502/5044] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:41 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:41.610418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:41.617290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:41.632830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:41.635061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:41.636630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:41.641047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:41.641665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:41.642135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:41.673977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] validate_networks() for [('98f8ab97-c2d2-4e08-b534-d2f935094c3c', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:22:41.743065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:41.773544 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c2726c5-5ead-4c59-a627-657133c377fd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176560 Oct 26 05:22:41.785002 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2503/5045] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:41 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:41.797177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:41.805820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:41.831931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:41.835857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:41.839273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:41.840264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:41.842260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:41.842938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:42.415744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:42.435494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d41acbc1-99b3-4620-9a6f-384cab48e365 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.645819 Oct 26 05:22:42.436392 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2504/5046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:41 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:42.474132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:42.475024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:42.501709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:42.505573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:42.506245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:42.509689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:42.510355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:42.510978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:43.665761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:43.681797 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8181d5f-b3c0-4836-a4ca-9bfb6016499b tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 1.221160 Oct 26 05:22:43.686062 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2505/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:42 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:43.705846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:43.706535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:43.724929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:43.726096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:43.726571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:43.727314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:43.730114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:43.730615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:43.780863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:22:43.781501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:22:43.781865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:22:43.782342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:22:43.782851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:22:43.802616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:43.803930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:43.805813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:43.813909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:43.814777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:43.815558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:43.897005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for project 227e01c08a304cb1b59273127d4ad575. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:22:43.900500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:43.909558 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-373d9293-d8a9-40cd-8cd1-6c2cf808d4ac tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1295 microversion: 2.1 time: 0.220422 Oct 26 05:22:43.910152 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2506/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:43 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1295 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:43.912236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for user 91321abeaa5248beaadc6edf76c96886 and project 227e01c08a304cb1b59273127d4ad575. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:22:43.937716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:43.938274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:43.947564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:22:43.950483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:22:43.964533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:43.965177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:43.965751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:43.966619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:43.967256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:43.967796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.074134 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb17764f-2229-41da-a528-ced049442df8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.809691 Oct 26 05:22:44.082893 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2543/5049] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:22:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:22:44.096210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:44.100214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:44.133464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.137003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.137675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.140816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.141360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.141810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.208080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d73fc4b-1b69-4770-816e-7c939f745e94 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122720 Oct 26 05:22:44.208080 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2544/5050] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:44 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:44.218481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-695cf6ad-8c4d-476b-9a58-78c8fd321c47 req-b2c01181-95a6-4de7-ab12-a9e8a75f16bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df018771-9727-484c-a409-29d9119c1c45", "name": "network-vif-plugged", "status": "completed", "tag": "6c6028b3-d3ba-42c3-842b-48d7055f8fe6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:44.238904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-695cf6ad-8c4d-476b-9a58-78c8fd321c47 req-b2c01181-95a6-4de7-ab12-a9e8a75f16bb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.239426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-695cf6ad-8c4d-476b-9a58-78c8fd321c47 req-b2c01181-95a6-4de7-ab12-a9e8a75f16bb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.242415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-695cf6ad-8c4d-476b-9a58-78c8fd321c47 req-b2c01181-95a6-4de7-ab12-a9e8a75f16bb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.276188 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-695cf6ad-8c4d-476b-9a58-78c8fd321c47 req-b2c01181-95a6-4de7-ab12-a9e8a75f16bb service nova] Creating event network-vif-plugged:6c6028b3-d3ba-42c3-842b-48d7055f8fe6 for instance df018771-9727-484c-a409-29d9119c1c45 on n-h2-862416-4 Oct 26 05:22:44.299350 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-695cf6ad-8c4d-476b-9a58-78c8fd321c47 req-b2c01181-95a6-4de7-ab12-a9e8a75f16bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079641 Oct 26 05:22:44.301951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2545/5051] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:44.352309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:44.353180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:44.363687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.364190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.364635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.366116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.366587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.367020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.381384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:44.398508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:44.401834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:44.404660 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cafc9f4-4ac9-42c5-95c5-52e78096887c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.493520 Oct 26 05:22:44.420227 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2507/5052] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:43 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:44.420227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-113d12d2-a440-4097-ad4b-3722dfa78905 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:44.420227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-113d12d2-a440-4097-ad4b-3722dfa78905 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:44.532659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-113d12d2-a440-4097-ad4b-3722dfa78905 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:44.549875 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-113d12d2-a440-4097-ad4b-3722dfa78905 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1248 microversion: 2.1 time: 0.134350 Oct 26 05:22:44.552172 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2508/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:44 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1248 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:44.642967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:44.655178 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2b77c8ef-ef71-444f-9ac0-16f934b14f9b tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.319900 Oct 26 05:22:44.656411 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2546/5054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:44 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:44.713086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:44.713882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:44.743786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.744471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.745256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.746270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.747045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.749338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.937573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:44.939133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:44.942473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:44.967342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.968230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.969617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:44.973282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:44.977225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:44.998185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.137292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:45.151776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f59903b-9735-4b06-b1a0-c442a50efe71 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.443743 Oct 26 05:22:45.153219 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2509/5055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:44 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:45.205875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:45.218908 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8c7955c-8513-4f09-bfea-b167e950c45c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1295 microversion: 2.1 time: 0.285943 Oct 26 05:22:45.219702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2547/5056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:44 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1295 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:45.221105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:45.223739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:45.243476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.248611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.249359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.252089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.255092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.256663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.387727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2ea0b7f-0b72-45d5-8d15-c930f10e0f81 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171240 Oct 26 05:22:45.396031 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2510/5057] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:45 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:45.458972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:45.461153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:45.485971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.492922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.495724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.496933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.498243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.508009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.578254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:45.579214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:45.616981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.617915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.624779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.626026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.629169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.635407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.755108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:45.781577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:45.787971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:45.790638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-663208da-5942-42f5-8664-468b33576c31 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.346041 Oct 26 05:22:45.809512 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2548/5058] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:45 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:45.830852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:45.844447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:45.874965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.875567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.877867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.880525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:45.881013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:45.881491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:45.897100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:45.910749 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d7f4351-baf9-4cc6-81d9-9d53927b306d tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1300 microversion: 2.1 time: 0.335702 Oct 26 05:22:45.911699 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2511/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:45 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1300 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:46.157851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:46.167164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f3ebb17-b488-4739-b7f1-5d7a18e740d4 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1324 microversion: 2.1 time: 0.356358 Oct 26 05:22:46.181368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:46.181368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:46.184779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2549/5060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:45 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:46.189503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.191828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.192356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.193156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.196129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.197513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.247597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:46.248520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:46.254896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.257335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.258334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.259567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.266233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.266937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.485084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:46.495142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eaa2a6e5-02d9-489b-b2ae-f5271facf04f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1295 microversion: 2.1 time: 0.253132 Oct 26 05:22:46.500021 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2550/5061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:46 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1295 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:46.523628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:46.530566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:46.553203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.554185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.554836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.558454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.559434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.560467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.642165 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4fd09a19-65d8-416e-97ca-7379706b815d tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139539 Oct 26 05:22:46.643078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2551/5062] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:46 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:46.658335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:46.686850 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02e733a7-a770-419c-a9a7-efe741eb817d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.496291 Oct 26 05:22:46.690522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2512/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:46 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:46.823437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:46.824181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:46.832239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.832884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.833561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.834378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.834947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.835481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.936405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:46.937125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:46.956595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.957482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.958122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:46.959044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:46.963959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:46.964796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.151381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.160911 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05344c14-9347-4a22-a216-7ca94d472ec1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1306 microversion: 2.1 time: 0.228682 Oct 26 05:22:47.169769 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2513/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:46 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:47.198938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:47.199668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:47.223396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.228021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.229059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.233755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.239062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.239829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.284771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.293285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.299319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.303228 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01eeb7c8-ff20-4cd1-8d5e-d885542f89a8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.484159 Oct 26 05:22:47.307090 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2552/5065] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:46 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:47.315863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:47.323723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:47.345363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.346474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.349362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.350429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.352349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.354898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.610852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.631570 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-345186cc-3efc-4e23-8cbf-b2788ba2c4ad tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1522 microversion: 2.1 time: 0.442637 Oct 26 05:22:47.635137 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2514/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:47 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:47.665878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:47.667496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:47.695011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.700991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.703966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.705797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.708463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.710193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.836535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.848685 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b95098e2-c665-44f0-bf8f-f79292f3856a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1295 microversion: 2.1 time: 0.210849 Oct 26 05:22:47.866591 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2515/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:47 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:47.870358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.885542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:47.889779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:47.891292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.892761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:47.894080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff7a8b99-a77e-426d-9f14-014d87112ca1 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2955 microversion: 2.42 time: 0.585665 Oct 26 05:22:47.894654 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2553/5068] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:47 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2955 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:47.910337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.911567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:47.912096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.912212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:47.914196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.917363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.918423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.919472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.920256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.920587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.921021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:47.924587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.930173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:47.931526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:47.996625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] HTTP exception thrown: Instance is not a member of specified network Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Request method failure captured: Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45/ips/invalid HTTP/1.1 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMQQ5MxQyZubH3dD52JqOKW5y8jDSGrETWx8EA1-1At8-Gwn5BrgqtcZBjbrWoV_d88vbzdkpZOo3LbBJDEuGvF7YUpJkgeMnGVCcu1sgleJCxuIFa3mbmc0ilmeuJR7oXrH29D2Ui40eRtjUqPUy9nFjGnY4grF_w9RpjZ-zaYZYWo Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a63b5fd786034e97a05e85cfbe842122 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a63b5fd786034e97a05e85cfbe842122 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerAddressesNegativeTestJSON-2040219577-project Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c5aa5f1203a741acb729f50babdec5cc Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2040219577-project Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance is not a member of specified network Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': 'df018771-9727-484c-a409-29d9119c1c45', 'id': 'invalid'} Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 26 05:22:48.006959 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.014514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dae4323c-9db2-40e0-bcef-312112ee5eba tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136745 Oct 26 05:22:48.018539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:48.019845 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-126a02cf-6efe-405a-8bbd-9a8c7ed10c4c tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.124181 Oct 26 05:22:48.021001 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2554/5070] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 05:22:47 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45/ips/invalid => generated 91 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:22:48.025035 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2516/5070] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:47 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:48.031033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.032035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.036899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.037381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.054976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.055867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.056819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.058535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.059328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.061136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.061982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.062124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.062467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.063201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.063837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.064645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.338791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69e3dd9f-a043-438c-a203-249356c25429 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.312330 Oct 26 05:22:48.349890 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2517/5071] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892/os-interface => generated 1830 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:48.355803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-775f19cc-8341-4b56-be42-e7eca5406752 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.357143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-775f19cc-8341-4b56-be42-e7eca5406752 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Failed to fetch instance by id 999 {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 26 05:22:48.361775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-775f19cc-8341-4b56-be42-e7eca5406752 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] HTTP exception thrown: Instance 999 could not be found. Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-775f19cc-8341-4b56-be42-e7eca5406752 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Request method failure captured: Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQQ5MxQyZubH3dD52JqOKW5y8jDSGrETWx8EA1-1At8-Gwn5BrgqtcZBjbrWoV_d88vbzdkpZOo3LbBJDEuGvF7YUpJkgeMnGVCcu1sgleJCxuIFa3mbmc0ilmeuJR7oXrH29D2Ui40eRtjUqPUy9nFjGnY4grF_w9RpjZ-zaYZYWo Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a63b5fd786034e97a05e85cfbe842122 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a63b5fd786034e97a05e85cfbe842122 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerAddressesNegativeTestJSON-2040219577-project Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c5aa5f1203a741acb729f50babdec5cc Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2040219577-project Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 999 could not be found. Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': '999'} Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 26 05:22:48.367052 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:48.374828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-775f19cc-8341-4b56-be42-e7eca5406752 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:48.378169 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-775f19cc-8341-4b56-be42-e7eca5406752 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.026332 Oct 26 05:22:48.380334 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2518/5072] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:22:48.390028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.391436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.407769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.408775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.409630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.411373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.423142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.423561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:48.424935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.442006 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0141990-dff2-4003-9351-3fd14b889613 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.418971 Oct 26 05:22:48.443287 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2555/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:48.448330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.452374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.468467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.471894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.472751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.473742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.476658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.477402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.634626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:48.649962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-acc594f9-92fd-4569-a80c-8af3a9f4ca8f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1306 microversion: 2.1 time: 0.266045 Oct 26 05:22:48.665433 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2519/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:48.665433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.665433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.682367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.682744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.683201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.683938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.684408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.688939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.753046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:22:48.757986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:48.773891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:48.780446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:48.782180 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1f5d616-8490-4e8d-9c94-2546ace90a6f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.337366 Oct 26 05:22:48.806218 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2556/5075] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:48.882580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.882580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.894981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.896462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.897872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.901960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.902689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.903500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:48.946435 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-240cde33-c225-41bb-a521-0cce73fdccfc tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 204 len: 0 microversion: 2.1 time: 0.293119 Oct 26 05:22:48.948651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2520/5076] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:48 2022] DELETE /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:22:48.963520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:48.966454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:48.994302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:48.996151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:48.998746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.001059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.004293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.005255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.031980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:49.227942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:49.242879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-17b5b204-4633-429d-a169-e0cf541c1342 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.366019 Oct 26 05:22:49.243867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2557/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:49.274496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:49.292000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:49.306076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.309513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.310583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.315944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.317198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.318841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.392417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55e15e8c-4f25-41bc-978b-339d809fbcc4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132334 Oct 26 05:22:49.398984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:49.404937 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2558/5078] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:49 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:49.414232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29244990-800f-4d47-9ac4-993d796e2bf8 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1528 microversion: 2.1 time: 0.459369 Oct 26 05:22:49.415328 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2521/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:48 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1528 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:49.478560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:49.479915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:49.491900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.493969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.495769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.496672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.498127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.498679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.679939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:49.680870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:49.695810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.698295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.699029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.700021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.703505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.704530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.832867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:49.847621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:49.853630 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd3b146a-c1f1-4f4e-9abd-87b6e742f8c4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.382194 Oct 26 05:22:49.860013 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2559/5080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:49 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:49.864038 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27798f9e-4ff4-4f67-b5ee-06a9959ba2bf tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1306 microversion: 2.1 time: 0.188559 Oct 26 05:22:49.865843 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2522/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:49 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:49.869805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:49.870689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:49.878070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.879118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.880050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.881027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:49.881754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:49.882428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:49.887276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:50.084657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:50.098550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:50.100423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:50.102033 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d379d466-99fc-4b70-9874-d42f39b7bf69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.238697 Oct 26 05:22:50.116880 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2560/5082] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:49 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:50.270710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:50.272057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:50.302253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.306587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.307326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.313496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.314607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.318249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.413303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:50.416096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:50.429786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.430703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.435760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.437027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.437781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.439874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.515533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-95484447-1fea-49d0-96ef-18c993af7aee tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107120 Oct 26 05:22:50.521693 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2561/5083] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:50 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:22:50.527218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:50.529369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:50.538010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.538890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.539641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.540851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.541770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.542458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.619483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:50.632117 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64abd445-bc65-4fb2-9c70-4277f612a768 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.365424 Oct 26 05:22:50.648655 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2523/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:50 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:50.829759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:50.839429 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab9348bb-baf1-4689-b870-c94393802dcd tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1528 microversion: 2.1 time: 0.316249 Oct 26 05:22:50.840436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2562/5085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:50 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1528 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:50.888249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:50.889688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:50.899128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.899628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.900075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.900817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.901277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.901731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.915373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:50.916245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:50.930068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.930562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.931287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:50.937288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:50.940558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:50.941224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.085950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:51.107836 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5f4762d-23ae-4aeb-a000-59815af970ee tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1306 microversion: 2.1 time: 0.196387 Oct 26 05:22:51.112339 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2563/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:50 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:51.136336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:51.139594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:51.150675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.152051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.153968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.154920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.155644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.156561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.201425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:51.211774 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05322daa-b501-45f7-92df-1cacc24ba5cc tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.328183 Oct 26 05:22:51.212744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2524/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:50 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:51.346178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:51.358776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:51.360376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:51.362125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78141d2e-7c9b-4567-9994-9bf3a0465edd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.234643 Oct 26 05:22:51.363156 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2564/5088] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:51 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:51.530841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:51.534043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:51.541073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.541898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.543658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.545145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.546051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.546743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.580124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f383d1d-53a0-4ea5-9d7c-0a733d204367 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055820 Oct 26 05:22:51.588365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2525/5089] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:22:51 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:22:51.660295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:51.661270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:51.669732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.670591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.671257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.672186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.672861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.673566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.690072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:51.690598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:51.697193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.697727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.698180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.698906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.699370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.699807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.736668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:22:51.896488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:51.928654 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-264d71a4-2c80-45d2-8acb-a3e8279ba977 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 204 len: 0 microversion: 2.1 time: 0.243491 Oct 26 05:22:51.937596 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2526/5090] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:22:51 2022] DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:22:51.945583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:51.947066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:51.957720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.959589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.960571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:51.961613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:51.963407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:51.964092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:52.186923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:52.201245 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b82579e6-fd62-4884-95a2-fe3dc587255a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.549164 Oct 26 05:22:52.202310 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2565/5091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:51 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:52.217847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:52.218484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:52.224758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:52.225250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:52.225714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:52.244173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:52.244950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:52.246602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:52.483326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:52.498040 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-171728d2-4da3-45df-9692-de30bb8f7c3e tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1528 microversion: 2.1 time: 0.558278 Oct 26 05:22:52.498967 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2527/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:51 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1528 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:52.517709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:52.518354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:52.531895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:52.532610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:52.537745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:52.538866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:52.539569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:52.540227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:52.837389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:52.858971 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08b1c208-57bc-41e6-a240-dc01ef208a65 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1682 microversion: 2.1 time: 0.655487 Oct 26 05:22:52.860863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2566/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:52 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1682 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:52.873840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:52.877740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:52.892761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:52.894544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:52.898107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:52.906198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:52.906761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:52.908376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.014810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.024690 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b818ce8b-86e9-4e21-83e7-36741245a47c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.524600 Oct 26 05:22:53.026160 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2528/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:52 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:53.049146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:53.050691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:53.059700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.064450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.065198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.066627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.069088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.069776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.379350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.391355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.393551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.395335 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f67f9a74-eeae-4a55-9063-2f3d0974c5b0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.365101 Oct 26 05:22:53.396525 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2529/5095] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:53 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:53.419621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d98f7ef2-35a8-484a-bfdc-02a1059d335f req-029266aa-3556-4d56-924f-c41fe60c135a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2215f5a-5cbe-477f-b610-9a71bb40c5e7", "tag": "0972ead2-1e24-42b0-991e-45db7f81b8b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:53.432903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d98f7ef2-35a8-484a-bfdc-02a1059d335f req-029266aa-3556-4d56-924f-c41fe60c135a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.433850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d98f7ef2-35a8-484a-bfdc-02a1059d335f req-029266aa-3556-4d56-924f-c41fe60c135a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.434645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d98f7ef2-35a8-484a-bfdc-02a1059d335f req-029266aa-3556-4d56-924f-c41fe60c135a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.464628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d98f7ef2-35a8-484a-bfdc-02a1059d335f req-029266aa-3556-4d56-924f-c41fe60c135a service nova] Creating event network-changed:0972ead2-1e24-42b0-991e-45db7f81b8b0 for instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 on n-h1-862416-4 Oct 26 05:22:53.476959 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d98f7ef2-35a8-484a-bfdc-02a1059d335f req-029266aa-3556-4d56-924f-c41fe60c135a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078306 Oct 26 05:22:53.477906 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2530/5096] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:53.493991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:53.494952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:53.511425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.512195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.513201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.514330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.517977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.518816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.654751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.664522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-892d9045-f54b-4866-b015-f88c4e875661 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.801522 Oct 26 05:22:53.671473 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2567/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:52 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:53.679777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:53.681130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:53.689691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.690546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.691244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.692575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.693292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.693983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.842962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5aa5f1203a741acb729f50babdec5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b5fd786034e97a05e85cfbe842122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.851417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:53.857439 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2bffcd53-862a-45e8-b5c6-32d3b4a017ec tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 200 len: 1486 microversion: 2.1 time: 0.184446 Oct 26 05:22:53.859863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2568/5098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:53 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 1486 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:53.889478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:53.890364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:53.899205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:53.933176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=14 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:53.937341 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d58f9650-c21a-447b-a0cf-2a55ec3b5108 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.458164 Oct 26 05:22:53.938650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.939437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.940232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.944141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:53.945026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:53.945730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:53.958885 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2531/5099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:53 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:54.054311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:54.054941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:54.064072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:54.064576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:54.065020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:54.066264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:54.066682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:54.067186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:54.538272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=18 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:54.711330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:54.722419 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08100bce-6bc8-43ca-929f-8dfe955556c6 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.672833 Oct 26 05:22:54.723123 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2532/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:54 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:54.740727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:54.741699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:54.749123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:54.749672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:54.750117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:54.756248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:54.756736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:54.757182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:54.827320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:54.835888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d66bf99e-05de-49ba-a4eb-fc4341650bfd tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1682 microversion: 2.1 time: 0.953794 Oct 26 05:22:54.838128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2569/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:53 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1682 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:54.850470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:54.851757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:54.865089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:54.868327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:54.868977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:54.870128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:54.873919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:54.879097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.476028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:55.492407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:55.494884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:55.497229 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0be9a430-540d-49a7-99b7-4bef4023d7f7 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.760046 Oct 26 05:22:55.508027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2533/5102] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:54 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:55.519311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:55.520288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] [instance: df018771-9727-484c-a409-29d9119c1c45] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:55.535408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.536201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.536875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.538191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.539010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.539669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.554727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:55.566155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] HTTP exception thrown: Instance df018771-9727-484c-a409-29d9119c1c45 could not be found. Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Request method failure captured: Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 HTTP/1.1 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQQ5MxQyZubH3dD52JqOKW5y8jDSGrETWx8EA1-1At8-Gwn5BrgqtcZBjbrWoV_d88vbzdkpZOo3LbBJDEuGvF7YUpJkgeMnGVCcu1sgleJCxuIFa3mbmc0ilmeuJR7oXrH29D2Ui40eRtjUqPUy9nFjGnY4grF_w9RpjZ-zaYZYWo Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a63b5fd786034e97a05e85cfbe842122 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a63b5fd786034e97a05e85cfbe842122"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a63b5fd786034e97a05e85cfbe842122 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2040219577 Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerAddressesNegativeTestJSON-2040219577-project Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c5aa5f1203a741acb729f50babdec5cc Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2040219577-project Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance df018771-9727-484c-a409-29d9119c1c45 could not be found. Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'df018771-9727-484c-a409-29d9119c1c45'} Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df018771-9727-484c-a409-29d9119c1c45 could not be found. Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df018771-9727-484c-a409-29d9119c1c45 could not be found. Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:55.569474 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df018771-9727-484c-a409-29d9119c1c45 could not be found. Oct 26 05:22:55.573508 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:22:55.574017 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a261411-7233-4481-a759-98f41cc7ab6a tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.723460 Oct 26 05:22:55.574017 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2570/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:54 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:55.576429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] Returning 404 to user: Instance df018771-9727-484c-a409-29d9119c1c45 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:22:55.577714 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f11bde0-7041-40f9-a845-78fc8b039f18 tempest-ServerAddressesNegativeTestJSON-2040219577 tempest-ServerAddressesNegativeTestJSON-2040219577-project] 10.222.0.16 "GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45" status: 404 len: 111 microversion: 2.1 time: 0.068362 Oct 26 05:22:55.579060 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2534/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:55 2022] GET /compute/v2.1/servers/df018771-9727-484c-a409-29d9119c1c45 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:22:55.586894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:55.587521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:55.595128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.595639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.596089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.596886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.597370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.597810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.734534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8448d98a-9907-47be-b7f4-d00307f21769 req-4e1d14a2-030e-48c6-8915-fd2befb63714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df018771-9727-484c-a409-29d9119c1c45", "name": "network-vif-deleted", "tag": "6c6028b3-d3ba-42c3-842b-48d7055f8fe6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:55.756308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8448d98a-9907-47be-b7f4-d00307f21769 req-4e1d14a2-030e-48c6-8915-fd2befb63714 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.757266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8448d98a-9907-47be-b7f4-d00307f21769 req-4e1d14a2-030e-48c6-8915-fd2befb63714 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.759495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8448d98a-9907-47be-b7f4-d00307f21769 req-4e1d14a2-030e-48c6-8915-fd2befb63714 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.793256 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8448d98a-9907-47be-b7f4-d00307f21769 req-4e1d14a2-030e-48c6-8915-fd2befb63714 service nova] Creating event network-vif-deleted:6c6028b3-d3ba-42c3-842b-48d7055f8fe6 for instance df018771-9727-484c-a409-29d9119c1c45 on n-h2-862416-4 Oct 26 05:22:55.804750 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8448d98a-9907-47be-b7f4-d00307f21769 req-4e1d14a2-030e-48c6-8915-fd2befb63714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074460 Oct 26 05:22:55.806404 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2535/5105] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:22:55.820156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:55.822688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:55.843123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.845424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.846984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.847960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:55.849989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:55.850683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:55.914952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:55.932394 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e14f75a-85d5-43a6-b9ac-2109458cf510 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.359401 Oct 26 05:22:55.932908 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2571/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:55 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:55.957244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:55.971894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:56.007330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.007835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.008277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.008990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.009476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.009902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.176716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:56.198962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab0d70be-33af-4c96-b27a-09f02365f0cb tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.390710 Oct 26 05:22:56.214816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2536/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:55 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:56.312190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a5998d7a-3ec1-44d1-be1b-2cb763424cc7 req-d5d5a904-5e1e-4959-8c5c-75ab87d12eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e822d940-00cf-4781-a19a-0b94b133e357", "name": "network-vif-unplugged", "status": "completed", "tag": "3ce9206c-cb78-42a0-bb38-3b85449b919a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:56.332760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a5998d7a-3ec1-44d1-be1b-2cb763424cc7 req-d5d5a904-5e1e-4959-8c5c-75ab87d12eb7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.337915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a5998d7a-3ec1-44d1-be1b-2cb763424cc7 req-d5d5a904-5e1e-4959-8c5c-75ab87d12eb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.339622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a5998d7a-3ec1-44d1-be1b-2cb763424cc7 req-d5d5a904-5e1e-4959-8c5c-75ab87d12eb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.370576 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a5998d7a-3ec1-44d1-be1b-2cb763424cc7 req-d5d5a904-5e1e-4959-8c5c-75ab87d12eb7 service nova] Creating event network-vif-unplugged:3ce9206c-cb78-42a0-bb38-3b85449b919a for instance e822d940-00cf-4781-a19a-0b94b133e357 on n-h2-862416-4 Oct 26 05:22:56.387957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a5998d7a-3ec1-44d1-be1b-2cb763424cc7 req-d5d5a904-5e1e-4959-8c5c-75ab87d12eb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078442 Oct 26 05:22:56.390493 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2537/5108] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:22:56.477457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:56.488013 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65e7bf21-7ffd-48b6-9af5-22febf2c59f0 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1682 microversion: 2.1 time: 0.551930 Oct 26 05:22:56.496265 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2572/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:55 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1682 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:56.533471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:56.534265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:56.542521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.543115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.544471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.545377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.546106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.546792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.599936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:56.600553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:56.623058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.624084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.624751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.628167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:56.629136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:56.632378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:56.846224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:56.856509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:56.863921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:56.866191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:56.868066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0393f442-49d3-4841-97ea-eea837850ac1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.340310 Oct 26 05:22:56.892304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2538/5110] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:56 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:56.908779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:56.921243 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3325c306-575f-40b4-841a-89714d739900 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.325263 Oct 26 05:22:56.923237 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2573/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:56 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:56.970566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:56.971246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:56.999035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.001202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.001692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.002678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.003311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.004384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.225224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:57.225877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:57.261220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.261220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.261220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.261220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.261220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.261220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.266084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:57.275731 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0f4e3df-758b-45a2-8ad2-d5292f3a3d03 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.320410 Oct 26 05:22:57.281556 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2539/5112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:56 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:57.517028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:57.518653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:57.527130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.527738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.528968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.529906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.530716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.531365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.564206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:57.573349 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2217f68-985f-4d19-a7ed-77a83604ca6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.352074 Oct 26 05:22:57.574501 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2574/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:57 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:57.660722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:57.672979 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-379149f7-71dd-4266-8d38-a91a5c4bf59c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1614 microversion: 2.1 time: 0.161543 Oct 26 05:22:57.673698 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2540/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:57 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1614 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:57.849710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-dd588cd4-aff7-4431-9817-a5203d1f345f req-0200e78d-784c-4a94-929a-18166ef43e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35f7e6f-981b-4d57-9a68-131b7f986021", "tag": "45b187fd-251d-47f3-95d3-bdd43a3b3697"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:22:57.873857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-dd588cd4-aff7-4431-9817-a5203d1f345f req-0200e78d-784c-4a94-929a-18166ef43e1a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.874346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-dd588cd4-aff7-4431-9817-a5203d1f345f req-0200e78d-784c-4a94-929a-18166ef43e1a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.874780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-dd588cd4-aff7-4431-9817-a5203d1f345f req-0200e78d-784c-4a94-929a-18166ef43e1a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.901240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:57.901885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:57.910761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.911248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.911698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.912403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.912854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.916956 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-dd588cd4-aff7-4431-9817-a5203d1f345f req-0200e78d-784c-4a94-929a-18166ef43e1a service nova] Creating event network-changed:45b187fd-251d-47f3-95d3-bdd43a3b3697 for instance a35f7e6f-981b-4d57-9a68-131b7f986021 on n-h1-862416-4 Oct 26 05:22:57.927990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.929778 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-dd588cd4-aff7-4431-9817-a5203d1f345f req-0200e78d-784c-4a94-929a-18166ef43e1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083820 Oct 26 05:22:57.935812 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2575/5115] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:22:57.951874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:57.952691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:57.980617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.981121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.988609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:57.991938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:57.994930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:57.995585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.360647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.375939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.379938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.382732 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8bced999-7d25-494a-9a6d-7dfe4d091233 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1740 microversion: 2.20 time: 0.485482 Oct 26 05:22:58.390821 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2541/5116] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:57 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1740 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:58.391178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.391296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:58.391296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:58.395321 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57aa7789-ab91-48c2-8299-b7ae2e018703 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.447771 Oct 26 05:22:58.395908 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2576/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:57 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:22:58.397985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:58.398600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:58.399171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.399990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:58.400575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:58.401113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.576316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.599005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:58.600020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:58.603839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e37c7f2-1b29-43b1-85ff-581fe310871c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.218845 Oct 26 05:22:58.607177 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2542/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:58 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:58.608549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:58.609193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:58.610183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.611068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:58.611828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:58.612397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.641435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:22:58.702278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:58.703393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:58.712972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:58.716653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:58.718988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.722349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:58.722983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:58.723566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:58.799460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.810881 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d4110a8-bbe4-4402-82ad-f5c786ebc400 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.215359 Oct 26 05:22:58.819836 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2577/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:58 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:58.841154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c244ca4ef34828a356a07af0d74302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133cf27e350423c8cad75a57ee47ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:58.862309 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b48338a0-ca49-41df-8a47-33d51e865997 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 200 len: 1614 microversion: 2.1 time: 0.165158 Oct 26 05:22:58.863896 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2543/5120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:58 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 1614 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:59.411585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:59.412387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:59.423439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:59.428676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:59.443358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.444830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.445789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.446601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.447733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.449466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.450858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.452121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.454534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.454763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.455650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.457259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.736934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:59.751040 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed462ef6-f98a-4c8c-a3a5-b8dd7296d4f4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.331482 Oct 26 05:22:59.752733 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2544/5121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:59 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:22:59.759940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:59.771307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:59.772190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:59.772340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:59.775222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:22:59.776909 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f605c2de-a167-4562-814e-0e2a00a29ccd tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1722 microversion: 2.20 time: 0.369425 Oct 26 05:22:59.778039 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2578/5122] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:22:59 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:22:59.779515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.780208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.780796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.781698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.782304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.782881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.844234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:22:59.844857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:22:59.857205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.858099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.858726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:22:59.859641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:22:59.860270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:22:59.860856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.015871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:00.037727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29929142-052c-47dd-bcc0-8740ae064832 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.283066 Oct 26 05:23:00.039421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2545/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:59 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:00.049725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:00.055774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:00.058446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9bc3826b-ab6b-46bd-9cff-a0fd3860a014 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.219427 Oct 26 05:23:00.059183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:00.060699 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2579/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:22:59 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:00.080763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.083363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.083820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.085272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.087571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.088032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.103478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-7b1e7303-cf9d-49e3-9628-91184192804d req-7322cea2-351f-4f4a-9af4-b21e88ccb8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e822d940-00cf-4781-a19a-0b94b133e357", "name": "network-vif-deleted", "tag": "3ce9206c-cb78-42a0-bb38-3b85449b919a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:00.104577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 HTTP/1.1 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e822d940-00cf-4781-a19a-0b94b133e357'} Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:00.106959 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:00.111520 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:00.113271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:00.114314 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a0fc85e-1be1-4b79-aa55-cfd7258787d7 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 404 len: 111 microversion: 2.1 time: 0.071610 Oct 26 05:23:00.118170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2546/5125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:00 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:00.121590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7b1e7303-cf9d-49e3-9628-91184192804d req-7322cea2-351f-4f4a-9af4-b21e88ccb8f5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.122414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7b1e7303-cf9d-49e3-9628-91184192804d req-7322cea2-351f-4f4a-9af4-b21e88ccb8f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.123063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-7b1e7303-cf9d-49e3-9628-91184192804d req-7322cea2-351f-4f4a-9af4-b21e88ccb8f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.131278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-abc4ce5c-5bfa-4894-8eab-a97723d12d4e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '.version_select at 0x7f470eba8790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:00.136638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-7b1e7303-cf9d-49e3-9628-91184192804d req-7322cea2-351f-4f4a-9af4-b21e88ccb8f5 service nova] Creating event network-vif-deleted:3ce9206c-cb78-42a0-bb38-3b85449b919a for instance e822d940-00cf-4781-a19a-0b94b133e357 on n-h2-862416-4 Oct 26 05:23:00.143105 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-7b1e7303-cf9d-49e3-9628-91184192804d req-7322cea2-351f-4f4a-9af4-b21e88ccb8f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044639 Oct 26 05:23:00.144793 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2580/5126] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:00.152122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-abc4ce5c-5bfa-4894-8eab-a97723d12d4e tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-634954275" status: 202 len: 0 microversion: 2.1 time: 0.025325 Oct 26 05:23:00.152710 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2547/5127] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:23:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-634954275 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:23:00.185032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a99bf458-2a29-49fb-90fb-9a422cd2ce10 req-32340692-31c0-4520-8f53-14d35c8557dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2215f5a-5cbe-477f-b610-9a71bb40c5e7", "name": "network-vif-plugged", "status": "completed", "tag": "0972ead2-1e24-42b0-991e-45db7f81b8b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:00.199397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a99bf458-2a29-49fb-90fb-9a422cd2ce10 req-32340692-31c0-4520-8f53-14d35c8557dc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.201702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a99bf458-2a29-49fb-90fb-9a422cd2ce10 req-32340692-31c0-4520-8f53-14d35c8557dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.202506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a99bf458-2a29-49fb-90fb-9a422cd2ce10 req-32340692-31c0-4520-8f53-14d35c8557dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.222607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a99bf458-2a29-49fb-90fb-9a422cd2ce10 req-32340692-31c0-4520-8f53-14d35c8557dc service nova] Creating event network-vif-plugged:0972ead2-1e24-42b0-991e-45db7f81b8b0 for instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 on n-h1-862416-4 Oct 26 05:23:00.229703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a99bf458-2a29-49fb-90fb-9a422cd2ce10 req-32340692-31c0-4520-8f53-14d35c8557dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055012 Oct 26 05:23:00.231206 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2581/5128] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:00.775373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:00.776176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:00.784538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.785684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.786329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.787152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.789051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.790872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.810681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:00.811378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:00.829929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.830948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.832497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:00.833561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:00.834733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:00.835356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:01.051802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:01.066976 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-675de5ed-b1cc-4af6-b2b5-4f5f370c5a0f tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.295391 Oct 26 05:23:01.084271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2548/5129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:00 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:01.096221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:01.097141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:01.103509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:01.104242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:01.104879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:01.105783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:01.106519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:01.107138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:01.246987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:01.256294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:01.263758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:01.265992 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f6142b1b-9f9f-4f39-9eff-acc603dda77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1722 microversion: 2.20 time: 0.461683 Oct 26 05:23:01.286636 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2582/5130] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:00 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1722 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:01.297484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:01.298751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:01.310813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:01.311534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:01.312134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:01.313292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:01.313928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:01.314507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:01.362694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:01.373950 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-740931cc-ee98-4b8d-be4f-dfdd69fa6c2c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.288324 Oct 26 05:23:01.374914 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2549/5131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:01 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:01.551572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:01.561769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b3827404-bdb0-4cda-b4da-1faf113c4bbc tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.273601 Oct 26 05:23:01.562738 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2583/5132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:01 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:02.096460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:02.097918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:02.110106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.110963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.111590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.112611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.113337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.113926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.301394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:02.302527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:02.321567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.322075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.322517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.328948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.330075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.330686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.366934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:02.391751 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a36d1cb1-827d-4a91-b89d-589178f1ddd7 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.299445 Oct 26 05:23:02.410249 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2550/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:02 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:02.427852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:02.432071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:02.480852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.486337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.488005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.501770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.507303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.507303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.588043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:02.598361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:02.599854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:02.601075 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d588ebd8-f954-4fc8-817a-885be825aa96 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1722 microversion: 2.20 time: 0.304663 Oct 26 05:23:02.610994 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2584/5134] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:02 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:23:02.616990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:02.623017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:02.647769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.648585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.651252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.654834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.655336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.655797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:02.926407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:02.949141 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b78bf79-4d77-4414-8b74-34a221f94c0d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1362 microversion: 2.1 time: 0.533028 Oct 26 05:23:02.952165 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2551/5135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:02 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:02.965014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a2ec0690-7871-410f-8ed4-25974354b3cf req-1dab037e-2925-4454-b994-b61f8d30ebba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "name": "network-vif-unplugged", "status": "completed", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:02.977887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a2ec0690-7871-410f-8ed4-25974354b3cf req-1dab037e-2925-4454-b994-b61f8d30ebba service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:02.978648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a2ec0690-7871-410f-8ed4-25974354b3cf req-1dab037e-2925-4454-b994-b61f8d30ebba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:02.979294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a2ec0690-7871-410f-8ed4-25974354b3cf req-1dab037e-2925-4454-b994-b61f8d30ebba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.000226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:03.004543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a2ec0690-7871-410f-8ed4-25974354b3cf req-1dab037e-2925-4454-b994-b61f8d30ebba service nova] Creating event network-vif-unplugged:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:23:03.010038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-21748a18-7ed0-4915-8874-1b3314df45b1 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.397619 Oct 26 05:23:03.011888 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a2ec0690-7871-410f-8ed4-25974354b3cf req-1dab037e-2925-4454-b994-b61f8d30ebba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057066 Oct 26 05:23:03.012051 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2585/5136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:02 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:03.026274 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2552/5137] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:03.422195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:03.423615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:03.431833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.432752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.433464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.434494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.435222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.436008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.651606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:03.652414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:03.664271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:03.675209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.676424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.676424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.677119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.677607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.678046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.679286 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc9bab3a-d983-4038-953d-b845f91d123c tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1485 microversion: 2.1 time: 0.261686 Oct 26 05:23:03.681794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2586/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:03 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1485 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:03.707983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:03.708700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:03.720132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.721637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.723412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.724833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.729470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.729470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.925705 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d077257e-0102-4110-8022-f721d61a6b26 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "POST /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c/action" status: 202 len: 0 microversion: 2.1 time: 0.221990 Oct 26 05:23:03.928651 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2587/5139] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:23:03 2022] POST /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:23:03.942679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:03.943666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:03.960639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.961427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.962062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:03.964921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:03.966541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:03.969272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:04.253793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:04.264050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:04.266102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:04.267718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-183d52f8-8222-4c62-9b2e-93a1db6e0848 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1722 microversion: 2.20 time: 0.620907 Oct 26 05:23:04.282247 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2553/5140] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:03 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1722 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:23:04.296269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:04.297118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:04.311372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:04.312121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:04.312995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:04.313933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:04.314559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:04.317940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:04.369758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:04.384218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4e29543-5e3d-4156-ae4b-1e7e9ad7463e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1493 microversion: 2.1 time: 0.448907 Oct 26 05:23:04.392317 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2588/5141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:03 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1493 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:04.397865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:04.398692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:04.412547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:04.412942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:04.413432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:04.415465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:04.416119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:04.426995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:04.667521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:04.678654 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-784d13d7-fe00-4311-ac7a-5157cb5741e1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1549 microversion: 2.1 time: 0.394987 Oct 26 05:23:04.679545 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2554/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:04 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1549 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:04.707757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:04.708265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:04.724901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:04.725439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:04.725879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:04.727555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:04.728842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:04.731515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:05.222639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:05.243743 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-565cc499-026e-4d86-bf86-568b30cf7705 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.849804 Oct 26 05:23:05.244448 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2589/5143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:04 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:05.299556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:05.300475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:05.314633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:05.315719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:05.316315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:05.317545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:05.318163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:05.318944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:05.367267 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-282cca5b-3f0e-4dc3-b478-6b868beddd15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.663114 Oct 26 05:23:05.379266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2555/5144] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:23:04 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-interface => generated 285 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:05.425432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:05.426784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:05.458873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:05.460581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:05.461172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:05.464571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:05.465245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:05.467543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.146428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:06.158349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:06.163930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:06.165446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-74d9ef27-abfb-4e60-95ff-00a70663eeef tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1722 microversion: 2.20 time: 0.871769 Oct 26 05:23:06.169735 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2590/5145] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:05 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1722 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:06.182858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:06.185459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:06.201373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.204173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.206756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.207720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.209623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.211203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.251300 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 HTTP/1.1 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e822d940-00cf-4781-a19a-0b94b133e357'} Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:06.255178 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.259147 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.264405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:06.265571 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd601e46-d431-48dd-8b66-b4a2ef558893 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 404 len: 111 microversion: 2.1 time: 0.094634 Oct 26 05:23:06.268454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2591/5146] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:06 2022] DELETE /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:06.278975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:06.279882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:06.292180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.294859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.295513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.297694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.298425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.299832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.367518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:06.381170 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e1c752d2-45f8-4757-aa5b-c87c3e73453d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1493 microversion: 2.1 time: 0.968967 Oct 26 05:23:06.399211 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2556/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:05 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1493 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:06.416867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:06.419097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: e822d940-00cf-4781-a19a-0b94b133e357] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:06.432923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.435735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.436410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.438029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.444662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.450340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:06.510388 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 HTTP/1.1 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e822d940-00cf-4781-a19a-0b94b133e357'} Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:06.513384 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. Oct 26 05:23:06.517476 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:06.519756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance e822d940-00cf-4781-a19a-0b94b133e357 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:06.522038 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf382f3b-600d-4e3c-8a79-c9021d3ecbf4 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357" status: 404 len: 111 microversion: 2.1 time: 0.120338 Oct 26 05:23:06.523142 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2557/5148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:06 2022] GET /compute/v2.1/servers/e822d940-00cf-4781-a19a-0b94b133e357 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:06.892763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:06.915213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-964b3919-25c1-4971-a4c5-d7a2f5f8916b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 0.643801 Oct 26 05:23:06.930996 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2592/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:06 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:06.963974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-eb8c896a-8ec5-4b7c-9eb6-829bb7d05e36 req-6b8257d9-6b11-496e-a54b-8810b3af450e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35f7e6f-981b-4d57-9a68-131b7f986021", "name": "network-vif-plugged", "status": "completed", "tag": "45b187fd-251d-47f3-95d3-bdd43a3b3697"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:06.977728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eb8c896a-8ec5-4b7c-9eb6-829bb7d05e36 req-6b8257d9-6b11-496e-a54b-8810b3af450e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:06.978277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eb8c896a-8ec5-4b7c-9eb6-829bb7d05e36 req-6b8257d9-6b11-496e-a54b-8810b3af450e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:06.978730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-eb8c896a-8ec5-4b7c-9eb6-829bb7d05e36 req-6b8257d9-6b11-496e-a54b-8810b3af450e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.002836 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-eb8c896a-8ec5-4b7c-9eb6-829bb7d05e36 req-6b8257d9-6b11-496e-a54b-8810b3af450e service nova] Creating event network-vif-plugged:45b187fd-251d-47f3-95d3-bdd43a3b3697 for instance a35f7e6f-981b-4d57-9a68-131b7f986021 on n-h1-862416-4 Oct 26 05:23:07.012376 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-eb8c896a-8ec5-4b7c-9eb6-829bb7d05e36 req-6b8257d9-6b11-496e-a54b-8810b3af450e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053604 Oct 26 05:23:07.014620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2558/5150] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:07.206975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:07.210242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:07.230009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:07.232960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:07.235427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.236204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:07.236753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:07.237119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.416734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:07.418187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:07.432236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:07.435866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:07.436799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.437812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:07.439904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:07.442737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.501714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:07.858086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:07.868361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:07.875412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:07.876686 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d9c6d58-7129-41df-a1bc-ab2f17ef470c tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1665 microversion: 2.20 time: 0.681755 Oct 26 05:23:07.877649 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2593/5151] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:07 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1665 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:07.906459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40e770c3-df72-4600-9fbe-79ca6fed53fb"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:07.909204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:07.922822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:07.923540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:07.926536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.927475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:07.929923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:07.930550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:07.984921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:07.997141 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b12b674-0148-4f9a-acfb-c32a71a1171e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1493 microversion: 2.1 time: 0.585331 Oct 26 05:23:08.061387 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2559/5152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:07 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1493 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:08.061387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:08.065731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:08.095506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:08.096263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:08.100887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:08.102413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:08.103086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:08.105657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:08.107010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:08.523154 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-378a4354-d765-4db1-8a6b-4fe658a7bc95 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.621496 Oct 26 05:23:08.530830 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2594/5153] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 26 05:23:07 2022] POST /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-volume_attachments => generated 188 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:23:08.834326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:08.834942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:08.843673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:08.844915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:08.847617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:08.848623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:08.850755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:08.851424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.170822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:09.186094 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02c2a225-5a4a-4d1b-82c5-a01533a81119 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1373 microversion: 2.1 time: 1.130944 Oct 26 05:23:09.187009 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2560/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:08 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1373 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:09.208880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:09.215796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:09.224815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.227795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.228526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.230142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.232746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.233468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.367280 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9dbc8e6c-df51-4d23-ae8b-093778a84fae tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-volume_attachments/40e770c3-df72-4600-9fbe-79ca6fed53fb" status: 202 len: 0 microversion: 2.20 time: 0.538791 Oct 26 05:23:09.382224 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2595/5155] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 26 05:23:08 2022] DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-volume_attachments/40e770c3-df72-4600-9fbe-79ca6fed53fb => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:23:09.520673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:09.521602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:09.540126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.544843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.545786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.546770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.547463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.549895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.645962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:09.651109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120586) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 05:23:09.788410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:09.796845 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1f3de79-5604-4ba2-b41b-7c8670615941 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "POST /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/action" status: 202 len: 0 microversion: 2.20 time: 0.281307 Oct 26 05:23:09.797794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2596/5156] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 26 05:23:09 2022] POST /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:23:09.801707 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8dac2997-fa28-42d0-9f10-2b3dc01918aa tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1499 microversion: 2.1 time: 0.605922 Oct 26 05:23:09.805024 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2561/5157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:09 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1499 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:09.811532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0078d036-6db9-4189-941a-2deb2c1693c4 req-8dbbb190-191c-4ebd-988f-74353247d7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2215f5a-5cbe-477f-b610-9a71bb40c5e7", "tag": "0972ead2-1e24-42b0-991e-45db7f81b8b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:09.820406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:09.822268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:09.830833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0078d036-6db9-4189-941a-2deb2c1693c4 req-8dbbb190-191c-4ebd-988f-74353247d7e6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.831750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0078d036-6db9-4189-941a-2deb2c1693c4 req-8dbbb190-191c-4ebd-988f-74353247d7e6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.832346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0078d036-6db9-4189-941a-2deb2c1693c4 req-8dbbb190-191c-4ebd-988f-74353247d7e6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.835289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.835799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.836253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.841213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.842415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.845022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.885551 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0078d036-6db9-4189-941a-2deb2c1693c4 req-8dbbb190-191c-4ebd-988f-74353247d7e6 service nova] Creating event network-changed:0972ead2-1e24-42b0-991e-45db7f81b8b0 for instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 on n-h1-862416-4 Oct 26 05:23:09.910988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0078d036-6db9-4189-941a-2deb2c1693c4 req-8dbbb190-191c-4ebd-988f-74353247d7e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106053 Oct 26 05:23:09.912123 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2597/5158] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:09.923543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:09.924821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:09.934841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.935644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.937166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:09.938090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:09.938839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:09.939469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:10.009194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:23:10.169347 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-350a195a-58f5-4c8a-9db6-c600b174bdcf tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 204 len: 0 microversion: 2.1 time: 0.252502 Oct 26 05:23:10.172130 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2598/5159] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:09 2022] DELETE /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:23:10.184596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:10.186243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:10.202749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:10.203501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:10.205984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:10.206911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:10.207407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:10.207864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:10.541165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:10.556419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:10.560664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:10.564393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:10.565977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-392395e7-8c3f-4196-8129-98827dee27a0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1673 microversion: 2.20 time: 0.759748 Oct 26 05:23:10.567106 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2562/5160] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:09 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1673 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:10.573188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:10.574020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:10.581729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:10.582846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:10.583526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:10.584441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:10.585068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:10.585687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:10.589205 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-813a4beb-39db-4605-993c-7ac1a648c630 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.412681 Oct 26 05:23:10.589860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2599/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:10 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:10.853345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:10.862884 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-76367477-eaca-46df-8b3e-cc3e83247a81 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1546 microversion: 2.1 time: 0.294420 Oct 26 05:23:10.863483 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2563/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:10 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1546 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:10.888568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:10.889192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:10.898344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:10.900994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:10.901796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:10.903375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:10.908203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:10.908656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:11.250550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:11.259400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f475ee2-f5e5-4747-86e0-38224a7fdabd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1546 microversion: 2.1 time: 0.374768 Oct 26 05:23:11.269227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2600/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:10 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1546 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:11.595684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:11.596398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:11.603705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:11.604126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:11.604570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:11.605278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:11.605762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:11.606261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:11.624064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:11.625623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:11.634500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:11.635519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:11.637703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:11.639327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:11.640070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:11.643517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:11.885029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:11.900170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:11.903746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:11.907155 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bdc8cb7-1433-4386-a04b-7cdb7194f51f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1673 microversion: 2.20 time: 0.315357 Oct 26 05:23:11.919267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2564/5164] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:11 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1673 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:12.025936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:12.040256 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d31c620-6f00-4a94-a721-cadf474baa9e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.419062 Oct 26 05:23:12.042342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2601/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:11 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:12.948835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:12.951915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:12.995732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:12.996329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.003492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.009405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.012852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.015572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.066914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:13.067583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:13.080960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.094706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.104730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.105685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.106754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.107058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.725835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:13.741736 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd8cbb5b-f716-4a29-bc57-a6b5ecfb3bd2 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1505 microversion: 2.1 time: 0.676605 Oct 26 05:23:13.751230 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2602/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:13 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:13.765269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:13.765836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:13.771938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:13.781958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.782757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.783368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.784266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.784896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.785527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.785958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:13.790790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:13.792014 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-582c20e5-acd4-47a9-a907-46f2590ffc6a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1675 microversion: 2.20 time: 0.847696 Oct 26 05:23:13.798126 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2565/5167] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:12 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1675 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:13.812515 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 HTTP/1.1 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '537cbd71-74b4-4d99-895f-cc873448f370'} Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:13.814047 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.818254 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.822389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:13.823532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8143e209-5a2d-4ba1-b276-c1451c147e79 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 404 len: 111 microversion: 2.1 time: 0.071313 Oct 26 05:23:13.829588 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2603/5168] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:13 2022] DELETE /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:13.836838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:13.838076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: 537cbd71-74b4-4d99-895f-cc873448f370] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:13.852107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.855462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.858380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.861903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.862672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.863479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.923662 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 HTTP/1.1 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '537cbd71-74b4-4d99-895f-cc873448f370'} Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:13.927197 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. Oct 26 05:23:13.935182 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.937225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance 537cbd71-74b4-4d99-895f-cc873448f370 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:13.939000 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b48c69e-c22e-453f-8c19-79b2cb3bb959 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370" status: 404 len: 111 microversion: 2.1 time: 0.108066 Oct 26 05:23:13.939759 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2566/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:13 2022] GET /compute/v2.1/servers/537cbd71-74b4-4d99-895f-cc873448f370 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:23:13.949159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:13.950535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:13.957972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.958716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.959335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.960400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:13.961021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:13.961643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:13.978673 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 HTTP/1.1 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'da72c67d-c2eb-4917-9051-70592110c760'} Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:13.980707 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:13.986842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:13.989156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:13.990448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de19459f-877d-4d56-8297-a133ffcd55c5 tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 404 len: 111 microversion: 2.1 time: 0.046391 Oct 26 05:23:14.001685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:14.002884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: da72c67d-c2eb-4917-9051-70592110c760] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:14.007835 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2604/5170] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:13 2022] DELETE /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:14.012766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:14.013577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:14.014329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:14.015454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:14.016095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:14.016692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:14.034656 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 HTTP/1.1 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'da72c67d-c2eb-4917-9051-70592110c760'} Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:14.036483 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. Oct 26 05:23:14.041372 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:14.044870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance da72c67d-c2eb-4917-9051-70592110c760 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:14.046056 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a7807ea-1db5-4a64-9d2b-a587ffcc355b tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760" status: 404 len: 111 microversion: 2.1 time: 0.050660 Oct 26 05:23:14.050081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2567/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:13 2022] GET /compute/v2.1/servers/da72c67d-c2eb-4917-9051-70592110c760 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:14.532320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1084073426", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "0c85cc3e-f00a-4d2c-8961-b7ecfa7d6fd1"}, {"uuid": "6102d977-78c4-46b9-be70-1bf026e68544"}, {"uuid": "0c85cc3e-f00a-4d2c-8961-b7ecfa7d6fd1"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:14.622527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] validate_networks() for [('0c85cc3e-f00a-4d2c-8961-b7ecfa7d6fd1', None, None, None, None, None), ('6102d977-78c4-46b9-be70-1bf026e68544', None, None, None, None, None), ('0c85cc3e-f00a-4d2c-8961-b7ecfa7d6fd1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:23:14.773801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:14.774686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:14.784659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:14.790071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:14.809706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:14.810706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:14.823713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:14.824367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:15.053711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:15.067346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e69ab11b-261c-4bf0-a7d7-43be95923b3d tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 200 len: 1463 microversion: 2.1 time: 0.297467 Oct 26 05:23:15.070374 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2568/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:14 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 1463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:15.079541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:15.083349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:15.100174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:15.106462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:15.107110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:15.108257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:15.108923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:15.112574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.244339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:16.272682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:16.278288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:16.280097 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cb55df9-57a6-4ac9-b486-1bcdfb3b4704 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 1.208282 Oct 26 05:23:16.281079 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2569/5173] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:15 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:16.304547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9b8fe5fe-62f4-4d27-9216-13e105618b2c req-cedbcff9-e994-4222-ae80-295f695ffe3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c", "name": "network-vif-deleted", "tag": "96185633-d091-4579-8072-65eecf07dee0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:16.322271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9b8fe5fe-62f4-4d27-9216-13e105618b2c req-cedbcff9-e994-4222-ae80-295f695ffe3b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.323335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9b8fe5fe-62f4-4d27-9216-13e105618b2c req-cedbcff9-e994-4222-ae80-295f695ffe3b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.325201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9b8fe5fe-62f4-4d27-9216-13e105618b2c req-cedbcff9-e994-4222-ae80-295f695ffe3b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.356935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9b8fe5fe-62f4-4d27-9216-13e105618b2c req-cedbcff9-e994-4222-ae80-295f695ffe3b service nova] Creating event network-vif-deleted:96185633-d091-4579-8072-65eecf07dee0 for instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c on n-h2-862416-4 Oct 26 05:23:16.366811 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9b8fe5fe-62f4-4d27-9216-13e105618b2c req-cedbcff9-e994-4222-ae80-295f695ffe3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084254 Oct 26 05:23:16.370516 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2570/5174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:16.382017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:16.388604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:16.396445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.397063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.402299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.403535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.404714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.405510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.436305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] HTTP exception thrown: Instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c could not be found. Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Request method failure captured: Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c HTTP/1.1 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPSw0pa3oyM3j76fp5PsZOjM78ZSigEvhfXks8zAkcazJDVVxUryQpCnigQqHVTk2kTJu89KrS3es8ZtrOg8fcvjGT_GBQG5u4kJQLJZZvBqnRZ6DMZVdhYLH0QL3FE4pHAmp3y90hShIEguN3y3wI2CZolN7BK1sek022gphpKnw8 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 945d499d0daa4ad196f3f99a9f48c1bd Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueTestJSON-1056392991 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueTestJSON-1056392991 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 945d499d0daa4ad196f3f99a9f48c1bd Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueTestJSON-1056392991 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueTestJSON-1056392991-project Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 65ac46030b2744868d7235c5badf4cf2 Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueTestJSON-1056392991-project Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c could not be found. Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c'} Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c could not be found. Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c could not be found. Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:16.441286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c could not be found. Oct 26 05:23:16.445438 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:16.456384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Returning 404 to user: Instance 49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:16.457729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b634a09-bd0b-4b8e-864e-35bf75b2a9af tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c" status: 404 len: 111 microversion: 2.1 time: 0.085561 Oct 26 05:23:16.458909 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2571/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:16 2022] GET /compute/v2.1/servers/49e38a6c-0b73-4ed8-b3c6-b9a7db9e585c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:16.478804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:16.490046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:16.541204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.541746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.542297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.545987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.546667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.547432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.610705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:23:16.734943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:16.784582 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-825359f7-1757-40f0-b45b-27fcdebe0d31 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 204 len: 0 microversion: 2.1 time: 0.317451 Oct 26 05:23:16.785187 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2572/5176] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:16 2022] DELETE /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:23:16.814802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:16.816592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:16.824030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.824819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.825477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:16.826422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:16.827235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:16.827826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:17.561344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:17.581703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b70d8c77-6bef-4a3b-a3fd-02a96777bdc4 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1492 microversion: 2.1 time: 0.790584 Oct 26 05:23:17.582555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2573/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:16 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1492 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:17.597468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:17.598465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:17.608671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:17.609180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:17.609656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:17.610390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:17.610859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:17.611297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:18.379666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:18.403594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:18.412361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:18.417741 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82c99aa5-d4ee-4e0a-b23d-86ec7d49a303 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.829833 Oct 26 05:23:18.418878 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2574/5178] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:17 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:18.614572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:18.615254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:18.627652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:18.630544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:18.631034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:18.631763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:18.632225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:18.632653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:19.496526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:23:19.497763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:23:19.498526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:23:19.499960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:23:19.500692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:23:19.524409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:19.526648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:19.528523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:19.531036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:19.533689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:19.536694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:19.565225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Getting quotas for project bb324d5cc720471abe62f4a6fdd5de5f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:23:19.574442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Getting quotas for user 9e7230bc61b549b8adf602f9ce37c4d6 and project bb324d5cc720471abe62f4a6fdd5de5f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:23:19.597811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:23:19.602116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:23:19.729727 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35a9a0cf-860f-4bb3-8f4d-2799d99163ad tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.201685 Oct 26 05:23:19.733605 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2605/5179] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 5205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:23:19.746159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:19.749345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:19.770723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:19.771371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:19.776058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:19.777144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:19.778643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:19.779322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:19.849465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:19.864844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2801a6f9-ed88-4142-b37e-b0fd40b3d678 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1492 microversion: 2.1 time: 1.256830 Oct 26 05:23:19.869563 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2575/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:18 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1492 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:19.876454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3be7ead8-2894-4060-8509-6fb2c1cbb781 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:19.879048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3be7ead8-2894-4060-8509-6fb2c1cbb781 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:20.021408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3be7ead8-2894-4060-8509-6fb2c1cbb781 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:20.033579 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3be7ead8-2894-4060-8509-6fb2c1cbb781 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1213 microversion: 2.1 time: 0.160741 Oct 26 05:23:20.034663 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2576/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:19 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:20.039964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:20.040631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:20.050835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:20.051846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:20.053751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:20.054949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:20.056395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:20.057183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:20.078277 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 HTTP/1.1 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7'} Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:20.081257 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.085745 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.090052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:20.092122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e5a6311-e494-47d5-ac0b-3fe0e2967fcf tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 404 len: 111 microversion: 2.1 time: 0.056123 Oct 26 05:23:20.097862 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2577/5182] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:20 2022] DELETE /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:20.108330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:20.109854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] [instance: f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:20.117346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:20.118340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:20.119344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:20.120649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:20.122131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:20.122849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:20.144656 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] HTTP exception thrown: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Request method failure captured: Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 HTTP/1.1 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMI9eVlTomt4odZcJ7zzvvqQQAmy6NPSFI57Tpl2hpNJT26qzJLM_9tu5Nt6fc1Fez1t9PO_7WAFbCWDerZSs99n10S8Wrxj-EKMCTrU0NhKxbSOLSe_2h6AZOQiNgsmC146kiSaXRxqOgdWVLiZBvRbt5FU3qofARGMDrVI9JNnNBY Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7133cf27e350423c8cad75a57ee47ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 7133cf27e350423c8cad75a57ee47ca2 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840977609 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 26c244ca4ef34828a356a07af0d74302 Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeNegativeTest-840977609-project Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7'} Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:20.146523 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. Oct 26 05:23:20.151402 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:20.153740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] Returning 404 to user: Instance f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:20.154820 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a60b770-27a8-4371-8fdf-a3032417207c tempest-AttachVolumeNegativeTest-840977609 tempest-AttachVolumeNegativeTest-840977609-project] 10.222.0.16 "GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7" status: 404 len: 111 microversion: 2.1 time: 0.054270 Oct 26 05:23:20.159208 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2578/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:20 2022] GET /compute/v2.1/servers/f4d114f0-da2f-4ed6-a273-78d3a8dcc0f7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:20.813575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:20.816544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=10,nova_cell1:INSERT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:20.845500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:20.855672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:20.861708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-686f9e2a-e9d4-4001-8124-9cbfb44fa129 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 1.124033 Oct 26 05:23:20.863739 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2606/5184] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:19 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:20.892539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:20.893814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:20.910806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:20.912941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:20.913659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:20.932094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:20.935342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:20.935572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:21.002918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1313a1e5-b658-49a3-8254-9bbe7fd90304 req-e3d33005-ae74-4550-aa9e-51e9327fa82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fba0a6a-bc0d-40a6-8554-fe9cf373778f", "name": "network-vif-deleted", "tag": "31c450a0-2b83-4ee8-8e0c-23c61a4e3206"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:21.056151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1313a1e5-b658-49a3-8254-9bbe7fd90304 req-e3d33005-ae74-4550-aa9e-51e9327fa82a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:21.061997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1313a1e5-b658-49a3-8254-9bbe7fd90304 req-e3d33005-ae74-4550-aa9e-51e9327fa82a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:21.073393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1313a1e5-b658-49a3-8254-9bbe7fd90304 req-e3d33005-ae74-4550-aa9e-51e9327fa82a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:21.116916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:21.138526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1313a1e5-b658-49a3-8254-9bbe7fd90304 req-e3d33005-ae74-4550-aa9e-51e9327fa82a service nova] Creating event network-vif-deleted:31c450a0-2b83-4ee8-8e0c-23c61a4e3206 for instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f on n-h2-862416-4 Oct 26 05:23:21.156916 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1313a1e5-b658-49a3-8254-9bbe7fd90304 req-e3d33005-ae74-4550-aa9e-51e9327fa82a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155787 Oct 26 05:23:21.158017 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2607/5185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:21.182005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:21.191916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:21.220591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:21.224559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:21.228738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:21.236918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:21.238687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:21.240370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:21.611171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:21.627379 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2695f340-8a28-40d4-9fe1-988927110806 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1450 microversion: 2.1 time: 0.739209 Oct 26 05:23:21.647292 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2579/5186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:20 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1450 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:21.700895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:21.718041 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f078230-6ed3-4ae0-9e93-84a8b08f1ca0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1209 microversion: 2.1 time: 0.557455 Oct 26 05:23:21.722456 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2608/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:21 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1209 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:21.897005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:21.898955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:21.937103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:21.937646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:21.944458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:21.945242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:21.945893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:21.946399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:22.365165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:22.401962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:22.407479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:22.417460 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91243b0b-a19e-47e3-baea-ec957fbbbb4b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.525190 Oct 26 05:23:22.427316 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2580/5188] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:21 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:22.651801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:22.652486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:22.675483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:22.678252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:22.678804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:22.679619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:22.686691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:22.691130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:22.752210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:22.753005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:22.771359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:22.771890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:22.772345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:22.773139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:22.775829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:22.777343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:22.854752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:22.856299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:22.860058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:22.860886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lazy-loading 'fault' on Instance uuid 0fba0a6a-bc0d-40a6-8554-fe9cf373778f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:23:23.018661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:23.049895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-106b2b93-ea3f-423c-8e28-c3326be84a8e tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1304 microversion: 2.1 time: 0.402176 Oct 26 05:23:23.087886 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2609/5189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:22 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1304 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:23.193391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:23.206359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8bab01e-1c66-4568-b2de-602f5580dbef tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1273 microversion: 2.1 time: 0.461655 Oct 26 05:23:23.206978 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2581/5190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:22 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1273 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:23.457641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:23.460618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:23.475376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:23.475916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:23.476420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:23.477345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:23.480066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:23.491126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:23.819189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:23.837442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:23.839469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:23.840935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07cc6441-ea04-485d-905f-9f25d925383f tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.388475 Oct 26 05:23:23.843829 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2610/5191] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:23 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:24.114162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:24.114775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:24.123908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.124402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.124843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:24.125585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.126039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.126471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:24.215496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.216241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.216611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:24.216788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lazy-loading 'fault' on Instance uuid 0fba0a6a-bc0d-40a6-8554-fe9cf373778f {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:23:24.233782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:24.234453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:24.259634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.260405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.261046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:24.262173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.262811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.263408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:24.348041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:24.359868 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1a0d57b-ee07-4bb8-a6c3-7f71c43e56b9 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1304 microversion: 2.1 time: 0.249505 Oct 26 05:23:24.362735 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2582/5192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:24 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1304 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:24.443850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:24.456762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb179a9b-743a-4b64-902c-9a4cea96fea8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1271 microversion: 2.1 time: 0.227380 Oct 26 05:23:24.463056 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2611/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:24 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:24.873498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:24.874548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:24.895452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.899184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.899869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:24.900805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:24.901482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:24.904121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:25.172937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:25.183058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:25.185237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:25.186487 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fec154f9-39e4-4a19-8ad5-d135f8851c1a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.319942 Oct 26 05:23:25.187053 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2583/5194] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:24 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:25.393882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:25.394550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:25.404102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:25.404632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:25.405083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:25.410480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:25.418887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:25.419634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:25.487315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:25.488581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:25.500486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:25.501274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:25.506008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:25.509104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:25.509819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:25.510439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:25.515348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:25.515850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:25.516299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:25.516767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lazy-loading 'fault' on Instance uuid 0fba0a6a-bc0d-40a6-8554-fe9cf373778f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:23:25.628994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65ac46030b2744868d7235c5badf4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945d499d0daa4ad196f3f99a9f48c1bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:25.646179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10ae3ef1-254e-4814-96d6-82ba403ebec8 tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 200 len: 1304 microversion: 2.1 time: 0.247392 Oct 26 05:23:25.664502 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2612/5195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:25 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:25.747629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:25.759023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c454c5d3-4ef9-461a-9358-9c9915f43add tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1271 microversion: 2.1 time: 0.275563 Oct 26 05:23:25.759625 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2584/5196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:25 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:26.216111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:26.216732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:26.226758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:26.227468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:26.234411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:26.235431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:26.236079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:26.236678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:26.640902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:26.659533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:26.667280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:26.671444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f05fc96d-e755-44c3-990b-33700a452929 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.459165 Oct 26 05:23:26.675675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:26.677223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] [instance: 0fba0a6a-bc0d-40a6-8554-fe9cf373778f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:26.679640 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2613/5197] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:26 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:26.706002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:26.706555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:26.707000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:26.707942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:26.708609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:26.709208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:26.756520 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] HTTP exception thrown: Instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f could not be found. Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Request method failure captured: Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f HTTP/1.1 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPSw0pa3oyM3j76fp5PsZOjM78ZSigEvhfXks8zAkcazJDVVxUryQpCnigQqHVTk2kTJu89KrS3es8ZtrOg8fcvjGT_GBQG5u4kJQLJZZvBqnRZ6DMZVdhYLH0QL3FE4pHAmp3y90hShIEguN3y3wI2CZolN7BK1sek022gphpKnw8 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 945d499d0daa4ad196f3f99a9f48c1bd Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueTestJSON-1056392991 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/945d499d0daa4ad196f3f99a9f48c1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueTestJSON-1056392991 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 945d499d0daa4ad196f3f99a9f48c1bd Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueTestJSON-1056392991 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueTestJSON-1056392991-project Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 65ac46030b2744868d7235c5badf4cf2 Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueTestJSON-1056392991-project Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f could not be found. Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0fba0a6a-bc0d-40a6-8554-fe9cf373778f'} Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f could not be found. Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f could not be found. Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:26.765019 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f could not be found. Oct 26 05:23:26.771042 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:26.781452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] Returning 404 to user: Instance 0fba0a6a-bc0d-40a6-8554-fe9cf373778f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:26.786869 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff5c909c-7f4a-4ce2-a328-58ce9c089dfb tempest-ServerRescueTestJSON-1056392991 tempest-ServerRescueTestJSON-1056392991-project] 10.222.0.16 "GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f" status: 404 len: 111 microversion: 2.1 time: 0.113873 Oct 26 05:23:26.790291 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2585/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:26 2022] GET /compute/v2.1/servers/0fba0a6a-bc0d-40a6-8554-fe9cf373778f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:26.790488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:26.791126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:26.820963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:26.826591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:26.829845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:26.832438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:26.834444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:26.838166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:27.227583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:27.262287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5bae9961-aa3f-4f87-9aa5-dbe183a2fc91 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1271 microversion: 2.1 time: 0.466156 Oct 26 05:23:27.262665 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2614/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:26 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1271 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:27.708386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:27.709884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:27.734740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:27.739516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:27.739982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:27.742366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:27.744334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:27.753531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:28.213286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:28.224699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:28.226216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:28.243410 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bffb6b52-98bd-4455-8d96-73593bd1e77a tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.523408 Oct 26 05:23:28.244634 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2586/5200] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:27 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:28.288272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:28.290298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:28.316657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:28.319883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:28.320491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:28.326587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:28.329532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:28.330132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:28.778495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:28.793920 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ec13b99-5f05-4203-ab1a-4083fd4a6fe8 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1313 microversion: 2.1 time: 0.507780 Oct 26 05:23:28.805489 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2615/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:28 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:29.271965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:29.272593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:29.299841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:29.299841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:29.300283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:29.303337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:29.303869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:29.306578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:29.821305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:29.822713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:29.835046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:29.838993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:29.848180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:29.849066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:29.850291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:29.851444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:29.852473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:29.853140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:30.032628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:30.068213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:30.086401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:30.095686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:30.108569 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-606e0b6d-4247-4f18-9259-d52caa766221 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.832091 Oct 26 05:23:30.125943 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2587/5202] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:29 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:30.206735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:30.227231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d84c1986-2112-4e35-8169-770bcd59e9bf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1313 microversion: 2.1 time: 0.409899 Oct 26 05:23:30.243245 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2616/5203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:29 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:31.136533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:31.138466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:31.151687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:31.153537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:31.164974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:31.166220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:31.166906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:31.168956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:31.257274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:31.258699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:31.288270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:31.289139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:31.290200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:31.291487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:31.294366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:31.295390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:32.224125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:32.236854 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-230c91a8-0a9e-4cd6-be42-a36a117a34c6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1313 microversion: 2.1 time: 0.984500 Oct 26 05:23:32.245088 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2617/5204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:31 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1313 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:32.275770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:32.301527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:32.306515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:32.311279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-97833f23-802f-4bde-a01e-90e2a1632560 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 1.178834 Oct 26 05:23:32.342123 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2588/5205] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:31 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:33.271288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:33.272734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:33.292383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:33.293416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:33.294631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:33.295640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:33.296263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:33.296853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:33.345285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:33.346708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:33.364683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:33.365442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:33.366220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:33.370167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:33.370861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:33.374882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:33.862157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:33.867597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:33.875917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:33.877418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:33.878621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a774148e-b1c5-456d-9bf6-e17299cd2a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.541454 Oct 26 05:23:33.879199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2589/5206] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:33 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:33.896351 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-06b48d47-71eb-45f2-8d43-e335c7044be6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1334 microversion: 2.1 time: 0.613062 Oct 26 05:23:33.897398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2618/5207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:33 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1334 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:34.142590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1860569377", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:34.222147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] validate_networks() for [('933a08be-42cd-45ca-847a-1e91906d8571', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:23:34.910649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:34.912314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:34.929830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:34.930493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:34.931430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:34.933110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:34.934495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:34.937752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:35.181287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:23:35.181800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:23:35.182200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:23:35.182613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:23:35.183211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:23:35.206230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:35.208756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:35.209215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:35.210254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:35.210760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:35.214049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:35.233027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:35.247963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:35.250123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:35.251659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bb0ffc8-9ad4-48ae-8e72-3e3e5419fdc0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.346254 Oct 26 05:23:35.252752 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2619/5208] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:34 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:35.265425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:35.265583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Getting quotas for project 463e8f834f2a47a3b0621f437650d37a. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:23:35.267139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:35.273904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:35.275013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:35.275670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Getting quotas for user 2aa4205ada5a48c0a97dfd0fc2f6fc62 and project 463e8f834f2a47a3b0621f437650d37a. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:23:35.276256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:35.277219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:35.278078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:35.278673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:35.307394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:23:35.311545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:23:35.436128 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e2b28b0-c0e1-4bd9-aa2e-ccd883a4e009 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555721 Oct 26 05:23:35.437202 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2590/5209] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:23:35.456330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fc22a2f-c694-4e77-b284-87f99438db9f tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:35.457071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fc22a2f-c694-4e77-b284-87f99438db9f tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:35.594687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fc22a2f-c694-4e77-b284-87f99438db9f tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:35.602208 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fc22a2f-c694-4e77-b284-87f99438db9f tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1224 microversion: 2.1 time: 0.156746 Oct 26 05:23:35.603170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2591/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:35 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:35.656167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:35.669760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abbe591f-9b07-4337-8c01-21c9b6637214 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1334 microversion: 2.1 time: 0.413862 Oct 26 05:23:35.670641 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2620/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:35 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1334 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:36.281291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:36.282011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:36.296939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:36.305842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:36.306989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:36.307770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:36.308244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:36.309216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:36.628104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:36.629335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:36.641033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:36.642094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:36.642653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:36.643824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:36.644874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:36.645508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:36.665608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:36.691267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:36.708597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:36.713282 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f061d8af-bc2d-4d13-b1ca-09bdf3ec31c9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.436679 Oct 26 05:23:36.733351 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2592/5212] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:36 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:36.740374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:36.745807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:36.771788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:36.772613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:36.775794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:36.780776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:36.782432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:36.783042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:36.969546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:36.990161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da301eb6-1cc2-43ce-9b8e-5b5be4c66094 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1228 microversion: 2.1 time: 0.365733 Oct 26 05:23:37.005379 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2621/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:36 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1228 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:37.260482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:37.278666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9bba34e0-ec7d-449e-aec4-b21f7b9424ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.556427 Oct 26 05:23:37.279175 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2593/5214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:36 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:37.748187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:37.749385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:37.766181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:37.767029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:37.767704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:37.768608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:37.769233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:37.770782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:38.019034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:38.019815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:38.037451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:38.038196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:38.038913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:38.039861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:38.040530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:38.041153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:38.051822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:38.067391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:38.071817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:38.076322 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7158ba4a-175c-4273-add5-51343bd708d4 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.333484 Oct 26 05:23:38.079477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2622/5215] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:37 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:38.217477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:38.232171 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1801f5af-7072-47d0-9d2e-b51a36f59e43 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1276 microversion: 2.1 time: 0.217693 Oct 26 05:23:38.234149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2594/5216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:38 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:38.302989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:38.303615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:38.317991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:38.318424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:38.321247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:38.322086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:38.323066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:38.325533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:38.365266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:39.110270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:39.111698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:39.130215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:39.131739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:39.132921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:39.136835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:39.137832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:39.138451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:39.400482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:39.410500 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b21a1031-32bd-4e25-a3d1-63076c3a7bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 1.111950 Oct 26 05:23:39.413795 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2623/5217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:38 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:39.427262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-94994442-ba7c-41c2-8eca-9753e90dcd2c req-419bb91e-bd88-45c9-af9c-6f6b078ebb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "tag": "469ca255-c764-4412-a39b-51ad317903bd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:39.447159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-94994442-ba7c-41c2-8eca-9753e90dcd2c req-419bb91e-bd88-45c9-af9c-6f6b078ebb26 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:39.450057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-94994442-ba7c-41c2-8eca-9753e90dcd2c req-419bb91e-bd88-45c9-af9c-6f6b078ebb26 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:39.450787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-94994442-ba7c-41c2-8eca-9753e90dcd2c req-419bb91e-bd88-45c9-af9c-6f6b078ebb26 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:39.470913 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-94994442-ba7c-41c2-8eca-9753e90dcd2c req-419bb91e-bd88-45c9-af9c-6f6b078ebb26 service nova] Creating event network-changed:469ca255-c764-4412-a39b-51ad317903bd for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:23:39.477805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-94994442-ba7c-41c2-8eca-9753e90dcd2c req-419bb91e-bd88-45c9-af9c-6f6b078ebb26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061526 Oct 26 05:23:39.479156 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2624/5218] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:39.486374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:39.487473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:39.496780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:39.497574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:39.498298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:39.499272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:39.500036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:39.500737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:39.630835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:39.640610 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-41b48f09-30be-4aa1-b266-d0fd9424d374 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1282 microversion: 2.1 time: 0.159992 Oct 26 05:23:39.645134 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2625/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:39 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:39.790120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:39.800559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:39.804442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:39.806381 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c205723-e9e7-495b-8df9-d5e910f3c1f0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.702703 Oct 26 05:23:39.808097 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2595/5220] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:39 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:23:40.145298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:40.154651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:40.170042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:40.171856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.174284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.177084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.179238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.180643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.193974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.277401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:23:40.437952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:40.439292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:40.450122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.459103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.459940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.461118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.461851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.463226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.490248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63491d4d-1d06-4c5b-9cf4-596674eeba6b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 204 len: 0 microversion: 2.1 time: 0.348633 Oct 26 05:23:40.493437 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2626/5221] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:40 2022] DELETE /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:23:40.509435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:40.512002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:40.522559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.525806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.530199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.533103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.535372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.535991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.872544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:40.886209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0db3c49-20a7-4eee-89cd-da259eee8925 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1552 microversion: 2.1 time: 0.385293 Oct 26 05:23:40.887555 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2627/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:40 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1552 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:40.895176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:40.895797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:40.916064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.916355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.916752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.917529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:40.918074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:40.918736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:40.975310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:40.988697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0d6d7eb6-6217-4f76-889d-21b3646032d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.554577 Oct 26 05:23:40.990980 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2596/5223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:40 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:40.997423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b17311de-a738-449e-b4df-5a6796ea0ece req-77737099-7d37-4f3f-8674-78c8592568c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "name": "network-vif-plugged", "status": "completed", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:41.020566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b17311de-a738-449e-b4df-5a6796ea0ece req-77737099-7d37-4f3f-8674-78c8592568c2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.021384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b17311de-a738-449e-b4df-5a6796ea0ece req-77737099-7d37-4f3f-8674-78c8592568c2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.022018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b17311de-a738-449e-b4df-5a6796ea0ece req-77737099-7d37-4f3f-8674-78c8592568c2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:41.053269 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b17311de-a738-449e-b4df-5a6796ea0ece req-77737099-7d37-4f3f-8674-78c8592568c2 service nova] Creating event network-vif-plugged:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:23:41.061436 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b17311de-a738-449e-b4df-5a6796ea0ece req-77737099-7d37-4f3f-8674-78c8592568c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068733 Oct 26 05:23:41.062888 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2597/5224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:41.088903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:41.090759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:41.112276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.113330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.113970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:41.119183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.120090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.121102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:41.299329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:41.312785 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d36ae25-316a-44e0-97b9-d5572a5fc524 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 0.422793 Oct 26 05:23:41.313813 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2628/5225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:40 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:41.330077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:41.330576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:41.342617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.343126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.343575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:41.344300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.344761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.345188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:41.409954 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1fa9c93-a3c7-4110-b9cc-39ee2e4a2a6c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/ips" status: 200 len: 146 microversion: 2.1 time: 0.094923 Oct 26 05:23:41.410560 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2629/5226] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:23:41 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/ips => generated 146 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:41.551891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:41.563674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:41.576179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:41.578742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:41.595392 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-697b613a-523b-443e-803c-01cf74de44f9 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.529756 Oct 26 05:23:41.601405 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2598/5227] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:41 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:41.915117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:41.916374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:41.926725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.927231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.927704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:41.928418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:41.928875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:41.929299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.016646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:42.017185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:42.026334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:42.027269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:42.027967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.028938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:42.029761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:42.031014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.353032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:42.363029 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48f65b0a-96da-43da-945e-80019ee033ec tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.350774 Oct 26 05:23:42.363627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2599/5228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:42 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:42.399211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:42.399904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:42.420094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:42.422769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:42.434362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.436515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:42.440046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:42.442460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.539235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:42.556010 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-644a4609-f825-4a0b-910f-61207f6ebaa8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1552 microversion: 2.1 time: 0.644633 Oct 26 05:23:42.557552 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2630/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:41 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1552 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:42.633111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:42.633782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:42.644987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:42.645821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:42.646450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.650565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:42.651821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:42.652658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:42.968005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:42.977945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-78d074a9-a0ab-4a38-832a-9ba8ff1b4570 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 0.594397 Oct 26 05:23:42.982595 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2600/5230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:42 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:43.151528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a13ab6e4-8100-48ff-849c-0003772663aa req-45033aa6-9b87-49db-b400-1b77c699dd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "tag": "eaddccf5-62c7-49b7-8e15-ddb754f0bd97"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:43.179980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a13ab6e4-8100-48ff-849c-0003772663aa req-45033aa6-9b87-49db-b400-1b77c699dd3f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:43.180966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a13ab6e4-8100-48ff-849c-0003772663aa req-45033aa6-9b87-49db-b400-1b77c699dd3f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:43.183509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a13ab6e4-8100-48ff-849c-0003772663aa req-45033aa6-9b87-49db-b400-1b77c699dd3f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:43.237697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a13ab6e4-8100-48ff-849c-0003772663aa req-45033aa6-9b87-49db-b400-1b77c699dd3f service nova] Creating event network-changed:eaddccf5-62c7-49b7-8e15-ddb754f0bd97 for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:23:43.258909 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a13ab6e4-8100-48ff-849c-0003772663aa req-45033aa6-9b87-49db-b400-1b77c699dd3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111103 Oct 26 05:23:43.259532 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2601/5231] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:23:43.291461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:43.304449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:43.305980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:43.307190 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-853ab45c-c562-4b6f-a478-c1a1c3a53a7b tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.678205 Oct 26 05:23:43.324520 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2631/5232] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:42 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:43.362967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e1aaff41-3700-4f85-8df1-3e988ffa96ba req-ea15ef20-fc1e-4b83-bda8-769fd74f5698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04740648-2164-4199-9c29-0e28eba4efd7", "tag": "03fe8e68-43ba-451d-a893-4973c48c3a7a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:43.390008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:43.390891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:43.398498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:43.405689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e1aaff41-3700-4f85-8df1-3e988ffa96ba req-ea15ef20-fc1e-4b83-bda8-769fd74f5698 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:43.407734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:43.408394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:43.415174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:43.416549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e1aaff41-3700-4f85-8df1-3e988ffa96ba req-ea15ef20-fc1e-4b83-bda8-769fd74f5698 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:43.417217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e1aaff41-3700-4f85-8df1-3e988ffa96ba req-ea15ef20-fc1e-4b83-bda8-769fd74f5698 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:43.419858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:43.421919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:43.473824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e1aaff41-3700-4f85-8df1-3e988ffa96ba req-ea15ef20-fc1e-4b83-bda8-769fd74f5698 service nova] Creating event network-changed:03fe8e68-43ba-451d-a893-4973c48c3a7a for instance 04740648-2164-4199-9c29-0e28eba4efd7 on n-h2-862416-4 Oct 26 05:23:43.487279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e1aaff41-3700-4f85-8df1-3e988ffa96ba req-ea15ef20-fc1e-4b83-bda8-769fd74f5698 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130142 Oct 26 05:23:43.488329 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2602/5233] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:43.585265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:43.586777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:43.598010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:43.598529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:43.599299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:43.600208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:43.600827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:43.601468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:43.927186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:43.942886 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b310d2dd-ed68-4e9c-afa0-bbaa6d04bcb6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.557125 Oct 26 05:23:43.943304 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2632/5234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:43 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:44.008679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:44.010026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:44.021350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.022304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.023557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:44.024655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.027853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.028548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:44.060036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:44.076730 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1be227c4-f119-417a-bd67-d21d214ccef8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1552 microversion: 2.1 time: 0.494982 Oct 26 05:23:44.077483 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2603/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:43 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1552 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:44.333338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-00f64c2a-8177-4c97-9966-0f5f9b649153 req-96ecb9ba-bdd3-41be-9a71-9c4a5c4b2856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35f7e6f-981b-4d57-9a68-131b7f986021", "name": "network-vif-unplugged", "status": "completed", "tag": "45b187fd-251d-47f3-95d3-bdd43a3b3697"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:44.354267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00f64c2a-8177-4c97-9966-0f5f9b649153 req-96ecb9ba-bdd3-41be-9a71-9c4a5c4b2856 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.355671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00f64c2a-8177-4c97-9966-0f5f9b649153 req-96ecb9ba-bdd3-41be-9a71-9c4a5c4b2856 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.356497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00f64c2a-8177-4c97-9966-0f5f9b649153 req-96ecb9ba-bdd3-41be-9a71-9c4a5c4b2856 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:44.370504 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-00f64c2a-8177-4c97-9966-0f5f9b649153 req-96ecb9ba-bdd3-41be-9a71-9c4a5c4b2856 service nova] Creating event network-vif-unplugged:45b187fd-251d-47f3-95d3-bdd43a3b3697 for instance a35f7e6f-981b-4d57-9a68-131b7f986021 on n-h1-862416-4 Oct 26 05:23:44.377981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-00f64c2a-8177-4c97-9966-0f5f9b649153 req-96ecb9ba-bdd3-41be-9a71-9c4a5c4b2856 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049478 Oct 26 05:23:44.379164 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2604/5236] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:44.385902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:44.386855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:44.388564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:44.399368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.400118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.400724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:44.401825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.403246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.404110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:44.418804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b48b1fc-2a98-47bc-8925-f7f897f3c23e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 0.413940 Oct 26 05:23:44.426560 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2633/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:44 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:44.668712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:44.690097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:44.700701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:44.705691 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce6eba12-982e-49a3-a6f5-ab9137581779 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 0.322886 Oct 26 05:23:44.706577 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2605/5238] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:44 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:44.970393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:44.971015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:44.977792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.982279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.982828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:44.983641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:44.985083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:44.985707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.105940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:45.107762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:45.114240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:45.115546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:45.117017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.118348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:45.118980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:45.119612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.244543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:45.303053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:45.334825 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-27a6405f-ebc4-4036-94bb-396afa122425 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.368382 Oct 26 05:23:45.339729 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2634/5239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:44 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:45.430516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:45.455739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:45.460691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:45.486417 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c1ab160-6711-408d-9961-81e7d351b4c8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 200 len: 1485 microversion: 2.1 time: 0.385442 Oct 26 05:23:45.496117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:45.499913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:45.503735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.512829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:45.513652 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2606/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:45 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 1485 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:45.514561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:45.515626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.532082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab22955-597b-4744-b105-1884f18361ec"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:45.537078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:45.553616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:45.554968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:45.556157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.557807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:45.559820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:45.561049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:45.646775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:46.163328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf7e8a1f-d7dd-426c-9795-3db9eaf82b9e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648059 Oct 26 05:23:46.164334 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2607/5241] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:23:45 2022] POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:46.178756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-00018791-ec80-4e71-9f75-fdd0c41a7aaa req-c83c2065-2840-418d-aec2-c9d34d0b3d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35f7e6f-981b-4d57-9a68-131b7f986021", "name": "network-vif-deleted", "tag": "45b187fd-251d-47f3-95d3-bdd43a3b3697"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:46.192054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00018791-ec80-4e71-9f75-fdd0c41a7aaa req-c83c2065-2840-418d-aec2-c9d34d0b3d3f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:46.192840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00018791-ec80-4e71-9f75-fdd0c41a7aaa req-c83c2065-2840-418d-aec2-c9d34d0b3d3f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:46.193547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00018791-ec80-4e71-9f75-fdd0c41a7aaa req-c83c2065-2840-418d-aec2-c9d34d0b3d3f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:46.209069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-00018791-ec80-4e71-9f75-fdd0c41a7aaa req-c83c2065-2840-418d-aec2-c9d34d0b3d3f service nova] Creating event network-vif-deleted:45b187fd-251d-47f3-95d3-bdd43a3b3697 for instance a35f7e6f-981b-4d57-9a68-131b7f986021 on n-h1-862416-4 Oct 26 05:23:46.218216 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-00018791-ec80-4e71-9f75-fdd0c41a7aaa req-c83c2065-2840-418d-aec2-c9d34d0b3d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051633 Oct 26 05:23:46.219275 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2608/5242] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:46.228728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:46.229836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:46.241844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:46.242863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:46.243585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:46.244870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:46.246347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:46.247008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:46.960555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:46.982319 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8993e7e-b4f0-4729-9b22-eb6223701653 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 1.531780 Oct 26 05:23:47.016377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2635/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:45 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:47.029433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:47.035135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:47.052591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:47.057979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:47.060769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:47.064001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:47.065283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:47.070195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:47.378976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:47.395338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:47.399632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:47.408039 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-948a5987-9c96-4169-bdc6-2e1dd8e315b6 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1731 microversion: 2.20 time: 1.185674 Oct 26 05:23:47.410286 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2609/5244] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:46 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1731 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:47.426146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:47.427524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: a35f7e6f-981b-4d57-9a68-131b7f986021] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:47.429964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:47.448125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:47.451947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:47.452649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:47.456597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:47.457391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:47.458010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:47.497416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] HTTP exception thrown: Instance a35f7e6f-981b-4d57-9a68-131b7f986021 could not be found. Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Request method failure captured: Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 HTTP/1.1 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPFU2h-VGZk3WRsPv1BCOiOS_yKXCoX1_lfk4vlkw40qalVO1t5L7duAW2-whMMjIIJLhwPlhG1Gfhe-OJkQOD9dgeeMLNok3nR-8zfwPf-jMjx4sVAhn8c-EdZyyHe4mX7vDR4DNMwscoDNs_qrggZAHx5bKv0eeibpFdAjMbjOpI Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 227e01c08a304cb1b59273127d4ad575 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_227e01c08a304cb1b59273127d4ad575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 227e01c08a304cb1b59273127d4ad575 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkBasicOps-1735840462-project Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 91321abeaa5248beaadc6edf76c96886 Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkBasicOps-1735840462-project Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a35f7e6f-981b-4d57-9a68-131b7f986021 could not be found. Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a35f7e6f-981b-4d57-9a68-131b7f986021'} Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a35f7e6f-981b-4d57-9a68-131b7f986021 could not be found. Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a35f7e6f-981b-4d57-9a68-131b7f986021 could not be found. Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:47.501488 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a35f7e6f-981b-4d57-9a68-131b7f986021 could not be found. Oct 26 05:23:47.506629 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:47.510613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Returning 404 to user: Instance a35f7e6f-981b-4d57-9a68-131b7f986021 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:47.516589 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1e782d3b-a349-4113-9ee5-385914bbe6a7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021" status: 404 len: 111 microversion: 2.1 time: 0.100538 Oct 26 05:23:47.517691 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2610/5245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:47 2022] GET /compute/v2.1/servers/a35f7e6f-981b-4d57-9a68-131b7f986021 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:47.637124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:47.650540 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d3357174-b7b4-477b-9f24-d4842446317e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.631155 Oct 26 05:23:47.654673 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2636/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:47 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:48.022614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:48.023476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:48.034310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:48.035710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:48.036833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:48.039332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:48.040692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:48.045265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:48.266393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-85f44de4-d231-46cd-8ec6-074f3677f29b req-ed8b5973-f167-48e8-9e5e-ccb2730051fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "tag": "63a89396-5d40-47a3-a7db-eb71e69fe9b7"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:48.305128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85f44de4-d231-46cd-8ec6-074f3677f29b req-ed8b5973-f167-48e8-9e5e-ccb2730051fb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:48.305673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85f44de4-d231-46cd-8ec6-074f3677f29b req-ed8b5973-f167-48e8-9e5e-ccb2730051fb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:48.306115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85f44de4-d231-46cd-8ec6-074f3677f29b req-ed8b5973-f167-48e8-9e5e-ccb2730051fb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:48.374821 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-85f44de4-d231-46cd-8ec6-074f3677f29b req-ed8b5973-f167-48e8-9e5e-ccb2730051fb service nova] Creating event network-changed:63a89396-5d40-47a3-a7db-eb71e69fe9b7 for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:23:48.386607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-85f44de4-d231-46cd-8ec6-074f3677f29b req-ed8b5973-f167-48e8-9e5e-ccb2730051fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126325 Oct 26 05:23:48.390268 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2637/5247] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:48.402601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a15c73a0-7275-4792-8901-ce584d5bf5ea tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '.version_select at 0x7f47095d0a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:48.457580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a15c73a0-7275-4792-8901-ce584d5bf5ea tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2033597239" status: 202 len: 0 microversion: 2.1 time: 0.065668 Oct 26 05:23:48.470809 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2638/5248] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 05:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2033597239 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:23:48.480685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:48.483767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:48.505748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:48.507416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:48.508879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:48.510386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:48.513361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:48.519030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:48.954671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:48.968050 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd06b8dd-6fd0-4d72-b162-184e79a7a7e7 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 0.950422 Oct 26 05:23:48.969790 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2611/5249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:48 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:48.986874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:48.989007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:48.998368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:48.999107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:48.999702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:49.000889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:49.001545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:49.002295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:50.109235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:50.124363 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7bc2870c-5a92-430e-8527-242597ae9414 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 1.152744 Oct 26 05:23:50.125820 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2612/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:48 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:50.131030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:50.132338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:50.142427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:50.142920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:50.143359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:50.145182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:50.145294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:50.146180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:50.153110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:50.166179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:50.170713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:50.190106 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22bcbb65-adad-4665-8e98-c8e92a6748c8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1718 microversion: 2.20 time: 1.717804 Oct 26 05:23:50.193287 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2639/5251] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:23:48 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1718 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:23:50.495169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:50.503931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-de131467-a706-41a9-9de8-3ce599155838 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 0.376971 Oct 26 05:23:50.512401 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2613/5252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:50 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:50.774908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3336b27f-bb8f-49d4-a304-760a9a6be3ca req-30aa2901-3670-4477-b498-21a696bd7638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04740648-2164-4199-9c29-0e28eba4efd7", "name": "network-vif-plugged", "status": "completed", "tag": "03fe8e68-43ba-451d-a893-4973c48c3a7a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:50.825369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3336b27f-bb8f-49d4-a304-760a9a6be3ca req-30aa2901-3670-4477-b498-21a696bd7638 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:50.825868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3336b27f-bb8f-49d4-a304-760a9a6be3ca req-30aa2901-3670-4477-b498-21a696bd7638 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:50.839890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3336b27f-bb8f-49d4-a304-760a9a6be3ca req-30aa2901-3670-4477-b498-21a696bd7638 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:50.875285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3336b27f-bb8f-49d4-a304-760a9a6be3ca req-30aa2901-3670-4477-b498-21a696bd7638 service nova] Creating event network-vif-plugged:03fe8e68-43ba-451d-a893-4973c48c3a7a for instance 04740648-2164-4199-9c29-0e28eba4efd7 on n-h2-862416-4 Oct 26 05:23:50.897904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3336b27f-bb8f-49d4-a304-760a9a6be3ca req-30aa2901-3670-4477-b498-21a696bd7638 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124666 Oct 26 05:23:50.899801 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2640/5253] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:51.149583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:51.150888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:51.174663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:51.175178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:51.175629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:51.185729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:51.186796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:51.187464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:51.540119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:51.543189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:51.550734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:51.559927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:51.560428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:51.563475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:51.564164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:51.564637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:51.565073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:51.582679 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-447aaf4e-36b6-48d3-96e1-ad8cd986da6f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.438572 Oct 26 05:23:51.606094 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2614/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:51 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:52.070435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:52.078266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:52.083450 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffbd862c-61ed-4ea2-befd-c71ce5739110 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 0.548617 Oct 26 05:23:52.084680 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2641/5255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:51 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:52.615146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:52.615791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:52.644939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:52.648378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:52.650328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:52.655896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:52.659269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:52.660412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:52.743297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1344840076", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:52.874473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:23:53.423099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:53.450976 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a1e3de26-f10b-458f-850f-0491819525a0 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.839272 Oct 26 05:23:53.453464 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2642/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:52 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:53.467880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:53.469111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:53.491467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:53.493345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:53.494451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:53.496862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:53.497618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:53.499616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:54.650361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:54.663951 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-094056b0-d899-4e92-9c07-074d3dd715ec tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1324 microversion: 2.1 time: 1.209160 Oct 26 05:23:54.664867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2643/5257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:53 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1324 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:54.682025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:54.687920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:54.695008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:54.695513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:54.695962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:54.696682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:54.697150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:54.697610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.048330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:23:55.049197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:23:55.049718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:23:55.050136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:23:55.050558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:23:55.065112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.065662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.072775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.074484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.074972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.076933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.126530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:23:55.138780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:23:55.156727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:23:55.163898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:23:55.273083 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed397436-76af-4963-a675-149cc4e5cc16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.085758 Oct 26 05:23:55.280736 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2615/5258] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:23:55.314497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3c145da-1525-4f07-89e8-edd04b3f083c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:55.316348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3c145da-1525-4f07-89e8-edd04b3f083c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:55.388608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:55.404308 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b0eb94e-c264-4a36-88b1-f87bac710547 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.737308 Oct 26 05:23:55.409169 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2644/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:54 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:55.525388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3c145da-1525-4f07-89e8-edd04b3f083c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:55.549902 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3c145da-1525-4f07-89e8-edd04b3f083c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1193 microversion: 2.1 time: 0.264706 Oct 26 05:23:55.552804 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2616/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:55 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1193 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:55.605076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:55.605895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:55.615649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.617523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.624106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.625861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fda73e09-7c63-4dcf-afe4-70c48556bd84 req-106f7673-46c5-4afc-8021-1196bd828a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b541231-8d6a-40d6-9c01-0ae06c0e8f5c", "tag": "fe7d4e3f-8fa7-40f7-97fa-f783e80262ba"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:55.631709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.632217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.635510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.642890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fda73e09-7c63-4dcf-afe4-70c48556bd84 req-106f7673-46c5-4afc-8021-1196bd828a8d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.647455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fda73e09-7c63-4dcf-afe4-70c48556bd84 req-106f7673-46c5-4afc-8021-1196bd828a8d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.649354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fda73e09-7c63-4dcf-afe4-70c48556bd84 req-106f7673-46c5-4afc-8021-1196bd828a8d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.690189 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fda73e09-7c63-4dcf-afe4-70c48556bd84 req-106f7673-46c5-4afc-8021-1196bd828a8d service nova] Creating event network-changed:fe7d4e3f-8fa7-40f7-97fa-f783e80262ba for instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c on n-h1-862416-4 Oct 26 05:23:55.702691 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fda73e09-7c63-4dcf-afe4-70c48556bd84 req-106f7673-46c5-4afc-8021-1196bd828a8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082586 Oct 26 05:23:55.709445 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2617/5261] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 26 05:23:55.712590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:23:55.722633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:55.723525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:55.748983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.753867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.754381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.755230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:55.755701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:55.756139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:55.977769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c10869cf-0f45-4a90-93f5-82677b03130b tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 204 len: 0 microversion: 2.1 time: 0.383640 Oct 26 05:23:55.980517 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2645/5262] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:55 2022] DELETE /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:23:55.990904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:55.996965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:56.021019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:56.025137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:56.031426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:56.041589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:56.042904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:56.043745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:56.336115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:56.356475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c486c55-2b10-4c9c-8454-6143a44d4d17 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1520 microversion: 2.1 time: 0.640429 Oct 26 05:23:56.369345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2618/5263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:55 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1520 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:56.474360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:56.475720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:56.486634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:56.490377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:56.491127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:56.493153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:56.495033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:56.496043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:56.568346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:56.585417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fd172a4-c88f-45ce-b049-4d07000d2273 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1671 microversion: 2.1 time: 0.599698 Oct 26 05:23:56.586025 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2646/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:55 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1671 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:56.597544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:56.602009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:56.623976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:56.624488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:56.624937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:56.625757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:56.626231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:56.626650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:56.795479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:56.810814 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7ec6908-7235-4a59-a6ba-e714ba27bd86 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1197 microversion: 2.1 time: 0.223703 Oct 26 05:23:56.812212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2647/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:56 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:56.819022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b87c1fd-b435-4349-8c65-88d1333b849b tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-354260026", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b87c1fd-b435-4349-8c65-88d1333b849b tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 242 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-354260026", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-354260026', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '933a08be-42cd-45ca-847a-1e91906d8571'}]}}} Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:23:56.824711 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:56.829600 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.831512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:56.831512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:23:56.833129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b87c1fd-b435-4349-8c65-88d1333b849b tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:56.834325 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8b87c1fd-b435-4349-8c65-88d1333b849b tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021116 Oct 26 05:23:56.835665 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2648/5266] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:56 2022] POST /compute/v2.1/servers => generated 175 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:23:56.838921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-760ed662-bde9-4f9a-b20d-7248ba49c621 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.395503 Oct 26 05:23:56.839784 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2619/5267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:56 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:56.860276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54c224e6-4de9-4bae-a98e-b292131c1800 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:56.860940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-54c224e6-4de9-4bae-a98e-b292131c1800 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: d77ab6ad-aade-4c7e-92dc-044959970dfe] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:56.872748 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-54c224e6-4de9-4bae-a98e-b292131c1800 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] HTTP exception thrown: Instance d77ab6ad-aade-4c7e-92dc-044959970dfe could not be found. Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54c224e6-4de9-4bae-a98e-b292131c1800 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d77ab6ad-aade-4c7e-92dc-044959970dfe/metadata HTTP/1.1 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d77ab6ad-aade-4c7e-92dc-044959970dfe could not be found. Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': 'd77ab6ad-aade-4c7e-92dc-044959970dfe'} Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d77ab6ad-aade-4c7e-92dc-044959970dfe could not be found. Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d77ab6ad-aade-4c7e-92dc-044959970dfe could not be found. Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:56.892325 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:56.897195 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:56.897195 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:56.897195 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d77ab6ad-aade-4c7e-92dc-044959970dfe could not be found. Oct 26 05:23:56.897195 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:56.897195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54c224e6-4de9-4bae-a98e-b292131c1800 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 404 to user: Instance d77ab6ad-aade-4c7e-92dc-044959970dfe could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:56.899198 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54c224e6-4de9-4bae-a98e-b292131c1800 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/d77ab6ad-aade-4c7e-92dc-044959970dfe/metadata" status: 404 len: 111 microversion: 2.1 time: 0.056621 Oct 26 05:23:56.899968 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2649/5268] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:23:56 2022] GET /compute/v2.1/servers/d77ab6ad-aade-4c7e-92dc-044959970dfe/metadata => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:56.996809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6b825849-160f-43ac-8027-4255915d8163 req-6148f49b-cc68-4d29-9572-fa9d74762b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "name": "network-vif-plugged", "status": "completed", "tag": "469ca255-c764-4412-a39b-51ad317903bd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:57.007726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6b825849-160f-43ac-8027-4255915d8163 req-6148f49b-cc68-4d29-9572-fa9d74762b01 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.008393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6b825849-160f-43ac-8027-4255915d8163 req-6148f49b-cc68-4d29-9572-fa9d74762b01 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.009020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6b825849-160f-43ac-8027-4255915d8163 req-6148f49b-cc68-4d29-9572-fa9d74762b01 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.022520 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6b825849-160f-43ac-8027-4255915d8163 req-6148f49b-cc68-4d29-9572-fa9d74762b01 service nova] Creating event network-vif-plugged:469ca255-c764-4412-a39b-51ad317903bd for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:23:57.033944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6b825849-160f-43ac-8027-4255915d8163 req-6148f49b-cc68-4d29-9572-fa9d74762b01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042232 Oct 26 05:23:57.034353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4aab1597-ce7d-4942-982d-d19b98c471e4 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1076724853", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:57.034918 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2620/5269] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4aab1597-ce7d-4942-982d-d19b98c471e4 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 499 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1076724853", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1076724853', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '933a08be-42cd-45ca-847a-1e91906d8571'}]}}} Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:23:57.038597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4aab1597-ce7d-4942-982d-d19b98c471e4 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4aab1597-ce7d-4942-982d-d19b98c471e4 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.009604 Oct 26 05:23:57.051596 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2650/5270] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:23:57.174576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-919d683c-384c-4bba-9c48-e96d0cc4d049 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-967897241", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-919d683c-384c-4bba-9c48-e96d0cc4d049 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 499 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-967897241", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-967897241', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '933a08be-42cd-45ca-847a-1e91906d8571'}]}}} Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:23:57.198001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.203091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-919d683c-384c-4bba-9c48-e96d0cc4d049 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:57.216518 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-919d683c-384c-4bba-9c48-e96d0cc4d049 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.049303 Oct 26 05:23:57.216518 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2621/5271] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:23:57.344471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f821c34-0671-4b21-969b-6a8cabf39182 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1430652479", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f821c34-0671-4b21-969b-6a8cabf39182 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 754 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1430652479", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1430652479', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '933a08be-42cd-45ca-847a-1e91906d8571'}]}}} Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:23:57.349878 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:23:57.352526 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:23:57.355821 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.355821 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.355821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f821c34-0671-4b21-969b-6a8cabf39182 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:57.355821 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f821c34-0671-4b21-969b-6a8cabf39182 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011054 Oct 26 05:23:57.361014 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2651/5272] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:23:57 2022] POST /compute/v2.1/servers => generated 1197 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 26 05:23:57.422137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-738f782d-85a5-4809-ab01-3b834832c04a tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-437353452", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-738f782d-85a5-4809-ab01-3b834832c04a tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 1265 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-437353452", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "933a08be-42cd-45ca-847a-1e91906d8571"}]}} Oct 26 05:23:57.456376 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-437353452', 'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '933a08be-42cd-45ca-847a-1e91906d8571'}]}}} Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise error Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.458515 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 05:23:57.459665 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 05:23:57.461509 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 26 05:23:57.461509 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.461509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-738f782d-85a5-4809-ab01-3b834832c04a tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:57.461509 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-738f782d-85a5-4809-ab01-3b834832c04a tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.042694 Oct 26 05:23:57.463230 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2622/5273] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Oct 26 05:23:57 2022] POST /compute/v2.1/servers => generated 2221 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 26 05:23:57.472953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ac223ef-d0ff-43a3-b156-5d1dfd865845 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:57.473494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7ac223ef-d0ff-43a3-b156-5d1dfd865845 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 77f4a520-d64a-4097-8c6f-be251b624342] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:57.486897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7ac223ef-d0ff-43a3-b156-5d1dfd865845 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] HTTP exception thrown: Instance 77f4a520-d64a-4097-8c6f-be251b624342 could not be found. Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ac223ef-d0ff-43a3-b156-5d1dfd865845 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/77f4a520-d64a-4097-8c6f-be251b624342/metadata/test2 HTTP/1.1 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 77f4a520-d64a-4097-8c6f-be251b624342 could not be found. Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '77f4a520-d64a-4097-8c6f-be251b624342', 'id': 'test2'} Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f4a520-d64a-4097-8c6f-be251b624342 could not be found. Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f4a520-d64a-4097-8c6f-be251b624342 could not be found. Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:23:57.488428 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f4a520-d64a-4097-8c6f-be251b624342 could not be found. Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7ac223ef-d0ff-43a3-b156-5d1dfd865845 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 404 to user: Instance 77f4a520-d64a-4097-8c6f-be251b624342 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7ac223ef-d0ff-43a3-b156-5d1dfd865845 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/77f4a520-d64a-4097-8c6f-be251b624342/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.021271 Oct 26 05:23:57.504104 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2652/5274] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 05:23:57 2022] GET /compute/v2.1/servers/77f4a520-d64a-4097-8c6f-be251b624342/metadata/test2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:23:57.505448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:57.506581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:57.522190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.523532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.526004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.527889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.529779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.530392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.611705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:57.612255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:57.620206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:23:57.624997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.625880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.629889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.631873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.632326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.636847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.785177 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aed6eb7b-a74a-4783-9e27-e982e6b03462 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "DELETE /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 204 len: 0 microversion: 2.1 time: 0.284700 Oct 26 05:23:57.785888 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2623/5275] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:23:57 2022] DELETE /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:23:57.804229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:57.805071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:57.817892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.825715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.826524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.827481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.828108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.829302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.863183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:57.874360 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1dc7ae4-54d9-4dc8-ace4-d949af3e255c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1671 microversion: 2.1 time: 0.266564 Oct 26 05:23:57.893062 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2653/5276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:57 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1671 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:57.906508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:57.907307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:57.923005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.923781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.924391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:57.925303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:57.925788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:57.926222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.071927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:58.081754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-860063a5-339e-49ab-a8dc-eecef989bc87 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1245 microversion: 2.1 time: 0.187447 Oct 26 05:23:58.082354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2654/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:57 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1245 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:58.090522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:58.091362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:58.107599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:58.108385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:58.109030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.110025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:58.110719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:58.111391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.149972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:58.169589 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d060d9a-5195-4b47-9abd-08ad0ae6a393 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1526 microversion: 2.1 time: 0.379289 Oct 26 05:23:58.181581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2624/5278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:57 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1526 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:58.331635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:58.342897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f140db74-e897-499f-b372-14ac91895fc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.256198 Oct 26 05:23:58.344141 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2655/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:58 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:58.710396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8c85a670-d857-43e4-85dc-96a7e3cbc56e req-5d2c1762-6c21-40b9-8cc5-7565573b01eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b541231-8d6a-40d6-9c01-0ae06c0e8f5c", "name": "network-vif-deleted", "tag": "fe7d4e3f-8fa7-40f7-97fa-f783e80262ba"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:58.725964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8c85a670-d857-43e4-85dc-96a7e3cbc56e req-5d2c1762-6c21-40b9-8cc5-7565573b01eb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:58.726704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8c85a670-d857-43e4-85dc-96a7e3cbc56e req-5d2c1762-6c21-40b9-8cc5-7565573b01eb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:58.727146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8c85a670-d857-43e4-85dc-96a7e3cbc56e req-5d2c1762-6c21-40b9-8cc5-7565573b01eb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.738745 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8c85a670-d857-43e4-85dc-96a7e3cbc56e req-5d2c1762-6c21-40b9-8cc5-7565573b01eb service nova] Creating event network-vif-deleted:fe7d4e3f-8fa7-40f7-97fa-f783e80262ba for instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c on n-h1-862416-4 Oct 26 05:23:58.744045 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8c85a670-d857-43e4-85dc-96a7e3cbc56e req-5d2c1762-6c21-40b9-8cc5-7565573b01eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037288 Oct 26 05:23:58.744916 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2625/5280] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:58.899399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:58.901099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:58.910462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:58.911051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:58.911706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.912754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:58.913440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:58.914088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.953424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:58.955076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:58.955626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:58.956194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lazy-loading 'fault' on Instance uuid 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:23:59.029495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:59.050440 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d82a387-edd2-4353-aaa0-2156af4d6c75 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 200 len: 1338 microversion: 2.1 time: 0.155669 Oct 26 05:23:59.054332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "name": "network-vif-plugged", "status": "completed", "tag": "eaddccf5-62c7-49b7-8e15-ddb754f0bd97"}, {"server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "name": "network-vif-plugged", "status": "completed", "tag": "63a89396-5d40-47a3-a7db-eb71e69fe9b7"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:23:59.066359 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2656/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:58 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 1338 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:23:59.072239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.077600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.078664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.091203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] Creating event network-vif-plugged:eaddccf5-62c7-49b7-8e15-ddb754f0bd97 for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:23:59.092070 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] Creating event network-vif-plugged:63a89396-5d40-47a3-a7db-eb71e69fe9b7 for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:23:59.098819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-00177408-7b21-4f0e-922b-257ad3acc951 req-db5fffab-339b-4b57-9df5-677178b307ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048697 Oct 26 05:23:59.104044 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2626/5282] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:23:59.112239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:59.113053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:59.120549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.123236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.123701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.125459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.125938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.127825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.195471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:59.196184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:59.219257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.220010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.220662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.221623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.222287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.222966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.231827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:59.243403 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3b03b7d8-5b6f-4d74-ab29-f6e9dba94a47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1251 microversion: 2.1 time: 0.137614 Oct 26 05:23:59.257761 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2657/5283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:59 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1251 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:59.378604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:23:59.383400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:23:59.399971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.403328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.404192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.406456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:23:59.407529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:23:59.408273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:23:59.428493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:59.445852 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d65e425-f6db-4181-b041-48e57296696e tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1526 microversion: 2.1 time: 0.254210 Oct 26 05:23:59.458819 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2627/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:59 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:23:59.675191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:23:59.688084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ce2e970-11e6-4656-8f3e-ee9300592693 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.320491 Oct 26 05:23:59.688997 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2658/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:23:59 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:00.076338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:00.076931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:00.083736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.084436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.085042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.085765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.086221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.086651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.102209 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] HTTP exception thrown: Instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c could not be found. Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Request method failure captured: Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c HTTP/1.1 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPFU2h-VGZk3WRsPv1BCOiOS_yKXCoX1_lfk4vlkw40qalVO1t5L7duAW2-whMMjIIJLhwPlhG1Gfhe-OJkQOD9dgeeMLNok3nR-8zfwPf-jMjx4sVAhn8c-EdZyyHe4mX7vDR4DNMwscoDNs_qrggZAHx5bKv0eeibpFdAjMbjOpI Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 227e01c08a304cb1b59273127d4ad575 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_227e01c08a304cb1b59273127d4ad575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 227e01c08a304cb1b59273127d4ad575 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkBasicOps-1735840462-project Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 91321abeaa5248beaadc6edf76c96886 Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkBasicOps-1735840462-project Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c could not be found. Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0b541231-8d6a-40d6-9c01-0ae06c0e8f5c'} Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c could not be found. Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c could not be found. Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:00.104098 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c could not be found. Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Returning 404 to user: Instance 0b541231-8d6a-40d6-9c01-0ae06c0e8f5c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0dce8a27-daba-489b-a009-e803722cb0d9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c" status: 404 len: 111 microversion: 2.1 time: 0.034955 Oct 26 05:24:00.110314 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2628/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:00 2022] GET /compute/v2.1/servers/0b541231-8d6a-40d6-9c01-0ae06c0e8f5c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:24:00.270466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:00.271259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:00.286097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.286737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.287494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.288329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.288932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.289850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.312949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59b4ad4d-ada9-48ac-bd4d-40618f325e44 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '.version_select at 0x7f4709a57ee0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:00.388036 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59b4ad4d-ada9-48ac-bd4d-40618f325e44 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1383705386" status: 202 len: 0 microversion: 2.1 time: 0.089101 Oct 26 05:24:00.388893 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2629/5287] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 05:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1383705386 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:24:00.473065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:00.476046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:00.492630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.493562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.494375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.495172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.496022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.496791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.604593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:00.617083 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d943748-6b8b-4054-8c11-70ac714af1be tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1293 microversion: 2.1 time: 0.351304 Oct 26 05:24:00.618568 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2659/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:00 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1293 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:00.716190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:00.717070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:00.729537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.731894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.733659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.736636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:00.739726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:00.740407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:00.770270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:00.784817 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b59ff02-618a-4f5e-9ed5-809be34cb5f0 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1526 microversion: 2.1 time: 0.320318 Oct 26 05:24:00.786459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2630/5289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:00 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1526 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:01.163667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:01.179605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8087e747-cf60-48df-b2b9-8d586d0f63b1 req-1472a071-0bdd-44ec-980a-a63906369418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04740648-2164-4199-9c29-0e28eba4efd7", "name": "network-vif-deleted", "tag": "03fe8e68-43ba-451d-a893-4973c48c3a7a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:01.187066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4bd2213c-ba82-4a7c-97fd-6781d65ff2cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1355 microversion: 2.1 time: 0.476810 Oct 26 05:24:01.198055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2660/5290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:00 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1355 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:01.213954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8087e747-cf60-48df-b2b9-8d586d0f63b1 req-1472a071-0bdd-44ec-980a-a63906369418 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:01.215541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8087e747-cf60-48df-b2b9-8d586d0f63b1 req-1472a071-0bdd-44ec-980a-a63906369418 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:01.221681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8087e747-cf60-48df-b2b9-8d586d0f63b1 req-1472a071-0bdd-44ec-980a-a63906369418 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:01.250516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8087e747-cf60-48df-b2b9-8d586d0f63b1 req-1472a071-0bdd-44ec-980a-a63906369418 service nova] Creating event network-vif-deleted:03fe8e68-43ba-451d-a893-4973c48c3a7a for instance 04740648-2164-4199-9c29-0e28eba4efd7 on n-h2-862416-4 Oct 26 05:24:01.266551 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8087e747-cf60-48df-b2b9-8d586d0f63b1 req-1472a071-0bdd-44ec-980a-a63906369418 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093984 Oct 26 05:24:01.272763 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2631/5291] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:01.640231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:01.640852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:01.650391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:01.650891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:01.651337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:01.652977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:01.654308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:01.654751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:01.675664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:01.811197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:01.812201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:01.825275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:01.826085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:01.830184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:01.831674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:01.832346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:01.832941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:01.886631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:01.900239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:01.912658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:01.915747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:01.916227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lazy-loading 'fault' on Instance uuid 04740648-2164-4199-9c29-0e28eba4efd7 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:24:01.919306 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d60aacfa-8ed8-4ddc-a310-e83c43565867 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1293 microversion: 2.1 time: 0.283067 Oct 26 05:24:01.923299 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2661/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:01 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1293 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:02.024111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4205ada5a48c0a97dfd0fc2f6fc62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463e8f834f2a47a3b0621f437650d37a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:02.035435 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6407987b-8ca3-4104-a60e-d117600f4d82 tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 200 len: 1314 microversion: 2.1 time: 0.229314 Oct 26 05:24:02.037501 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2632/5293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:01 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:02.224444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:02.226345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:02.235984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.237142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.237901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.238995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.239727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.240493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.838674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:02.851164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9107c8b2-36f5-4d83-8358-e3d66a7867ee tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1803 microversion: 2.1 time: 0.632556 Oct 26 05:24:02.873134 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2662/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:02 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1803 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:02.879988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:02.880575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:02.902087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.902846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.903490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.904219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.904982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.905473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.946049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-637309d7-699f-40bc-bc20-fdc5119afaf1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2/ips" status: 200 len: 216 microversion: 2.1 time: 0.069789 Oct 26 05:24:02.953377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:02.954850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:02.958676 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2633/5295] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:24:02 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2/ips => generated 216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:02.965248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:02.966445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:02.970435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.973739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.975070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.975685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.976168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.977028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.978068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.978574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:02.979266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.980515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:02.980697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:02.981808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:03.021012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:03.174762 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7173473c-af31-4f18-b975-e6962ebc22dc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 204 len: 0 microversion: 2.1 time: 0.213607 Oct 26 05:24:03.179846 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2634/5296] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:02 2022] DELETE /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:24:03.187133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:03.187913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] [instance: 04740648-2164-4199-9c29-0e28eba4efd7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:03.196036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:03.196802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:03.197451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:03.198354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:03.199693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:03.200355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:03.229234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] HTTP exception thrown: Instance 04740648-2164-4199-9c29-0e28eba4efd7 could not be found. Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Request method failure captured: Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 HTTP/1.1 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRV-8Iv9twTb-eJ1y3FzpvCQ5j5wnB1tTysqfwDcGXxRC2A88QIm08eVMSAejsDN8wll6PrnQ2FWaAPunNpNhdvwLg1UxYtROrdB_BVZJSxN1yGev2xc1lNFpfz_-TzyB-O08KQuRzkueVbyozGo_vPiU2D0xJupQpzMAwZxDPW-XQ Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/463e8f834f2a47a3b0621f437650d37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 463e8f834f2a47a3b0621f437650d37a Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-680440308 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2aa4205ada5a48c0a97dfd0fc2f6fc62 Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-680440308-project Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 04740648-2164-4199-9c29-0e28eba4efd7 could not be found. Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '04740648-2164-4199-9c29-0e28eba4efd7'} Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04740648-2164-4199-9c29-0e28eba4efd7 could not be found. Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04740648-2164-4199-9c29-0e28eba4efd7 could not be found. Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:03.231209 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04740648-2164-4199-9c29-0e28eba4efd7 could not be found. Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] Returning 404 to user: Instance 04740648-2164-4199-9c29-0e28eba4efd7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d31d2c4e-e82d-4cd6-8e28-74d87ac7275d tempest-ServerMetadataNegativeTestJSON-680440308 tempest-ServerMetadataNegativeTestJSON-680440308-project] 10.222.0.16 "GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7" status: 404 len: 111 microversion: 2.1 time: 0.051378 Oct 26 05:24:03.236193 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2635/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:03 2022] GET /compute/v2.1/servers/04740648-2164-4199-9c29-0e28eba4efd7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:24:03.248986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:03.249639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:03.267657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:03.268226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:03.268680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:03.269435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:03.269909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:03.270344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:03.358646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:03.384200 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9bda4726-d293-4752-ad94-9d83c137f5a8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1293 microversion: 2.1 time: 0.440315 Oct 26 05:24:03.385557 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2663/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:02 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1293 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:03.391358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4a1c598d-79a3-4d90-a981-92481ac71656 req-b3ac505c-7371-43e1-81ae-90b0e63dbd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d9967f-1ac1-43cc-8096-9090d86a985a", "tag": "16f03f9b-a53c-40c7-b2bb-fdc6fb224841"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:03.414120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a1c598d-79a3-4d90-a981-92481ac71656 req-b3ac505c-7371-43e1-81ae-90b0e63dbd15 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:03.415240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a1c598d-79a3-4d90-a981-92481ac71656 req-b3ac505c-7371-43e1-81ae-90b0e63dbd15 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:03.419836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a1c598d-79a3-4d90-a981-92481ac71656 req-b3ac505c-7371-43e1-81ae-90b0e63dbd15 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:03.454413 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4a1c598d-79a3-4d90-a981-92481ac71656 req-b3ac505c-7371-43e1-81ae-90b0e63dbd15 service nova] Creating event network-changed:16f03f9b-a53c-40c7-b2bb-fdc6fb224841 for instance f0d9967f-1ac1-43cc-8096-9090d86a985a on n-h1-862416-4 Oct 26 05:24:03.463826 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4a1c598d-79a3-4d90-a981-92481ac71656 req-b3ac505c-7371-43e1-81ae-90b0e63dbd15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075670 Oct 26 05:24:03.465550 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2664/5299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:03.669513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:03.682738 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-022871c4-3895-4d98-a30d-780cf3d8e9cf tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1809 microversion: 2.1 time: 0.438313 Oct 26 05:24:03.686215 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2636/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:03 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1809 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:04.322536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c072bdd6-687b-44e7-b21d-66d4df6b4e4c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:04.343547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c072bdd6-687b-44e7-b21d-66d4df6b4e4c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.344304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c072bdd6-687b-44e7-b21d-66d4df6b4e4c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.344853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c072bdd6-687b-44e7-b21d-66d4df6b4e4c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:04.406793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c072bdd6-687b-44e7-b21d-66d4df6b4e4c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Going to try to stop instance {{(pid=120586) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:24:04.412510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:04.413866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:04.439766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.444287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.447623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:04.451529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.452145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.452667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:04.510086 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c072bdd6-687b-44e7-b21d-66d4df6b4e4c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.192677 Oct 26 05:24:04.512154 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2665/5301] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:24:04 2022] POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:24:04.523892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:04.527003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:04.541486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.544905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.546531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:04.548922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.549606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.552326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:04.818172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:04.832636 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3074f8d7-7be4-4a65-aafe-b96deb557018 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1293 microversion: 2.1 time: 0.424391 Oct 26 05:24:04.833245 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2637/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:04 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1293 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:04.851163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:04.852531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:04.863639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.864296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.864753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:04.865519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:04.865994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:04.866433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:05.032277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:05.050923 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-89ce9c5b-e3b0-4cda-964e-779fe35b4158 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.534092 Oct 26 05:24:05.053540 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2666/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:04 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:05.109773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:05.263455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:05.282506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbd1d751-52a1-4e95-93f3-7dd1fcba172c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1809 microversion: 2.1 time: 0.446826 Oct 26 05:24:05.284198 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2638/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:04 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1809 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:05.864782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:05.865452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:05.881348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:05.882120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:05.885035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:05.887380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:05.889580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:05.891209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:06.077124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:06.077809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:06.087356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:06.098138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:06.098919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:06.099243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:06.100041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:06.100613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:06.101124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:06.365811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:06.381743 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d3d0899-4ff5-401e-908a-8ae38de6048a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1293 microversion: 2.1 time: 0.523489 Oct 26 05:24:06.382683 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2667/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:05 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1293 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:06.391487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-10caa783-f0b5-4c6b-9c28-3fcf4c5b0ed5 req-faf9e7a2-fcb0-400a-bfad-d312c21336c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "name": "network-vif-deleted", "tag": "63a89396-5d40-47a3-a7db-eb71e69fe9b7"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:06.410161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10caa783-f0b5-4c6b-9c28-3fcf4c5b0ed5 req-faf9e7a2-fcb0-400a-bfad-d312c21336c6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:06.410938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10caa783-f0b5-4c6b-9c28-3fcf4c5b0ed5 req-faf9e7a2-fcb0-400a-bfad-d312c21336c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:06.411711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10caa783-f0b5-4c6b-9c28-3fcf4c5b0ed5 req-faf9e7a2-fcb0-400a-bfad-d312c21336c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:06.434351 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-10caa783-f0b5-4c6b-9c28-3fcf4c5b0ed5 req-faf9e7a2-fcb0-400a-bfad-d312c21336c6 service nova] Creating event network-vif-deleted:63a89396-5d40-47a3-a7db-eb71e69fe9b7 for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:24:06.442686 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-10caa783-f0b5-4c6b-9c28-3fcf4c5b0ed5 req-faf9e7a2-fcb0-400a-bfad-d312c21336c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057108 Oct 26 05:24:06.444002 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2668/5306] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:06.450693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:06.452109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:06.461181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:06.462017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:06.462726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:06.463797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:06.465396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:06.466081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:06.543692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:06.560798 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ede59b5c-b679-4987-bad5-cbaef1a474a3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.489069 Oct 26 05:24:06.562649 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2639/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:06 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:06.836838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:06.865715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a7c4f44-22fb-4501-8048-c0aa2e02d436 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1788 microversion: 2.1 time: 0.420076 Oct 26 05:24:06.870755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2669/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:06 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1788 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:07.107660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c3098e03-0e0b-45d3-b54e-affa20ed13c5 req-e11e9558-0d27-4873-8c4f-35bcf0c4feee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d9967f-1ac1-43cc-8096-9090d86a985a", "name": "network-vif-plugged", "status": "completed", "tag": "16f03f9b-a53c-40c7-b2bb-fdc6fb224841"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:07.127856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3098e03-0e0b-45d3-b54e-affa20ed13c5 req-e11e9558-0d27-4873-8c4f-35bcf0c4feee service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.128363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3098e03-0e0b-45d3-b54e-affa20ed13c5 req-e11e9558-0d27-4873-8c4f-35bcf0c4feee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.128807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3098e03-0e0b-45d3-b54e-affa20ed13c5 req-e11e9558-0d27-4873-8c4f-35bcf0c4feee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:07.139654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:07.169646 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c3098e03-0e0b-45d3-b54e-affa20ed13c5 req-e11e9558-0d27-4873-8c4f-35bcf0c4feee service nova] Creating event network-vif-plugged:16f03f9b-a53c-40c7-b2bb-fdc6fb224841 for instance f0d9967f-1ac1-43cc-8096-9090d86a985a on n-h1-862416-4 Oct 26 05:24:07.192719 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c3098e03-0e0b-45d3-b54e-affa20ed13c5 req-e11e9558-0d27-4873-8c4f-35bcf0c4feee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088951 Oct 26 05:24:07.197185 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2640/5309] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:07.404789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:07.405449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:07.413895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.414809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.415478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:07.416471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.418648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.419321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:07.590550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:07.591273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:07.601470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.601981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.602421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:07.613329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.614013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.614630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:07.895858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:07.915774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-adbf0ef3-c6f8-488d-86cc-0f15e4f871e1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1293 microversion: 2.1 time: 0.515367 Oct 26 05:24:07.916680 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2670/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:07 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1293 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:07.936911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:07.937812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:07.943424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:07.945087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.945791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.947316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:07.948239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:07.949413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:07.950012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:08.211543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:08.222619 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63aa62f4-414f-456d-8461-22a1ade336e6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.636769 Oct 26 05:24:08.239776 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2641/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:07 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:08.421176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:08.435532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37152b2c-f020-4f89-899c-68e023c2a6cb tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1654 microversion: 2.1 time: 0.504812 Oct 26 05:24:08.436180 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2671/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:07 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1654 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:08.619670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c3c9f502-9756-4de3-b7f6-be12e10c0027 req-1bd534bf-e348-4bdf-b108-bb895546135f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "name": "network-vif-deleted", "tag": "469ca255-c764-4412-a39b-51ad317903bd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:08.636854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3c9f502-9756-4de3-b7f6-be12e10c0027 req-1bd534bf-e348-4bdf-b108-bb895546135f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:08.637917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3c9f502-9756-4de3-b7f6-be12e10c0027 req-1bd534bf-e348-4bdf-b108-bb895546135f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:08.638787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3c9f502-9756-4de3-b7f6-be12e10c0027 req-1bd534bf-e348-4bdf-b108-bb895546135f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:08.673284 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c3c9f502-9756-4de3-b7f6-be12e10c0027 req-1bd534bf-e348-4bdf-b108-bb895546135f service nova] Creating event network-vif-deleted:469ca255-c764-4412-a39b-51ad317903bd for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:24:08.680914 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c3c9f502-9756-4de3-b7f6-be12e10c0027 req-1bd534bf-e348-4bdf-b108-bb895546135f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065990 Oct 26 05:24:08.682058 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2642/5313] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:24:08.943315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:08.943946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:08.958604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:08.958604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:08.959059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:08.964305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:08.964846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:08.970347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:09.250612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:09.253023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:09.279214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:09.280379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:09.281038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:09.282002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:09.282892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:09.283562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:09.294654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:09.303087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1526ba2e-9f32-46c4-a8a3-722205d219ba tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1474 microversion: 2.1 time: 0.363575 Oct 26 05:24:09.303694 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2672/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:08 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:09.460216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:09.460835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:09.473538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:09.474056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:09.475133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:09.476216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:09.476680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:09.486460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:09.555309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:09.555813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:09.556260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:09.556719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lazy-loading 'fault' on Instance uuid 984b308d-6dbd-4405-8653-83445c48ebf2 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:24:09.640534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:09.648170 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2aeff21-584c-4448-9890-09e02b245922 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 200 len: 1303 microversion: 2.1 time: 0.191964 Oct 26 05:24:09.648774 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2673/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:09 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:09.657802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1593229624", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:09.734011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:09.737674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:09.747079 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ccc00113-40df-4b13-86a4-86fb0ce4b763 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.500584 Oct 26 05:24:09.762167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2643/5316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:09 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:10.553144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:10.553805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:10.554189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:10.554607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:10.555024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:10.570232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.570955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.571550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:10.572484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.573119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.573659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:10.592560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:10.599016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:10.612503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:10.615208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 75606396-55ad-4280-976b-0f3abcfc21e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:10.672356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:10.672851 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a83dcd7-9e0c-487b-965c-9392bff44787 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022700 Oct 26 05:24:10.673056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:10.685539 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2674/5317] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:24:10.685854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.686360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.686804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:10.688955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.689439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.694846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1d4adaca-e183-4417-b5d7-92da2628ec12 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:10.697629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1d4adaca-e183-4417-b5d7-92da2628ec12 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 75606396-55ad-4280-976b-0f3abcfc21e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:10.700159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:10.721263 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] HTTP exception thrown: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Request method failure captured: Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 HTTP/1.1 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQ85O-Y89w7zvnUC3kMZwh_uSOCxlX7CE0n9fje3gE9RXoVOYi5DuuUFWjHiPWLd7Wr8KwSivjnunINpmB05UYc5LYLK0Jgoz-cHiExIHKXjodRo1XfsMZ4HBfDzzAbK8OfZn6qY0tBeu5kGkJK-JfmBVUF1Zk2nbo9JT-JaSiQUnE Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9e7230bc61b549b8adf602f9ce37c4d6 Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '984b308d-6dbd-4405-8653-83445c48ebf2'} Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:10.723757 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:10.728698 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:10.729235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1d4adaca-e183-4417-b5d7-92da2628ec12 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 75606396-55ad-4280-976b-0f3abcfc21e2] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:10.731176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Returning 404 to user: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:10.732206 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e23e498b-73d2-4b31-9e47-c7f8c0e72ba9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 404 len: 111 microversion: 2.1 time: 0.064530 Oct 26 05:24:10.733246 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2644/5318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:10 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:24:10.750627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d0524d69-32f6-497f-984d-2ebff4563833 req-1783539f-493b-4b22-8fe4-967a4b88d9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984b308d-6dbd-4405-8653-83445c48ebf2", "name": "network-vif-deleted", "tag": "eaddccf5-62c7-49b7-8e15-ddb754f0bd97"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:10.794446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d0524d69-32f6-497f-984d-2ebff4563833 req-1783539f-493b-4b22-8fe4-967a4b88d9a6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.797682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d0524d69-32f6-497f-984d-2ebff4563833 req-1783539f-493b-4b22-8fe4-967a4b88d9a6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.797682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d0524d69-32f6-497f-984d-2ebff4563833 req-1783539f-493b-4b22-8fe4-967a4b88d9a6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:10.825239 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d0524d69-32f6-497f-984d-2ebff4563833 req-1783539f-493b-4b22-8fe4-967a4b88d9a6 service nova] Creating event network-vif-deleted:eaddccf5-62c7-49b7-8e15-ddb754f0bd97 for instance 984b308d-6dbd-4405-8653-83445c48ebf2 on n-h2-862416-4 Oct 26 05:24:10.835889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d0524d69-32f6-497f-984d-2ebff4563833 req-1783539f-493b-4b22-8fe4-967a4b88d9a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101203 Oct 26 05:24:10.840244 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2645/5319] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:10.850901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:10.853660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:10.859767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:10.873928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.878871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.882537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:10.890175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:10.890884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:10.892290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:11.159322 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1d4adaca-e183-4417-b5d7-92da2628ec12 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2" status: 204 len: 0 microversion: 2.1 time: 0.471466 Oct 26 05:24:11.160267 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2675/5320] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:10 2022] DELETE /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:24:11.170521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d262479-db89-4a72-949e-ac4d956dbe83 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:11.171905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d262479-db89-4a72-949e-ac4d956dbe83 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 75606396-55ad-4280-976b-0f3abcfc21e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:11.194038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6d262479-db89-4a72-949e-ac4d956dbe83 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d262479-db89-4a72-949e-ac4d956dbe83 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 HTTP/1.1 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75606396-55ad-4280-976b-0f3abcfc21e2'} Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 75606396-55ad-4280-976b-0f3abcfc21e2 Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:11.201640 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:24:11.209467 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:11.212239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d262479-db89-4a72-949e-ac4d956dbe83 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:11.214097 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d262479-db89-4a72-949e-ac4d956dbe83 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2" status: 404 len: 111 microversion: 2.1 time: 0.048993 Oct 26 05:24:11.215692 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2676/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:11 2022] GET /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:24:11.239972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:11.259967 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a95d2ef0-21df-4a6f-8810-80b4642c1234 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.413180 Oct 26 05:24:11.261239 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2646/5322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:10 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:11.362252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-950682830", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:11.483557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:12.192177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:12.193634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:12.194608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:12.195360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:12.196054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:12.212537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:12.213414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:12.214816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:12.216710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:12.217468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:12.218821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:12.246249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:12.253118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:12.291367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:12.292161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:12.307458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:12.310170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:12.310693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:12.311149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:12.315274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:12.316467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:12.317702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:12.318213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:12.427607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-742ab152-608c-4754-ba16-45351c0abb56 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073245 Oct 26 05:24:12.430376 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2677/5323] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:24:12.441650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56632a15-8255-4897-95ec-8650cc8a2225 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:12.442657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56632a15-8255-4897-95ec-8650cc8a2225 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:12.640201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56632a15-8255-4897-95ec-8650cc8a2225 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:12.648172 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56632a15-8255-4897-95ec-8650cc8a2225 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1220 microversion: 2.1 time: 0.210606 Oct 26 05:24:12.650750 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2678/5324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:12 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1220 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:12.735869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:12.752430 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6653bc2c-885a-446f-bc25-063a9c190f17 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.465472 Oct 26 05:24:12.766582 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2647/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:12 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:13.686704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:13.687416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:13.700886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:13.706727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:13.707608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:13.711403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:13.713546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:13.714993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:13.783315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:13.785048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:13.796249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:13.798902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:13.799781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:13.801661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:13.803780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:13.805331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:13.953286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:13.964025 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d46dcd54-ea14-48e3-868e-c754064dd383 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1216 microversion: 2.1 time: 0.284406 Oct 26 05:24:13.970243 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2679/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:13 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:14.216040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:14.241599 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6539723f-323b-4e49-9642-cfc8a695db71 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.461574 Oct 26 05:24:14.247082 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2648/5327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:13 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:14.998006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:14.999562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:15.013812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:15.015292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:15.017751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:15.020701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:15.021648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:15.023608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:15.163863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:15.180326 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8739790d-c9c1-447c-8663-9572606efc26 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1278 microversion: 2.1 time: 0.187726 Oct 26 05:24:15.181353 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2680/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:14 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:15.278913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:15.280135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:15.287814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:15.288456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:15.289174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:15.290033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:15.290598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:15.291266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:15.754621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:15.769222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2a8a70b1-08a6-4bcc-8652-2ccd2fcd41bc tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.495828 Oct 26 05:24:15.782912 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2649/5329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:15 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:16.210947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:16.212192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:16.220875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:16.221584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:16.222190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:16.223315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:16.224039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:16.225547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:16.456837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:16.469142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a384bdb0-9cf2-4629-bdc8-d4a0b646b2d9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1278 microversion: 2.1 time: 0.263465 Oct 26 05:24:16.489681 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2681/5330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:16 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:16.798898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:16.800190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:16.823922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:16.824875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:16.849144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:16.853369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:16.856422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:16.857164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:17.502460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:17.503086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:17.519942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:17.520437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:17.520894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:17.525846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:17.528329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:17.529703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:17.545549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:17.559234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-26fd59b7-e402-4d64-9697-6f8cf994430f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.767365 Oct 26 05:24:17.560563 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2650/5331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:16 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:17.591858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:18.075242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:18.086816 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b720f0d1-c877-408a-989e-a449481b8052 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.585350 Oct 26 05:24:18.088248 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2682/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:17 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:18.459352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-55f0d023-3ed2-40f6-836b-8cc627a30827 req-6b452168-78f5-4f58-a0fa-4e4a27596ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14777b85-2844-44d2-a8f0-711890e84a88", "tag": "a747c0c0-9a77-40fa-809e-f9178726eea5"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:18.480219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-55f0d023-3ed2-40f6-836b-8cc627a30827 req-6b452168-78f5-4f58-a0fa-4e4a27596ed7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:18.482626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-55f0d023-3ed2-40f6-836b-8cc627a30827 req-6b452168-78f5-4f58-a0fa-4e4a27596ed7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:18.484202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-55f0d023-3ed2-40f6-836b-8cc627a30827 req-6b452168-78f5-4f58-a0fa-4e4a27596ed7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:18.513013 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-55f0d023-3ed2-40f6-836b-8cc627a30827 req-6b452168-78f5-4f58-a0fa-4e4a27596ed7 service nova] Creating event network-changed:a747c0c0-9a77-40fa-809e-f9178726eea5 for instance 14777b85-2844-44d2-a8f0-711890e84a88 on n-h2-862416-4 Oct 26 05:24:18.523311 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-55f0d023-3ed2-40f6-836b-8cc627a30827 req-6b452168-78f5-4f58-a0fa-4e4a27596ed7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067519 Oct 26 05:24:18.524524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2651/5333] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:18.587787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:18.588520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:18.605711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:18.606343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:18.610622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:18.614697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:18.615807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:18.618264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:19.075773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:19.090802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49c8bb9d-5519-45e9-a0d1-13f3149a1509 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.508130 Oct 26 05:24:19.101835 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2683/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:18 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:19.114873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:19.115594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:19.131693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:19.132200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:19.132660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:19.133427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:19.133897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:19.134335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:19.542974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:19.560880 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b8917db-326e-4830-a293-137f0f98e62d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.450911 Oct 26 05:24:19.563088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2652/5335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:19 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:19.687737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1897826183", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "26b343e5-4292-4beb-8e29-5676182350e0"}, {"uuid": "551a934b-2581-4f53-9fc9-4e3e4818fe09"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:19.787537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] validate_networks() for [('26b343e5-4292-4beb-8e29-5676182350e0', None, None, None, None, None), ('551a934b-2581-4f53-9fc9-4e3e4818fe09', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:20.116451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:20.117072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:20.135213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:20.135857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:20.136300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:20.137037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:20.137697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:20.137945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:20.796393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:20.806610 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d7bf774-8fb4-45ce-9759-f2cdd17a427d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.693500 Oct 26 05:24:20.808192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2653/5336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:20 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:20.823045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:20.832524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:20.848151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:20.850911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:20.851578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:20.854170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:20.854988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:20.856205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:21.362669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:21.374101 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f9a6779-9701-4e49-ad7c-4011407d9d91 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.559361 Oct 26 05:24:21.390835 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2654/5337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:20 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:21.842917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:21.843553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:21.857422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:21.857931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:21.858382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:21.859114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:21.859579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:21.867112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:21.890793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:21.891421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:21.897870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:21.899384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:21.900071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:21.926010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:21.932056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:21.934359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:21.939638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:21.940281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:21.945020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:21.990634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Getting quotas for project bb324d5cc720471abe62f4a6fdd5de5f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:21.997511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Getting quotas for user 9e7230bc61b549b8adf602f9ce37c4d6 and project bb324d5cc720471abe62f4a6fdd5de5f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:22.020409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:22.026875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:22.161718 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7fddd47-2152-43e1-b2aa-cbeeba82bff2 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.485401 Oct 26 05:24:22.164914 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2684/5338] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:24:22.180928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7326c625-57fb-4bca-8c6f-1ef945dc29e3 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'create', calling method: .version_select at 0x7f470956da60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2088139707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESq940FjKSvJN+risziD/Cq7mmQisKZMq1mL4zSImQSGdgSpH2EVeSeaRFdcso9hlPKXGS9XnAm+CYQMB2otDTFfKIx2duNEOP+rO736sheQ5rJgDCNnohA7MAB/sLrqA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:22.236866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7326c625-57fb-4bca-8c6f-1ef945dc29e3 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for project 227e01c08a304cb1b59273127d4ad575. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:22.252033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7326c625-57fb-4bca-8c6f-1ef945dc29e3 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for user 91321abeaa5248beaadc6edf76c96886 and project 227e01c08a304cb1b59273127d4ad575. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:22.259794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:22.268786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:22.275081 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d5c2716-1637-4c88-aa30-6bcc39e2a256 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.442921 Oct 26 05:24:22.282708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2655/5339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:21 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:22.296648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6402f53-29a6-4337-85ac-2cd09edc8483 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:22.298649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d6402f53-29a6-4337-85ac-2cd09edc8483 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:22.342269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7326c625-57fb-4bca-8c6f-1ef945dc29e3 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.176072 Oct 26 05:24:22.343493 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2685/5340] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:24:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:22.413565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:22.415027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:22.434550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d6402f53-29a6-4337-85ac-2cd09edc8483 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:22.446868 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d6402f53-29a6-4337-85ac-2cd09edc8483 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1213 microversion: 2.1 time: 0.162660 Oct 26 05:24:22.447482 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2656/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:22 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:22.453295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:22.456403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:22.457289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:22.460521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:22.461296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:22.461987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:22.677963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:22.691117 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3faa04ae-40b2-475f-ab5a-3050cc7aa4cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.292214 Oct 26 05:24:22.692813 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2686/5342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:22 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:23.321305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:23.323949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:23.351312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:23.354171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:23.356130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:23.359596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:23.360148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:23.363828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:23.478607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:23.479397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:23.496242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:23.496763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:23.497269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:23.498099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:23.498627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:23.499066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:23.670026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:23.686862 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9874c6f-d78a-4a58-a985-8a285148b6fc tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1217 microversion: 2.1 time: 0.211304 Oct 26 05:24:23.687956 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2687/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:23 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:23.724708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:23.725575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:23.741771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:23.742492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:23.743821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:23.752422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:23.755718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:23.758618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:23.897273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:23.917998 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e1c14e47-961e-4196-adeb-0c8a5a648540 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.600897 Oct 26 05:24:23.927115 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2657/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:23 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:24.404663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:24.418008 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4140b4f8-00b6-404b-ab2c-bd457613d1b2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.694551 Oct 26 05:24:24.422448 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2688/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:23 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:24.715316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:24.716101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:24.732667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:24.746473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:24.748237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:24.749221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:24.750068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:24.750980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:24.949123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:24.950478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:24.965104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:24.968895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:24.969884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:24.974250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:24.975661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:24.977541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:25.107430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:25.132617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-440a7c76-81ac-49e6-b197-53ad7ed64ad9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1273 microversion: 2.1 time: 0.420757 Oct 26 05:24:25.135677 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2658/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:24 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1273 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:25.444778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:25.458403 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a3fa1dcc-84af-405d-b0aa-f34f7526ed2a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.516405 Oct 26 05:24:25.461602 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2689/5347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:24 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:25.462354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:25.463064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:25.478398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:25.486961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:25.487574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:25.488337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:25.488805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:25.489248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:26.002355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:26.018977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-745c4f71-1fc5-4d56-9ff1-5f580de969ed tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.562884 Oct 26 05:24:26.019947 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2659/5348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:25 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:26.160566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:26.160953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:26.168299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:26.168992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:26.169473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:26.170174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:26.170818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:26.171412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:26.431303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:26.442289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0562412d-76e1-455e-a5a8-08e17423ff68 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1313 microversion: 2.1 time: 0.286069 Oct 26 05:24:26.442881 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2690/5349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:26 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:26.487339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:26.488134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:26.497419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:26.497930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:26.498382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:26.499111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:26.499573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:26.500010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:27.094080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:27.108438 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b2d9845-a255-4e1f-9bc0-e2b1e0b34f16 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.625508 Oct 26 05:24:27.128085 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2660/5350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:26 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:27.129505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:27.130335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:27.143581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:27.153447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:27.154818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:27.156573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:27.162301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:27.165468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:27.469656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:27.470512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:27.483045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:27.483852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:27.485608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:27.486650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:27.487456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:27.490299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:27.565141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:27.614455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:27.627913 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c4633d5-7aec-4d59-aab5-0700fae41a64 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.503602 Oct 26 05:24:27.629227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2691/5351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:27 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:28.026187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:28.040942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-504e4818-4ff8-40f4-b022-c883313daba9 req-b78b2e8a-b342-4b1a-ba6e-8a92e5bca322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14777b85-2844-44d2-a8f0-711890e84a88", "name": "network-vif-plugged", "status": "completed", "tag": "a747c0c0-9a77-40fa-809e-f9178726eea5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:28.044517 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36a9009c-48f4-4ddc-a0f5-51cfad5eac43 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.579637 Oct 26 05:24:28.050433 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2661/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:27 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:28.066436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-504e4818-4ff8-40f4-b022-c883313daba9 req-b78b2e8a-b342-4b1a-ba6e-8a92e5bca322 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:28.066944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-504e4818-4ff8-40f4-b022-c883313daba9 req-b78b2e8a-b342-4b1a-ba6e-8a92e5bca322 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:28.067442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-504e4818-4ff8-40f4-b022-c883313daba9 req-b78b2e8a-b342-4b1a-ba6e-8a92e5bca322 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:28.099708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-504e4818-4ff8-40f4-b022-c883313daba9 req-b78b2e8a-b342-4b1a-ba6e-8a92e5bca322 service nova] Creating event network-vif-plugged:a747c0c0-9a77-40fa-809e-f9178726eea5 for instance 14777b85-2844-44d2-a8f0-711890e84a88 on n-h2-862416-4 Oct 26 05:24:28.110562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-504e4818-4ff8-40f4-b022-c883313daba9 req-b78b2e8a-b342-4b1a-ba6e-8a92e5bca322 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073908 Oct 26 05:24:28.117154 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2692/5353] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:28.141510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:28.143069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:28.175770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:28.176838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:28.177497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:28.178508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:28.181117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:28.181788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:28.234553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1007479313", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "8b050f7a-9053-4505-bd03-b3c5230ad30c"}], "key_name": "tempest-TestNetworkBasicOps-2088139707", "security_groups": [{"name": "tempest-secgroup-smoke-1176429748"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:28.561925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] validate_networks() for [('8b050f7a-9053-4505-bd03-b3c5230ad30c', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:28.679728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:28.688748 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-525cda50-3a9f-4200-a567-b0894b57a49d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1723 microversion: 2.1 time: 0.556241 Oct 26 05:24:28.694060 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2662/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:28 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1723 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:28.704129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:28.707847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:28.717240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:28.717977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:28.718375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:28.719165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:28.719754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:28.720303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:29.059363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:29.072964 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f424efc-b844-461f-9729-18904c33edab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1320 microversion: 2.1 time: 0.376376 Oct 26 05:24:29.072964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2663/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:28 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:29.080924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-364602ea-0057-498a-8329-940d75be19b4 req-0a1617e8-1435-4670-a10b-518b29a879b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3af690fe-2901-4e22-b4ff-050c1ca7a882", "tag": "aecd3a6f-f1f3-40fd-ae5b-2595a3bd0ed2"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:29.101579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-364602ea-0057-498a-8329-940d75be19b4 req-0a1617e8-1435-4670-a10b-518b29a879b4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:29.102129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-364602ea-0057-498a-8329-940d75be19b4 req-0a1617e8-1435-4670-a10b-518b29a879b4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:29.102574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-364602ea-0057-498a-8329-940d75be19b4 req-0a1617e8-1435-4670-a10b-518b29a879b4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:29.129837 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-364602ea-0057-498a-8329-940d75be19b4 req-0a1617e8-1435-4670-a10b-518b29a879b4 service nova] Creating event network-changed:aecd3a6f-f1f3-40fd-ae5b-2595a3bd0ed2 for instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 on n-h2-862416-4 Oct 26 05:24:29.136877 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-364602ea-0057-498a-8329-940d75be19b4 req-0a1617e8-1435-4670-a10b-518b29a879b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061289 Oct 26 05:24:29.137742 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2664/5356] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:29.145445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:29.146880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:29.155755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:29.156528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:29.157141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:29.158081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:29.158894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:29.159559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:29.427881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:29.429594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:29.431033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:29.431887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:29.433049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:29.456274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:29.457472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:29.458202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:29.459730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:29.460816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:29.468256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:29.495318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for project 227e01c08a304cb1b59273127d4ad575. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:29.502125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Getting quotas for user 91321abeaa5248beaadc6edf76c96886 and project 227e01c08a304cb1b59273127d4ad575. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:29.524340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:29.528157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:29.618753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:29.629279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61afac59-1bfc-4e3c-bdac-a8a33e2492d6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.488939 Oct 26 05:24:29.639419 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2665/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:29 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:29.655715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99a9edd3-f412-4969-9eff-1b92e34f86b4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.426487 Oct 26 05:24:29.656799 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2693/5358] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:24:29.691227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e91a706-2199-42b1-bbd6-5e36f4065a58 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:29.702107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e91a706-2199-42b1-bbd6-5e36f4065a58 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:30.238367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-351175147", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:30.326382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] validate_networks() for [('83274ad0-96d9-4ba9-8361-99c750e25ec6', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:30.517743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e91a706-2199-42b1-bbd6-5e36f4065a58 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:30.542933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e91a706-2199-42b1-bbd6-5e36f4065a58 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1249 microversion: 2.1 time: 0.877343 Oct 26 05:24:30.548330 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2694/5359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:29 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1249 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:30.572089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:30.573100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:30.580572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:30.581883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:30.582739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:30.583697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:30.584667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:30.585439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.042355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:31.063327 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b9fdde37-7a4e-489f-9327-5efbf18f5397 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1700 microversion: 2.1 time: 0.506399 Oct 26 05:24:31.076642 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2695/5360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:30 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1700 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:31.081684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:31.082317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:31.097204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.098345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.098805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.099537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.100004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.100440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.467418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:31.481251 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff407b47-ecd0-482a-aa35-62d4800d6145 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1501 microversion: 2.1 time: 0.403483 Oct 26 05:24:31.482130 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2696/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:31 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1501 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:31.482845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:31.483341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:31.483867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:31.484279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:31.484876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:31.488568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:31.489600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:31.495478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.496281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.497137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.498958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.500251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.500780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.501456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.502547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.502683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.503703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.504310 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.504868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.530789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:31.540915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for user dde934392aab4940960535dd1794b37b and project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:31.562504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:31.566801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:31.655007 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a98dc29-ec14-4364-89f0-4d47b9b342f7 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.013491 Oct 26 05:24:31.656591 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2666/5362] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:24:31.671168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50a604fd-5042-429d-9738-48455bd31d54 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:31.683737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a604fd-5042-429d-9738-48455bd31d54 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.684557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a604fd-5042-429d-9738-48455bd31d54 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.685195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a604fd-5042-429d-9738-48455bd31d54 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.724777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50a604fd-5042-429d-9738-48455bd31d54 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Going to try to start instance {{(pid=120585) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 05:24:31.788805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50a604fd-5042-429d-9738-48455bd31d54 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.130006 Oct 26 05:24:31.791065 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2667/5363] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:24:31 2022] POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:24:31.803952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a8c9090e-3794-491b-9290-0b7418df9387 req-bb596825-9278-4070-a91b-5eccaab796f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3af690fe-2901-4e22-b4ff-050c1ca7a882", "tag": "ab786d12-865c-4362-867d-656347f5e551"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:31.825743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8c9090e-3794-491b-9290-0b7418df9387 req-bb596825-9278-4070-a91b-5eccaab796f1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.826000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8c9090e-3794-491b-9290-0b7418df9387 req-bb596825-9278-4070-a91b-5eccaab796f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.826441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8c9090e-3794-491b-9290-0b7418df9387 req-bb596825-9278-4070-a91b-5eccaab796f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.840041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:31.851100 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a8c9090e-3794-491b-9290-0b7418df9387 req-bb596825-9278-4070-a91b-5eccaab796f1 service nova] Creating event network-changed:ab786d12-865c-4362-867d-656347f5e551 for instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 on n-h2-862416-4 Oct 26 05:24:31.859924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a8c9090e-3794-491b-9290-0b7418df9387 req-bb596825-9278-4070-a91b-5eccaab796f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066381 Oct 26 05:24:31.861242 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2668/5364] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:31.862976 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-025431a4-2747-4484-b5b6-82da7c3d0b45 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.379480 Oct 26 05:24:31.867832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:31.868730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:31.877195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.877989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.878634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.879529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.880282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.881567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.887121 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2697/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:31 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:31.903349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:31.912735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:31.940678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.942577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.944823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:31.948723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:31.950220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:31.964225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.096613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:32.110358 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-330f86e9-de14-4a60-93ee-67b9d20acd7e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1301 microversion: 2.1 time: 0.218944 Oct 26 05:24:32.113370 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2698/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:31 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1301 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:32.127572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b64aa698-809a-4ac2-b64c-87bbea865150 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:32.129294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b64aa698-809a-4ac2-b64c-87bbea865150 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:32.139883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:32.150484 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d98ac326-739f-45b9-9281-2358f1be227f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1501 microversion: 2.1 time: 0.287814 Oct 26 05:24:32.154100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2669/5367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:31 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:32.159294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:32.160234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:32.171853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:32.172624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:32.173238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.175160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:32.175837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:32.176781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.255132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b64aa698-809a-4ac2-b64c-87bbea865150 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:32.262420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=35 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:32.265330 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b64aa698-809a-4ac2-b64c-87bbea865150 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1221 microversion: 2.1 time: 0.149995 Oct 26 05:24:32.280889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2699/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:32 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:32.288538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:32.289265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:32.300120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:32.301065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:32.302027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.303417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:32.304098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:32.304769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.396948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:32.509078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:32.524957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fa84526-92a3-4134-85cd-18438d1d0935 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1709 microversion: 2.1 time: 0.368260 Oct 26 05:24:32.526542 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2670/5369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:32 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1709 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:32.552254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-506615634", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:32.633166 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46dbcc76-dfa8-4edd-b2d8-02a0482ee99c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 204 len: 0 microversion: 2.1 time: 0.349942 Oct 26 05:24:32.634227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2700/5370] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:32 2022] DELETE /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:24:32.651712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] validate_networks() for [('83274ad0-96d9-4ba9-8361-99c750e25ec6', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:32.656149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:32.656882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:32.669247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:32.673230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:32.673768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.676288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:32.678185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:32.678821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:32.989574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:33.027803 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7581a688-5435-4ac8-8fc6-701b67f11d4f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1507 microversion: 2.1 time: 0.386373 Oct 26 05:24:33.031394 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2701/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:32 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:33.041242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:33.046208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:33.063742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.065401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.065990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.066823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.067352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.067852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.100467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:33.356909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:33.374827 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dec2712b-eeae-4fe4-b824-665aa7f61ebd tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.341230 Oct 26 05:24:33.375938 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2702/5372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:33 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:33.381882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:33.382815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:33.392919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.394520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.395753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.398279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.399300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.400497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.411983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:33.412687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:33.413402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:33.414058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:33.414700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:33.426355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.427778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.428327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.429549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.429835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.430356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.459510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:33.466347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for user dde934392aab4940960535dd1794b37b and project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:33.482048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:33.485453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:33.555495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:33.568902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f34eae4-3ed8-4e8b-b069-385afe8ec737 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1307 microversion: 2.1 time: 0.191425 Oct 26 05:24:33.569540 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2703/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:33 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:33.595278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:33.595908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:33.613021 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b2471f8-971d-45e4-b177-e3780c4ac40e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.069264 Oct 26 05:24:33.614443 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2671/5374] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:24:33.616511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.617013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.617489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.618202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:33.618668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:33.619099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:33.627746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db800c5a-c8b5-47fa-98b2-eb0611c9a5b4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:33.628605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db800c5a-c8b5-47fa-98b2-eb0611c9a5b4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:33.762407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db800c5a-c8b5-47fa-98b2-eb0611c9a5b4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:33.774255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db800c5a-c8b5-47fa-98b2-eb0611c9a5b4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1221 microversion: 2.1 time: 0.150739 Oct 26 05:24:33.775519 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2672/5375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:33 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:33.955202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:33.974903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f470696-ac23-4091-8c3c-54a8925e2eb2 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1709 microversion: 2.1 time: 0.391639 Oct 26 05:24:33.981420 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2704/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:33 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1709 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:34.058166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:34.059284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:34.085462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:34.086607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:34.088092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:34.091435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:34.092345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:34.096431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:34.364675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:34.377284 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f78e0a12-b945-4cb0-b8ef-dff34a80bf1d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1507 microversion: 2.1 time: 0.325418 Oct 26 05:24:34.378678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2673/5377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:34 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:34.407204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:34.407962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:34.429163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:34.430453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:34.433767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:34.434895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:34.435693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:34.437611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:34.597161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:34.598298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:34.614569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:34.618076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:34.620932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:34.623487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:34.627351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:34.630599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.181446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:35.196058 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d55a4356-e99f-4824-a480-998575a8d2c9 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1375 microversion: 2.1 time: 0.602866 Oct 26 05:24:35.196924 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2674/5378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:34 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1375 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:35.200503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:35.204411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:35.205488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:35.211364 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b6c81fc-231c-483c-a00c-b122f0ebffc9 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.805911 Oct 26 05:24:35.213818 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2705/5379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:34 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:35.223853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:35.226670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:35.233532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:35.236329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:35.236795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.237579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:35.238047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:35.240680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.242039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:35.243924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:35.244592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.246747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:35.248361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:35.248970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.427623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:35.453016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa7d7207-5174-43bf-a257-2eb15756fb5b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1273 microversion: 2.1 time: 0.254415 Oct 26 05:24:35.461601 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2675/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:35 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:35.471621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:35.472239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:35.483105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:35.483602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:35.487367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.488135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:35.488958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:35.489584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:35.677733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:35.699031 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-81b23fc7-e638-475e-8582-dbb899fad23e tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1713 microversion: 2.1 time: 0.483268 Oct 26 05:24:35.700450 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2706/5381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:35 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1713 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:35.769001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:35.778805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd7cb830-da45-423b-8fc6-665acfb99489 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1507 microversion: 2.1 time: 0.319999 Oct 26 05:24:35.780701 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2676/5382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:35 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:36.107653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5ceca61d-d0cf-401d-93c7-a732507489d3 req-7af136c0-3d1e-4652-9684-dc12172bb440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14777b85-2844-44d2-a8f0-711890e84a88", "name": "network-vif-deleted", "tag": "a747c0c0-9a77-40fa-809e-f9178726eea5"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:36.134304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5ceca61d-d0cf-401d-93c7-a732507489d3 req-7af136c0-3d1e-4652-9684-dc12172bb440 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.134820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5ceca61d-d0cf-401d-93c7-a732507489d3 req-7af136c0-3d1e-4652-9684-dc12172bb440 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.136021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5ceca61d-d0cf-401d-93c7-a732507489d3 req-7af136c0-3d1e-4652-9684-dc12172bb440 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.162075 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5ceca61d-d0cf-401d-93c7-a732507489d3 req-7af136c0-3d1e-4652-9684-dc12172bb440 service nova] Creating event network-vif-deleted:a747c0c0-9a77-40fa-809e-f9178726eea5 for instance 14777b85-2844-44d2-a8f0-711890e84a88 on n-h2-862416-4 Oct 26 05:24:36.169023 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5ceca61d-d0cf-401d-93c7-a732507489d3 req-7af136c0-3d1e-4652-9684-dc12172bb440 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065970 Oct 26 05:24:36.174170 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2707/5383] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:36.219470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:36.220080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:36.230942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.231445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.233841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.240364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:36.244927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:36.252200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.253705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.254164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.258765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.259265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.259708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.265970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.266492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.266935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.819061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:36.825682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:36.828725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b261740-8858-40ef-8876-150b60fff234 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1375 microversion: 2.1 time: 0.613182 Oct 26 05:24:36.829768 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2677/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:36 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1375 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:36.834034 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-982e6477-380d-412f-9460-939dec9f202c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.598406 Oct 26 05:24:36.834735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:36.835680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:36.837647 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2708/5385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:36 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:36.843126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:36.843654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.843795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:36.844577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.845205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.846279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.847120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.847975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.862182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.863059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.863699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.864614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:36.865421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:36.866038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:36.996042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:37.003504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:37.004263 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-049b743d-d185-4285-b29e-33d47003407d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1273 microversion: 2.1 time: 0.173280 Oct 26 05:24:37.018146 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2678/5386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:36 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:37.029232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b682fa1-19a6-4099-9644-2f50de4ace1b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1465 microversion: 2.1 time: 0.190466 Oct 26 05:24:37.030265 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2709/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:36 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1465 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:37.852620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:37.853234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:37.860218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:37.860960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:37.862709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:37.863322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:37.863635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:37.864513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:37.864962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:37.865416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:37.867503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:37.868244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:37.874007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:37.874893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:37.875558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:37.876001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.163886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:38.172141 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-66e9a49d-a8c5-4e89-af7b-b650ae3ce825 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1375 microversion: 2.1 time: 0.323295 Oct 26 05:24:38.173074 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2679/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:37 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1375 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:38.183724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:38.191529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:38.191917 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-802af337-f9f2-47a2-bc34-bc4b1bd0115e tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.335537 Oct 26 05:24:38.193241 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2710/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:37 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:38.196411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:38.199795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:38.210454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:38.211510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:38.215332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:38.215859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:38.216321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.218571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:38.219216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:38.220761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.223157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:38.223704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:38.226913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.227875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:38.228367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:38.228836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.248472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:38.299594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:38.300297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:38.301063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.301969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lazy-loading 'fault' on Instance uuid 14777b85-2844-44d2-a8f0-711890e84a88 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:24:38.533171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:38.537524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:38.550501 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-74e8012c-637d-45b5-a0d5-f7eeca185bac tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 200 len: 1310 microversion: 2.1 time: 0.354882 Oct 26 05:24:38.551386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2711/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:38 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 1310 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:38.553958 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4fb50072-8c25-4c01-a90f-b54474c22681 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1281 microversion: 2.1 time: 0.376454 Oct 26 05:24:38.554961 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2680/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:38 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1281 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:38.576729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c6229853-9402-48fc-8310-9ff238e13194 req-e0cbfb22-7422-42af-ba0a-3a5f341a493d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6", "tag": "9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:38.592868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6229853-9402-48fc-8310-9ff238e13194 req-e0cbfb22-7422-42af-ba0a-3a5f341a493d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:38.593504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6229853-9402-48fc-8310-9ff238e13194 req-e0cbfb22-7422-42af-ba0a-3a5f341a493d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:38.594652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6229853-9402-48fc-8310-9ff238e13194 req-e0cbfb22-7422-42af-ba0a-3a5f341a493d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:38.619875 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c6229853-9402-48fc-8310-9ff238e13194 req-e0cbfb22-7422-42af-ba0a-3a5f341a493d service nova] Creating event network-changed:9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a for instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 on n-h1-862416-4 Oct 26 05:24:38.631685 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c6229853-9402-48fc-8310-9ff238e13194 req-e0cbfb22-7422-42af-ba0a-3a5f341a493d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076587 Oct 26 05:24:38.636934 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2712/5392] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:39.199841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:39.200492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:39.211757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.218507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:39.219219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:39.225785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.228543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.229896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.235575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.246257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.246764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.247239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.248065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.248856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.257503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.259311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.485608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:39.681787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:39.689255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:39.703867 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3c10c1b-294e-4016-b028-1c4c696ea2bd tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1375 microversion: 2.1 time: 0.510457 Oct 26 05:24:39.706743 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab2f6e52-50df-4b2b-bdc4-2cf9c538ae64 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.493436 Oct 26 05:24:39.723447 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2681/5393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:39 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1375 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:39.728536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2713/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:39 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:39.739860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6ec4f1ea-9f1e-4340-92d4-2f705cefa84f req-ff843d8f-7867-4c20-958d-9efaac68b947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c237b10e-845b-472d-a639-66f8f2db0482", "tag": "f0f1d44d-e2eb-46c2-ac1b-454083fedc19"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:39.743508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:39.744390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:39.757969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.759987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.760698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.762868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.763440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6ec4f1ea-9f1e-4340-92d4-2f705cefa84f req-ff843d8f-7867-4c20-958d-9efaac68b947 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.764174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6ec4f1ea-9f1e-4340-92d4-2f705cefa84f req-ff843d8f-7867-4c20-958d-9efaac68b947 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.764852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.765551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6ec4f1ea-9f1e-4340-92d4-2f705cefa84f req-ff843d8f-7867-4c20-958d-9efaac68b947 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.766252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.802337 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6ec4f1ea-9f1e-4340-92d4-2f705cefa84f req-ff843d8f-7867-4c20-958d-9efaac68b947 service nova] Creating event network-changed:f0f1d44d-e2eb-46c2-ac1b-454083fedc19 for instance c237b10e-845b-472d-a639-66f8f2db0482 on n-h2-862416-4 Oct 26 05:24:39.812158 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6ec4f1ea-9f1e-4340-92d4-2f705cefa84f req-ff843d8f-7867-4c20-958d-9efaac68b947 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086023 Oct 26 05:24:39.813831 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:24:39.816255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2682/5395] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 HTTP/1.1 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '14777b85-2844-44d2-a8f0-711890e84a88'} Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:39.823267 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-76ea5c21-bd26-4626-b9e6-cb5c60c4450d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 404 len: 111 microversion: 2.1 time: 0.092850 Oct 26 05:24:39.827889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2714/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:39 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:24:39.830657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:39.836483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:39.844039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.844711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa2a8111-907f-4bbc-8fc2-a8e06213ca84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: .version_select at 0x7f4709626940>, body: {"keypair": {"name": "tempest-key-1645386552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPki1p3jULaOGQP8cOMsulB6ZzlSudSvUzVBwcljVsETVDs2cFjEyVcMJOgbxCD28AhQzQqf2C2w0p4nE/9v6TPFVWEB1csvStO66Xaee0mNTRgbab1a5d63XAlXlGumQ=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:39.845196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.845885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.847880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:39.848587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:39.849242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:39.883627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-aa2a8111-907f-4bbc-8fc2-a8e06213ca84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:39.896392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-aa2a8111-907f-4bbc-8fc2-a8e06213ca84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:39.947332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:39.961383 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa2a8111-907f-4bbc-8fc2-a8e06213ca84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.120369 Oct 26 05:24:39.963404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:39.964852 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2715/5397] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:24:39 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:39.975785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30d7c216-3cfb-4f26-ba94-2bdb9f86d5bb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '.version_select at 0x7f470958b700>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:39.976419 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a781db96-d6f9-4b52-80aa-07a7d0ea1913 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1279 microversion: 2.1 time: 0.157408 Oct 26 05:24:39.981447 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2683/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:39 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:39.981744 n-d-862416-4 devstack@n-api.service[120586]: WARNING oslo_db.sqlalchemy.utils [None req-30d7c216-3cfb-4f26-ba94-2bdb9f86d5bb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 26 05:24:39.990769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30d7c216-3cfb-4f26-ba94-2bdb9f86d5bb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.019268 Oct 26 05:24:39.991908 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2716/5399] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 26 05:24:39 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:24:40.137572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1679258668", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-key-1645386552", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:40.242019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:24:40.737151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:40.738466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:40.749639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:40.750757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:40.751457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:40.752582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:40.753946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:40.754841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.173940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:41.188813 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-454b6e6d-37b5-4a7c-85ad-d4d976a0a76e tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1375 microversion: 2.1 time: 0.456604 Oct 26 05:24:41.201408 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2717/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:40 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1375 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:41.201408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:41.201860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:41.227133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.227569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.228022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.232142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.235594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.236297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.257556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:24:41.258651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:24:41.259575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:24:41.260431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:24:41.261404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:24:41.272471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.273188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.274675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.276455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.277141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.277949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.300766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:24:41.309908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:24:41.370400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:24:41.376623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:24:41.512224 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d22ef4d1-13ff-493f-b438-1a05ebd6209a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377972 Oct 26 05:24:41.522720 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2684/5401] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:24:41.535074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:41.536217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:41.567007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.567654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.568114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.568834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.569637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.570245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.591646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:41.621760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a356c51a-69e5-4abc-930b-6d59f8dfeac6 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.423787 Oct 26 05:24:41.627111 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2718/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:41 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:41.650045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4fb3a800-1b1b-484e-92a2-d3c1c009e1a4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:41.654785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4fb3a800-1b1b-484e-92a2-d3c1c009e1a4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:41.786706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4fb3a800-1b1b-484e-92a2-d3c1c009e1a4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:41.796736 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4fb3a800-1b1b-484e-92a2-d3c1c009e1a4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1229 microversion: 2.1 time: 0.166879 Oct 26 05:24:41.798547 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2719/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:41 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1229 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:41.813391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-2efc5ea1-eca1-4e57-b5b4-32d215eab049 req-eae92109-ea95-40f2-816e-971680545984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6", "name": "network-vif-plugged", "status": "completed", "tag": "9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:41.834863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2efc5ea1-eca1-4e57-b5b4-32d215eab049 req-eae92109-ea95-40f2-816e-971680545984 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.837614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2efc5ea1-eca1-4e57-b5b4-32d215eab049 req-eae92109-ea95-40f2-816e-971680545984 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.840332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2efc5ea1-eca1-4e57-b5b4-32d215eab049 req-eae92109-ea95-40f2-816e-971680545984 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:41.841224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:41.849698 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b07db07e-9a25-48ad-a9e5-6ea5c0857189 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.324290 Oct 26 05:24:41.864984 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2685/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:41 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:41.867156 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-2efc5ea1-eca1-4e57-b5b4-32d215eab049 req-eae92109-ea95-40f2-816e-971680545984 service nova] Creating event network-vif-plugged:9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a for instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 on n-h1-862416-4 Oct 26 05:24:41.877848 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-2efc5ea1-eca1-4e57-b5b4-32d215eab049 req-eae92109-ea95-40f2-816e-971680545984 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076262 Oct 26 05:24:41.878836 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2720/5405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:41.984178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c40719f3-d789-499b-a7e4-8c9ce8ce2b6d req-15686e3a-e2ec-46f2-9e70-8bc81d14b4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da551da1-9fc7-4baf-9aec-bc52d1749af7", "tag": "92c53345-c1c9-4e9e-b88a-070fd4d8d3bd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:41.996428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c40719f3-d789-499b-a7e4-8c9ce8ce2b6d req-15686e3a-e2ec-46f2-9e70-8bc81d14b4e1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:41.997202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c40719f3-d789-499b-a7e4-8c9ce8ce2b6d req-15686e3a-e2ec-46f2-9e70-8bc81d14b4e1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:41.997848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c40719f3-d789-499b-a7e4-8c9ce8ce2b6d req-15686e3a-e2ec-46f2-9e70-8bc81d14b4e1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.014475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c40719f3-d789-499b-a7e4-8c9ce8ce2b6d req-15686e3a-e2ec-46f2-9e70-8bc81d14b4e1 service nova] Creating event network-changed:92c53345-c1c9-4e9e-b88a-070fd4d8d3bd for instance da551da1-9fc7-4baf-9aec-bc52d1749af7 on n-h2-862416-4 Oct 26 05:24:42.020870 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c40719f3-d789-499b-a7e4-8c9ce8ce2b6d req-15686e3a-e2ec-46f2-9e70-8bc81d14b4e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041215 Oct 26 05:24:42.021996 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2686/5406] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:42.218853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:42.220254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:42.227666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.228585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.229785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.231073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.231621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.232324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.393257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:42.404442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aac9ff3b-a557-41d1-a89d-88b829746c88 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1375 microversion: 2.1 time: 0.191068 Oct 26 05:24:42.410619 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2721/5407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:42 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1375 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:42.651312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:42.652117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:42.663325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.664473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.665268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.666945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.667810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.668714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.829730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:42.830828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:42.831845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:42.841669 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-355926c3-cc2a-4ddf-83b6-6d9cb41fa072 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.195184 Oct 26 05:24:42.842049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.842850 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2687/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:42 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:42.843850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.844852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.846387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.847559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.848191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.878031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:42.879483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:42.889706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.891364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.903926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.911460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:42.911961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:42.912415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:42.930826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:42.942642 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cbd371eb-48da-4501-b265-531f9270818d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1225 microversion: 2.1 time: 0.122306 Oct 26 05:24:42.958038 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2722/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:42 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:43.259073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:43.274694 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa73aefe-304f-4301-89bd-25cfbc6e086e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.405717 Oct 26 05:24:43.275487 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2688/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:42 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:43.435014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:43.437234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:43.462357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:43.464877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:43.467696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:43.469725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:43.471136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:43.473188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:43.790066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:43.809756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23678ad8-6eb1-41d9-9c51-7d931ead32f2 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1547 microversion: 2.1 time: 0.384604 Oct 26 05:24:43.811040 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2723/5411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:43 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1547 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:43.834745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:43.835911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:43.844916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:43.845809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:43.846485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:43.847980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:43.848781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:43.849511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:43.868385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:43.871183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:43.885080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:43.887757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:43.888453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:43.890168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:43.891765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:43.892708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:43.940674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:44.218414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:44.228298 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58fa8380-3521-4408-a2f5-a5ec6afb7a39 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1547 microversion: 2.1 time: 0.397476 Oct 26 05:24:44.230705 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2689/5412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:43 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1547 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:44.236633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af690fe-2901-4e22-b4ff-050c1ca7a882", "name": "network-vif-plugged", "status": "completed", "tag": "ab786d12-865c-4362-867d-656347f5e551"}, {"server_uuid": "3af690fe-2901-4e22-b4ff-050c1ca7a882", "name": "network-vif-plugged", "status": "completed", "tag": "aecd3a6f-f1f3-40fd-ae5b-2595a3bd0ed2"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:44.254700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:44.255206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:44.255647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:44.268612 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] Creating event network-vif-plugged:ab786d12-865c-4362-867d-656347f5e551 for instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 on n-h2-862416-4 Oct 26 05:24:44.269131 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] Creating event network-vif-plugged:aecd3a6f-f1f3-40fd-ae5b-2595a3bd0ed2 for instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 on n-h2-862416-4 Oct 26 05:24:44.275147 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-337d06f5-2849-4ef8-8915-cc91abb4df2f req-43b205e2-0df0-4b7a-a8dd-8b1dd2a38da5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042958 Oct 26 05:24:44.276959 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2690/5413] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:44.284177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:44.285115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:44.307570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:44.308281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:44.308714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:44.309102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:44.310239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:44.310869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:44.311467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:44.328679 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bdd4f506-1fbe-43b0-a62b-49f49bd2639f tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.464029 Oct 26 05:24:44.329285 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2724/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:43 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:44.340315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:44.341210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:44.367448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:44.367980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:44.368449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:44.369182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:44.369723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:44.370159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:44.485508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:44.503663 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4a496b1-7e62-4c90-9137-bdad4ede23bc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1287 microversion: 2.1 time: 0.225041 Oct 26 05:24:44.517343 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2691/5415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:44 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1287 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:44.584192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:44.592526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a08fd39-1211-479f-b0ea-ce772c4c6a2c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.262002 Oct 26 05:24:44.593209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2725/5416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:44 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:45.356687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:45.357297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:45.367374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.368251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.368856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.370149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.372626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.373525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.531502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:45.540432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:45.558949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.561012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.562487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.563436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.564099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.564743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.573364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:45.587150 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c18a3b0a-fd38-4bad-b4c5-f236436af108 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.233586 Oct 26 05:24:45.614168 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2692/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:45 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:45.626870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:45.629102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:45.647140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.648692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.651036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.653851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.655571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.657357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.876452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:45.891437 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb83717b-d72d-4329-9d48-6a8f55fdd0b6 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.365761 Oct 26 05:24:45.892100 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2726/5418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:45 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:45.898889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:45.901434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:45.909554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.910318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.911114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.912005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:45.912727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:45.914017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:45.938256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:45.948954 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc870018-040f-485a-8e02-775cef3a3295 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055417 Oct 26 05:24:45.955421 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2727/5419] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 26 05:24:45 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:45.960118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-38d08c37-c498-4ff1-b8f0-4ab1b37ec1ce tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.342560 Oct 26 05:24:45.961000 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2693/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:45 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:46.022488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:46.022998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:46.029852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.030433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.031188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.032391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.032913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.033563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.064318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:46.163327 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-33e44a85-b7c5-453c-a765-c6096e317fe8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 204 len: 0 microversion: 2.20 time: 0.146327 Oct 26 05:24:46.167327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2728/5421] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:24:46 2022] DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:24:46.172747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:46.173896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:46.180158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.180573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.181008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.181999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.182655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.183085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.344843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:46.355513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:46.357449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:46.359590 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-12c92c2a-735a-4930-ad29-d3f158f466fa tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.190722 Oct 26 05:24:46.366840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2694/5422] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:46 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:46.614608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:46.615850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:46.625014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.626058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.626536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.627247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.627707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.628138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.917782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:46.918574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:46.934293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.935607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.937863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:46.941527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:46.942949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:46.943606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.233786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:47.253009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab4e6191-a839-46d6-9cb5-d8975e92ce4b tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.645652 Oct 26 05:24:47.256401 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2729/5423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:46 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:47.278176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:47.280250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:47.282539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:47.289071 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4dd49dab-dd46-4f21-a137-0cbdf0d20ddc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.376520 Oct 26 05:24:47.298759 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2695/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:46 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:47.305796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0cbd6abd-98d6-45a0-8f53-ecb34f8c3b2b req-abe256a4-5374-4e4e-a345-8b0d64ff2243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c237b10e-845b-472d-a639-66f8f2db0482", "name": "network-vif-plugged", "status": "completed", "tag": "f0f1d44d-e2eb-46c2-ac1b-454083fedc19"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:47.307544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:47.309815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:47.311781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.314360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:47.315460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:47.318873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.328207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0cbd6abd-98d6-45a0-8f53-ecb34f8c3b2b req-abe256a4-5374-4e4e-a345-8b0d64ff2243 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:47.328985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0cbd6abd-98d6-45a0-8f53-ecb34f8c3b2b req-abe256a4-5374-4e4e-a345-8b0d64ff2243 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:47.329621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0cbd6abd-98d6-45a0-8f53-ecb34f8c3b2b req-abe256a4-5374-4e4e-a345-8b0d64ff2243 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.344758 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0cbd6abd-98d6-45a0-8f53-ecb34f8c3b2b req-abe256a4-5374-4e4e-a345-8b0d64ff2243 service nova] Creating event network-vif-plugged:f0f1d44d-e2eb-46c2-ac1b-454083fedc19 for instance c237b10e-845b-472d-a639-66f8f2db0482 on n-h2-862416-4 Oct 26 05:24:47.351475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0cbd6abd-98d6-45a0-8f53-ecb34f8c3b2b req-abe256a4-5374-4e4e-a345-8b0d64ff2243 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051189 Oct 26 05:24:47.352612 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2696/5425] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:47.361610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-fb6ec876-cb00-4f1b-9529-48be37c98fa2 req-134fcac1-db30-40c7-bc2e-22a4935cdef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39536ca2-aa43-47e9-8c8f-69a6a9f59d00", "tag": "6c3d3b6a-c14b-4bab-9db0-950bb530f5f4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:47.375710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb6ec876-cb00-4f1b-9529-48be37c98fa2 req-134fcac1-db30-40c7-bc2e-22a4935cdef3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:47.376406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb6ec876-cb00-4f1b-9529-48be37c98fa2 req-134fcac1-db30-40c7-bc2e-22a4935cdef3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:47.377019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-fb6ec876-cb00-4f1b-9529-48be37c98fa2 req-134fcac1-db30-40c7-bc2e-22a4935cdef3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.395949 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-fb6ec876-cb00-4f1b-9529-48be37c98fa2 req-134fcac1-db30-40c7-bc2e-22a4935cdef3 service nova] Creating event network-changed:6c3d3b6a-c14b-4bab-9db0-950bb530f5f4 for instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 on n-h1-862416-4 Oct 26 05:24:47.406177 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-fb6ec876-cb00-4f1b-9529-48be37c98fa2 req-134fcac1-db30-40c7-bc2e-22a4935cdef3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051942 Oct 26 05:24:47.407312 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2697/5426] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:47.415234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:47.417156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:47.425825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:47.426789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:47.427374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.428265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:47.430360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:47.431001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:47.683183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:47.694385 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff7b4138-41a7-4e00-ad0d-e68bd1c21504 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.436490 Oct 26 05:24:47.695209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2730/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:47 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:47.739712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:47.751637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:47.753430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:47.754959 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b956234-dfb5-48ac-bb6c-cdfec7528a69 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.345934 Oct 26 05:24:47.755718 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2698/5428] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:47 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:48.279451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:48.280084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:48.286595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.287086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.287548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.288253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.288710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.289137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.317363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:48.318037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:48.328201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.337589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.338134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.339244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.340126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.340558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.621248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:48.632352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb26c166-2788-4c11-ada7-5a6fd651b090 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1334 microversion: 2.1 time: 0.357830 Oct 26 05:24:48.648638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2731/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:48 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1334 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:48.675323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:48.705820 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb2bb928-fdd7-4154-aeb5-4d4a24812f76 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.391150 Oct 26 05:24:48.707978 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2699/5430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:48 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:48.727496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:48.730370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:48.740101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.740611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.741050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.743537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.744791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.746329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.785063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:48.785843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:48.800860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.800860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.800860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:48.800860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:48.800860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:48.800860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:49.362549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:49.379613 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8f3d0bd-c7a2-4b15-8035-dedd4a91b813 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.658855 Oct 26 05:24:49.381179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2732/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:48 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:49.408807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da551da1-9fc7-4baf-9aec-bc52d1749af7", "name": "network-vif-plugged", "status": "completed", "tag": "92c53345-c1c9-4e9e-b88a-070fd4d8d3bd"}, {"server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "name": "network-vif-unplugged", "status": "completed", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:49.422786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:49.423476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:49.424235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:49.441147 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] Creating event network-vif-plugged:92c53345-c1c9-4e9e-b88a-070fd4d8d3bd for instance da551da1-9fc7-4baf-9aec-bc52d1749af7 on n-h2-862416-4 Oct 26 05:24:49.446284 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] Creating event network-vif-unplugged:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:24:49.450478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:49.454329 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c6359359-acd4-4d78-a1c2-4d7c2e9a5d8f req-19474eca-f47d-43cf-83c8-70f36eed6f64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.056562 Oct 26 05:24:49.456051 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2733/5432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:24:49.462247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c4cfc4b5-e39a-4fce-8fc8-dc60f350fd0f req-40b8c2eb-2fa3-4f71-b878-a41c661ab71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6", "tag": "9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:49.465823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:49.469473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:49.472873 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23165583-edb6-4a3e-94d9-f4f9f40155d8 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1724 microversion: 2.20 time: 0.692488 Oct 26 05:24:49.474305 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2700/5433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:48 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1724 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:24:49.507013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c4cfc4b5-e39a-4fce-8fc8-dc60f350fd0f req-40b8c2eb-2fa3-4f71-b878-a41c661ab71a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:49.507512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c4cfc4b5-e39a-4fce-8fc8-dc60f350fd0f req-40b8c2eb-2fa3-4f71-b878-a41c661ab71a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:49.507962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c4cfc4b5-e39a-4fce-8fc8-dc60f350fd0f req-40b8c2eb-2fa3-4f71-b878-a41c661ab71a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:49.530259 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c4cfc4b5-e39a-4fce-8fc8-dc60f350fd0f req-40b8c2eb-2fa3-4f71-b878-a41c661ab71a service nova] Creating event network-changed:9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a for instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 on n-h1-862416-4 Oct 26 05:24:49.540418 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c4cfc4b5-e39a-4fce-8fc8-dc60f350fd0f req-40b8c2eb-2fa3-4f71-b878-a41c661ab71a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082262 Oct 26 05:24:49.545139 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2734/5434] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:49.660883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:49.661829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:49.670533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:49.673094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:49.675319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:49.676250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:49.679412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:49.680031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:49.684941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:49.737206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:49.737958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:49.749565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:49.750337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:49.751025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:49.752311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:49.753022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:49.753984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.032112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:50.046089 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34f6dc3e-de5f-45e7-86cc-accff866be3d tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1668 microversion: 2.1 time: 0.387934 Oct 26 05:24:50.047620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2701/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:49 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:50.090554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:50.091062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:50.102576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.103193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.103745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.104478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.105036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.105512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.177034 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f449b5f-122d-4fc6-9d82-025183ddaf3c tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882/ips" status: 200 len: 178 microversion: 2.1 time: 0.090794 Oct 26 05:24:50.178243 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2702/5436] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:24:50 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882/ips => generated 178 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:24:50.196162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:50.205424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:50.222948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.240099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.245858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.246654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.251814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.252302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.357364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:50.531024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cb08977-0956-4f40-a7c6-64c77a985b40 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 204 len: 0 microversion: 2.1 time: 0.340384 Oct 26 05:24:50.534532 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2703/5437] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:50 2022] DELETE /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:24:50.547837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:50.550290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:50.565821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.566737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.567335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.569386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.569937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.571917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.920612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:50.939102 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c1da479-9fd0-48bc-a86f-ad9a353e5d9f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 1.207659 Oct 26 05:24:50.953342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2735/5438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:49 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:50.954019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:50.954812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:50.968903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.969693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.970315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:50.971201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:50.972206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:50.972809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:51.069294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:51.080501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:51.082428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:51.083901 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-13bd7574-e721-4d89-8f75-e7d701c031fe tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1656 microversion: 2.20 time: 0.142694 Oct 26 05:24:51.098955 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2736/5439] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:50 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1656 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:51.098955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:51.098955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:51.098955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:51.098955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:51.099495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:51.099827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:51.100733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:51.101360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:51.121247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:51.131765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19b3d5a9-08df-462c-a922-770d41e902c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.595872 Oct 26 05:24:51.132915 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2704/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:50 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:51.138595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-85d1fb4c-8754-4dcb-a020-cfc3be0673fa req-9630bbee-2677-4c92-b614-ac773d9251e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f53604-8fda-4485-bcee-5e4e794cd058", "name": "network-vif-deleted", "tag": "4a3c14c7-f9ca-4960-b563-d05a5cf85f2f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:51.162563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-85d1fb4c-8754-4dcb-a020-cfc3be0673fa req-9630bbee-2677-4c92-b614-ac773d9251e4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:51.163321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-85d1fb4c-8754-4dcb-a020-cfc3be0673fa req-9630bbee-2677-4c92-b614-ac773d9251e4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:51.163955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-85d1fb4c-8754-4dcb-a020-cfc3be0673fa req-9630bbee-2677-4c92-b614-ac773d9251e4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:51.177214 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-85d1fb4c-8754-4dcb-a020-cfc3be0673fa req-9630bbee-2677-4c92-b614-ac773d9251e4 service nova] Creating event network-vif-deleted:4a3c14c7-f9ca-4960-b563-d05a5cf85f2f for instance 91f53604-8fda-4485-bcee-5e4e794cd058 on n-h2-862416-4 Oct 26 05:24:51.183993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-85d1fb4c-8754-4dcb-a020-cfc3be0673fa req-9630bbee-2677-4c92-b614-ac773d9251e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049674 Oct 26 05:24:51.184855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2705/5441] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:51.309630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:51.322182 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dfe3191a-09bc-400c-97ad-114233498bac tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1674 microversion: 2.1 time: 0.236010 Oct 26 05:24:51.342148 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2737/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:51 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:51.963516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:51.965436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=22 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:51.972753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:51.973830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:51.989406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:51.990904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:51.991722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:51.992444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:51.992928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:51.993391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.116296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:52.116978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:52.119990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=7 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:52.125732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.126404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.126941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.127943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.128848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.130384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.165937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:52.174707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.175938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.176108 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-948f8b4b-240e-4997-aca7-f03839bdb7ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.213806 Oct 26 05:24:52.176958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.177965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lazy-loading 'fault' on Instance uuid 91f53604-8fda-4485-bcee-5e4e794cd058 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:24:52.189426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2706/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:51 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:52.196451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:52.198956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:52.207705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.210371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.211030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.212064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.212741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.216510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.230071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:52.257940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:52.259663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fba70f93f3fc434eac4137621494d0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3d6d7b2504435b8cbad3ea0782e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:52.260959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-933e6e4b-2f8d-4525-aa25-637921bd3e11 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 200 len: 1371 microversion: 2.20 time: 0.148864 Oct 26 05:24:52.261557 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2738/5444] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:52 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:52.348033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:52.348893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:52.356324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.357081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.357991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.359052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:52.359727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:52.360358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:52.385110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:52.397060 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2620932c-aaeb-4dfc-9f14-770b10b874f5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1321 microversion: 2.1 time: 0.205531 Oct 26 05:24:52.398866 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2707/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:52 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:52.566331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:52.582354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b8c611fa-f4f7-4c48-aadd-f3d26e1ee8a4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1674 microversion: 2.1 time: 0.238149 Oct 26 05:24:52.582978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2739/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:52 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:53.015651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4ebbd21b-fd82-4901-a9ad-20af2e38d925 req-2e67f71e-b0a2-4199-867c-7ea87fc12cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39536ca2-aa43-47e9-8c8f-69a6a9f59d00", "name": "network-vif-plugged", "status": "completed", "tag": "6c3d3b6a-c14b-4bab-9db0-950bb530f5f4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:53.035066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4ebbd21b-fd82-4901-a9ad-20af2e38d925 req-2e67f71e-b0a2-4199-867c-7ea87fc12cab service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.037080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4ebbd21b-fd82-4901-a9ad-20af2e38d925 req-2e67f71e-b0a2-4199-867c-7ea87fc12cab service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.037753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4ebbd21b-fd82-4901-a9ad-20af2e38d925 req-2e67f71e-b0a2-4199-867c-7ea87fc12cab service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.066979 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4ebbd21b-fd82-4901-a9ad-20af2e38d925 req-2e67f71e-b0a2-4199-867c-7ea87fc12cab service nova] Creating event network-vif-plugged:6c3d3b6a-c14b-4bab-9db0-950bb530f5f4 for instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 on n-h1-862416-4 Oct 26 05:24:53.086258 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4ebbd21b-fd82-4901-a9ad-20af2e38d925 req-2e67f71e-b0a2-4199-867c-7ea87fc12cab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074084 Oct 26 05:24:53.091379 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2740/5447] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:24:53.202468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.204695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.220402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.222407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.223572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.225008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.226410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.227207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.261767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:53.354492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.355095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.361773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.362272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.362715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.363423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.363891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.364308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.403482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:53.473468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:53.493189 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55d59b4f-c487-4af3-9a84-fd9df5a805cb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.296785 Oct 26 05:24:53.510970 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2741/5448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:53 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:53.516065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.518201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.526274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.527199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.527891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.528908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.529726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.530485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.556311 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] HTTP exception thrown: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:53.557420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf580930-8875-47fc-bf62-05130066f7a0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "DELETE /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 204 len: 0 microversion: 2.42 time: 0.561877 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Request method failure captured: Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 HTTP/1.1 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMJXpET6wgIgCMUoE659hcitHIb8B2Rwz0CbQOocAtWaYJrdEYAy_axwmp1oSXjzOZxl5AC9mgZw8kE2g8qKr8KifS3_5M6uxKfDaAzS0ZY20KyFS28MTEQUpXDaHMDkr1rcJzTu2X5dN00KnYlsvz8rjU1DFYtM8ccmjzPeuF4xha8 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: fba70f93f3fc434eac4137621494d0e3 Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '91f53604-8fda-4485-bcee-5e4e794cd058'} Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:53.558174 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:53.564906 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:53.566102 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2708/5449] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:24:52 2022] DELETE /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:24:53.566258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Returning 404 to user: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:53.566258 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-830bb627-631c-41f0-9ed2-5e1d5a55b716 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 404 len: 111 microversion: 2.20 time: 0.050901 Oct 26 05:24:53.566571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.566804 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2742/5450] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:53 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:24:53.566957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.571833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.572988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.573516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.579740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.580438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.580887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.581073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.581821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.581967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.582347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.582777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.583259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.583895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.584564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.876944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:53.888458 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-516177b2-f519-40cb-b157-127295b9aadb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1515 microversion: 2.1 time: 0.328181 Oct 26 05:24:53.897408 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2709/5451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:53 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:53.903306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b42f0d60-69de-43c8-a52d-f5b31620e953 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '.version_select at 0x7f47092ab8b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.917905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:53.931245 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b42f0d60-69de-43c8-a52d-f5b31620e953 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332493794" status: 204 len: 0 microversion: 2.20 time: 0.032362 Oct 26 05:24:53.931467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:53.932915 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2710/5452] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 26 05:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332493794 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:24:53.936821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:53.938623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36579d66-6a2f-4a43-a4c5-caccd59afeb2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2961 microversion: 2.42 time: 0.370659 Oct 26 05:24:53.939191 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2743/5453] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:53 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2961 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:53.949596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:53.949596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.963069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.963924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.965165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.966181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:53.967098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.968072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.969008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.969395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:53.976063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.976583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.977041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:53.977785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:53.978239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:53.979111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.020079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'flavor' on Instance uuid da551da1-9fc7-4baf-9aec-bc52d1749af7 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:24:54.116812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec4649b6-2980-42cb-93ea-ec2ab3147f2d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action" status: 200 len: 32 microversion: 2.1 time: 0.165092 Oct 26 05:24:54.117592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2744/5454] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:24:53 2022] POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:24:54.123738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b58e87a9-5a28-4a6a-98ec-642741b19c74 req-9d8dedc1-6688-479f-9a0d-950ae9171045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af690fe-2901-4e22-b4ff-050c1ca7a882", "name": "network-vif-deleted", "tag": "aecd3a6f-f1f3-40fd-ae5b-2595a3bd0ed2"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:54.134344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b58e87a9-5a28-4a6a-98ec-642741b19c74 req-9d8dedc1-6688-479f-9a0d-950ae9171045 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.135409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b58e87a9-5a28-4a6a-98ec-642741b19c74 req-9d8dedc1-6688-479f-9a0d-950ae9171045 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.135748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b58e87a9-5a28-4a6a-98ec-642741b19c74 req-9d8dedc1-6688-479f-9a0d-950ae9171045 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.151501 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b58e87a9-5a28-4a6a-98ec-642741b19c74 req-9d8dedc1-6688-479f-9a0d-950ae9171045 service nova] Creating event network-vif-deleted:aecd3a6f-f1f3-40fd-ae5b-2595a3bd0ed2 for instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 on n-h2-862416-4 Oct 26 05:24:54.158396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b58e87a9-5a28-4a6a-98ec-642741b19c74 req-9d8dedc1-6688-479f-9a0d-950ae9171045 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039045 Oct 26 05:24:54.159643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2745/5455] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:54.167160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:54.168284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:54.175716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.177221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.177963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.178698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.179264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.179697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.330704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7230bc61b549b8adf602f9ce37c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb324d5cc720471abe62f4a6fdd5de5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:54.351054 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93a01968-21c6-4732-b402-c20cb08c2958 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 200 len: 1653 microversion: 2.1 time: 0.416678 Oct 26 05:24:54.351863 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2711/5456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:53 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 1653 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:54.493681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:54.501745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f940cee-bea9-4153-88bc-ccd90928a196 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.340856 Oct 26 05:24:54.502344 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2746/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:54 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:54.524242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:54.526841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:54.536833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.537708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.538388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.539375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.540000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.540713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.868272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:54.878566 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61138259-72f8-461c-abfb-7b34435c6eeb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.356938 Oct 26 05:24:54.880194 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2712/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:54 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:54.971727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:54.972701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:54.981201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.982483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.982941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:54.983659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:54.984119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:54.984734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:55.355363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:55.368665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:55.372376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:55.379061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:55.380008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:55.387618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c52a6a0-e713-4e79-94cc-731a9247aa2c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2961 microversion: 2.42 time: 0.419446 Oct 26 05:24:55.391197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2747/5459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:54 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2961 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:55.393565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:55.394282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:55.394950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:55.395870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:55.396556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:55.397184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:55.413015 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] HTTP exception thrown: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Request method failure captured: Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 HTTP/1.1 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQ85O-Y89w7zvnUC3kMZwh_uSOCxlX7CE0n9fje3gE9RXoVOYi5DuuUFWjHiPWLd7Wr8KwSivjnunINpmB05UYc5LYLK0Jgoz-cHiExIHKXjodRo1XfsMZ4HBfDzzAbK8OfZn6qY0tBeu5kGkJK-JfmBVUF1Zk2nbo9JT-JaSiQUnE Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9e7230bc61b549b8adf602f9ce37c4d6 Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3af690fe-2901-4e22-b4ff-050c1ca7a882'} Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:55.415545 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Returning 404 to user: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c328398e-72a4-4874-b210-296de6ef63b1 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 404 len: 111 microversion: 2.1 time: 0.042772 Oct 26 05:24:55.420377 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2713/5460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:55 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:24:55.525006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:55.526037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:55.532276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:55.532998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:55.533663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:55.534389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:55.535024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:55.535636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:55.772448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:55.787994 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36031877-c6a5-4d9a-b159-206c46b2945c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.267590 Oct 26 05:24:55.807484 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2748/5461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:55 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:55.909438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:55.911276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:55.937269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:55.937789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:55.938242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:55.945458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:55.946731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:55.947872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:56.206583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-033049bb-d86d-446e-9ade-a3f6d19f54de req-64a4f2d4-d762-4459-b26e-3db2a021a566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af690fe-2901-4e22-b4ff-050c1ca7a882", "name": "network-vif-deleted", "tag": "ab786d12-865c-4362-867d-656347f5e551"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:56.229685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:56.230463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-033049bb-d86d-446e-9ade-a3f6d19f54de req-64a4f2d4-d762-4459-b26e-3db2a021a566 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:56.231268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-033049bb-d86d-446e-9ade-a3f6d19f54de req-64a4f2d4-d762-4459-b26e-3db2a021a566 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:56.232188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-033049bb-d86d-446e-9ade-a3f6d19f54de req-64a4f2d4-d762-4459-b26e-3db2a021a566 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:56.239637 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b325c37-dcf1-43c2-9509-20125d6ce9a2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1329 microversion: 2.1 time: 0.335680 Oct 26 05:24:56.245855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2714/5462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:55 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1329 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:56.255733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-033049bb-d86d-446e-9ade-a3f6d19f54de req-64a4f2d4-d762-4459-b26e-3db2a021a566 service nova] Creating event network-vif-deleted:ab786d12-865c-4362-867d-656347f5e551 for instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 on n-h2-862416-4 Oct 26 05:24:56.267841 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-033049bb-d86d-446e-9ade-a3f6d19f54de req-64a4f2d4-d762-4459-b26e-3db2a021a566 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064780 Oct 26 05:24:56.270423 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2749/5463] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:56.416968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:56.417990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:56.421718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:56.435109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:56.435877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:56.436608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:56.437508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:56.439306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:56.440838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:56.815159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:56.816595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:56.824565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:56.825471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:56.826152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:56.827091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:56.827766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:56.828950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:56.940089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:56.972761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:57.011706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:57.013353 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a3a7b56e-826d-46d3-8ae3-17312a3308d3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2961 microversion: 2.42 time: 0.600750 Oct 26 05:24:57.016395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2715/5464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:56 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2961 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:57.243843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:57.257903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f638cc7c-15f8-496d-a5ae-2b0ad34438b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.446286 Oct 26 05:24:57.267274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:57.267950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:57.280553 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2750/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:56 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:57.281763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:57.282305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:57.282744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:57.283468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:57.284160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:57.284608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:57.599423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:57.607607 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bec73cf0-80a9-4763-97f8-16bb953eb2ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1510 microversion: 2.1 time: 0.345356 Oct 26 05:24:57.608278 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2716/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:57 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:24:57.631421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:57.632439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:57.639563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:57.640445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:57.641133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:57.641965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:57.642531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:57.643044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.051495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:58.053547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:58.066347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.070471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.071049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.071938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.075371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.075933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.086681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:24:58.114793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:58.128114 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-877b04af-570e-4a39-9058-b0b5ac68d443 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1510 microversion: 2.1 time: 0.501111 Oct 26 05:24:58.129901 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2751/5467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:57 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:58.162098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:58.162613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:58.170548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.171301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.172525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.173509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.174154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.174967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.219903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:24:58.459060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:58.466433 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-036adb02-1c0c-480d-b412-2ddeb878d12d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 204 len: 0 microversion: 2.1 time: 0.312228 Oct 26 05:24:58.467789 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2752/5468] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:58 2022] DELETE /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:24:58.476642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:58.479422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:58.483033 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ddb74655-29eb-4b64-a324-aa03ce869a13 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2961 microversion: 2.42 time: 0.436399 Oct 26 05:24:58.486251 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2717/5469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:58 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2961 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:58.488063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:58.491076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:58.498472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:58.499313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:58.509987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.512416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.512844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.514038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.514357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.514489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.514887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.515532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.515659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.516035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.516613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.526382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.831783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:58.845127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-443307d7-2b85-48e4-b8f8-0e4e155e9637 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1516 microversion: 2.1 time: 0.355706 Oct 26 05:24:58.865789 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2718/5470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:58 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1516 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:58.899483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:58.907644 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f504eb5-9f4a-4314-b3b0-95c9a3f91eae tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.435055 Oct 26 05:24:58.912659 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2753/5471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:58 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:24:58.960616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:58.961546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:58.968517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.969422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.970293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.971934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:58.972617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:58.973517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:58.992477 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] HTTP exception thrown: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Request method failure captured: Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 HTTP/1.1 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJXpET6wgIgCMUoE659hcitHIb8B2Rwz0CbQOocAtWaYJrdEYAy_axwmp1oSXjzOZxl5AC9mgZw8kE2g8qKr8KifS3_5M6uxKfDaAzS0ZY20KyFS28MTEQUpXDaHMDkr1rcJzTu2X5dN00KnYlsvz8rjU1DFYtM8ccmjzPeuF4xha8 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: fba70f93f3fc434eac4137621494d0e3 Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '91f53604-8fda-4485-bcee-5e4e794cd058'} Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:58.995006 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.000979 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.003567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Returning 404 to user: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:59.005087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d46cbed8-5a68-495c-b326-3960cdcbbdb3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 404 len: 111 microversion: 2.20 time: 0.049240 Oct 26 05:24:59.007262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2719/5472] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:24:58 2022] DELETE /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:24:59.016218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.016925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 91f53604-8fda-4485-bcee-5e4e794cd058] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:59.027820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.028812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.029508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.030596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.031274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.031917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.050448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] HTTP exception thrown: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Request method failure captured: Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 HTTP/1.1 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMJXpET6wgIgCMUoE659hcitHIb8B2Rwz0CbQOocAtWaYJrdEYAy_axwmp1oSXjzOZxl5AC9mgZw8kE2g8qKr8KifS3_5M6uxKfDaAzS0ZY20KyFS28MTEQUpXDaHMDkr1rcJzTu2X5dN00KnYlsvz8rjU1DFYtM8ccmjzPeuF4xha8 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: fba70f93f3fc434eac4137621494d0e3 Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '91f53604-8fda-4485-bcee-5e4e794cd058'} Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.052862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. Oct 26 05:24:59.058233 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.060483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Returning 404 to user: Instance 91f53604-8fda-4485-bcee-5e4e794cd058 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:59.061640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-712df1c0-2589-4a6c-a38b-f1c38a605ec0 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058" status: 404 len: 111 microversion: 2.20 time: 0.051270 Oct 26 05:24:59.062738 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2754/5473] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:59 2022] GET /compute/v2.1/servers/91f53604-8fda-4485-bcee-5e4e794cd058 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:24:59.104211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a8092f34-c08e-468e-86fa-896d7e89af88 req-37fb9f89-9d94-44ec-8de1-c9d1151475ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-unplugged", "status": "completed", "tag": "29394b68-b95f-441f-9916-74f55e138b57"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:24:59.129031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8092f34-c08e-468e-86fa-896d7e89af88 req-37fb9f89-9d94-44ec-8de1-c9d1151475ad service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.135690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8092f34-c08e-468e-86fa-896d7e89af88 req-37fb9f89-9d94-44ec-8de1-c9d1151475ad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.136419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a8092f34-c08e-468e-86fa-896d7e89af88 req-37fb9f89-9d94-44ec-8de1-c9d1151475ad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.170331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a8092f34-c08e-468e-86fa-896d7e89af88 req-37fb9f89-9d94-44ec-8de1-c9d1151475ad service nova] Creating event network-vif-unplugged:29394b68-b95f-441f-9916-74f55e138b57 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:24:59.187695 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a8092f34-c08e-468e-86fa-896d7e89af88 req-37fb9f89-9d94-44ec-8de1-c9d1151475ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087279 Oct 26 05:24:59.188818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2720/5474] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:24:59.529955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.529955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:59.551435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.556924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.557770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.561252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.563103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.564389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.708533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.709140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:59.723358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.726020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.726499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.727241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.727715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.728151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.762394 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] HTTP exception thrown: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Request method failure captured: Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 HTTP/1.1 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQ85O-Y89w7zvnUC3kMZwh_uSOCxlX7CE0n9fje3gE9RXoVOYi5DuuUFWjHiPWLd7Wr8KwSivjnunINpmB05UYc5LYLK0Jgoz-cHiExIHKXjodRo1XfsMZ4HBfDzzAbK8OfZn6qY0tBeu5kGkJK-JfmBVUF1Zk2nbo9JT-JaSiQUnE Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9e7230bc61b549b8adf602f9ce37c4d6 Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3af690fe-2901-4e22-b4ff-050c1ca7a882'} Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:59.768380 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Returning 404 to user: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d375a00e-6db5-4756-a8ac-a9f0be0b82d4 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 404 len: 111 microversion: 2.1 time: 0.065772 Oct 26 05:24:59.778641 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2721/5475] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:59 2022] DELETE /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:24:59.784545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.785286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 3af690fe-2901-4e22-b4ff-050c1ca7a882] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:59.798256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.798760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.801433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.802434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.807049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.807946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.844182 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] HTTP exception thrown: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Request method failure captured: Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 HTTP/1.1 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQ85O-Y89w7zvnUC3kMZwh_uSOCxlX7CE0n9fje3gE9RXoVOYi5DuuUFWjHiPWLd7Wr8KwSivjnunINpmB05UYc5LYLK0Jgoz-cHiExIHKXjodRo1XfsMZ4HBfDzzAbK8OfZn6qY0tBeu5kGkJK-JfmBVUF1Zk2nbo9JT-JaSiQUnE Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9e7230bc61b549b8adf602f9ce37c4d6 Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3af690fe-2901-4e22-b4ff-050c1ca7a882'} Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.845836 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Returning 404 to user: Instance 3af690fe-2901-4e22-b4ff-050c1ca7a882 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:59.850090 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0dc719f3-96ce-427e-8d91-c6dda8bf4c62 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882" status: 404 len: 111 microversion: 2.1 time: 0.075159 Oct 26 05:24:59.856946 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2722/5476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:59 2022] GET /compute/v2.1/servers/3af690fe-2901-4e22-b4ff-050c1ca7a882 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:24:59.862187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.866270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:59.877347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.879659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.880710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.881491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.883254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.884876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.904170 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] HTTP exception thrown: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Request method failure captured: Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 HTTP/1.1 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQ85O-Y89w7zvnUC3kMZwh_uSOCxlX7CE0n9fje3gE9RXoVOYi5DuuUFWjHiPWLd7Wr8KwSivjnunINpmB05UYc5LYLK0Jgoz-cHiExIHKXjodRo1XfsMZ4HBfDzzAbK8OfZn6qY0tBeu5kGkJK-JfmBVUF1Zk2nbo9JT-JaSiQUnE Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9e7230bc61b549b8adf602f9ce37c4d6 Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestMultiNic-296451753-project Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '984b308d-6dbd-4405-8653-83445c48ebf2'} Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:24:59.905849 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Returning 404 to user: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a27d2c59-b1bf-41f1-96ec-85b84b5f084a tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 404 len: 111 microversion: 2.1 time: 0.049050 Oct 26 05:24:59.913525 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2723/5477] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:24:59 2022] DELETE /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:24:59.916786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.917629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:24:59.924623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.928766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.929488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.932109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:24:59.932773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:24:59.940157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:24:59.973609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:59.985876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:59.987681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:24:59.989200 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b07340c2-08b8-496f-b4c6-7ce4daaaea91 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2940 microversion: 2.42 time: 0.472040 Oct 26 05:24:59.990327 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2755/5478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:24:59 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2940 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:24:59.996342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:24:59.997269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] [instance: 984b308d-6dbd-4405-8653-83445c48ebf2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:00.016668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:00.017661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:00.018451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:00.019391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:00.024025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:00.024761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:00.059296 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] HTTP exception thrown: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Request method failure captured: Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 HTTP/1.1 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMQ85O-Y89w7zvnUC3kMZwh_uSOCxlX7CE0n9fje3gE9RXoVOYi5DuuUFWjHiPWLd7Wr8KwSivjnunINpmB05UYc5LYLK0Jgoz-cHiExIHKXjodRo1XfsMZ4HBfDzzAbK8OfZn6qY0tBeu5kGkJK-JfmBVUF1Zk2nbo9JT-JaSiQUnE Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb324d5cc720471abe62f4a6fdd5de5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestMultiNic-296451753 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: bb324d5cc720471abe62f4a6fdd5de5f Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestMultiNic-296451753 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestMultiNic-296451753-project Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 9e7230bc61b549b8adf602f9ce37c4d6 Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestMultiNic-296451753-project Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '984b308d-6dbd-4405-8653-83445c48ebf2'} Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:00.063142 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. Oct 26 05:25:00.068345 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:00.070909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] Returning 404 to user: Instance 984b308d-6dbd-4405-8653-83445c48ebf2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:00.073442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-38ef4d84-301b-4826-ab3e-ec838e492048 tempest-ServersTestMultiNic-296451753 tempest-ServersTestMultiNic-296451753-project] 10.222.0.16 "GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2" status: 404 len: 111 microversion: 2.1 time: 0.080620 Oct 26 05:25:00.076083 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2756/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:59 2022] GET /compute/v2.1/servers/984b308d-6dbd-4405-8653-83445c48ebf2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:25:00.091653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:00.093956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:00.105513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:00.119528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:00.120475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:00.121854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:00.124463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:00.125507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:00.128798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:00.180281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:00.538337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:00.554065 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-deb09939-7c37-49dd-83ac-9fa55123676d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1516 microversion: 2.1 time: 0.644796 Oct 26 05:25:00.554812 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2724/5480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:24:59 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1516 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:00.646805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:00.659503 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cadfe08d-f02c-4f90-9614-87d588a382d9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.578089 Oct 26 05:25:00.660612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2757/5481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:00 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:01.021639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:01.022673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:01.030348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.031137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.031775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:01.032717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.033434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.034088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:01.265429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-unplugged", "status": "completed", "tag": "a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-unplugged", "status": "completed", "tag": "4fddf85f-a296-4afa-b733-f473ffa50c68"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-unplugged", "status": "completed", "tag": "0b48ce7f-88c2-4c95-a5bf-164fed997c95"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-unplugged", "status": "completed", "tag": "34e7a88d-8eed-44ca-8f5b-7a13e098a31f"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-unplugged", "status": "completed", "tag": "6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:01.292124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.293647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.294392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:01.312830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Creating event network-vif-unplugged:a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:01.313775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Creating event network-vif-unplugged:4fddf85f-a296-4afa-b733-f473ffa50c68 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:01.314557 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Creating event network-vif-unplugged:0b48ce7f-88c2-4c95-a5bf-164fed997c95 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:01.315209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Creating event network-vif-unplugged:34e7a88d-8eed-44ca-8f5b-7a13e098a31f for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:01.315947 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] Creating event network-vif-unplugged:6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:01.323272 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ce4a779d-c20f-40ee-b04f-34d831def803 req-a0bd01c7-55c2-4559-a28a-789f6189a064 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.065322 Oct 26 05:25:01.331206 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2758/5482] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:01.354924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:01.378985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:01.381131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:01.383797 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-566f039c-49ee-45a3-b2f3-c66febc6d2ff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2940 microversion: 2.42 time: 0.366142 Oct 26 05:25:01.386431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2725/5483] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:01 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2940 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:01.585095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:01.586378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:01.599007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.599624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.600279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:01.602373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.603986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.605138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:01.689256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:01.690724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:01.709138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.710005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.710676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:01.713177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:01.713971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:01.714620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:02.143935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:02.155423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:02.158215 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0047a2f9-069d-4f1a-bc22-56f0d301ae84 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 200 len: 1516 microversion: 2.1 time: 0.581537 Oct 26 05:25:02.159303 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2759/5484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:01 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 1516 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:02.168060 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af8dddd3-2637-40cf-8e5e-e4e89eabe7d6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.483503 Oct 26 05:25:02.183646 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2726/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:01 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:02.197795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-aafea433-1ce6-46d1-8d74-6a51e73a9e32 req-2b2b2e38-e4c4-4315-b234-a4842d9f45e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39536ca2-aa43-47e9-8c8f-69a6a9f59d00", "name": "network-vif-deleted", "tag": "6c3d3b6a-c14b-4bab-9db0-950bb530f5f4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:02.215853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aafea433-1ce6-46d1-8d74-6a51e73a9e32 req-2b2b2e38-e4c4-4315-b234-a4842d9f45e1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:02.216354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aafea433-1ce6-46d1-8d74-6a51e73a9e32 req-2b2b2e38-e4c4-4315-b234-a4842d9f45e1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:02.216798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aafea433-1ce6-46d1-8d74-6a51e73a9e32 req-2b2b2e38-e4c4-4315-b234-a4842d9f45e1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:02.251874 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-aafea433-1ce6-46d1-8d74-6a51e73a9e32 req-2b2b2e38-e4c4-4315-b234-a4842d9f45e1 service nova] Creating event network-vif-deleted:6c3d3b6a-c14b-4bab-9db0-950bb530f5f4 for instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 on n-h1-862416-4 Oct 26 05:25:02.264794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-aafea433-1ce6-46d1-8d74-6a51e73a9e32 req-2b2b2e38-e4c4-4315-b234-a4842d9f45e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070755 Oct 26 05:25:02.265670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2760/5486] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:02.413330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:02.413980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:02.431225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:02.431806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:02.432255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:02.432980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:02.433477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:02.443441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:02.787505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:02.802214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:02.803607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:02.805223 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63443fc7-3699-4757-a136-4bbdeff2ba55 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2919 microversion: 2.42 time: 0.395509 Oct 26 05:25:02.808264 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2727/5487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:02 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2919 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:03.189077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:03.194990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:03.195881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:03.201967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:03.242884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:03.245204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:03.247454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:03.250273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:03.252024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:03.252499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:03.253026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:03.253542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:03.258450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:03.261271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:03.262877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:03.263762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:03.332142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 HTTP/1.1 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '39536ca2-aa43-47e9-8c8f-69a6a9f59d00'} Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:03.338510 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:03.344922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:03.344922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:03.344922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:03.344922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:03.344922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:25:03.344922 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:03.351251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:03.356953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98250d8a-997f-4c9d-bfd4-0007627face4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 404 len: 111 microversion: 2.1 time: 0.171548 Oct 26 05:25:03.357728 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2761/5488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:03 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:25:03.375906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c085ed1d-76b4-47be-8676-b13005ca21bf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '.version_select at 0x7f47094b2430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:03.407462 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c085ed1d-76b4-47be-8676-b13005ca21bf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1645386552" status: 202 len: 0 microversion: 2.1 time: 0.042800 Oct 26 05:25:03.421189 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2762/5489] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 26 05:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1645386552 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:25:03.687305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1808739866", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:03.830587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:25:04.052250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:04.065027 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1b81eb7-0f38-4a9a-841d-977f0c6dc2d4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.874378 Oct 26 05:25:04.074557 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2728/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:03 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:04.096427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:04.106006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:04.112772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.113536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.115549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.116490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.122028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.122753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.567321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:04.584997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:04.604968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:04.607702 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a22d6a8-4edb-46cd-bb06-ea4c4b436fff tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2872 microversion: 2.42 time: 0.531319 Oct 26 05:25:04.614225 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2729/5491] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:04 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2872 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:04.638782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:04.639745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:04.662854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.665074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.666471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.677887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.678519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.678845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.707171 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] HTTP exception thrown: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Request method failure captured: Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 HTTP/1.1 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJXpET6wgIgCMUoE659hcitHIb8B2Rwz0CbQOocAtWaYJrdEYAy_axwmp1oSXjzOZxl5AC9mgZw8kE2g8qKr8KifS3_5M6uxKfDaAzS0ZY20KyFS28MTEQUpXDaHMDkr1rcJzTu2X5dN00KnYlsvz8rjU1DFYtM8ccmjzPeuF4xha8 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: fba70f93f3fc434eac4137621494d0e3 Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9'} Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:04.711788 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.717473 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.724629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Returning 404 to user: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:04.725843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58347404-09ca-41c9-8480-fa54ad8942c3 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 404 len: 111 microversion: 2.20 time: 0.109610 Oct 26 05:25:04.731970 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2730/5492] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:25:04 2022] DELETE /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:25:04.760729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8087258e-ada3-476b-91dd-641c22071d55 req-638f171b-d9f6-4839-bb74-c0bed8ec7f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-deleted", "tag": "6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:04.776967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8087258e-ada3-476b-91dd-641c22071d55 req-638f171b-d9f6-4839-bb74-c0bed8ec7f11 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.777907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8087258e-ada3-476b-91dd-641c22071d55 req-638f171b-d9f6-4839-bb74-c0bed8ec7f11 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.779532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8087258e-ada3-476b-91dd-641c22071d55 req-638f171b-d9f6-4839-bb74-c0bed8ec7f11 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.804894 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8087258e-ada3-476b-91dd-641c22071d55 req-638f171b-d9f6-4839-bb74-c0bed8ec7f11 service nova] Creating event network-vif-deleted:6ab27c6a-0fcd-4d7b-8729-5b80e2e3232e for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:04.830318 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8087258e-ada3-476b-91dd-641c22071d55 req-638f171b-d9f6-4839-bb74-c0bed8ec7f11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095258 Oct 26 05:25:04.831386 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2731/5493] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:04.841738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:04.844400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] [instance: 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:04.857000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.859545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.862103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.863477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:04.864347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:04.865031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:04.902699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] HTTP exception thrown: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Request method failure captured: Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 HTTP/1.1 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMJXpET6wgIgCMUoE659hcitHIb8B2Rwz0CbQOocAtWaYJrdEYAy_axwmp1oSXjzOZxl5AC9mgZw8kE2g8qKr8KifS3_5M6uxKfDaAzS0ZY20KyFS28MTEQUpXDaHMDkr1rcJzTu2X5dN00KnYlsvz8rjU1DFYtM8ccmjzPeuF4xha8 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dab3d6d7b2504435b8cbad3ea0782e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: dab3d6d7b2504435b8cbad3ea0782e34 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2126198730 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: fba70f93f3fc434eac4137621494d0e3 Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2126198730-project Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9'} Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.906355 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. Oct 26 05:25:04.911229 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:04.916269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] Returning 404 to user: Instance 454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:04.917410 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43f16baf-189f-4ffb-b5a9-73c3f792c3c1 tempest-AttachVolumeShelveTestJSON-2126198730 tempest-AttachVolumeShelveTestJSON-2126198730-project] 10.222.0.16 "GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9" status: 404 len: 111 microversion: 2.20 time: 0.084125 Oct 26 05:25:04.923421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2732/5494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:04 2022] GET /compute/v2.1/servers/454cdcd3-5cd6-4eb1-b4de-6696b0c8bdb9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:25:05.050838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:25:05.053622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:25:05.055188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:25:05.055706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:25:05.059317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:25:05.083862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:05.084362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:05.085614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:05.086300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:05.086765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:05.087195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:05.104555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:05.105218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:05.114600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:05.115022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:05.115460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:05.116178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:05.116629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:05.117054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:05.136889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:25:05.154685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:25:05.180737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:25:05.191320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:25:05.276956 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd36bb94-5994-454f-ba2b-4c2de25c62fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595395 Oct 26 05:25:05.284622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2763/5495] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:25:05.289959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3bf5994-060a-4b08-926d-0f46fd48782c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:05.290597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e3bf5994-060a-4b08-926d-0f46fd48782c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:05.823272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e3bf5994-060a-4b08-926d-0f46fd48782c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:05.836642 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e3bf5994-060a-4b08-926d-0f46fd48782c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1209 microversion: 2.1 time: 0.550749 Oct 26 05:25:05.837364 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2764/5496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:05 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1209 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:05.856148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:05.860251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:05.868530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:05.878277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:05.878858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:05.880151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:05.880860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:05.881672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:06.648191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:06.659992 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6305051f-7274-4e59-85f7-d2f5ba526eab tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 1.561554 Oct 26 05:25:06.663335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2733/5497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:05 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:06.793024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:06.812524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:06.816317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:06.819446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f07e6841-a1b0-45eb-b31c-ab0ff5c6fa83 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2664 microversion: 2.42 time: 0.979193 Oct 26 05:25:06.820108 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2765/5498] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:05 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2664 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:06.858271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-deleted", "tag": "34e7a88d-8eed-44ca-8f5b-7a13e098a31f"}, {"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-deleted", "tag": "29394b68-b95f-441f-9916-74f55e138b57"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:06.876479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:06.877860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:06.878753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:06.881730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:06.882486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:06.895194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:06.895856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:06.901086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:06.901989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:06.902522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:06.903254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:06.913568 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] Creating event network-vif-deleted:34e7a88d-8eed-44ca-8f5b-7a13e098a31f for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:06.925123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] Creating event network-vif-deleted:29394b68-b95f-441f-9916-74f55e138b57 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:06.936883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3976bc61-822c-4822-adb7-5a2ea9c6223e req-d48fe762-cb36-4f8d-81d0-a8768ada0733 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085193 Oct 26 05:25:06.938244 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2734/5499] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:07.035439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:07.053937 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f67a7452-9833-491f-bc32-53664e83d775 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1261 microversion: 2.1 time: 0.186952 Oct 26 05:25:07.054406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2766/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:06 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:07.688422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:07.691959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:07.709724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:07.710605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:07.711216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:07.712123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:07.712800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:07.713430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:07.855466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:07.857766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:07.868479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:07.869545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:07.871860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:07.872856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:07.875224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:07.877780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:08.055436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:08.070613 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cea8f215-7baa-4adb-bef2-46ed8ce4ab42 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.387360 Oct 26 05:25:08.085739 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2735/5501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:07 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:08.097160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:08.098231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:08.105962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:08.106600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:08.108931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:08.109989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:08.110742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:08.111403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:08.311140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:08.326714 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b8d65fce-77ae-45d1-9951-6f8646054f15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1267 microversion: 2.1 time: 0.234977 Oct 26 05:25:08.327522 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2736/5502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:08 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:08.392798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:08.421702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:08.428570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:08.430370 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34304905-e581-445c-832d-1da933ee24d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 2390 microversion: 2.42 time: 0.585619 Oct 26 05:25:08.431157 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2767/5503] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:07 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 2390 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:25:08.958609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-73baf90a-df9d-48af-b719-3a64b09e3d54 req-1a7b0604-c993-40ee-b2b9-ac809885e478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-deleted", "tag": "a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:08.979262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-73baf90a-df9d-48af-b719-3a64b09e3d54 req-1a7b0604-c993-40ee-b2b9-ac809885e478 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:08.980015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-73baf90a-df9d-48af-b719-3a64b09e3d54 req-1a7b0604-c993-40ee-b2b9-ac809885e478 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:08.980650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-73baf90a-df9d-48af-b719-3a64b09e3d54 req-1a7b0604-c993-40ee-b2b9-ac809885e478 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:08.996546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-73baf90a-df9d-48af-b719-3a64b09e3d54 req-1a7b0604-c993-40ee-b2b9-ac809885e478 service nova] Creating event network-vif-deleted:a86303c0-f1bc-4c80-a8d0-c5cce5d9bb04 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:09.004725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-73baf90a-df9d-48af-b719-3a64b09e3d54 req-1a7b0604-c993-40ee-b2b9-ac809885e478 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050001 Oct 26 05:25:09.007172 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2737/5504] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:09.102901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:09.105401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:09.123498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:09.124323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:09.125134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:09.126248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:09.127509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:09.128187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:09.357597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:09.359325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:09.368272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:09.368926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:09.370085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:09.381361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:09.381876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:09.382329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:09.990031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:10.020088 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3e11e68-0b87-4a30-937e-781b39f15504 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1309 microversion: 2.1 time: 0.666682 Oct 26 05:25:10.021583 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2738/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:09 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1309 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:10.025947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:10.042702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:10.043642 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b7e4144-b616-4934-acf1-1f3b2522fdc1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.944966 Oct 26 05:25:10.044625 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2768/5506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:09 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:10.057525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:10.083360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:10.083917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:10.085487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:10.086894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:10.089001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:10.089328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:10.427851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:10.448512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:10.450727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:10.451999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10dbb0ec-87fd-417c-a833-e00d19e6fdbd tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.428030 Oct 26 05:25:10.452570 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2739/5507] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:10 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:11.070717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:11.072060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:11.076177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b63a3042-c849-42ad-83ed-ebcdbcb17792 req-7bfe23ce-ff5d-4edb-9be3-a25487500652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197cf9a5-6df3-4044-a397-36baf97da892", "name": "network-vif-deleted", "tag": "0b48ce7f-88c2-4c95-a5bf-164fed997c95"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:11.088983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:11.092934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:11.095670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:11.097213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b63a3042-c849-42ad-83ed-ebcdbcb17792 req-7bfe23ce-ff5d-4edb-9be3-a25487500652 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:11.100377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:11.101032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b63a3042-c849-42ad-83ed-ebcdbcb17792 req-7bfe23ce-ff5d-4edb-9be3-a25487500652 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:11.101581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b63a3042-c849-42ad-83ed-ebcdbcb17792 req-7bfe23ce-ff5d-4edb-9be3-a25487500652 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:11.102653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:11.103357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:11.135605 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b63a3042-c849-42ad-83ed-ebcdbcb17792 req-7bfe23ce-ff5d-4edb-9be3-a25487500652 service nova] Creating event network-vif-deleted:0b48ce7f-88c2-4c95-a5bf-164fed997c95 for instance 197cf9a5-6df3-4044-a397-36baf97da892 on n-h1-862416-4 Oct 26 05:25:11.149839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b63a3042-c849-42ad-83ed-ebcdbcb17792 req-7bfe23ce-ff5d-4edb-9be3-a25487500652 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077757 Oct 26 05:25:11.164239 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2740/5508] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:11.179414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:11.180160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:11.204813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:11.205559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:11.206019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:11.206770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:11.207241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:11.207675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:11.216539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:12.416170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:12.425679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:12.427268 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-09967b9c-d8a7-482f-9167-bad3de34d567 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 1.261473 Oct 26 05:25:12.427870 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2741/5509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:11 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:12.441644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:12.443831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:12.452401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9135553-279e-4deb-9492-bd0b52b78b15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1309 microversion: 2.1 time: 1.390700 Oct 26 05:25:12.456666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2769/5510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:11 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1309 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:12.457693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:12.458186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:12.464068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:12.465016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:12.465692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:12.466294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:12.468846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:12.474694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:12.483628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:12.484462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:12.485167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:12.486702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:12.487345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:12.488304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:12.559188 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-572bcfdd-3d01-4341-ae83-4d85395c6cc8 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6/action" status: 200 len: 24547 microversion: 2.1 time: 0.100933 Oct 26 05:25:12.567395 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2770/5511] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:12 2022] POST /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6/action => generated 24547 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:25:12.639031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:12.657630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:12.659136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:12.660345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-75a88367-086e-441b-b86a-7987de15f66a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.231551 Oct 26 05:25:12.660915 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2742/5512] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:12 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:13.235430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d8e00713-d6b5-4b75-82a0-7665ecfc6af9 req-5bda2a09-61d4-4432-a8af-2b637b6c438d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88a7c78-e082-4ba2-95c7-e942ca4974a0", "tag": "41e1ea11-97ec-43e5-a281-ae97a5603b2e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:13.248581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d8e00713-d6b5-4b75-82a0-7665ecfc6af9 req-5bda2a09-61d4-4432-a8af-2b637b6c438d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.249343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d8e00713-d6b5-4b75-82a0-7665ecfc6af9 req-5bda2a09-61d4-4432-a8af-2b637b6c438d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.250013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d8e00713-d6b5-4b75-82a0-7665ecfc6af9 req-5bda2a09-61d4-4432-a8af-2b637b6c438d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:13.270015 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d8e00713-d6b5-4b75-82a0-7665ecfc6af9 req-5bda2a09-61d4-4432-a8af-2b637b6c438d service nova] Creating event network-changed:41e1ea11-97ec-43e5-a281-ae97a5603b2e for instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 on n-h1-862416-4 Oct 26 05:25:13.277051 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d8e00713-d6b5-4b75-82a0-7665ecfc6af9 req-5bda2a09-61d4-4432-a8af-2b637b6c438d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045992 Oct 26 05:25:13.278011 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2771/5513] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:25:13.451786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:13.452747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:13.462190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.463892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.464521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:13.469666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.470516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.471163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:13.484883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:13.486538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:13.503160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.503962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.504658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:13.505991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.506900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.508329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:13.829231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:13.829804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:13.843529 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0dbcd31f-d3aa-46b3-9c5c-4993a6e55c6b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1309 microversion: 2.1 time: 0.365581 Oct 26 05:25:13.844755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2772/5514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:13 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:13.852889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:13.855135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:13.873996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.876094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.877167 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02fe81b9-71cb-40cd-8f7a-d1479d52d47e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.430097 Oct 26 05:25:13.877581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:13.879356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:13.880010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2743/5515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:13 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:13.880816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:13.882492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:14.055441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:14.078688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:14.080444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:14.081830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad941763-ca70-4639-b313-4bf43731d1c3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.235955 Oct 26 05:25:14.082405 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2773/5516] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:13 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:14.262247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:14.263256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:14.276483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:14.277240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:14.277871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:14.279205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:14.282998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:14.283771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:14.476781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lazy-loading 'services' on Instance uuid b2215f5a-5cbe-477f-b610-9a71bb40c5e7 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:25:14.629989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed81296a-eee4-4faa-bbf8-f736e8e884aa tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-volume_attachments/9ab22955-597b-4744-b105-1884f18361ec" status: 202 len: 0 microversion: 2.1 time: 0.371988 Oct 26 05:25:14.630606 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2744/5517] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:25:14 2022] DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-volume_attachments/9ab22955-597b-4744-b105-1884f18361ec => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:25:14.875099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:14.875820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:14.891541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:14.893719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:14.898631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:14.899476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:14.900649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:14.901192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:14.908170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:14.908879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:14.925100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:14.925919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:14.926948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:14.927968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:14.928604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:14.929196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:15.125720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:15.632536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:15.642914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4ef1a5c1-78d9-4612-aba9-e485192fcfd1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1309 microversion: 2.1 time: 0.775385 Oct 26 05:25:15.646208 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2774/5518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:14 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1309 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:15.660157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:15.660973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:15.678325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:15.682677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:15.683464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:15.692934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:15.692934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:15.692934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:15.692934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:15.696352 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1e5c3a4-3c80-482b-ae3a-253af219057a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.789932 Oct 26 05:25:15.697473 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2745/5519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:14 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:15.829265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:15.831531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:15.843145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:15.846054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:15.847292 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c229ef1c-a9cf-43ce-b104-56aff197d5d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.198094 Oct 26 05:25:15.875046 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2775/5520] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:15 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:16.673636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:16.674385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:16.686162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:16.687459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:16.688753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:16.691281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:16.692000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:16.693698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:16.729628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:16.731795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:16.747047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:16.748330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:16.749396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:16.751411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:16.752126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:16.754577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:17.090064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:17.105176 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48307ad8-1031-4452-89ce-d14cae898894 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1309 microversion: 2.1 time: 0.433613 Oct 26 05:25:17.106725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2746/5521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:16 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:17.112079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:17.112891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:17.126229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:17.126733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:17.127173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:17.128081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:17.128710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:17.129144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:17.169212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:17.185607 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-046bca73-c080-40eb-a0cc-feefa0c55bd3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.461000 Oct 26 05:25:17.186160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2776/5522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:16 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:17.366475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:17.381942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:17.383567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:17.386192 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44fae1c8-b386-4210-b866-6599d4c327f2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.278058 Oct 26 05:25:17.401992 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2747/5523] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:17 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:17.542614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-879b96f0-c36b-419e-839a-15b1fb304c86 req-ad82d98c-07e5-4367-8a9a-86be087e0c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88a7c78-e082-4ba2-95c7-e942ca4974a0", "name": "network-vif-plugged", "status": "completed", "tag": "41e1ea11-97ec-43e5-a281-ae97a5603b2e"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:17.562780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-879b96f0-c36b-419e-839a-15b1fb304c86 req-ad82d98c-07e5-4367-8a9a-86be087e0c57 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:17.565704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-879b96f0-c36b-419e-839a-15b1fb304c86 req-ad82d98c-07e5-4367-8a9a-86be087e0c57 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:17.566028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-879b96f0-c36b-419e-839a-15b1fb304c86 req-ad82d98c-07e5-4367-8a9a-86be087e0c57 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:17.602253 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-879b96f0-c36b-419e-839a-15b1fb304c86 req-ad82d98c-07e5-4367-8a9a-86be087e0c57 service nova] Creating event network-vif-plugged:41e1ea11-97ec-43e5-a281-ae97a5603b2e for instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 on n-h1-862416-4 Oct 26 05:25:17.612042 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-879b96f0-c36b-419e-839a-15b1fb304c86 req-ad82d98c-07e5-4367-8a9a-86be087e0c57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075220 Oct 26 05:25:17.615205 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2777/5524] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:18.130959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:18.133441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:18.148027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:18.151357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:18.152030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:18.156592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:18.157267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:18.157918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:18.219741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:18.221071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:18.231881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:18.232649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:18.234617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:18.237279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:18.238012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:18.239706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:18.718619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:18.731099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb7270e6-fd0c-4f9f-8d16-e040f3f905b8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1309 microversion: 2.1 time: 0.603988 Oct 26 05:25:18.731696 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2748/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:18 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1309 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:18.746494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:18.747610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:18.759652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:18.761926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:18.762388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:18.765907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:18.766390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:18.766836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:18.819296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:18.834426 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0921b0b9-24a0-4d1c-b3ed-6b26d59650f2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.625603 Oct 26 05:25:18.837765 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2778/5526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:18 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:19.037605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:19.053297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:19.060973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:19.062510 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d56eb31d-78ed-4685-a7f5-f4215ef3d50a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.324662 Oct 26 05:25:19.064621 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2749/5527] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:18 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:19.758831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:19.761104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:19.772267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:19.776003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:19.776904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:19.778082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:19.778943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:19.779609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:19.861445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:19.862234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:19.873585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:19.878589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:19.879529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:19.881672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:19.888586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:19.891067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:20.483995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:20.504555 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-53db8c15-7cc9-4f82-841d-398b52abfdcf tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1490 microversion: 2.1 time: 0.750293 Oct 26 05:25:20.505514 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2779/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:19 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1490 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:20.512509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:20.513131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:20.531587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:20.532292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:20.532924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:20.534667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:20.535446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:20.536043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:20.573750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:20.693028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:20.699660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:20.710834 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17138ce7-a5ad-4f63-8ea8-dc171a4eef3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.853404 Oct 26 05:25:20.717035 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2750/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:19 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:20.719546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:20.722670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:20.726006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1808739866", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:20.727457 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e503c62c-c733-4088-be7a-47030b66e7d0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.219645 Oct 26 05:25:20.729933 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2780/5530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:20 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:20.827475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:25:21.756952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:21.758415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:21.788054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:21.790086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:21.793910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:21.797936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:21.810094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:21.810652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:21.986687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:22.004711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:22.006197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:22.007437 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd76d4d1-2589-4ae6-84c7-f3d0605fc0e7 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.255250 Oct 26 05:25:22.017505 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2781/5531] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:21 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:25:22.030489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:22.032486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:22.049351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:22.050352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:22.051210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:22.054502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:22.056648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:22.058719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:22.263948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:25:22.265204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:25:22.265913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:25:22.266675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:25:22.269752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:25:22.296590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:22.297281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:22.299396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:22.301076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:22.301684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:22.302635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:22.363735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:25:22.382308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:25:22.427407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:25:22.429973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:25:22.492835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:22.506201 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-edf42062-f674-4d62-8049-b03a45171287 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 0.489964 Oct 26 05:25:22.506799 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2782/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:22 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:22.598453 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-75719def-c428-469a-870c-0ff65747070f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877856 Oct 26 05:25:22.599614 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2751/5533] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:25:22.610708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eacd9f13-a37a-4bd1-8d1d-4a7e920e6caa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:22.611361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eacd9f13-a37a-4bd1-8d1d-4a7e920e6caa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:22.704719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eacd9f13-a37a-4bd1-8d1d-4a7e920e6caa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:22.718417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eacd9f13-a37a-4bd1-8d1d-4a7e920e6caa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1209 microversion: 2.1 time: 0.111495 Oct 26 05:25:22.719019 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2783/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:22 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:23.045903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:23.046976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:23.082413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.082870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.087041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:23.088534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.090155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.091796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:23.246037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:23.271500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:23.287386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:23.288761 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-159eed79-0652-43b9-9983-51a0a2cdc069 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.249232 Oct 26 05:25:23.297987 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2752/5535] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:23 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:23.528154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a59c6cb-90be-429b-9a3a-e9bc01e7de1a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:23.534524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:23.535273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:23.557965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.558463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.559001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a59c6cb-90be-429b-9a3a-e9bc01e7de1a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.560898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:23.561911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a59c6cb-90be-429b-9a3a-e9bc01e7de1a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.562717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a59c6cb-90be-429b-9a3a-e9bc01e7de1a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:23.567651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.568768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.573716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:23.652062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a59c6cb-90be-429b-9a3a-e9bc01e7de1a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Going to try to stop instance {{(pid=120586) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:25:23.789389 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a59c6cb-90be-429b-9a3a-e9bc01e7de1a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.265984 Oct 26 05:25:23.798152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2784/5536] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:23 2022] POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:25:23.816085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:23.819167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:23.840333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.841936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.842856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:23.844970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:23.845705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:23.846340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.122912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:24.141020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1be41716-fc94-45a7-871c-683658092a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1213 microversion: 2.1 time: 0.340039 Oct 26 05:25:24.142675 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2785/5537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:23 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1213 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:24.154700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:24.156589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:24.180044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:24.180473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:24.181514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.189461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:24.190366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:24.190986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.567845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:24.579928 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-953771b8-eee6-43da-85b3-0f7ad2fbdf7c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1521 microversion: 2.1 time: 1.049573 Oct 26 05:25:24.593751 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2753/5538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:23 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1521 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:24.599061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:24.604075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:24.616491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:24.617287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:24.617967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.619574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:24.620772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:24.621426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.687513 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d00f385-948c-4d87-a5ec-1efcd484cf62 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "POST /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6/action" status: 200 len: 32618 microversion: 2.1 time: 0.091769 Oct 26 05:25:24.689537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2754/5539] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:24 2022] POST /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6/action => generated 32618 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:25:24.695954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:24.698516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:24.715676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:24.716484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:24.717241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.718434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:24.719125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:24.720169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:24.981900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:24.991853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d4102978-dc96-40b9-bce3-a6be576d321c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1677 microversion: 2.1 time: 0.846796 Oct 26 05:25:24.992756 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2786/5540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:24 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1677 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:25.136430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:25.154413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:25.159251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:25.164193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8690f2c-ed0f-4d2e-a364-26e6a841f964 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.473147 Oct 26 05:25:25.171216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:25.172131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:25.177624 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2755/5541] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:24 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:25.191601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:25.194085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:25.194874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:25.198917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:25.199665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:25.200334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:25.468986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:25.478329 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-197594f3-9d34-4122-8ae2-d5b33290468f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1267 microversion: 2.1 time: 0.313372 Oct 26 05:25:25.499587 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2787/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:25 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:25.611835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:25.613119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:25.629046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:25.631595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:25.632327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:25.635440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:25.637794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:25.639336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.016539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:26.017166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:26.034764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.038103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.038611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.039381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.044241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.044714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.112198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:26.122628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6481c9d5-d23a-47f6-a96e-539850ffe592 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1501 microversion: 2.1 time: 0.516639 Oct 26 05:25:26.128770 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2756/5543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:25 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1501 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:26.153347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:26.154672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:26.170515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.171303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.171977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.173522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.179521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.180443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.705644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:26.722806 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-21793250-9540-49bf-a721-afb7a3fd7703 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1677 microversion: 2.1 time: 0.708414 Oct 26 05:25:26.723800 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2788/5544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:26 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1677 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:26.735002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:26.737023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:26.754655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.759395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.760981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.762501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.779293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.780055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.783871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:26.793467 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8f685512-a006-4be1-9234-931a8e3dfd7e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1515 microversion: 2.1 time: 0.644748 Oct 26 05:25:26.798026 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2757/5545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:26 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1515 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:26.811513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:26.813939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:26.833706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:26.841862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.843942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.845920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.848570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:26.849365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:26.852119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:26.877672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:27.081533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:27.117407 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a3c72753-bc49-4385-9c73-44b89459cf15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1267 microversion: 2.1 time: 0.315787 Oct 26 05:25:27.129472 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2758/5546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:26 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:27.130935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:27.139719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-940b8fb7-3544-4364-82a1-239f501c766f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:27.142623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-940b8fb7-3544-4364-82a1-239f501c766f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 0d217945-9e28-400d-9c9d-f483f9170426] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:27.155385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:27.157179 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-940b8fb7-3544-4364-82a1-239f501c766f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Instance 0d217945-9e28-400d-9c9d-f483f9170426 could not be found. Oct 26 05:25:27.158696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:27.164417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-646e01d7-5d9c-4d16-844b-02faec6de5f6 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.438329 Oct 26 05:25:27.168410 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2789/5547] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:26 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-940b8fb7-3544-4364-82a1-239f501c766f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/0d217945-9e28-400d-9c9d-f483f9170426/action HTTP/1.1 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 14 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: {"rescue": {}} Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0d217945-9e28-400d-9c9d-f483f9170426 could not be found. Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0d217945-9e28-400d-9c9d-f483f9170426', 'body': {'rescue': {}}} Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d217945-9e28-400d-9c9d-f483f9170426 could not be found. Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d217945-9e28-400d-9c9d-f483f9170426 could not be found. Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:27.187075 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d217945-9e28-400d-9c9d-f483f9170426 could not be found. Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-940b8fb7-3544-4364-82a1-239f501c766f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 404 to user: Instance 0d217945-9e28-400d-9c9d-f483f9170426 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-940b8fb7-3544-4364-82a1-239f501c766f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/0d217945-9e28-400d-9c9d-f483f9170426/action" status: 404 len: 111 microversion: 2.1 time: 0.066454 Oct 26 05:25:27.192286 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2759/5548] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:27 2022] POST /compute/v2.1/servers/0d217945-9e28-400d-9c9d-f483f9170426/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:25:27.200414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:27.201290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:27.210638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:27.212360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:27.213034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:27.215114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:27.217853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:27.218553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:27.319088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b45dd3e3-de7f-4205-8197-93c895840b06 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action" status: 202 len: 0 microversion: 2.1 time: 0.123771 Oct 26 05:25:27.323444 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2790/5549] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:27 2022] POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:25:27.331637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:27.332261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:27.347281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:27.350128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:27.353780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:27.354517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:27.355013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:27.358449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:27.749336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:27.750344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:27.782913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:27.783449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:27.783926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:27.784670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:27.785348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:27.787884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:29.030433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:29.056840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fa1b84c-1b1c-4ee8-a3e1-2e6280475777 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1520 microversion: 2.1 time: 1.725832 Oct 26 05:25:29.065212 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2760/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:27 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1520 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:29.079164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:29.081611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:29.112973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:29.113489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:29.117039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:29.117039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:29.117039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:29.117039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:29.623188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:29.633734 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb9fbb27-3775-4f19-938f-670880d51830 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1677 microversion: 2.1 time: 1.888524 Oct 26 05:25:29.651769 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2791/5551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:27 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1677 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:29.669745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:29.671930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:29.686895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:29.687600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:29.688233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:29.689145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:29.690309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:29.691012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:29.957472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:29.984943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:29.986589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:29.990371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c6c77466-4f15-4537-b721-bd837b9ded7d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.329265 Oct 26 05:25:29.991650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2792/5552] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:29 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:30.092132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:30.093057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:30.117257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.123040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.123696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.124635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.125530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.129380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.135022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:30.149707 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-25dc7326-1da7-44e5-8743-213a8af8145d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 1.082574 Oct 26 05:25:30.151541 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2761/5553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:29 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:30.421093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:30.422507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:30.441773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.445245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.448193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.452929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.453639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.455305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.533574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:25:30.695055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:30.710886 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d145a345-58d8-4a9e-8475-aac6195a396d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1500 microversion: 2.1 time: 0.623727 Oct 26 05:25:30.737960 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2793/5554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:30 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1500 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:30.744259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6cf157f2-8360-4aaa-9ce3-c4d210635e87 req-03d9d530-ba36-4c78-9ed2-d24612a5d824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6", "tag": "9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:30.764862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bccca857-bfc7-4716-b65a-1bd3a1211d52 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 204 len: 0 microversion: 2.1 time: 0.347811 Oct 26 05:25:30.769025 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2762/5555] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:25:30 2022] DELETE /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:25:30.788774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:30.790962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:30.795699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6cf157f2-8360-4aaa-9ce3-c4d210635e87 req-03d9d530-ba36-4c78-9ed2-d24612a5d824 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.796979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:30.803240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6cf157f2-8360-4aaa-9ce3-c4d210635e87 req-03d9d530-ba36-4c78-9ed2-d24612a5d824 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.806873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6cf157f2-8360-4aaa-9ce3-c4d210635e87 req-03d9d530-ba36-4c78-9ed2-d24612a5d824 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.813587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.823481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.826396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.827290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.829565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.830297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.857916 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6cf157f2-8360-4aaa-9ce3-c4d210635e87 req-03d9d530-ba36-4c78-9ed2-d24612a5d824 service nova] Creating event network-changed:9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a for instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 on n-h1-862416-4 Oct 26 05:25:30.872810 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6cf157f2-8360-4aaa-9ce3-c4d210635e87 req-03d9d530-ba36-4c78-9ed2-d24612a5d824 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132693 Oct 26 05:25:30.875657 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2794/5556] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:30.891599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:30.902898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:30.934129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.934911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.936564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:30.942207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:30.943141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:30.943697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.022977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'flavor' on Instance uuid c237b10e-845b-472d-a639-66f8f2db0482 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:25:31.066545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Cannot 'rescue' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state paused Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action HTTP/1.1 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 14 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: {"rescue": {}} Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'rescue' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state paused Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'c237b10e-845b-472d-a639-66f8f2db0482', 'body': {'rescue': {}}} Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c237b10e-845b-472d-a639-66f8f2db0482 in vm_state paused. Cannot rescue while the instance is in this state. Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state paused Oct 26 05:25:31.070225 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state paused Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:25:31.076385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 409 to user: Cannot 'rescue' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state paused {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:31.085123 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f84c831-2f21-46a9-b693-61c222d084db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action" status: 409 len: 144 microversion: 2.1 time: 0.205280 Oct 26 05:25:31.086571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2795/5557] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:30 2022] POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action => generated 144 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:25:31.096017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:31.096877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:31.106139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.107404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.108913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.111078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.111698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.112138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.528250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:31.542205 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4130576-aee1-4f50-be23-c789217e10f8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1677 microversion: 2.1 time: 0.767520 Oct 26 05:25:31.542819 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2763/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:30 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1677 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:31.561006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:31.561659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:31.590561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.591072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.591521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.592246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.592713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.593136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.811329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:31.816681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:31.840648 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86142e33-8dac-41eb-bf92-fcc45769e00f tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1672 microversion: 2.1 time: 0.747118 Oct 26 05:25:31.841618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2796/5559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:31 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1672 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:31.865995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:31.867752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:31.875000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:31.888740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.891547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.892424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:31.893245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.896103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:31.898541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.899352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.900365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.900740 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-624e1498-bff6-4b5b-99af-2d77137348d2 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.349104 Oct 26 05:25:31.901609 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2764/5560] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:31 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:31.912770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:31.916351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:31.933405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.936098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.937732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:31.939390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:31.939877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:31.940326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:32.138396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84b0fcc0-ccd3-4843-aff1-01bb15efb94d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action" status: 202 len: 0 microversion: 2.1 time: 0.294756 Oct 26 05:25:32.143773 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2797/5561] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:31 2022] POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:25:32.166755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:32.182284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:32.191899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:32.192586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:32.193198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:32.194744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:32.195756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:32.197446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:32.332626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:32.409886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:32.622016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:32.633400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9462aed0-af15-425c-81b9-3ecbcb4ec2e6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1507 microversion: 2.1 time: 0.488068 Oct 26 05:25:32.635609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2798/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:32 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:32.659591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:32.660644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:32.681943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:32.684162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:32.685628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:32.686947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:32.687539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:32.687852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:32.745645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:32.872806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:32.886943 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d88a5aa0-7fb5-4ff4-9b0a-b282dd8c268c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.980991 Oct 26 05:25:32.892005 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2765/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:31 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:32.912347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:32.913589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:32.937784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:32.938068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:32.938529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:32.939267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:32.939756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:32.940197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:33.413117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:33.444157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-614edbd5-3cd9-45e0-a33b-60981dd6d42f tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1677 microversion: 2.1 time: 0.807235 Oct 26 05:25:33.457346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2799/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:32 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1677 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:33.457346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:33.457346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:33.482651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:33.485251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:33.486211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:33.492798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:33.494199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:33.494856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:33.696757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:33.718295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:33.718582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:33.724771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:33.728297 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a963bdf2-db5c-4297-be47-3cbd31e2d54c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.281361 Oct 26 05:25:33.743019 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69f523a0-163f-4600-b37a-64bacd7b687c tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1672 microversion: 2.1 time: 0.842992 Oct 26 05:25:33.743019 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2766/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:32 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1672 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:33.744577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2800/5566] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:33 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:33.762560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:33.772830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:33.800401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:33.802156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:33.811873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:33.814665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:33.815335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:33.817601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:33.919376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:33.922312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:33.930878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:33.939991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:33.940772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:33.945461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:33.945882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:33.950488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:34.551620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:34.568961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b59b8d88-fd9e-4fb3-a5b1-51df8f679720 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1507 microversion: 2.1 time: 0.828474 Oct 26 05:25:34.570597 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2767/5567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:33 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:34.576083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:34.588367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:34.590484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:34.602404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:34.603581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:34.604039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:34.604775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:34.605242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:34.605769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:34.606719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb923913-b66a-4915-ae9c-5c1629c353f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.692270 Oct 26 05:25:34.608776 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2801/5568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:33 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:34.718208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c5311c26-13a9-4553-9964-b756542d9464 req-5008ec7c-3319-4eff-b656-5c7b7c218db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80119bd-8693-48e0-8f56-f43dbcd012ca", "tag": "7b793102-baa7-4ea3-9dc5-761aeaedfb70"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:34.733726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c5311c26-13a9-4553-9964-b756542d9464 req-5008ec7c-3319-4eff-b656-5c7b7c218db8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:34.734332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c5311c26-13a9-4553-9964-b756542d9464 req-5008ec7c-3319-4eff-b656-5c7b7c218db8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:34.736948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c5311c26-13a9-4553-9964-b756542d9464 req-5008ec7c-3319-4eff-b656-5c7b7c218db8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:34.768930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c5311c26-13a9-4553-9964-b756542d9464 req-5008ec7c-3319-4eff-b656-5c7b7c218db8 service nova] Creating event network-changed:7b793102-baa7-4ea3-9dc5-761aeaedfb70 for instance a80119bd-8693-48e0-8f56-f43dbcd012ca on n-h2-862416-4 Oct 26 05:25:34.788666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c5311c26-13a9-4553-9964-b756542d9464 req-5008ec7c-3319-4eff-b656-5c7b7c218db8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074027 Oct 26 05:25:34.789702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2802/5569] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:34.795962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:34.796749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:34.808606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:34.816153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:34.816861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:34.817846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:34.818475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:34.819088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:34.959657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:34.972365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:34.982182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:34.983454 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c0a943ee-dcd2-41f5-8412-9bb8275c6b4d tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.191893 Oct 26 05:25:34.984122 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2803/5570] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:34 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:34.988712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:34.989346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:35.007841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.008347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.008960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:35.010105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.010792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.011231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:35.242975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:35.257848 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e399f03-f1d5-4f94-8a43-672db4852a7a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1654 microversion: 2.1 time: 0.685366 Oct 26 05:25:35.273370 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2768/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:34 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1654 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:35.281094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-933243d3-937d-4905-94b8-e8c6a5e6fd2d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:35.288912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-933243d3-937d-4905-94b8-e8c6a5e6fd2d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.289656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-933243d3-937d-4905-94b8-e8c6a5e6fd2d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.298012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-933243d3-937d-4905-94b8-e8c6a5e6fd2d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:35.347187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-933243d3-937d-4905-94b8-e8c6a5e6fd2d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Going to try to start instance {{(pid=120585) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 05:25:35.441232 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-933243d3-937d-4905-94b8-e8c6a5e6fd2d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.161945 Oct 26 05:25:35.444375 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2769/5572] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:35 2022] POST /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:25:35.460344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:35.461544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:35.482602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.483532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.484151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:35.486048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91321abeaa5248beaadc6edf76c96886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227e01c08a304cb1b59273127d4ad575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:35.486436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.487257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.487874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:35.518802 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-58b57adf-3948-4d52-b25f-b730cb8075a4 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 200 len: 1672 microversion: 2.1 time: 0.520531 Oct 26 05:25:35.534273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2804/5573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:34 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 1672 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:35.596517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:35.598046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:35.606172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.607214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.607924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:35.609024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:35.609779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:35.610449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:36.378435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:36.392105 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-decc91d2-2f96-4d4f-b7e2-b478086caf67 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1507 microversion: 2.1 time: 0.799751 Oct 26 05:25:36.392721 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2805/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:35 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1507 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:36.424998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:36.426670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:36.444624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:36.447314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:36.448154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:36.449820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:36.452192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:36.452759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:36.469196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:36.492025 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9f330e7-eb78-4f1f-9d83-eeb4ea17f7b8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1663 microversion: 2.1 time: 1.042804 Oct 26 05:25:36.492652 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2770/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:35 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1663 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:36.510541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:36.513642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:36.538664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:36.541747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:36.545642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:36.547587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:36.549879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:36.550340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:36.940771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:36.951779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:36.953259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:36.954509 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a4e37772-241f-475e-b44f-211f2c0900f0 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.455972 Oct 26 05:25:36.976476 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2771/5576] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:36 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:36.992317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:36.993664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] [instance: 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:37.006982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.007776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.009931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:37.011915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.013490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.015361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:37.041231 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] HTTP exception thrown: Instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 could not be found. Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Request method failure captured: Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 HTTP/1.1 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMPFU2h-VGZk3WRsPv1BCOiOS_yKXCoX1_lfk4vlkw40qalVO1t5L7duAW2-whMMjIIJLhwPlhG1Gfhe-OJkQOD9dgeeMLNok3nR-8zfwPf-jMjx4sVAhn8c-EdZyyHe4mX7vDR4DNMwscoDNs_qrggZAHx5bKv0eeibpFdAjMbjOpI Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 227e01c08a304cb1b59273127d4ad575 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_227e01c08a304cb1b59273127d4ad575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/227e01c08a304cb1b59273127d4ad575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 227e01c08a304cb1b59273127d4ad575 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkBasicOps-1735840462 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkBasicOps-1735840462-project Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 91321abeaa5248beaadc6edf76c96886 Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkBasicOps-1735840462-project Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 could not be found. Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6'} Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 could not be found. Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 could not be found. Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:37.043392 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 could not be found. Oct 26 05:25:37.049056 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:37.051019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Returning 404 to user: Instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:37.053266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7c508ade-4af6-4001-9432-5761e63cd2b7 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6" status: 404 len: 111 microversion: 2.1 time: 0.074140 Oct 26 05:25:37.054478 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2772/5577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:36 2022] GET /compute/v2.1/servers/5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:25:37.070612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1a271f69-7c3c-43af-96d8-8678e0fba87f req-8440caf9-1c04-45c5-a35e-dd42cd8ad92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6", "name": "network-vif-deleted", "tag": "9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:37.104262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1a271f69-7c3c-43af-96d8-8678e0fba87f req-8440caf9-1c04-45c5-a35e-dd42cd8ad92f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.105402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1a271f69-7c3c-43af-96d8-8678e0fba87f req-8440caf9-1c04-45c5-a35e-dd42cd8ad92f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.106012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1a271f69-7c3c-43af-96d8-8678e0fba87f req-8440caf9-1c04-45c5-a35e-dd42cd8ad92f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:37.149808 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1a271f69-7c3c-43af-96d8-8678e0fba87f req-8440caf9-1c04-45c5-a35e-dd42cd8ad92f service nova] Creating event network-vif-deleted:9a78e9b4-caf0-4ca3-a86a-c342bd1c0b1a for instance 5d6fa8e6-04a7-4f55-8164-36ec8dc84fd6 on n-h1-862416-4 Oct 26 05:25:37.157519 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1a271f69-7c3c-43af-96d8-8678e0fba87f req-8440caf9-1c04-45c5-a35e-dd42cd8ad92f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100845 Oct 26 05:25:37.159058 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2773/5578] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:37.266148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:37.293294 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a90f4adf-e696-45ef-aab9-a17dba336962 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.883272 Oct 26 05:25:37.309882 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2806/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:36 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:37.419366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:37.422543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:37.430110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.431767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.432465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:37.433781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.437202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.438137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:37.487095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:37.520855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:37.521794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:37.531920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.536341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.537094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:37.538168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:37.538985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:37.539681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:38.095155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:38.114898 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-983409b6-2a0d-40e2-8b36-31c98e82c74c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1507 microversion: 2.1 time: 0.699244 Oct 26 05:25:38.116580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2774/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:37 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1507 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:38.123576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:38.125025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:38.132067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:38.132987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:38.135507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:38.137851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:38.140216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:38.140874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:38.156623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:38.168857 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f9d57e9-43bb-411f-995c-a6bd6e8c33af tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1663 microversion: 2.1 time: 0.651786 Oct 26 05:25:38.169529 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2807/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:37 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1663 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:38.316523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:38.318227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:38.337742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:38.338346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:38.338807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:38.339550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:38.342793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:38.343417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:38.432151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:38.454735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:38.461167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:38.463501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bef35394-7b80-49f1-8096-ae9f5cbc2e66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.345277 Oct 26 05:25:38.464668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2775/5582] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:38 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:38.965361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:38.977957 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e258346f-0c41-4928-b503-42b2aeaa4a89 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.662177 Oct 26 05:25:38.979873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2808/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:38 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:39.145586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:39.146241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:39.160585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:39.163751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:39.168814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:39.173204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:39.175113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:39.177054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:39.208378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:39.210753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:39.221860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:39.222736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:39.223475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:39.224739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:39.228466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:39.229158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:39.697273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:39.706310 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ecbbf52-929c-4f7b-89a8-f5328ffdcdde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1515 microversion: 2.1 time: 0.564866 Oct 26 05:25:39.706967 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2776/5584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:39 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1515 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:39.720006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:39.721795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:39.733996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:39.735478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:39.736369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:39.738385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:39.742084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:39.745126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:39.786517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:39.800551 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3b0a49c6-9ce3-4e87-b7a8-25544cfc84ef tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1663 microversion: 2.1 time: 0.606880 Oct 26 05:25:39.806342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2809/5585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:39 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1663 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:39.828794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90cab39c-afc7-4ea1-b668-9e1153890975 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] Calling method '.version_select at 0x7f470a0ab9d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:39.884662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90cab39c-afc7-4ea1-b668-9e1153890975 tempest-TestNetworkBasicOps-1735840462 tempest-TestNetworkBasicOps-1735840462-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2088139707" status: 202 len: 0 microversion: 2.1 time: 0.075420 Oct 26 05:25:39.891879 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2810/5586] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 05:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2088139707 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:25:40.008380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:40.010074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:40.034983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:40.036540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:40.041878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:40.045140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:40.045873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:40.046430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:40.167484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:40.208081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:40.211026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:40.214300 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0b5a8cb-8ab0-4430-b7a3-b266d908af66 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.504810 Oct 26 05:25:40.240066 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2777/5587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:39 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:40.829067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:40.832089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:40.842945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:40.847046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:40.847755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:40.850307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:40.855776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:40.857675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:41.247126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:41.274617 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a73a8103-ec46-41bd-9a77-f9f53c5dc287 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 1.270849 Oct 26 05:25:41.286572 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2811/5588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:40 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:41.314919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:41.315712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:41.354209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:41.354868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:41.355345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:41.356119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:41.356598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:41.357043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:41.786062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:41.798681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:41.812555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3b41dcc17d84bb3a8d03749c0e3ab7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc62f1394b0845ea895ba6bbd995d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:41.815798 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d97e5cdc-2aeb-4637-b3f1-ae31746ed76c tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 200 len: 1604 microversion: 2.42 time: 0.528085 Oct 26 05:25:41.822157 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2812/5589] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:41 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 1604 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:25:42.234540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:42.250458 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5bc753ef-9dc0-425b-b3f9-c796f009d814 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1667 microversion: 2.1 time: 1.424338 Oct 26 05:25:42.261211 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2778/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:40 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1667 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:42.298891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:42.300365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:42.316176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:42.317555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:42.318858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:42.322667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:42.323551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:42.324193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:42.846722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:42.854765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:42.881041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:42.882923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:42.885854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:42.886656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:42.890072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:42.890542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:42.995995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'flavor' on Instance uuid c237b10e-845b-472d-a639-66f8f2db0482 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:25:43.209260 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a8c8882b-7d93-48cf-bedb-89c2c32d2539 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action" status: 200 len: 32 microversion: 2.1 time: 0.366723 Oct 26 05:25:43.211651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2779/5591] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:25:42 2022] POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action => generated 32 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:25:43.228571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:43.230961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:43.242621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:43.245193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:43.246006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:43.246947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:43.247620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:43.249180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:43.287313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] HTTP exception thrown: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Request method failure captured: Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 HTTP/1.1 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMMmjjQrpikoTrBr00bDNp0UK4pysQPVKNbhhN8bD3Dt3bVa0aT5UNIC3MggMUxZU7BtjReD-yb1F0l8MqNw987vP2uV4oW7zQAoM6B4SP6_jHqlckC7FC2Pv9FRLE3lEIb0D9kGsKnlXxsrl3WDr4FCOovgbKjrrQ882DjFtve0LpM Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.42 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bc62f1394b0845ea895ba6bbd995d6b7 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bc62f1394b0845ea895ba6bbd995d6b7 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TaggedBootDevicesTest_v242-1460723428-project Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f3b41dcc17d84bb3a8d03749c0e3ab7a Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1460723428-project Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '197cf9a5-6df3-4044-a397-36baf97da892'} Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:43.290872 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:43.296617 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:43.302325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Returning 404 to user: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:43.303479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-00943729-ffba-497f-a7ad-1d31b3534b4a tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 404 len: 111 microversion: 2.42 time: 0.088318 Oct 26 05:25:43.304335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2780/5592] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:43 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:25:43.311048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:43.311848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:43.319059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:43.319800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:43.320675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:43.321999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:43.322678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:43.323271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:43.640205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:43.652197 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90a69a87-23ea-475e-836d-8f3d9b31ba10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 1.358294 Oct 26 05:25:43.653360 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2813/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:42 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:43.672429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de0a2fdd-d3d2-4a2a-808f-2f74681aadb3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '.version_select at 0x7f470a1c0af0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:43.722872 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de0a2fdd-d3d2-4a2a-808f-2f74681aadb3 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685005895" status: 204 len: 0 microversion: 2.42 time: 0.065556 Oct 26 05:25:43.729454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2814/5594] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 26 05:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685005895 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:25:43.842062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:43.854319 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1eb3d095-bbaa-40bb-8f93-6f78570c291f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.548697 Oct 26 05:25:43.861628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2781/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:43 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:44.681258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:44.681920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:44.698205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:44.698532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:44.707860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:44.708885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:44.709604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:44.714113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:44.771068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:44.886840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:44.887471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:44.913769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:44.914275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:44.924662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:44.927588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:44.932215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:44.932713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:45.169291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:45.183883 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b6a7ab3-6b8c-41cf-8575-0a6b0153cdc0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.506097 Oct 26 05:25:45.185620 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2815/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:44 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:45.480426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:45.503832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ee18798-2927-44e4-b0e8-253153a9ea4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.624968 Oct 26 05:25:45.509639 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2782/5597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:44 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:46.212654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:46.213511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:46.237259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:46.243887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:46.243887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:46.247764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:46.248589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:46.249268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:46.534802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:46.535665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:46.552833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:46.554945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:46.560299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:46.568447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:46.569274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:46.569765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:47.155100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:47.168741 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07db252b-c5c5-4e22-8445-64b6b1e7b453 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.960461 Oct 26 05:25:47.170494 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2816/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:46 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:47.193081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:47.203655 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df6ebe63-b15d-4203-9c0e-e1a52fda670a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.673990 Oct 26 05:25:47.207372 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2783/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:46 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:48.198950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:48.200213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:48.219367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:48.220083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:48.220708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:48.221706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:48.222494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:48.223105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:48.235643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:48.236811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:48.255675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:48.256066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:48.256522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:48.257637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:48.257770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:48.258151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:48.653792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:48.668456 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-285f0b75-4d24-4e72-a33d-8cf6bcbcf4ef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.437690 Oct 26 05:25:48.669152 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2784/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:48 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:48.696648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:48.704985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bef7b863-d2ec-4181-a7e2-3d322cb21074 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.510765 Oct 26 05:25:48.718357 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2817/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:48 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:49.692871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:49.693674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:49.722891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:49.725094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:49.731283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:49.731580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:49.732385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:49.737914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:49.741354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:49.741930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:49.747170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:49.747170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:49.749654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:49.750428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:49.756090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:49.756572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:50.925668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:50.935532 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3e04716-6aa5-4f8f-9079-8ec135ea0832 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 1.247270 Oct 26 05:25:50.936118 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2785/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:49 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:50.946509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-279f5181-8583-4719-84a9-92f9310b6af3 req-6e5d6c74-b5fe-4c72-8188-75c67232b5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80119bd-8693-48e0-8f56-f43dbcd012ca", "name": "network-vif-plugged", "status": "completed", "tag": "7b793102-baa7-4ea3-9dc5-761aeaedfb70"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:50.980739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-279f5181-8583-4719-84a9-92f9310b6af3 req-6e5d6c74-b5fe-4c72-8188-75c67232b5c6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:50.984270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-279f5181-8583-4719-84a9-92f9310b6af3 req-6e5d6c74-b5fe-4c72-8188-75c67232b5c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:50.984974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-279f5181-8583-4719-84a9-92f9310b6af3 req-6e5d6c74-b5fe-4c72-8188-75c67232b5c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:50.986488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:51.006196 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0c32ea96-dd93-4c6d-b54a-55467ab988f4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 1.278469 Oct 26 05:25:51.008102 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2818/5603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:49 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:51.052285 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-279f5181-8583-4719-84a9-92f9310b6af3 req-6e5d6c74-b5fe-4c72-8188-75c67232b5c6 service nova] Creating event network-vif-plugged:7b793102-baa7-4ea3-9dc5-761aeaedfb70 for instance a80119bd-8693-48e0-8f56-f43dbcd012ca on n-h2-862416-4 Oct 26 05:25:51.066661 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-279f5181-8583-4719-84a9-92f9310b6af3 req-6e5d6c74-b5fe-4c72-8188-75c67232b5c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121562 Oct 26 05:25:51.068342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2786/5604] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:51.962790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:51.964057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:51.984736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:51.985596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:51.988256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:51.991720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:51.995946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:51.997402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:52.031505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:52.032418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:52.051250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:52.052443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:52.053043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:52.054000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:52.054803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:52.055712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:52.531014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:52.540845 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99350f72-1fb7-4b15-89e9-f2997e7f548b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.584384 Oct 26 05:25:52.542302 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2819/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:51 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:52.651070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:52.662612 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6500b9b-eb6a-44a2-8ac4-8c5bcf3af30f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1309 microversion: 2.1 time: 0.636451 Oct 26 05:25:52.667015 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2787/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:52 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:53.567140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:53.568442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:53.595422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:53.595936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:53.601594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:53.605608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:53.607609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:53.611020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:53.691994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:53.692625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:53.712056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:53.714701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:53.718089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:53.719163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:53.722145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:53.723662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.010227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:54.020722 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-148cd173-fa15-4453-aa76-83d12f273b37 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1491 microversion: 2.1 time: 0.333979 Oct 26 05:25:54.026931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:54.039372 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2788/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:53 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1491 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:54.052711 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-072e4d3c-1976-4dfd-9070-f2bc9d1e97e4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.490358 Oct 26 05:25:54.073379 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2820/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:53 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:54.081222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:54.083426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:54.088831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:54.089508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:54.099541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.100612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.101062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.101795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.106514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.107038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.107357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.108065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.113690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.113812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.114297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.114772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.143725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] HTTP exception thrown: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Request method failure captured: Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 HTTP/1.1 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMMmjjQrpikoTrBr00bDNp0UK4pysQPVKNbhhN8bD3Dt3bVa0aT5UNIC3MggMUxZU7BtjReD-yb1F0l8MqNw987vP2uV4oW7zQAoM6B4SP6_jHqlckC7FC2Pv9FRLE3lEIb0D9kGsKnlXxsrl3WDr4FCOovgbKjrrQ882DjFtve0LpM Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.42 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bc62f1394b0845ea895ba6bbd995d6b7 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bc62f1394b0845ea895ba6bbd995d6b7 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TaggedBootDevicesTest_v242-1460723428-project Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f3b41dcc17d84bb3a8d03749c0e3ab7a Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1460723428-project Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '197cf9a5-6df3-4044-a397-36baf97da892'} Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:54.145607 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Returning 404 to user: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98722031-2076-4cbd-8f79-f1dd8cc2c4b5 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "DELETE /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 404 len: 111 microversion: 2.42 time: 0.095865 Oct 26 05:25:54.151814 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2789/5609] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:25:54 2022] DELETE /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:25:54.158127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:54.158600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] [instance: 197cf9a5-6df3-4044-a397-36baf97da892] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:54.173999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.175521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.176082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.176798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.182032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.182531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.207544 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] HTTP exception thrown: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Request method failure captured: Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 HTTP/1.1 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMMmjjQrpikoTrBr00bDNp0UK4pysQPVKNbhhN8bD3Dt3bVa0aT5UNIC3MggMUxZU7BtjReD-yb1F0l8MqNw987vP2uV4oW7zQAoM6B4SP6_jHqlckC7FC2Pv9FRLE3lEIb0D9kGsKnlXxsrl3WDr4FCOovgbKjrrQ882DjFtve0LpM Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.42 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bc62f1394b0845ea895ba6bbd995d6b7 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc62f1394b0845ea895ba6bbd995d6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bc62f1394b0845ea895ba6bbd995d6b7 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1460723428 Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TaggedBootDevicesTest_v242-1460723428-project Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f3b41dcc17d84bb3a8d03749c0e3ab7a Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1460723428-project Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '197cf9a5-6df3-4044-a397-36baf97da892'} Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.213422 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. Oct 26 05:25:54.218821 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:25:54.223853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] Returning 404 to user: Instance 197cf9a5-6df3-4044-a397-36baf97da892 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:25:54.225396 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19aa6932-aa50-4388-b576-49e2c6e26d36 tempest-TaggedBootDevicesTest_v242-1460723428 tempest-TaggedBootDevicesTest_v242-1460723428-project] 10.222.0.16 "GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892" status: 404 len: 111 microversion: 2.42 time: 0.070999 Oct 26 05:25:54.232759 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2790/5610] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:25:54 2022] GET /compute/v2.1/servers/197cf9a5-6df3-4044-a397-36baf97da892 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:25:54.402003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:54.418082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2d49e16-0a66-4bc9-b963-abe7561fc81a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1490 microversion: 2.1 time: 0.343259 Oct 26 05:25:54.420195 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2821/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:54 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1490 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:54.454634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:54.455266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:54.465542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.472440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.475531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.478304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.481016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.482404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.878556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:54.881305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:54.893773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60f248e2-d3d6-4da6-a1ef-e8b0d1b67450 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1491 microversion: 2.1 time: 0.446097 Oct 26 05:25:54.898121 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2791/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:54 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1491 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:54.922537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:54.922985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:54.936338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.937396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.939063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:54.943573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:54.944332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:54.946897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:55.015000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:25:55.078969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:55.079824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:55.092419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:55.094548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:55.095571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:55.096528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:55.098428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:55.099878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:55.248104 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e73d892a-8e33-4024-b204-2d032e11c4e7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 204 len: 0 microversion: 2.1 time: 0.329606 Oct 26 05:25:55.251373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2822/5613] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:25:54 2022] DELETE /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:25:55.265190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:55.267034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:55.283391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:55.286026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:55.286947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:55.288633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:55.289981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:55.290865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:55.530383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:55.545777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef4096a6-7b76-4462-885b-90630932e7a1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.466650 Oct 26 05:25:55.563375 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2792/5614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:55 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:55.661457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:55.672043 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c734460e-9a43-4571-9a42-188d2cc8f344 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1497 microversion: 2.1 time: 0.417253 Oct 26 05:25:55.692592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2823/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:55 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1497 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:56.578199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:56.579652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:56.596642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:56.597167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:56.597732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:56.598537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:56.599033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:56.599475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:56.711279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:56.712235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:56.726345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:56.729692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:56.731924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:56.732941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:56.737476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:56.738347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:57.233252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:57.243401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a8fe9452-d426-4876-9a33-3b53465b208c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.670007 Oct 26 05:25:57.245509 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2793/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:56 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:57.471374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:57.491113 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a3946359-7ea9-449d-901a-0c05ef8fa865 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1497 microversion: 2.1 time: 0.785517 Oct 26 05:25:57.513008 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2824/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:56 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1497 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:58.275402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:58.277088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:58.289092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:25:58.295351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:58.296221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:58.297511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:58.300683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:58.304324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:58.306180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:58.520416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:58.521050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:58.535379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:58.535899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:58.536320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:58.550584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:58.551092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:58.551535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:58.729937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:58.743486 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9845ff9f-4001-44cb-ab20-396c7f507c10 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1455 microversion: 2.1 time: 0.227254 Oct 26 05:25:58.744093 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2825/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:58 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1455 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:25:59.143808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1708a701-4046-4764-9638-161f93f809f6 req-16ef3a5a-d3fb-4458-94d0-768cfd814831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80119bd-8693-48e0-8f56-f43dbcd012ca", "name": "network-vif-deleted", "tag": "7b793102-baa7-4ea3-9dc5-761aeaedfb70"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:25:59.147448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:25:59.164016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-373388f2-51a0-4f94-9521-b19e49e7284e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.896093 Oct 26 05:25:59.165892 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2794/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:58 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:25:59.192882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1708a701-4046-4764-9638-161f93f809f6 req-16ef3a5a-d3fb-4458-94d0-768cfd814831 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:59.193509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1708a701-4046-4764-9638-161f93f809f6 req-16ef3a5a-d3fb-4458-94d0-768cfd814831 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:59.194037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1708a701-4046-4764-9638-161f93f809f6 req-16ef3a5a-d3fb-4458-94d0-768cfd814831 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:59.234193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1708a701-4046-4764-9638-161f93f809f6 req-16ef3a5a-d3fb-4458-94d0-768cfd814831 service nova] Creating event network-vif-deleted:7b793102-baa7-4ea3-9dc5-761aeaedfb70 for instance a80119bd-8693-48e0-8f56-f43dbcd012ca on n-h2-862416-4 Oct 26 05:25:59.241650 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1708a701-4046-4764-9638-161f93f809f6 req-16ef3a5a-d3fb-4458-94d0-768cfd814831 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106128 Oct 26 05:25:59.242753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2826/5620] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:25:59.777401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:25:59.779256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:25:59.795065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:59.799070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:59.799760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:59.802586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:25:59.804049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:25:59.804524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:25:59.984920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:00.012517 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-916e7b6a-5941-4298-95b8-3a9c27640c96 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1455 microversion: 2.1 time: 0.230815 Oct 26 05:26:00.040191 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2795/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:25:59 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1455 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:00.200074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:00.202728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:00.236594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:00.237765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:00.243282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:00.246884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:00.247578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:00.248671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:00.517786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1876761623", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d0bb2cdf-8376-4741-b77e-aba25871f8fe"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:00.621616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] validate_networks() for [('d0bb2cdf-8376-4741-b77e-aba25871f8fe', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:26:00.650477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:00.659981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf4d5021-d78d-4f92-b67a-71b67aa72f01 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.471215 Oct 26 05:26:00.668001 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2796/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:00 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:01.037147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:01.038700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:01.049657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.050280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.050829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.051647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.052638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.053664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.155927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.156413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.156853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.157327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lazy-loading 'fault' on Instance uuid a80119bd-8693-48e0-8f56-f43dbcd012ca {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:26:01.426336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:01.435926 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b99d4b07-8a2d-4618-a448-79194fb28d68 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 200 len: 1299 microversion: 2.1 time: 0.403677 Oct 26 05:26:01.438426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2797/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:01 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 1299 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:01.598648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:26:01.599097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:26:01.599546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:26:01.599965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:26:01.600384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:26:01.602597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:01.622997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.623498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.623940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.624678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.629137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.629947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.665852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Getting quotas for project bb917538e4004db18d06e6ebfb5f4286. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:01.673235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Getting quotas for user 08fad90cb7de446e83ae2c26cf6873e3 and project bb917538e4004db18d06e6ebfb5f4286. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:01.693576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:26:01.696863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:26:01.702753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:01.703896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:01.715462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.718468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.720247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.721247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:01.722109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:01.722782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:01.820387 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a3585dae-839f-4bc4-9cd1-3bfef294b7b9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767404 Oct 26 05:26:01.828439 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2827/5624] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:26:01.833768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df6fb969-f8dd-4939-917e-f2adea7c3043 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:01.842007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df6fb969-f8dd-4939-917e-f2adea7c3043 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:02.017877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df6fb969-f8dd-4939-917e-f2adea7c3043 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:02.028071 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df6fb969-f8dd-4939-917e-f2adea7c3043 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1215 microversion: 2.1 time: 0.198147 Oct 26 05:26:02.031281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2828/5625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:01 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:02.245059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:02.264782 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-665356ab-3acf-4a3f-83ab-c80b213edd02 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.562342 Oct 26 05:26:02.265454 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2798/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:01 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:02.461245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:02.462278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:02.475142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:02.484490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:02.490575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:02.490575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:02.490575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:02.490575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:02.525903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca HTTP/1.1 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'a80119bd-8693-48e0-8f56-f43dbcd012ca'} Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:02.528509 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:02.535288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:02.535288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:02.535288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:02.535288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:02.535288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:26:02.535288 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:02.540787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:02.542424 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5345759-dc34-45ef-a0f3-157c5d32be25 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 404 len: 111 microversion: 2.1 time: 0.085580 Oct 26 05:26:02.543866 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2829/5627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:02 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:26:02.552165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:02.552609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:02.561663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:02.562152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:02.564797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:02.569514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:02.570179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:02.585693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:02.616182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:26:02.735625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b0b10b0b-3074-4e99-b515-0115d4900c47 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 204 len: 0 microversion: 2.1 time: 0.187422 Oct 26 05:26:02.736961 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2799/5628] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:26:02 2022] DELETE /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:26:02.748955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:02.751716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:02.763983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:02.765075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:02.765818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:02.766792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:02.767367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:02.768125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.044171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:03.055377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:03.056418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:03.058626 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa98f4dc-23d1-485e-b0d5-70e1c401d850 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1496 microversion: 2.1 time: 0.315186 Oct 26 05:26:03.059233 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2830/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:02 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1496 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:03.068437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.069101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.069849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.073523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.073523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.073523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.182939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:03.196276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ab4330d-442b-48da-a698-99e6d4e73e5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1219 microversion: 2.1 time: 0.145378 Oct 26 05:26:03.197751 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2800/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:03 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:03.296098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:03.297094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:03.307473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.308270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.308898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.310030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.310662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.311261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.611389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:03.627720 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ee83ea1b-0112-4741-9118-3f20207cdfcc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1501 microversion: 2.1 time: 0.336776 Oct 26 05:26:03.643351 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2831/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:03 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1501 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:03.655108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1273fb5e-9e6e-4c81-9d05-893c3c88ee4b"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:03.658667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:03.669811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.670738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.671436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.672351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.673007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.673686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.707764 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Cannot 'attach_volume' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state rescued Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/os-volume_attachments HTTP/1.1 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 74 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: {"volumeAttachment": {"volumeId": "1273fb5e-9e6e-4c81-9d05-893c3c88ee4b"}} Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'attach_volume' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state rescued Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': 'c237b10e-845b-472d-a639-66f8f2db0482', 'body': {'volumeAttachment': {'volumeId': '1273fb5e-9e6e-4c81-9d05-893c3c88ee4b'}}} Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c237b10e-845b-472d-a639-66f8f2db0482 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 26 05:26:03.710011 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state rescued Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state rescued Oct 26 05:26:03.715330 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:03.717874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 409 to user: Cannot 'attach_volume' instance c237b10e-845b-472d-a639-66f8f2db0482 while it is in vm_state rescued {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:03.719115 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df24dfc5-135b-4d12-ae29-c8b849bb2c0f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068348 Oct 26 05:26:03.719968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2801/5632] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:26:03 2022] POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:26:03.733046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:03.734207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:03.744345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.745038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.745756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.748444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.749514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.750215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.822780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:03.871657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-44d912c5-279d-46c1-a5d7-7fc38a68fbde tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action" status: 202 len: 0 microversion: 2.1 time: 0.144435 Oct 26 05:26:03.873991 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2832/5633] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:26:03 2022] POST /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:26:03.881910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:03.882757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:03.889887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.890368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.890848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:03.891757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:03.895750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:03.896230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:04.084574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:04.085855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:04.092891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:04.093713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:04.094344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:04.095626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:04.096264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:04.096867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:04.815023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:04.835891 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e77f616f-358f-43eb-a86f-84f7a83270ac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1509 microversion: 2.1 time: 0.957872 Oct 26 05:26:04.836782 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2802/5634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:03 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1509 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:04.861827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:04.862440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:04.869682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:04.871065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:04.871708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:04.872597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:04.873225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:04.873853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:05.066916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:05.079945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61900285-4f98-48dc-9fb4-1a02566cf91d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1267 microversion: 2.1 time: 0.222720 Oct 26 05:26:05.080086 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2803/5635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:04 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:05.151286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:05.166572 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a4c2261-00a3-4213-8030-fe549040a0a3 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1496 microversion: 2.1 time: 1.085969 Oct 26 05:26:05.167404 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2833/5636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:04 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1496 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:05.616975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-784b7114-9ea4-4902-88ab-3f5ad7233993 req-618b2df6-d24a-4f2e-af24-4ff19886709d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88a7c78-e082-4ba2-95c7-e942ca4974a0", "name": "network-vif-deleted", "tag": "41e1ea11-97ec-43e5-a281-ae97a5603b2e"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:05.655376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-784b7114-9ea4-4902-88ab-3f5ad7233993 req-618b2df6-d24a-4f2e-af24-4ff19886709d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:05.657998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-784b7114-9ea4-4902-88ab-3f5ad7233993 req-618b2df6-d24a-4f2e-af24-4ff19886709d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:05.659916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-784b7114-9ea4-4902-88ab-3f5ad7233993 req-618b2df6-d24a-4f2e-af24-4ff19886709d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:05.706856 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-784b7114-9ea4-4902-88ab-3f5ad7233993 req-618b2df6-d24a-4f2e-af24-4ff19886709d service nova] Creating event network-vif-deleted:41e1ea11-97ec-43e5-a281-ae97a5603b2e for instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 on n-h1-862416-4 Oct 26 05:26:05.721762 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-784b7114-9ea4-4902-88ab-3f5ad7233993 req-618b2df6-d24a-4f2e-af24-4ff19886709d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109808 Oct 26 05:26:05.724737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2804/5637] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:05.862657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:05.863448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:05.890116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:05.892786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:05.894831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:05.896691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:05.901351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:05.904011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:06.110412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:06.112106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:06.121746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:06.122597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:06.124158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:06.129302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:06.130212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:06.130853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:06.341629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:06.358340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-922aa1c3-8e9f-4d15-a3fc-2e728d097f16 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1273 microversion: 2.1 time: 0.252435 Oct 26 05:26:06.361236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2805/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:06 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:06.398340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:06.399099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:06.420945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:06.423685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:06.425156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:06.427414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:06.429734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:06.432236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:06.550283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:06.550786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:06.552554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:06.553767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lazy-loading 'fault' on Instance uuid d88a7c78-e082-4ba2-95c7-e942ca4974a0 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:26:06.671658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:06.684581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f66d0be-de76-4d8f-9381-d7993c64922c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 200 len: 1299 microversion: 2.1 time: 0.321877 Oct 26 05:26:06.686605 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2806/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:06 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 1299 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:06.911570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:06.923004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6c934595-7760-44fd-966f-e84bccb6df0c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1509 microversion: 2.1 time: 1.064204 Oct 26 05:26:06.926386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2834/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:05 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1509 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:07.387603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:07.389740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:07.410061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:07.410908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:07.411632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:07.412609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:07.414183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:07.417037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:07.469450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:07.675731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:07.687211 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3894687a-9145-41b3-af0c-72dd7a828dcb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1315 microversion: 2.1 time: 0.304319 Oct 26 05:26:07.699775 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2807/5641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:07 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:07.708241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:07.708985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:07.720224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:07.720827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:07.721458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:07.722216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:07.722904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:07.723514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:07.755545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 HTTP/1.1 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd88a7c78-e082-4ba2-95c7-e942ca4974a0'} Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:07.757231 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:07.763141 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2898f02c-9203-48dd-aee8-70c382b7054b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 404 len: 111 microversion: 2.1 time: 0.055167 Oct 26 05:26:07.765475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2835/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:07 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:26:07.949705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:07.950328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:07.962311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:07.962810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:07.963259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:07.963982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:07.964439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:07.964870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:07.978136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2054682370", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:08.072889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:26:08.333153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:08.344089 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aac7f783-d8f8-4b32-8aef-ec45bdc71367 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1509 microversion: 2.1 time: 0.399930 Oct 26 05:26:08.361629 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2808/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:07 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:08.711551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:08.712430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:08.725624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:08.726617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:08.732820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:08.733635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:08.734461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:08.735112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:09.008185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:26:09.009142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:26:09.009668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:26:09.010085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:26:09.010499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:26:09.026895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:09.027390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:09.027834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:09.028572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:09.029018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:09.032253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:09.083657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:09.096251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:09.123736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:26:09.132369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:26:09.146131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:09.157649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a58c8d4e-d1d7-414c-a784-ed5d015b5b5f tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1315 microversion: 2.1 time: 0.449925 Oct 26 05:26:09.158693 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2809/5644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:08 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:09.171575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-aac42b6c-742e-4db0-a8ca-c98f008d35a6 req-b8f5692c-650c-422b-ac78-ac1b8ef0493e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13238a0f-2543-4aa1-aee3-fa53bc390876", "tag": "46426f6d-df14-40f3-be59-f2d2493ca925"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:09.197897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-aac42b6c-742e-4db0-a8ca-c98f008d35a6 req-b8f5692c-650c-422b-ac78-ac1b8ef0493e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:09.199066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-aac42b6c-742e-4db0-a8ca-c98f008d35a6 req-b8f5692c-650c-422b-ac78-ac1b8ef0493e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:09.201242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-aac42b6c-742e-4db0-a8ca-c98f008d35a6 req-b8f5692c-650c-422b-ac78-ac1b8ef0493e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:09.225621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-aac42b6c-742e-4db0-a8ca-c98f008d35a6 req-b8f5692c-650c-422b-ac78-ac1b8ef0493e service nova] Creating event network-changed:46426f6d-df14-40f3-be59-f2d2493ca925 for instance 13238a0f-2543-4aa1-aee3-fa53bc390876 on n-h1-862416-4 Oct 26 05:26:09.235514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-aac42b6c-742e-4db0-a8ca-c98f008d35a6 req-b8f5692c-650c-422b-ac78-ac1b8ef0493e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074309 Oct 26 05:26:09.237105 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2810/5645] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:09.252515 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bee14e05-4de8-456f-82d4-d0f457d62217 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279079 Oct 26 05:26:09.253282 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2836/5646] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:26:09.266562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8adb6d6d-10ee-4796-a909-33362b636a34 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:09.267537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8adb6d6d-10ee-4796-a909-33362b636a34 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:09.375592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:09.376316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:09.382753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:09.384011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:09.384722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:09.385620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:09.388522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:09.389070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:09.394954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8adb6d6d-10ee-4796-a909-33362b636a34 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:09.402305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8adb6d6d-10ee-4796-a909-33362b636a34 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1209 microversion: 2.1 time: 0.141285 Oct 26 05:26:09.405836 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2811/5647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:09 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:09.690296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:09.699164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10f27135-5e29-45bf-bd97-8d0d0926b2a4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1515 microversion: 2.1 time: 0.328312 Oct 26 05:26:09.703726 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2837/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:09 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:10.187577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:10.188159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:10.201754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:10.209577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:10.210384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:10.211617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:10.222331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:10.223006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:10.437870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:10.438436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:10.473969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:10.481751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:10.482467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:10.483436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:10.484407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:10.485126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:10.633567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:10.644845 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3022bb33-44a2-42af-b770-a1c6d49359a9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1315 microversion: 2.1 time: 0.461371 Oct 26 05:26:10.645490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2812/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:10 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:10.680347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:10.718475 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4ca740e-c195-4dba-8b1c-59bf20f440d4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1205 microversion: 2.1 time: 0.293700 Oct 26 05:26:10.719366 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2838/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:10 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1205 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:11.702252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:11.702881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:11.712372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:11.712867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:11.713396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:11.714060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:11.714516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:11.714950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:11.744319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:11.745247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:11.759551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:11.760241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:11.760802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:11.764381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:11.765366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:11.766065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:11.954115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:11.969676 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d99af9b-9285-4a76-9c56-db8a560d67ae tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1267 microversion: 2.1 time: 0.229131 Oct 26 05:26:11.972744 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2839/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:11 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:12.204309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:12.216424 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f4ff219-611a-400e-af9a-db54ceb19b73 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1315 microversion: 2.1 time: 0.529196 Oct 26 05:26:12.217375 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2813/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:11 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:12.504278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-184f883b-f5d1-4356-9a38-e2f73569f45b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'create', calling method: .version_select at 0x7f4709e47d30>, body: {"keypair": {"name": "tempest-keypair-1704473410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUaeURNaZSkzPk/YMPCSy9IdFPWfAxPDJXul4d81gEYC+I/Dyokqb/nKEmor+B5XJ3iK96Tb4PsXy6CLr23vZpIuufYb5Y87X83sd+W5x2jjYC4bXbTBhibdFFRgCaX0Q=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:12.567105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-184f883b-f5d1-4356-9a38-e2f73569f45b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:12.593955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-184f883b-f5d1-4356-9a38-e2f73569f45b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for user dde934392aab4940960535dd1794b37b and project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:12.675032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-184f883b-f5d1-4356-9a38-e2f73569f45b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179218 Oct 26 05:26:12.677755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2840/5653] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:26:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:12.998548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:12.999989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:13.034753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:13.035704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:13.036512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:13.037369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:13.037924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:13.038434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:13.245790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:13.247072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:13.257681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:13.259667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:13.260325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:13.261845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:13.263093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:13.263756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:13.286306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:13.295354 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4bd681cf-0775-4a62-85d8-c76f6b6c4f9a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1267 microversion: 2.1 time: 0.301935 Oct 26 05:26:13.300971 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2814/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:12 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:14.034361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-480e2bdc-da39-463e-a957-270c33d6c7d9 req-5d3f21db-95b7-451f-8289-de896c0d7357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13238a0f-2543-4aa1-aee3-fa53bc390876", "name": "network-vif-plugged", "status": "completed", "tag": "46426f6d-df14-40f3-be59-f2d2493ca925"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:14.061591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-480e2bdc-da39-463e-a957-270c33d6c7d9 req-5d3f21db-95b7-451f-8289-de896c0d7357 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:14.063508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-480e2bdc-da39-463e-a957-270c33d6c7d9 req-5d3f21db-95b7-451f-8289-de896c0d7357 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:14.064189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-480e2bdc-da39-463e-a957-270c33d6c7d9 req-5d3f21db-95b7-451f-8289-de896c0d7357 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:14.087178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-480e2bdc-da39-463e-a957-270c33d6c7d9 req-5d3f21db-95b7-451f-8289-de896c0d7357 service nova] Creating event network-vif-plugged:46426f6d-df14-40f3-be59-f2d2493ca925 for instance 13238a0f-2543-4aa1-aee3-fa53bc390876 on n-h1-862416-4 Oct 26 05:26:14.099697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-480e2bdc-da39-463e-a957-270c33d6c7d9 req-5d3f21db-95b7-451f-8289-de896c0d7357 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069309 Oct 26 05:26:14.102238 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2815/5655] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 26 05:26:14.162831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:14.174632 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2cb85f28-b510-4e7c-b696-d6182fb0bc03 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1315 microversion: 2.1 time: 0.934675 Oct 26 05:26:14.181828 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2841/5656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:13 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:14.330956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:14.332568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:14.353141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:14.354579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:14.355365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:14.357077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:14.357973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:14.359215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:14.648758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:14.660942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a061af3c-cd59-46b8-a750-973051a6d123 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.341923 Oct 26 05:26:14.673900 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2816/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:14 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:15.212958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:15.214176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:15.245235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:15.245797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:15.246256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:15.246979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:15.248325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:15.249818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:15.687160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:15.688484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:15.703561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:15.710538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:15.713176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:15.714193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:15.725799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:15.728172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:15.962857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:15.986950 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9423d8f6-03ff-478f-9c86-773e532e4713 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1315 microversion: 2.1 time: 0.782153 Oct 26 05:26:15.988272 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2842/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:15 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:15.995321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:16.007040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:16.020685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.026850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.027514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.029822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.030422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.031132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.137456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-12c995eb-2bca-4f23-bb19-9324f4c05c4a tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145956 Oct 26 05:26:16.138044 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2843/5659] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:26:15 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:26:16.243442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:16.244613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:16.253237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.253989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.254609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.255499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.256161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.256767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.290866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:26:16.481493 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f1da04f-d915-4215-a841-b392a2652ef9 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 204 len: 0 microversion: 2.1 time: 0.231319 Oct 26 05:26:16.482982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2844/5660] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:26:16 2022] DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:26:16.513399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:16.514404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:16.528169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.534278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.535410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.536897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.538201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.539715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.609591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:16.622900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-399e4d5f-9fb9-4858-93d2-5b38e0f39696 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.940199 Oct 26 05:26:16.630910 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2817/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:15 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:16.910817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0ed94c5a-edfd-4499-9bb7-8f5d433fad72 req-f806a82a-d526-4c8b-b41a-146ceb4f1e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44268d78-4109-4398-b3d7-d42f9dcd0c27", "tag": "8cdc86af-4e14-4a24-8bd1-34b00c1ce0b7"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:16.936956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ed94c5a-edfd-4499-9bb7-8f5d433fad72 req-f806a82a-d526-4c8b-b41a-146ceb4f1e79 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:16.937664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ed94c5a-edfd-4499-9bb7-8f5d433fad72 req-f806a82a-d526-4c8b-b41a-146ceb4f1e79 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:16.938196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0ed94c5a-edfd-4499-9bb7-8f5d433fad72 req-f806a82a-d526-4c8b-b41a-146ceb4f1e79 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:16.976557 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0ed94c5a-edfd-4499-9bb7-8f5d433fad72 req-f806a82a-d526-4c8b-b41a-146ceb4f1e79 service nova] Creating event network-changed:8cdc86af-4e14-4a24-8bd1-34b00c1ce0b7 for instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 on n-h2-862416-4 Oct 26 05:26:16.986396 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0ed94c5a-edfd-4499-9bb7-8f5d433fad72 req-f806a82a-d526-4c8b-b41a-146ceb4f1e79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080218 Oct 26 05:26:16.989235 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2818/5662] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:26:16.991740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:17.004501 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-faca5b51-ecd7-4a0e-adca-13e00fbe6337 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1673 microversion: 2.1 time: 0.508248 Oct 26 05:26:17.008989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2845/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:16 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1673 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:17.020877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:17.029120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:17.049273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.049985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.052530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.054294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.056142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.056765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.402143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:17.422167 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6dabce54-abd0-4f60-8c9e-d6d7cf9789ee tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1502 microversion: 2.1 time: 0.399917 Oct 26 05:26:17.423137 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2819/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:17 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:17.450069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:17.452091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:17.472016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.477961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.478874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.479941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.480590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.481226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.654694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:17.655728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:17.667568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.668384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.669003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.669938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.672720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.673376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.873302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:17.890805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-048bd94e-1c56-4dd1-807a-53c40d619cf3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1502 microversion: 2.1 time: 0.447905 Oct 26 05:26:17.900115 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2846/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:17 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1502 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:17.925130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:17.926069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:17.940177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.941929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.942908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:17.945733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:17.948063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:17.949850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:18.024031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lazy-loading 'flavor' on Instance uuid 13238a0f-2543-4aa1-aee3-fa53bc390876 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:26:18.152148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:18.170343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:18.178455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-90dcfeef-61c5-4553-a945-2c2f1677d759 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.527537 Oct 26 05:26:18.179421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2820/5666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:17 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:18.181051 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f1893af-4e1b-4bd3-8c2e-554c54dd0a11 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action" status: 202 len: 0 microversion: 2.1 time: 0.257225 Oct 26 05:26:18.183293 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2847/5667] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:26:17 2022] POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:26:18.198108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:18.206454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:18.218785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:18.225191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:18.225872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:18.226823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:18.227452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:18.228077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:18.232869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:18.234155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:18.246468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:18.247241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:18.247886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:18.248841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:18.249503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:18.254949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:19.053744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:19.060592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:19.072883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5bee77f5-c2e8-4c79-8570-fcd8a7a9b5a4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1673 microversion: 2.1 time: 0.892589 Oct 26 05:26:19.081217 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2821/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:18 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1673 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:19.086747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:19.098258 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf96638e-e15c-4ab2-90b2-ec0c9bab0cf9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1510 microversion: 2.1 time: 0.894684 Oct 26 05:26:19.110607 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2848/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:18 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1510 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:19.207704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:19.209486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:19.217212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:19.218217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:19.218823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:19.219786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:19.220411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:19.221009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:19.296629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-730412280", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83274ad0-96d9-4ba9-8361-99c750e25ec6"}], "security_groups": [{"name": "tempest-securitygroup--1818658769"}], "key_name": "tempest-keypair-1704473410", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:19.402670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:19.440807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:19.457672 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34c0feaf-e6eb-40c3-a7fb-ad5981ed24ff tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.255374 Oct 26 05:26:19.469356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2822/5670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:19 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:19.480477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] validate_networks() for [('83274ad0-96d9-4ba9-8361-99c750e25ec6', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:26:20.111771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:20.113096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:20.124278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.124898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.125627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.126420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.126946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.127473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.229682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:26:20.230185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:26:20.230572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:26:20.231219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:26:20.231625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:26:20.241652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.242885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.244279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.245128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.245816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.246260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.267978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:20.275060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Getting quotas for user dde934392aab4940960535dd1794b37b and project 6ce4dd876ace4d35a34d07effb8d6248. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:20.287225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:20.293763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:26:20.297156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:26:20.337368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:20.345581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34604f0d-5c1c-47f1-8195-39efc5460cdf tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1673 microversion: 2.1 time: 0.238631 Oct 26 05:26:20.357426 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-979b3a3d-31f5-4f26-8879-163ad9db1118 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.062486 Oct 26 05:26:20.357426 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2849/5671] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:26:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:26:20.358560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2823/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:20 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:20.359785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:20.360651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:20.367778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.368698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.369504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.370420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.371077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.371698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.375135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e83cc27a-4e6b-4df2-bb5e-633eb3be4077 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:20.375753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e83cc27a-4e6b-4df2-bb5e-633eb3be4077 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:20.541879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e83cc27a-4e6b-4df2-bb5e-633eb3be4077 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:20.549024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e83cc27a-4e6b-4df2-bb5e-633eb3be4077 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1245 microversion: 2.1 time: 0.177570 Oct 26 05:26:20.553575 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2824/5673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:20 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1245 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:20.566611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:20.567232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:20.577241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.577772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.578222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.578982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.579450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.579881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.713577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:20.724490 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57505be9-516e-4a4f-9602-0971a2820356 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1493 microversion: 2.1 time: 0.368661 Oct 26 05:26:20.725795 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2850/5674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:20 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1493 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:20.749148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:20.749776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:20.759083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.759385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.760496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.761296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.761804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.762425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.808886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:20.827542 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54e6071f-313b-4a5a-a1b2-d9f02fc544a7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.270584 Oct 26 05:26:20.828598 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2825/5675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:20 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:20.860897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-895b15e4-d110-4e7b-a7de-1f51ac84f7c3 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action" status: 202 len: 0 microversion: 2.1 time: 0.115751 Oct 26 05:26:20.862762 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2851/5676] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:26:20 2022] POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 05:26:20.890946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:20.891567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:20.912797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.916224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.917846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:20.921363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:20.922231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:20.923013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:21.370691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:21.383901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:21.385300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:21.391832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6d9fa47-521a-4dea-9771-fd48b3bfc76d tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1499 microversion: 2.1 time: 0.523554 Oct 26 05:26:21.394926 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2826/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:20 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1499 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:21.404318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:21.405095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:21.405806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:21.406689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:21.407323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:21.408500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:21.556947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:21.574080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5359ed5-7e51-4df9-aa68-66d23bc2da06 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1606 microversion: 2.1 time: 0.196836 Oct 26 05:26:21.574848 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2852/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:21 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1606 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:21.595774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:21.597031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:21.605712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:21.606541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:21.607498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:21.609652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:21.610339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:21.611054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:21.772824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:21.797919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:21.826125 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bac9dccf-28dd-4294-a122-5f7e8a183bac tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1297 microversion: 2.1 time: 0.239981 Oct 26 05:26:21.827598 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2827/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:21 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1297 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:21.854793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:21.855451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:21.871049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:21.871049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:21.885066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:21.886142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:21.886640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:21.888662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.307559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:22.322622 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-94f4fcdd-4619-4669-922d-2fdc4ba00d06 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.471729 Oct 26 05:26:22.323220 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2853/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:21 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:22.418876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:22.420174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:22.442714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:22.453721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:22.454360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.455571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:22.456164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:22.457011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.601753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:22.604031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:22.621582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:22.622351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:22.623714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.624829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:22.625430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:22.625943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.751759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:22.762801 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86033a24-9b2b-4fc8-81a5-8d2d16e6417c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1606 microversion: 2.1 time: 0.165573 Oct 26 05:26:22.763735 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2854/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:22 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1606 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:22.824947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:22.833904 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0d12f53a-b8df-481e-8ff3-fafd1f3fa47c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1499 microversion: 2.1 time: 0.420620 Oct 26 05:26:22.845712 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2828/5682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:22 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:22.856938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:22.857669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:22.863827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:22.864591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:22.865111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.865903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:22.866626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:22.867695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:22.950093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:22.959482 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e70e43a1-7e22-4c69-8279-29be737e9a2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1303 microversion: 2.1 time: 0.106388 Oct 26 05:26:22.962640 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2855/5683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:22 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:23.283031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-70cee067-600b-4c12-a772-0a1412a2ec23 req-ca57e693-a453-4149-a70c-66d9397c9abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2215f5a-5cbe-477f-b610-9a71bb40c5e7", "name": "network-vif-deleted", "tag": "0972ead2-1e24-42b0-991e-45db7f81b8b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:23.306330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70cee067-600b-4c12-a772-0a1412a2ec23 req-ca57e693-a453-4149-a70c-66d9397c9abe service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:23.307080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70cee067-600b-4c12-a772-0a1412a2ec23 req-ca57e693-a453-4149-a70c-66d9397c9abe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:23.311243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70cee067-600b-4c12-a772-0a1412a2ec23 req-ca57e693-a453-4149-a70c-66d9397c9abe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:23.325621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-70cee067-600b-4c12-a772-0a1412a2ec23 req-ca57e693-a453-4149-a70c-66d9397c9abe service nova] Creating event network-vif-deleted:0972ead2-1e24-42b0-991e-45db7f81b8b0 for instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 on n-h1-862416-4 Oct 26 05:26:23.330899 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-70cee067-600b-4c12-a772-0a1412a2ec23 req-ca57e693-a453-4149-a70c-66d9397c9abe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052411 Oct 26 05:26:23.331717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2829/5684] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:23.349650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:23.350275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:23.359375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:23.360178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:23.360826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:23.361865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:23.362500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:23.363105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:23.789349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:23.790947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:23.797766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:23.798642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:23.799356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:23.800319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:23.801011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:23.801728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:23.839545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:23.840418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:23.841088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:23.842084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lazy-loading 'fault' on Instance uuid b2215f5a-5cbe-477f-b610-9a71bb40c5e7 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:26:24.033090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:24.046722 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-582ea253-66ad-4177-8992-87a4caa2219d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 200 len: 1327 microversion: 2.1 time: 0.262278 Oct 26 05:26:24.049474 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2830/5685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:23 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 1327 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:24.077110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:24.078189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:24.086961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:24.087882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:24.088583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:24.089676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:24.090385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:24.091750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:24.193334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:24.234251 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3063828d-c8bb-4a47-a5ce-28386b43ef03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.888613 Oct 26 05:26:24.235030 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2856/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:23 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:24.259306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:24.260213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:24.279419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:24.280259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:24.280890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:24.281837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:24.282478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:24.283088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:24.474210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:24.490035 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2b43b9c-c041-4ee6-a605-5d0baf21c943 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1303 microversion: 2.1 time: 0.253900 Oct 26 05:26:24.490644 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2857/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:24 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:24.495809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-fa15291c-ab02-4ed3-b932-8e72e66f2c09 req-8bdc7aff-31a6-4d25-b673-4da5a256e58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44268d78-4109-4398-b3d7-d42f9dcd0c27", "name": "network-vif-plugged", "status": "completed", "tag": "8cdc86af-4e14-4a24-8bd1-34b00c1ce0b7"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:24.520451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fa15291c-ab02-4ed3-b932-8e72e66f2c09 req-8bdc7aff-31a6-4d25-b673-4da5a256e58e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:24.521372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fa15291c-ab02-4ed3-b932-8e72e66f2c09 req-8bdc7aff-31a6-4d25-b673-4da5a256e58e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:24.534117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fa15291c-ab02-4ed3-b932-8e72e66f2c09 req-8bdc7aff-31a6-4d25-b673-4da5a256e58e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:24.556323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-fa15291c-ab02-4ed3-b932-8e72e66f2c09 req-8bdc7aff-31a6-4d25-b673-4da5a256e58e service nova] Creating event network-vif-plugged:8cdc86af-4e14-4a24-8bd1-34b00c1ce0b7 for instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 on n-h2-862416-4 Oct 26 05:26:24.567200 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-fa15291c-ab02-4ed3-b932-8e72e66f2c09 req-8bdc7aff-31a6-4d25-b673-4da5a256e58e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073366 Oct 26 05:26:24.568699 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2858/5688] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:24.571610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:24.590307 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-55ed519f-6d79-4653-bdee-515d95070cca tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1499 microversion: 2.1 time: 0.524645 Oct 26 05:26:24.591180 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2831/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:24 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1499 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:25.079079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:25.080235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:25.090912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:25.093464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:25.094336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:25.095964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:25.096708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:25.097462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:25.133649 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] HTTP exception thrown: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Request method failure captured: Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 HTTP/1.1 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMQWf-0DZcjDPK6vE9szFgDmCU6x690eU9o_KQlda_Obi7wVzv7mAr14O0y-qzlL2Cu8DSmHc8JZvnynUVttw6HRL1YrI-dFPF4zfmnbm585vT73ku0b-8vAjqzSiGTQNReH5Ym8wNdyKjZi434An0gIMgS0V7CD9on0yj7DSExsdqs Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b095e3b8ee8c4fdca403334607c79df2 Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'b2215f5a-5cbe-477f-b610-9a71bb40c5e7'} Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:25.135824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:26:25.142405 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:25.150687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Returning 404 to user: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:25.152475 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-797220b9-0b78-452a-b1f5-7e4b7cd4bcf7 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 404 len: 111 microversion: 2.1 time: 0.078576 Oct 26 05:26:25.158285 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2859/5690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:25 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:26:25.162409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d22e422-001d-4a33-bacc-e855aced133c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '.version_select at 0x7f47092e9af0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:25.209375 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d22e422-001d-4a33-bacc-e855aced133c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046718712" status: 202 len: 0 microversion: 2.1 time: 0.050929 Oct 26 05:26:25.214716 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2832/5691] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046718712 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:26:25.263223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:25.265430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:25.288504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:25.291739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:25.293601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:25.295403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:25.298833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:25.299575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:25.515313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:25.515968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:25.536520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:25.537044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:25.537530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:25.538266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:25.539322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:25.552686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:26.181237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:26.196773 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb0cead4-d47b-4481-8f3f-77d98afed8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1309 microversion: 2.1 time: 0.941850 Oct 26 05:26:26.197409 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2860/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:25 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1309 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:26.219179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:26.223700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:26.238497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:26.239155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:26.239615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:26.240502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:26.241101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:26.241650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:26.299006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:26.318200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba8a019b-291f-4788-9159-6169cc36e5a3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.806360 Oct 26 05:26:26.341457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2833/5693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:25 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:27.018141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:27.044232 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f902cf8-3927-4cac-92b9-33d2d863c792 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1502 microversion: 2.1 time: 0.842791 Oct 26 05:26:27.045335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2861/5694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:26 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:27.074676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:27.075294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:27.098461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:27.100595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:27.102005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:27.103004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:27.103655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:27.104301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:27.153264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lazy-loading 'flavor' on Instance uuid 13238a0f-2543-4aa1-aee3-fa53bc390876 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:26:27.223323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:27.224316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:27.239866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:27.240473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:27.240983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:27.245500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:27.247010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:27.247713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:27.317920 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1bcc00e-2084-4822-bcdf-cb7497f82ca7 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action" status: 202 len: 0 microversion: 2.1 time: 0.247360 Oct 26 05:26:27.325749 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2834/5695] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:26:27 2022] POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:26:27.334063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:27.337384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:27.342748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:27.349164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:27.350038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:27.350865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:27.352340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:27.353045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:27.354321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:27.992300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:28.000437 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75b30d06-3425-4923-b3aa-fcbe3ec3d87c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1491 microversion: 2.1 time: 0.781744 Oct 26 05:26:28.001728 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2862/5696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:27 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1491 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:28.006807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:28.008245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:28.014892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:28.015747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:28.016442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:28.017435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:28.018146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:28.018811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:28.254233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:28.276272 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf2f0005-33d4-4e12-b773-022b5d21b068 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1510 microversion: 2.1 time: 0.944793 Oct 26 05:26:28.293117 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2835/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:27 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1510 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:28.310583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:28.316206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:28.322918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:28.324931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:28.325686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:28.326656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:28.327348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:28.328008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:28.447240 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3bf3dd77-e309-47a3-89ea-d23f66c8b087 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "PUT /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1086 microversion: 2.1 time: 0.151716 Oct 26 05:26:28.448801 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2836/5698] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:26:28 2022] PUT /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1086 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:28.456526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bbecdab7-0b9e-4900-970e-abe887c54543 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: .version_select at 0x7f47092339d0>, body: {"keypair": {"name": "tempest-keypair-742758324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuVbQSSmFXX/1tR3W/KpSUzyV7xD2WS/HHaSsBXKUvglFWNDFBYGCq03+1SGVTlW/my/wHHU5JMw5q+4h2XBhFe/vF23N8w4DsAIF3SSHiSAJsHGuTjWk4bC0ucbQr+Qw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:28.482313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bbecdab7-0b9e-4900-970e-abe887c54543 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for project bd4061413c95466b9bc8c80b8791be6a. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:28.500893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bbecdab7-0b9e-4900-970e-abe887c54543 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for user b095e3b8ee8c4fdca403334607c79df2 and project bd4061413c95466b9bc8c80b8791be6a. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:28.545945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bbecdab7-0b9e-4900-970e-abe887c54543 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094825 Oct 26 05:26:28.546802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2837/5699] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:26:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:28.560823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:28.561695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:28.576874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:28.589031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:28.589740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:28.591666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:28.592163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:28.592606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:28.603522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:28.621851 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c4b1f6b-eeb6-44f3-8fea-4b19f23ba6c0 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.618668 Oct 26 05:26:28.622482 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2863/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:28 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:28.964130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:28.973045 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-97210c11-bd51-4bf1-8e0e-654d6e12b284 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1512 microversion: 2.1 time: 0.425039 Oct 26 05:26:28.973967 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2838/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:28 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:29.013272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:29.015284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:29.035289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.036019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.036365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.037102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.037600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.038044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.154951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-721c1795-762a-45c3-926e-797c64437ab1 req-13984a38-676e-4d4b-9ba5-7829621bb923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7871b5f8-9765-4a97-a309-dfe6d5dcc6a8", "tag": "51f1501d-e68e-456a-8f5a-9f5e4c91fd83"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:29.177950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-721c1795-762a-45c3-926e-797c64437ab1 req-13984a38-676e-4d4b-9ba5-7829621bb923 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.178443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-721c1795-762a-45c3-926e-797c64437ab1 req-13984a38-676e-4d4b-9ba5-7829621bb923 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.178882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-721c1795-762a-45c3-926e-797c64437ab1 req-13984a38-676e-4d4b-9ba5-7829621bb923 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.204071 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-721c1795-762a-45c3-926e-797c64437ab1 req-13984a38-676e-4d4b-9ba5-7829621bb923 service nova] Creating event network-changed:51f1501d-e68e-456a-8f5a-9f5e4c91fd83 for instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 on n-h1-862416-4 Oct 26 05:26:29.219831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-721c1795-762a-45c3-926e-797c64437ab1 req-13984a38-676e-4d4b-9ba5-7829621bb923 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068652 Oct 26 05:26:29.220859 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2839/5702] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:26:29.305381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:29.310366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:29.313108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:29.320578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d25fe4c4-2799-4e87-90c3-6bff06e13c03 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1512 microversion: 2.1 time: 0.323338 Oct 26 05:26:29.331530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.331967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.332312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.333031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.341442 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2864/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:28 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:29.369040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.369986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.373855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:29.381593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:29.408947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.409782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.410402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.411323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.411963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.412572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.475767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:29.515127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:26:29.683441 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-699bc74c-b629-4a64-9eaf-87ad748c9d2f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 204 len: 0 microversion: 2.1 time: 0.318050 Oct 26 05:26:29.684252 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2865/5704] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:26:29 2022] DELETE /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:26:29.697185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:29.697948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:29.710899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.711717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.712341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:29.713262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:29.713943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:29.715058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.063934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:30.077595 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c91b1c67-6cb0-4ac8-af0d-676ce91668ef tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1493 microversion: 2.1 time: 0.779343 Oct 26 05:26:30.078920 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2840/5705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:29 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1493 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:30.091732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:30.092638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:30.107978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:30.108483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:30.110923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.112844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:30.115657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:30.116635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.254474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:30.282137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=24 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:30.374341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:30.392681 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b7267584-7a40-4703-8f0a-d68df6fe9342 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.702747 Oct 26 05:26:30.394047 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2866/5706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:29 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:30.402543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:30.403163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:30.410066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:30.410667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:30.411846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.412923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:30.413631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:30.414266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.508273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:30.521433 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43b20e74-7fe3-4893-a192-08efd40e3582 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1518 microversion: 2.1 time: 0.440590 Oct 26 05:26:30.523754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2841/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:30 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1518 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:30.537557 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0688e1a3-63b9-4671-8339-c7eab070525c tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action" status: 202 len: 0 microversion: 2.1 time: 0.140278 Oct 26 05:26:30.541699 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2867/5708] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:26:30 2022] POST /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:26:30.555157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:30.558477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:30.573354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:30.573951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:30.574421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.576351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:30.578539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:30.579340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:30.983636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:30.992823 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9dabe20d-c24e-4fe1-942f-8a92c8970584 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1499 microversion: 2.1 time: 0.449353 Oct 26 05:26:30.993705 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2842/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:30 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1499 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:31.424805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:31.425684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:31.442593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:31.443343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:31.443966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:31.444976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:31.445665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:31.446143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:31.552628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:31.555913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:31.564225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:31.565029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:31.565513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:31.566221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:31.566844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:31.567438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:32.452867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:32.469500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c89ab835-8612-4288-97c8-92dcc89735d1 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1518 microversion: 2.1 time: 0.919587 Oct 26 05:26:32.470783 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2843/5710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:31 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1518 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:32.481375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad7c35a7-c070-4447-b240-bb6e30237f6b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Action: 'create', calling method: .version_select at 0x7f470924ad30>, body: {"keypair": {"name": "tempest-keypair-812566541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU3T5rPl+LHGZd2RiFpPhi+6nwTEBzS3hEmPbH7LbOkXSGdJULM7pr+L3XcsjecV12tq1az5eJlsKtdLXG49dJih5wn1cUqloVFY9gYeX+qANnpl/6ZrOBiPjvFScUAcQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:32.561623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ad7c35a7-c070-4447-b240-bb6e30237f6b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Getting quotas for project 821c88694a6546eebf13b429a34bf057. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:32.580837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:32.599331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2cb0af7f-63e4-4cbd-a4c5-ff01c557d24d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 1.179940 Oct 26 05:26:32.610014 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2868/5711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:31 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:32.612046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ad7c35a7-c070-4447-b240-bb6e30237f6b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Getting quotas for user 05121fe0d9804c11a7403ddffd37f42f and project 821c88694a6546eebf13b429a34bf057. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:32.634178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:32.634802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:32.668227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:32.668743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:32.669192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:32.678513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:32.681749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:32.682485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:32.701138 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad7c35a7-c070-4447-b240-bb6e30237f6b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.228465 Oct 26 05:26:32.705151 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2844/5712] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 26 05:26:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 05:26:33.493208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:33.493891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:33.509714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:33.510320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:33.510787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:33.511846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:33.512403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:33.512858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:33.649528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:33.660588 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7597076-e716-4783-a23b-43514f9207f2 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1499 microversion: 2.1 time: 1.049186 Oct 26 05:26:33.661190 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2869/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:32 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1499 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:33.674251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:33.674913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:33.688628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:33.689340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:33.690402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:33.690590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:33.691063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:33.691842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:34.153844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:34.171846 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-926b41cf-2eda-4137-af2e-357bf55f95a9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 200 len: 1518 microversion: 2.1 time: 0.683408 Oct 26 05:26:34.221250 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2845/5714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:33 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 1518 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:34.260058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:34.271280 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8afb5168-7ddb-48eb-9bb3-071bb2c25b58 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.608891 Oct 26 05:26:34.274581 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2870/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:33 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:34.653054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-315c7649-7f72-40ed-a0c1-08e84b30135a req-e23437f0-df82-445e-ba9c-707671186013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44268d78-4109-4398-b3d7-d42f9dcd0c27", "name": "network-vif-deleted", "tag": "8cdc86af-4e14-4a24-8bd1-34b00c1ce0b7"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:34.684787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:34.685451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:34.685774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-315c7649-7f72-40ed-a0c1-08e84b30135a req-e23437f0-df82-445e-ba9c-707671186013 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:34.686296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-315c7649-7f72-40ed-a0c1-08e84b30135a req-e23437f0-df82-445e-ba9c-707671186013 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:34.686739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-315c7649-7f72-40ed-a0c1-08e84b30135a req-e23437f0-df82-445e-ba9c-707671186013 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:34.697133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:34.708488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:34.711793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:34.712338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:34.714325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:34.714881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:34.715822 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-315c7649-7f72-40ed-a0c1-08e84b30135a req-e23437f0-df82-445e-ba9c-707671186013 service nova] Creating event network-vif-deleted:8cdc86af-4e14-4a24-8bd1-34b00c1ce0b7 for instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 on n-h2-862416-4 Oct 26 05:26:34.716352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:34.740124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-315c7649-7f72-40ed-a0c1-08e84b30135a req-e23437f0-df82-445e-ba9c-707671186013 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359778 Oct 26 05:26:34.744920 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2846/5716] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:35.250122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:35.250773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:35.267621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:35.269047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:35.269769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:35.274084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:35.278472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:35.279328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:35.315841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 HTTP/1.1 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '44268d78-4109-4398-b3d7-d42f9dcd0c27'} Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:35.322890 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:35.330079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:35.330079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:35.330079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:35.330079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:35.330079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:26:35.330079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:35.332157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:35.334982 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48c99792-c619-4b23-a071-74cfd3750d4c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 404 len: 111 microversion: 2.1 time: 0.091010 Oct 26 05:26:35.337221 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2847/5717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:35 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:26:35.342506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:35.349704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:35.369738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:35.372791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:35.374010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:35.375137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:35.377115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:35.377895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:35.452342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:35.464803 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b1fdb0a-df17-4caf-b2f5-ed094f76bc82 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1502 microversion: 2.1 time: 0.784443 Oct 26 05:26:35.468430 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2871/5718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:34 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1502 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:35.491295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:35.492747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:35.504134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:35.505443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:35.506152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:35.509714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:35.512602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:35.513622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:35.604884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:26:35.794866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f7f0e21-5a3c-44d9-ba4f-56f2e91186bb tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 204 len: 0 microversion: 2.1 time: 0.307184 Oct 26 05:26:35.797137 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2872/5719] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:26:35 2022] DELETE /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:26:35.812851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1694020961", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "40257841-d7aa-4357-a332-17ab9fa4ffe1"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:35.907164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] validate_networks() for [('40257841-d7aa-4357-a332-17ab9fa4ffe1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:26:36.092704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:36.118978 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03c001aa-bf0a-42ee-9dd7-3ac2b3eea8b5 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.779710 Oct 26 05:26:36.121596 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2848/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:35 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:36.131388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:36.132822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:36.142386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:36.143242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:36.143898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:36.144634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:36.145094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:36.145957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:37.065087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:37.081184 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23914bc7-132a-4c24-8643-39a48d1b25d8 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1508 microversion: 2.1 time: 0.958119 Oct 26 05:26:37.081919 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2849/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:36 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1508 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:37.099633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-613602101", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "331a04fc-76a7-446e-beb4-ceb20eaaf2d7"}], "security_groups": [{"name": "tempest-securitygroup--161678947"}], "key_name": "tempest-keypair-742758324", "user_data": "}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:37.363545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] validate_networks() for [('331a04fc-76a7-446e-beb4-ceb20eaaf2d7', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:26:37.566505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:26:37.567434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:26:37.568489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:26:37.569154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:26:37.571695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:26:37.592741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:37.593242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:37.593729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:37.594472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:37.596749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:37.597200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:37.622116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:37.627973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Getting quotas for user a0f638704545419a984ecce9b4aa6b30 and project 8331fd49139f43338113b159d12eb6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:37.642898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:26:37.645796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:26:37.708669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b78bdf3-d2fd-418e-b46a-ee7e5e383e7a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.909372 Oct 26 05:26:37.716364 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2873/5722] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:26:37.722480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:37.724019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:37.747875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:37.749598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:37.753483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:37.754521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:37.755240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:37.757835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:38.205592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:38.217663 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30d23b23-c167-4af1-a0af-5fbb0998096e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.499531 Oct 26 05:26:38.219360 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2874/5723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:37 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:38.224811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1630401392", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0838762c-ed5e-4227-80ac-7c9935fed6c9"}, {"port": "1ce8d95a-d297-4c8b-9381-aa9252c03ccb", "tag": "port-1"}, {"port": "ee4a74ea-53cf-4b86-b64f-6e9b3d1620ad", "tag": "port-2"}, {"uuid": "ae781c15-2ae9-489c-b729-d8677f97353f", "tag": "net-1"}, {"uuid": "ae781c15-2ae9-489c-b729-d8677f97353f"}, {"uuid": "60a4f2dd-4cbd-4bbc-ae51-57f9e76ed55a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "60a4f2dd-4cbd-4bbc-ae51-57f9e76ed55a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a96c52b1-006c-432d-9192-08397de1da50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "216c4491-a9f3-474e-b53f-34b1971ca05c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1dda87b5-b8d2-4929-8c9a-b4f49fa4f1a1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1404364572"}], "key_name": "tempest-keypair-812566541", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:38.551801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] validate_networks() for [('0838762c-ed5e-4227-80ac-7c9935fed6c9', None, None, None, None, None), (None, None, '1ce8d95a-d297-4c8b-9381-aa9252c03ccb', None, None, None), (None, None, 'ee4a74ea-53cf-4b86-b64f-6e9b3d1620ad', None, None, None), ('ae781c15-2ae9-489c-b729-d8677f97353f', None, None, None, None, None), ('ae781c15-2ae9-489c-b729-d8677f97353f', None, None, None, None, None), ('60a4f2dd-4cbd-4bbc-ae51-57f9e76ed55a', '10.2.2.100', None, None, None, None), ('60a4f2dd-4cbd-4bbc-ae51-57f9e76ed55a', '10.2.2.200', None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:26:38.702775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:26:38.703325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:26:38.704579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:26:38.705535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:26:38.706791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:26:38.728177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:38.729847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:38.732116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:38.734289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:38.735849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:38.736389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:38.761480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for project bd4061413c95466b9bc8c80b8791be6a. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:38.767859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Getting quotas for user b095e3b8ee8c4fdca403334607c79df2 and project bd4061413c95466b9bc8c80b8791be6a. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:38.787690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:26:38.791725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:26:38.935106 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8487a28e-5edc-4d7e-a1da-961290350491 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.842442 Oct 26 05:26:38.942884 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2850/5724] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:26:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:26:38.995338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:38.999080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:39.043039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.047819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.050109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.055532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.061358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.064494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.296050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:39.309530 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-049fe101-0fd4-487b-8656-d9744402ecfe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1261 microversion: 2.1 time: 0.362292 Oct 26 05:26:39.310031 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2851/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:38 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1261 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:39.637530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0d53cd8b-ab72-4606-afd0-876f5cf5cd2c req-f5babc04-3710-4648-ade3-46e7754faa99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7871b5f8-9765-4a97-a309-dfe6d5dcc6a8", "name": "network-vif-plugged", "status": "completed", "tag": "51f1501d-e68e-456a-8f5a-9f5e4c91fd83"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:39.650027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0d53cd8b-ab72-4606-afd0-876f5cf5cd2c req-f5babc04-3710-4648-ade3-46e7754faa99 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.650569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0d53cd8b-ab72-4606-afd0-876f5cf5cd2c req-f5babc04-3710-4648-ade3-46e7754faa99 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.651283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0d53cd8b-ab72-4606-afd0-876f5cf5cd2c req-f5babc04-3710-4648-ade3-46e7754faa99 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.664416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0d53cd8b-ab72-4606-afd0-876f5cf5cd2c req-f5babc04-3710-4648-ade3-46e7754faa99 service nova] Creating event network-vif-plugged:51f1501d-e68e-456a-8f5a-9f5e4c91fd83 for instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 on n-h1-862416-4 Oct 26 05:26:39.670113 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0d53cd8b-ab72-4606-afd0-876f5cf5cd2c req-f5babc04-3710-4648-ade3-46e7754faa99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358695 Oct 26 05:26:39.671001 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2852/5726] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:39.677553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:39.680161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:39.689497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.690378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.691021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.691917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.692621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.693214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.730975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.732430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.733609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.734399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lazy-loading 'fault' on Instance uuid 13238a0f-2543-4aa1-aee3-fa53bc390876 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:26:39.893913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08fad90cb7de446e83ae2c26cf6873e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb917538e4004db18d06e6ebfb5f4286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:39.902160 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b5bc536f-09d9-45be-9478-ccc2fbff6bb1 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 200 len: 1305 microversion: 2.1 time: 0.229740 Oct 26 05:26:39.914257 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2853/5727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:39 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:39.914257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:39.914257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:39.918754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.919370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.919909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:39.920721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:39.921241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:39.922385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:40.102941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:40.113267 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-027eb61b-d04a-4334-b0e8-397c0915d71b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1240 microversion: 2.1 time: 0.206515 Oct 26 05:26:40.114333 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2854/5728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:39 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1240 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:40.123519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-81a89337-a72f-4493-8894-dd569f9734c2 req-4b32949d-64b4-43a3-a415-0cbfa69125d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13238a0f-2543-4aa1-aee3-fa53bc390876", "name": "network-vif-deleted", "tag": "46426f6d-df14-40f3-be59-f2d2493ca925"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:40.142716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81a89337-a72f-4493-8894-dd569f9734c2 req-4b32949d-64b4-43a3-a415-0cbfa69125d2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:40.143621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81a89337-a72f-4493-8894-dd569f9734c2 req-4b32949d-64b4-43a3-a415-0cbfa69125d2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:40.144510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81a89337-a72f-4493-8894-dd569f9734c2 req-4b32949d-64b4-43a3-a415-0cbfa69125d2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:40.168959 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-81a89337-a72f-4493-8894-dd569f9734c2 req-4b32949d-64b4-43a3-a415-0cbfa69125d2 service nova] Creating event network-vif-deleted:46426f6d-df14-40f3-be59-f2d2493ca925 for instance 13238a0f-2543-4aa1-aee3-fa53bc390876 on n-h1-862416-4 Oct 26 05:26:40.181164 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-81a89337-a72f-4493-8894-dd569f9734c2 req-4b32949d-64b4-43a3-a415-0cbfa69125d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063070 Oct 26 05:26:40.182587 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2855/5729] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:40.189389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:40.190670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:40.199526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:40.200317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:40.200929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:40.202076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:40.202700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:40.203297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:40.671867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:40.682145 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0af6fb1d-8f6c-46a9-95b6-06af0b9f60e1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1371 microversion: 2.1 time: 0.497885 Oct 26 05:26:40.683006 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2856/5730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:40 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1371 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:40.864133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a587d83-b9df-46e9-aeb2-1581a773b9ed tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Action: 'create', calling method: .version_select at 0x7f47092d8b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-951514016"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:41.396774 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a587d83-b9df-46e9-aeb2-1581a773b9ed tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.712449 Oct 26 05:26:41.406994 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2857/5731] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Oct 26 05:26:40 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 723 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 26 05:26:41.422262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:41.426756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:41.443668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:41.446241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:41.446945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:41.448164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:41.449838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:41.450533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:41.637486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:41.655672 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cd0759d6-1d79-4e67-9c69-d262de69b789 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1267 microversion: 2.1 time: 0.247124 Oct 26 05:26:41.656294 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2858/5732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:41 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:41.673259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:41.674530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] [instance: 13238a0f-2543-4aa1-aee3-fa53bc390876] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:41.686788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:41.687687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:41.689772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:41.690673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:41.692815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:41.693260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:41.722738 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] HTTP exception thrown: Instance 13238a0f-2543-4aa1-aee3-fa53bc390876 could not be found. Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Request method failure captured: Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 HTTP/1.1 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMTkh8FkDIDYWe7gOiwMnHg6WnxVQAWmZJ6j4hgnZFGAPlyz9koYsgWRxhLjSpvOpghNPTE724_frwAoEWoPdMPU8Bn7wSrsXeqy74N6OAR3-QhzJ8Qub5rlmQO2xUSfIm7tXn36_hsAGkiZkkgeTbCgEm6vqSjAMaGcbprqwAfsrPg Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bb917538e4004db18d06e6ebfb5f4286 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestServerAdvancedOps-39584839 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb917538e4004db18d06e6ebfb5f4286"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb917538e4004db18d06e6ebfb5f4286"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb917538e4004db18d06e6ebfb5f4286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb917538e4004db18d06e6ebfb5f4286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestServerAdvancedOps-39584839 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bb917538e4004db18d06e6ebfb5f4286 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestServerAdvancedOps-39584839 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestServerAdvancedOps-39584839-project Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 08fad90cb7de446e83ae2c26cf6873e3 Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestServerAdvancedOps-39584839-project Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 13238a0f-2543-4aa1-aee3-fa53bc390876 could not be found. Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '13238a0f-2543-4aa1-aee3-fa53bc390876'} Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13238a0f-2543-4aa1-aee3-fa53bc390876 could not be found. Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13238a0f-2543-4aa1-aee3-fa53bc390876 could not be found. Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:41.724736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13238a0f-2543-4aa1-aee3-fa53bc390876 could not be found. Oct 26 05:26:41.729876 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:41.731965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] Returning 404 to user: Instance 13238a0f-2543-4aa1-aee3-fa53bc390876 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:41.733078 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4efb459-ea6a-4720-8859-351ea7c35cb9 tempest-TestServerAdvancedOps-39584839 tempest-TestServerAdvancedOps-39584839-project] 10.222.0.16 "GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876" status: 404 len: 111 microversion: 2.1 time: 0.075237 Oct 26 05:26:41.734205 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2859/5733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:41 2022] GET /compute/v2.1/servers/13238a0f-2543-4aa1-aee3-fa53bc390876 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:26:41.740977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:41.742744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:41.749909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:41.750716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:41.751404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:41.752479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:41.753177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:41.753875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:41.881142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:41.896186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88d87bde-4399-4c18-85e2-147f7afda909 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1294 microversion: 2.1 time: 0.160650 Oct 26 05:26:41.897088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2860/5734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:41 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:41.905826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a87e78b6-0317-42a0-92ea-5d4df7d53afe tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47091f1550>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:42.048472 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a87e78b6-0317-42a0-92ea-5d4df7d53afe tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 200 len: 344 microversion: 2.1 time: 0.149534 Oct 26 05:26:42.049752 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2861/5735] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:41 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:42.056274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:42.057203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:42.066394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:42.069698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:42.070432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:42.071427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:42.076599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:42.080770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:42.490190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:42.516083 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-618415f2-3e3f-473b-9788-c0c7d16858bf tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1565 microversion: 2.1 time: 0.465000 Oct 26 05:26:42.522177 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2862/5736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:42 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1565 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:42.558405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:42.558903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:42.577503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:42.578007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:42.578460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:42.579175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:42.579824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:42.580441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:43.292390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5b6934c-94c9-40e3-8283-15cb253c8ce6 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.745523 Oct 26 05:26:43.293668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2863/5737] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:26:42 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-interface => generated 284 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:43.298670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:43.299368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:43.312882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:43.317374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:43.318025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:43.318793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:43.319273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:43.326929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:44.314134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:44.326669 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8a4fa4f3-03df-4745-8041-278813443ae4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 1.031213 Oct 26 05:26:44.327416 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2864/5738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:43 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:44.333633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:44.334937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:44.343593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:44.344590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:44.345302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:44.346310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:44.347333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:44.348023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:44.982875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:44.997485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-586bd36c-8059-461f-87a2-41470cf122ca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 0.666281 Oct 26 05:26:45.017445 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2865/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:44 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:45.023383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81331ed3-db6e-4b7f-b8cb-278f68acbde5 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47091c2700>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:45.125981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81331ed3-db6e-4b7f-b8cb-278f68acbde5 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 200 len: 345 microversion: 2.1 time: 0.107387 Oct 26 05:26:45.136346 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2866/5740] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:45 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:45.142819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dce7e25e-8b6d-452a-baf0-a4b98d41b615 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Action: 'create', calling method: .version_select at 0x7f4709321310>, body: {"snapshot": {"volume_id": "f9151dd1-7cac-4bf0-870b-1a6dbd008b06", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1371211754"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:45.423389 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dce7e25e-8b6d-452a-baf0-a4b98d41b615 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.284832 Oct 26 05:26:45.424636 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2867/5741] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 26 05:26:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:45.438887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4979682a-ee8b-413c-86c9-a0b444ae623b req-6d1048fc-24dc-49de-8490-71a7c95274c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "becc002f-e3bf-4495-8328-d51e854c579d", "tag": "4a21977f-e502-4728-8ce9-6f5d8bf1c4b8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:45.482421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4979682a-ee8b-413c-86c9-a0b444ae623b req-6d1048fc-24dc-49de-8490-71a7c95274c4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:45.483431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4979682a-ee8b-413c-86c9-a0b444ae623b req-6d1048fc-24dc-49de-8490-71a7c95274c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:45.485064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4979682a-ee8b-413c-86c9-a0b444ae623b req-6d1048fc-24dc-49de-8490-71a7c95274c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:45.512705 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4979682a-ee8b-413c-86c9-a0b444ae623b req-6d1048fc-24dc-49de-8490-71a7c95274c4 service nova] Creating event network-changed:4a21977f-e502-4728-8ce9-6f5d8bf1c4b8 for instance becc002f-e3bf-4495-8328-d51e854c579d on n-h2-862416-4 Oct 26 05:26:45.529356 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4979682a-ee8b-413c-86c9-a0b444ae623b req-6d1048fc-24dc-49de-8490-71a7c95274c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094672 Oct 26 05:26:45.530744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2868/5742] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:45.541124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:45.542278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:45.549715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:45.550520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:45.551073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:45.551902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:45.552724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:45.553244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:46.591047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:46.601340 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53333279-7db9-421b-8372-3d235e2dacbb tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 1.067446 Oct 26 05:26:46.617860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2869/5743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:45 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:46.623835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-26a3213d-2f67-4466-a8b3-c3ae503b874e tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f470920d8b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:46.658777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-26a3213d-2f67-4466-a8b3-c3ae503b874e tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 200 len: 287 microversion: 2.1 time: 0.039472 Oct 26 05:26:46.659829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2870/5744] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:26:46 2022] GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:46.665869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:46.666693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:46.669684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:46.680723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:46.681441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:46.682049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:46.682957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:46.683579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:46.684173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:47.288997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:47.306697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-094c8d32-b0ab-4148-9116-3a4102239a83 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 0.644940 Oct 26 05:26:47.307713 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2871/5745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:46 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:47.316183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd0046bf-a927-43b6-9422-3e24c4266299 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47092e9d30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:47.378435 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd0046bf-a927-43b6-9422-3e24c4266299 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.066088 Oct 26 05:26:47.386342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2872/5746] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 26 05:26:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:47.392103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63ed535f-3198-4cde-9888-4ac1f8f06605 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47092691f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:47.449496 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63ed535f-3198-4cde-9888-4ac1f8f06605 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 200 len: 287 microversion: 2.1 time: 0.062036 Oct 26 05:26:47.454692 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2873/5747] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:26:47 2022] GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:26:47.612293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:47.632434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:47.634053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:47.637661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:47.647522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:47.648127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:47.649635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:47.650547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:47.651326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:47.652096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:47.679493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:48.211503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:48.311498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:48.329873 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad11528d-07cf-4032-a323-df85d534c62f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 0.702918 Oct 26 05:26:48.331115 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2874/5748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:47 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:48.337649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7d15d51a-8501-406b-9169-594f2ec6baf8 req-548424c6-d53c-4a6c-be8e-dea44af7aca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcdd7b4a-3942-4cf8-99e0-998ee1a6906b", "tag": "77736840-b3a7-44f1-b25f-a14647cdc874"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:48.350234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7d15d51a-8501-406b-9169-594f2ec6baf8 req-548424c6-d53c-4a6c-be8e-dea44af7aca5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:48.351544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7d15d51a-8501-406b-9169-594f2ec6baf8 req-548424c6-d53c-4a6c-be8e-dea44af7aca5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:48.352256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7d15d51a-8501-406b-9169-594f2ec6baf8 req-548424c6-d53c-4a6c-be8e-dea44af7aca5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:48.368412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7d15d51a-8501-406b-9169-594f2ec6baf8 req-548424c6-d53c-4a6c-be8e-dea44af7aca5 service nova] Creating event network-changed:77736840-b3a7-44f1-b25f-a14647cdc874 for instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b on n-h2-862416-4 Oct 26 05:26:48.376283 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7d15d51a-8501-406b-9169-594f2ec6baf8 req-548424c6-d53c-4a6c-be8e-dea44af7aca5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043030 Oct 26 05:26:48.377515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2875/5749] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:48.385301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:48.386516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:48.410724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:48.411619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:48.412354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:48.415387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:48.416154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:48.416779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:48.469984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:26:48.470479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:26:48.471011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:26:48.471434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:26:48.471866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:26:48.488948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:48.489546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:48.490004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:48.490745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:48.491744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:48.492252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:48.516504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Getting quotas for project 821c88694a6546eebf13b429a34bf057. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:26:48.524777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Getting quotas for user 05121fe0d9804c11a7403ddffd37f42f and project 821c88694a6546eebf13b429a34bf057. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:26:48.748665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:48.758369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:26:48.761068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a96c52b1-006c-432d-9192-08397de1da50',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='216c4491-a9f3-474e-b53f-34b1971ca05c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dda87b5-b8d2-4929-8c9a-b4f49fa4f1a1',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:26:48.779420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=16 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:48.974252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:48.987426 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8ffa963-ae75-45cd-ae45-67a4af17091c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 0.607045 Oct 26 05:26:48.987679 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2876/5750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:48 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:49.006563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad72a2a4-2816-49c6-936a-51d80278a385 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47091fb280>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:49.071861 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad72a2a4-2816-49c6-936a-51d80278a385 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 200 len: 288 microversion: 2.1 time: 0.083262 Oct 26 05:26:49.079140 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2877/5751] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:26:48 2022] GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:49.087865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b60bb7a-fc97-4c60-9b06-afb475f436b6 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f4709247b80>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:49.176234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b60bb7a-fc97-4c60-9b06-afb475f436b6 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 202 len: 0 microversion: 2.1 time: 0.095615 Oct 26 05:26:49.176855 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2878/5752] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 26 05:26:49 2022] DELETE /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:26:49.187912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-169c0eb4-4abc-4382-a15d-90b24825415b tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47092478b0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:49.238066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-169c0eb4-4abc-4382-a15d-90b24825415b tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 200 len: 287 microversion: 2.1 time: 0.054187 Oct 26 05:26:49.245715 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2879/5753] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:26:49 2022] GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:49.356189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:49.356818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:49.368386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:49.369333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:49.370671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:49.382239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:49.384358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:49.388385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:49.448856 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35053f0e-94b8-41a3-a089-cf79b46f289e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.228140 Oct 26 05:26:49.462951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2875/5754] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Oct 26 05:26:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 11243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:26:49.484733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-904db249-4dbe-44b1-a128-f1b42af10b49 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:49.487153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-904db249-4dbe-44b1-a128-f1b42af10b49 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:49.502518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:49.985097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-904db249-4dbe-44b1-a128-f1b42af10b49 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:50.008607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-904db249-4dbe-44b1-a128-f1b42af10b49 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:50.014771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-904db249-4dbe-44b1-a128-f1b42af10b49 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:50.016511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-904db249-4dbe-44b1-a128-f1b42af10b49 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1285 microversion: 2.32 time: 0.543713 Oct 26 05:26:50.019035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2876/5755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:49 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1285 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:26:50.034800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:50.035437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:50.061904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:50.062759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:50.063399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:50.065559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:50.070216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:50.071336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:50.379641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:50.416689 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a47a2b7d-71f0-4d67-87d6-e3bba265a08e tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 1.066146 Oct 26 05:26:50.418105 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2880/5756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:49 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:50.425031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1675701b-e578-4824-92ab-89457687570a tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f4709247820>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:50.476456 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1675701b-e578-4824-92ab-89457687570a tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 200 len: 287 microversion: 2.1 time: 0.055451 Oct 26 05:26:50.478311 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2881/5757] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:26:50 2022] GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:50.485342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-83117c9e-9995-48f0-b06a-88b74744c75b req-284a4a56-c039-4e62-92d4-815f4b9d1e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7871b5f8-9765-4a97-a309-dfe6d5dcc6a8", "tag": "51f1501d-e68e-456a-8f5a-9f5e4c91fd83"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:50.519703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-83117c9e-9995-48f0-b06a-88b74744c75b req-284a4a56-c039-4e62-92d4-815f4b9d1e1b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:50.520200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-83117c9e-9995-48f0-b06a-88b74744c75b req-284a4a56-c039-4e62-92d4-815f4b9d1e1b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:50.520645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-83117c9e-9995-48f0-b06a-88b74744c75b req-284a4a56-c039-4e62-92d4-815f4b9d1e1b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:50.543824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-83117c9e-9995-48f0-b06a-88b74744c75b req-284a4a56-c039-4e62-92d4-815f4b9d1e1b service nova] Creating event network-changed:51f1501d-e68e-456a-8f5a-9f5e4c91fd83 for instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 on n-h1-862416-4 Oct 26 05:26:50.549168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-83117c9e-9995-48f0-b06a-88b74744c75b req-284a4a56-c039-4e62-92d4-815f4b9d1e1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069246 Oct 26 05:26:50.550312 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2882/5758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:50.757918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:50.771222 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2db75b69-bdde-45bc-830b-9366e6d609e4 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 0.749232 Oct 26 05:26:50.773415 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2877/5759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:50 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:51.051694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-33452629-e4e1-4b5a-9042-6214580fe881 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:51.052655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-33452629-e4e1-4b5a-9042-6214580fe881 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:51.270088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-33452629-e4e1-4b5a-9042-6214580fe881 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:51.283296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-33452629-e4e1-4b5a-9042-6214580fe881 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:51.289242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-33452629-e4e1-4b5a-9042-6214580fe881 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:51.291786 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-33452629-e4e1-4b5a-9042-6214580fe881 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1285 microversion: 2.32 time: 0.246817 Oct 26 05:26:51.296302 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2883/5760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:51 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:26:51.445845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:51.446418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:51.457038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:51.462439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:51.465042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:51.467106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:51.472892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:51.473278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:51.490370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a38feb6-5193-40e7-ac31-36f4180607da tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47092339d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:51.540296 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4a38feb6-5193-40e7-ac31-36f4180607da tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] HTTP exception thrown: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a38feb6-5193-40e7-ac31-36f4180607da tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Request method failure captured: Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c HTTP/1.1 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMUQrcj2FIxelbeAutXJKVu3ELG0hsl9Fp_jzVLeNB2DV-eQRxpDajVN401k-tSfoMy_2PTi9n3nzImzjZz7xvsm20kJV6EjsdoBrjOXi8jhpNdJlKZVdyJZQdrq4lGIlXtOYKrIbYeJtG7XAxfGIe4-EWO1UqIyvedGhoqMuOqL0Rk Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2d2beb5ebd4d4abca2e546232d2bcecf Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: exception: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0c446dc0-fbfa-4edb-80fa-a53ae6143f0c'} Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. (HTTP 404) (Request-ID: req-aa18ae96-d1ef-43d1-bc92-907fd0bef510) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:26:51.555206 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. Oct 26 05:26:51.560738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:51.566019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a38feb6-5193-40e7-ac31-36f4180607da tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Returning 404 to user: Snapshot 0c446dc0-fbfa-4edb-80fa-a53ae6143f0c could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:51.567063 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a38feb6-5193-40e7-ac31-36f4180607da tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c" status: 404 len: 111 microversion: 2.1 time: 0.080561 Oct 26 05:26:51.567809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2884/5761] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:26:51 2022] GET /compute/v2.1/os-snapshots/0c446dc0-fbfa-4edb-80fa-a53ae6143f0c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:26:51.576492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e2978821-9577-4fe1-915a-07d04c2839fb tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f470920dd30>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:51.698015 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e2978821-9577-4fe1-915a-07d04c2839fb tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 202 len: 0 microversion: 2.1 time: 0.125404 Oct 26 05:26:51.699108 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2885/5762] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:26:51 2022] DELETE /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:26:51.707064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8f56d108-4c03-4853-beb6-e1a2cfb4a18b tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47092339d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:51.823656 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8f56d108-4c03-4853-beb6-e1a2cfb4a18b tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 200 len: 344 microversion: 2.1 time: 0.120334 Oct 26 05:26:51.824716 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2886/5763] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:51 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:51.829607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:51.830324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:51.844947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:51.845742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:51.846352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:51.848711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:51.854355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:51.855090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:51.900434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:51.910118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3b5f9270-0d90-4265-94df-eb8532443aab tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 0.469847 Oct 26 05:26:51.922104 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2878/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:51 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:52.152924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:52.161750 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e1d0d01-7ba5-4dec-8453-12b59963245b tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 0.335643 Oct 26 05:26:52.166410 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2887/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:51 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:52.321740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:52.322811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:52.331582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:52.334094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:52.337129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:52.340903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:52.342190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:52.343102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:52.481607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:52.506151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:52.507854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:52.511879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-24205083-5507-4204-90e8-10361da3a844 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1583 microversion: 2.32 time: 0.193201 Oct 26 05:26:52.514764 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2879/5766] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:52 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1583 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:26:52.838244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e043846-07df-4626-9039-2e84319d86e9 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47092339d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:52.923158 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e043846-07df-4626-9039-2e84319d86e9 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 200 len: 344 microversion: 2.1 time: 0.088907 Oct 26 05:26:52.924225 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2888/5767] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:52 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:52.946444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:52.947070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:52.962587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:52.963094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:52.963545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:52.964268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:52.964734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:52.965170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:53.191790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:53.192672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:53.206816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:53.207616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:53.208236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:53.209119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:53.212236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:53.212894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:53.505068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:53.517971 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3510b349-0926-49e3-9e69-cdf97282aa16 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 0.573833 Oct 26 05:26:53.522811 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2880/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:52 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:53.545780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:53.546934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:53.559266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:53.560040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:53.560687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:53.566991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:53.567707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:53.569015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:53.762053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:53.790092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:53.792119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:53.795534 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1ab018fd-462e-44f7-b094-6467d153a8de tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1593 microversion: 2.32 time: 0.254536 Oct 26 05:26:53.796975 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2881/5769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:53 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1593 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:26:53.938233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de924a3b-efe2-401d-b40e-10fa8afc4b98 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f4709e47f70>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:54.042550 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de924a3b-efe2-401d-b40e-10fa8afc4b98 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 200 len: 344 microversion: 2.1 time: 0.108226 Oct 26 05:26:54.049277 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2882/5770] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:53 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:26:54.049277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0c3ae88f-af58-4e43-a4da-21f08824e12f req-4e016034-674f-45c6-a545-c4c53fefb263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becc002f-e3bf-4495-8328-d51e854c579d", "name": "network-vif-plugged", "status": "completed", "tag": "4a21977f-e502-4728-8ce9-6f5d8bf1c4b8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:54.068364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0c3ae88f-af58-4e43-a4da-21f08824e12f req-4e016034-674f-45c6-a545-c4c53fefb263 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:54.068869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0c3ae88f-af58-4e43-a4da-21f08824e12f req-4e016034-674f-45c6-a545-c4c53fefb263 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:54.069965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0c3ae88f-af58-4e43-a4da-21f08824e12f req-4e016034-674f-45c6-a545-c4c53fefb263 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:54.098755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0c3ae88f-af58-4e43-a4da-21f08824e12f req-4e016034-674f-45c6-a545-c4c53fefb263 service nova] Creating event network-vif-plugged:4a21977f-e502-4728-8ce9-6f5d8bf1c4b8 for instance becc002f-e3bf-4495-8328-d51e854c579d on n-h2-862416-4 Oct 26 05:26:54.120774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0c3ae88f-af58-4e43-a4da-21f08824e12f req-4e016034-674f-45c6-a545-c4c53fefb263 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074213 Oct 26 05:26:54.123441 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2883/5771] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:54.185088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:54.195023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-897d53df-2681-44fe-8cdd-d51afa8d6344 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 1.007091 Oct 26 05:26:54.205621 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2889/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:53 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:54.559604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:54.561034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:54.574469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:54.574972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:54.580255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:54.581590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:54.581779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:54.582204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:54.827760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:54.828881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:54.837728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:54.838643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:54.839325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:54.840314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:54.841091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:54.842024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:54.986822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:55.003914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:55.007199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:55.012412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-398ef768-7c30-43fd-8cb8-b2420dfd25ef tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1593 microversion: 2.32 time: 0.189733 Oct 26 05:26:55.026009 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2890/5773] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:54 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1593 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:26:55.060252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64e3b448-5c13-4d49-b21f-25bd977ec134 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47091aa430>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:55.065222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:55.098139 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a78fecca-b3d4-4089-a978-596bb749a1c0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 0.540728 Oct 26 05:26:55.099159 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2884/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:54 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:55.114892 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-64e3b448-5c13-4d49-b21f-25bd977ec134 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] HTTP exception thrown: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64e3b448-5c13-4d49-b21f-25bd977ec134 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Request method failure captured: Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 HTTP/1.1 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMUQrcj2FIxelbeAutXJKVu3ELG0hsl9Fp_jzVLeNB2DV-eQRxpDajVN401k-tSfoMy_2PTi9n3nzImzjZz7xvsm20kJV6EjsdoBrjOXi8jhpNdJlKZVdyJZQdrq4lGIlXtOYKrIbYeJtG7XAxfGIe4-EWO1UqIyvedGhoqMuOqL0Rk Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2d2beb5ebd4d4abca2e546232d2bcecf Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: exception: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f9151dd1-7cac-4bf0-870b-1a6dbd008b06'} Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. (HTTP 404) (Request-ID: req-d30797bf-20f0-40fd-98c6-e49b028b1ee1) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:26:55.117410 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.122835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64e3b448-5c13-4d49-b21f-25bd977ec134 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Returning 404 to user: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:55.126885 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64e3b448-5c13-4d49-b21f-25bd977ec134 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 404 len: 109 microversion: 2.1 time: 0.073450 Oct 26 05:26:55.134327 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2891/5775] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:55 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:26:55.138946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32e04d3c-f098-456a-8c26-c72c56323b97 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f470aac88b0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:55.202636 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-32e04d3c-f098-456a-8c26-c72c56323b97 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] HTTP exception thrown: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32e04d3c-f098-456a-8c26-c72c56323b97 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Request method failure captured: Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 HTTP/1.1 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMUQrcj2FIxelbeAutXJKVu3ELG0hsl9Fp_jzVLeNB2DV-eQRxpDajVN401k-tSfoMy_2PTi9n3nzImzjZz7xvsm20kJV6EjsdoBrjOXi8jhpNdJlKZVdyJZQdrq4lGIlXtOYKrIbYeJtG7XAxfGIe4-EWO1UqIyvedGhoqMuOqL0Rk Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 2d2beb5ebd4d4abca2e546232d2bcecf Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: method: Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: exception: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f9151dd1-7cac-4bf0-870b-1a6dbd008b06'} Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. (HTTP 404) (Request-ID: req-bb4fe2cd-1ecd-4a3f-9e8e-160bee745274) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:26:55.204541 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32e04d3c-f098-456a-8c26-c72c56323b97 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Returning 404 to user: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32e04d3c-f098-456a-8c26-c72c56323b97 tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 404 len: 109 microversion: 2.1 time: 0.071389 Oct 26 05:26:55.209275 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2885/5776] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:26:55 2022] DELETE /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:26:55.220049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d12b1fdf-5201-45ac-bc7b-8a24d65d94ca tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Calling method '.version_select at 0x7f47091e13a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:55.235918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:55.237134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:55.259367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:55.259877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:55.260325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:55.264881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:55.265639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:55.267450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:55.284964 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d12b1fdf-5201-45ac-bc7b-8a24d65d94ca tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] HTTP exception thrown: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d12b1fdf-5201-45ac-bc7b-8a24d65d94ca tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Request method failure captured: Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 HTTP/1.1 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMUQrcj2FIxelbeAutXJKVu3ELG0hsl9Fp_jzVLeNB2DV-eQRxpDajVN401k-tSfoMy_2PTi9n3nzImzjZz7xvsm20kJV6EjsdoBrjOXi8jhpNdJlKZVdyJZQdrq4lGIlXtOYKrIbYeJtG7XAxfGIe4-EWO1UqIyvedGhoqMuOqL0Rk Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a43c65b70de04dcb90417cd7d3fe9ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a43c65b70de04dcb90417cd7d3fe9ecc Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-779696035 Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 2d2beb5ebd4d4abca2e546232d2bcecf Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesSnapshotsTestJSON-779696035-project Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: method: Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: exception: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f9151dd1-7cac-4bf0-870b-1a6dbd008b06'} Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. (HTTP 404) (Request-ID: req-e053b7eb-bf59-416c-abc2-a79835873201) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 05:26:55.288688 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d12b1fdf-5201-45ac-bc7b-8a24d65d94ca tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] Returning 404 to user: Volume f9151dd1-7cac-4bf0-870b-1a6dbd008b06 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:26:55.293484 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d12b1fdf-5201-45ac-bc7b-8a24d65d94ca tempest-VolumesSnapshotsTestJSON-779696035 tempest-VolumesSnapshotsTestJSON-779696035-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06" status: 404 len: 109 microversion: 2.1 time: 0.077476 Oct 26 05:26:55.296385 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2892/5777] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 26 05:26:55 2022] GET /compute/v2.1/os-volumes/f9151dd1-7cac-4bf0-870b-1a6dbd008b06 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:26:55.951868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:55.982644 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c924d888-c2e5-406e-9e6a-1bc1b77828a0 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1361 microversion: 2.1 time: 0.748533 Oct 26 05:26:55.983705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2886/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:55 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1361 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:26:56.041760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:56.043063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:56.063897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:56.068702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:56.070121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:56.071232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:56.071871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:56.072699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:56.124195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:56.124822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:56.132369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:56.133423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:56.133640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:56.134251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:56.134714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:56.135149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:57.391001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:57.410433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:57.414561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:57.427955 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-749e5a64-a206-43df-a7db-63fc082bf941 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1661 microversion: 2.32 time: 1.390669 Oct 26 05:26:57.429247 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2893/5779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:56 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1661 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:26:57.434269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:57.435211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:57.446259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:57.447130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:57.447844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:57.448804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:57.449554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:57.450222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:57.527425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:57.536443 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c16ac18a-f90a-4054-8a87-b05da8c8b8fe tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 1.416091 Oct 26 05:26:57.537029 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2887/5780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:56 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:57.713632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:57.733628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-32c6d92a-383c-436e-a15f-9cba15f1d8e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1548 microversion: 2.1 time: 0.302896 Oct 26 05:26:57.735341 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2894/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:57 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1548 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:26:57.763683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:57.764190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:57.777556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:57.778147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:57.778601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:57.779326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:57.779790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:57.781386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:57.960650 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa7efe16-f026-427f-ba10-22bbc1dac146 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200854 Oct 26 05:26:57.970333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2888/5782] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:26:57 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:58.026726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-891481ae-98a1-4874-b1f3-4a3cdf8e1e74 req-6b172aea-a553-49aa-a665-fffac72c17cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdd7b4a-3942-4cf8-99e0-998ee1a6906b", "name": "network-vif-plugged", "status": "completed", "tag": "77736840-b3a7-44f1-b25f-a14647cdc874"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:26:58.048192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-891481ae-98a1-4874-b1f3-4a3cdf8e1e74 req-6b172aea-a553-49aa-a665-fffac72c17cb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:58.051323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-891481ae-98a1-4874-b1f3-4a3cdf8e1e74 req-6b172aea-a553-49aa-a665-fffac72c17cb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:58.052029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-891481ae-98a1-4874-b1f3-4a3cdf8e1e74 req-6b172aea-a553-49aa-a665-fffac72c17cb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:58.082445 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-891481ae-98a1-4874-b1f3-4a3cdf8e1e74 req-6b172aea-a553-49aa-a665-fffac72c17cb service nova] Creating event network-vif-plugged:77736840-b3a7-44f1-b25f-a14647cdc874 for instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b on n-h2-862416-4 Oct 26 05:26:58.093500 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-891481ae-98a1-4874-b1f3-4a3cdf8e1e74 req-6b172aea-a553-49aa-a665-fffac72c17cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073955 Oct 26 05:26:58.096668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2895/5783] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:26:58.458275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:58.458903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:58.474038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:58.475078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:58.477749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:58.478821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:58.479760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:58.480727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:58.555924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:26:58.561404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:26:58.562177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:26:58.583237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:58.583849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:58.584297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:58.585561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:26:58.586017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:26:58.586446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:26:59.282643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:59.306547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:59.310057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:59.310747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:26:59.313291 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c76160b2-dcb1-49f0-b698-599b22737b18 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1708 microversion: 2.32 time: 0.859214 Oct 26 05:26:59.317562 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2889/5784] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:26:58 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1708 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:26:59.328060 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a884a539-af78-44e2-a864-d87fec09bad0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 0.771850 Oct 26 05:26:59.331398 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2896/5785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:26:58 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:00.348702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:00.354039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:00.354655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:00.355679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:00.360442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:00.371672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:00.377200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:00.378890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:00.380106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:00.382125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:00.383452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:00.385564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:00.388511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:00.389133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:00.393118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:00.395076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:00.396395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:01.275271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:01.512164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:01.527616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3f6d6f27-1e72-402a-b4c3-c1acfe849acc tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1309 microversion: 2.1 time: 1.177729 Oct 26 05:27:01.545425 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2897/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:00 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1309 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:01.699867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:01.712581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:01.719377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:01.720927 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-098973fb-503b-434a-9ae4-a28abc34ac80 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1755 microversion: 2.32 time: 1.376167 Oct 26 05:27:01.734086 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2890/5787] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:00 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1755 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:02.549539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-481956f4-9ba1-4a2c-99cd-ff55f485be70 req-3a04ec29-bafa-41d3-90fc-ac9d80f02cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "becc002f-e3bf-4495-8328-d51e854c579d", "tag": "4a21977f-e502-4728-8ce9-6f5d8bf1c4b8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:02.558565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:02.559676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:02.570630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:02.571581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:02.572261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:02.573237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:02.573989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:02.574809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:02.577821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-481956f4-9ba1-4a2c-99cd-ff55f485be70 req-3a04ec29-bafa-41d3-90fc-ac9d80f02cb0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:02.578589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-481956f4-9ba1-4a2c-99cd-ff55f485be70 req-3a04ec29-bafa-41d3-90fc-ac9d80f02cb0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:02.579241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-481956f4-9ba1-4a2c-99cd-ff55f485be70 req-3a04ec29-bafa-41d3-90fc-ac9d80f02cb0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:02.613794 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-481956f4-9ba1-4a2c-99cd-ff55f485be70 req-3a04ec29-bafa-41d3-90fc-ac9d80f02cb0 service nova] Creating event network-changed:4a21977f-e502-4728-8ce9-6f5d8bf1c4b8 for instance becc002f-e3bf-4495-8328-d51e854c579d on n-h2-862416-4 Oct 26 05:27:02.622615 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-481956f4-9ba1-4a2c-99cd-ff55f485be70 req-3a04ec29-bafa-41d3-90fc-ac9d80f02cb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079397 Oct 26 05:27:02.626916 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2898/5788] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:02.752370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:02.753241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:02.768538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:02.770736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:02.771983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:02.775724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:02.778087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:02.781522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:03.265060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:03.276062 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3769a3db-00de-41ac-9d5c-f53e5422dda0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1490 microversion: 2.1 time: 0.721307 Oct 26 05:27:03.278151 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2891/5789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:02 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1490 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:03.306331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2046498692"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:03.309903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:03.323095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:03.326064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:03.326721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:03.329924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:03.330687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:03.331298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:03.469804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-33ba989e-69ac-46ae-995d-1a015cd5d50a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "PUT /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1075 microversion: 2.1 time: 0.168094 Oct 26 05:27:03.471262 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2892/5790] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:27:03 2022] PUT /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1075 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:03.495498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:03.496515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:03.507511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:03.508420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:03.509874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:03.512194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:03.513143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:03.514145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:03.595993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:03.614294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:03.622130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:03.624236 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f00aac4-05d7-4f5c-8d26-c8684eee3bd0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1755 microversion: 2.32 time: 0.877876 Oct 26 05:27:03.625616 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2899/5791] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:02 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1755 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:03.860557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:03.885819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c68c8d4-a79c-4347-bbd2-60257d41f895 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1501 microversion: 2.1 time: 0.397231 Oct 26 05:27:03.888332 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2893/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:03 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1501 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:03.915148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:03.915987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:03.932004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:03.932674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:03.934255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:03.936872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:03.938981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:03.942138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:04.358037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:04.376122 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-68cf30c7-4fed-4a85-a008-7cd63d17f1ce tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1501 microversion: 2.1 time: 0.466706 Oct 26 05:27:04.394657 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2900/5793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:03 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:04.406223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d287f056-8f83-4b85-bcf3-2b6a1133d324 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:04.424875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d287f056-8f83-4b85-bcf3-2b6a1133d324 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:04.427668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d287f056-8f83-4b85-bcf3-2b6a1133d324 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:04.428895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d287f056-8f83-4b85-bcf3-2b6a1133d324 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:04.489057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d287f056-8f83-4b85-bcf3-2b6a1133d324 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Going to try to stop instance {{(pid=120586) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:27:04.574830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:04.623017 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d287f056-8f83-4b85-bcf3-2b6a1133d324 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "POST /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b/action" status: 202 len: 0 microversion: 2.1 time: 0.218296 Oct 26 05:27:04.630717 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2894/5794] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:27:04 2022] POST /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:27:04.639721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:04.640954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:04.655304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:04.656014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:04.661988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:04.663268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:04.665156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:04.665823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:04.666738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:04.667394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:04.668063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:04.668674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:04.670280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:04.678601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:04.679107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:04.679557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:05.909127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:05.927755 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b468d641-98f2-4218-b0d4-525a29f75dee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 1.291697 Oct 26 05:27:05.931016 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2901/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:04 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:05.941046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:05.952628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:05.954362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:05.955724 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f22ae442-553a-4be6-a508-b8269c53d917 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1802 microversion: 2.32 time: 1.304811 Oct 26 05:27:05.956812 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2895/5796] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:04 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1802 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:06.956524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:06.960049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:06.983127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:06.984557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:06.992885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:06.993777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:06.994673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:06.996017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:06.996430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:06.997909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:06.998655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:06.999395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:07.000115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:07.002388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:07.003011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:07.003567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:07.344421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:07.369005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:07.372431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:07.378446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7fbed301-761f-47c9-bc71-911112501db3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1802 microversion: 2.32 time: 0.399750 Oct 26 05:27:07.389152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2896/5797] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:06 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1802 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:07.482348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:07.494575 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23a0d2d8-8a99-4464-a39b-5321e2139125 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.544621 Oct 26 05:27:07.511829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2902/5798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:06 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:08.413493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:08.414203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:08.425273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:08.425820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:08.426268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:08.430166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:08.433532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:08.434400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:08.530162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:08.530775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:08.549109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:08.555722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:08.556435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:08.558629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:08.559981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:08.562494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:09.013042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:09.034920 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fe464ec9-5a4b-4255-b74c-5b33c8f98ff9 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.517471 Oct 26 05:27:09.036849 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2903/5799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:08 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:09.080480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:09.094689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:09.098043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:09.104907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a5ab01f-ce17-4b94-8d69-3e2a8f44d450 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1849 microversion: 2.32 time: 0.697811 Oct 26 05:27:09.119031 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2897/5800] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:08 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1849 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:10.063590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:10.064189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:10.081479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:10.081986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:10.085853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:10.088036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:10.089993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:10.095091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:10.143258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:10.144711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:10.166240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:10.166745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:10.167173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:10.169033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:10.172861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:10.173564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:10.735864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:10.739176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:10.754515 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa200eed-5f0d-4b41-9ff5-9db1a61494a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.692964 Oct 26 05:27:10.757052 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2904/5801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:10 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:10.888526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:10.900557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d60793b3-3156-4119-88ed-f5ed3296ffa2 req-47917b5e-1cc9-4df6-8fec-2baa6cfc57f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "c76aa5e8-aa77-4513-baad-bf666234842a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:10.908243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:10.911616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:10.913409 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e53f51f-431c-4280-a279-b23ee83be7f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1849 microversion: 2.32 time: 0.780433 Oct 26 05:27:10.913993 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2898/5802] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:10 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1849 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:10.923306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d60793b3-3156-4119-88ed-f5ed3296ffa2 req-47917b5e-1cc9-4df6-8fec-2baa6cfc57f5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:10.924466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d60793b3-3156-4119-88ed-f5ed3296ffa2 req-47917b5e-1cc9-4df6-8fec-2baa6cfc57f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:10.925271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d60793b3-3156-4119-88ed-f5ed3296ffa2 req-47917b5e-1cc9-4df6-8fec-2baa6cfc57f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:10.979841 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d60793b3-3156-4119-88ed-f5ed3296ffa2 req-47917b5e-1cc9-4df6-8fec-2baa6cfc57f5 service nova] Creating event network-changed:c76aa5e8-aa77-4513-baad-bf666234842a for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:10.994948 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d60793b3-3156-4119-88ed-f5ed3296ffa2 req-47917b5e-1cc9-4df6-8fec-2baa6cfc57f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099103 Oct 26 05:27:10.998057 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2905/5803] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:27:11.783994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:11.785511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:11.796389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:11.810125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:11.810579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:11.811329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:11.811786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:11.812415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:11.946261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:11.947957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:11.965463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:11.976305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:11.978626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:11.979712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:11.982000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:11.990459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:12.459531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:12.470849 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f33a060f-929e-407f-aa50-033967137c53 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.690614 Oct 26 05:27:12.473759 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2899/5804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:11 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:12.742705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:12.779750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:12.782907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:12.784554 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e4d0828-efcc-4e6a-a063-665c0636aee3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1849 microversion: 2.32 time: 0.844585 Oct 26 05:27:12.803981 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2906/5805] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:11 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1849 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:13.497738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:13.498375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:13.511924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:13.514037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:13.515640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:13.518213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:13.525934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:13.527871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:13.815233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:13.816583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:13.830083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:13.831788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:13.834256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:13.836521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:13.838071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:13.840150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:13.929682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:13.941213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c6e6ef33-7024-48fe-80b9-dfaabc6b2ec8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.448478 Oct 26 05:27:13.948715 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2900/5806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:13 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:14.235560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-276ebe67-a802-422b-8c83-2bd90f7fc020 req-0f645b59-3352-4d96-bc68-7343b97d4809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "1ce8d95a-d297-4c8b-9381-aa9252c03ccb"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:14.293479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-276ebe67-a802-422b-8c83-2bd90f7fc020 req-0f645b59-3352-4d96-bc68-7343b97d4809 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:14.295659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-276ebe67-a802-422b-8c83-2bd90f7fc020 req-0f645b59-3352-4d96-bc68-7343b97d4809 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:14.296612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-276ebe67-a802-422b-8c83-2bd90f7fc020 req-0f645b59-3352-4d96-bc68-7343b97d4809 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:14.331600 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-276ebe67-a802-422b-8c83-2bd90f7fc020 req-0f645b59-3352-4d96-bc68-7343b97d4809 service nova] Creating event network-changed:1ce8d95a-d297-4c8b-9381-aa9252c03ccb for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:14.373118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-276ebe67-a802-422b-8c83-2bd90f7fc020 req-0f645b59-3352-4d96-bc68-7343b97d4809 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145316 Oct 26 05:27:14.378487 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2901/5807] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:14.982006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:14.985035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:15.002671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:15.003641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:15.005986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:15.009063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:15.010363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:15.011119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:15.315758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:15.334181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:15.335975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:15.337417 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f43934dd-c06a-4cc6-af39-20fa451d75d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1870 microversion: 2.32 time: 1.527543 Oct 26 05:27:15.356354 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2907/5808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:13 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1870 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:15.676107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:15.686636 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a4ff6b7-85e9-47a1-95ab-0584600b8a04 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.713426 Oct 26 05:27:15.687225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2902/5809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:14 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:16.378719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:16.378719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:16.387101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:16.387878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:16.388488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:16.389438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:16.390068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:16.390708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:16.716045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:16.716753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:16.738208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:16.743916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:16.747057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:16.748786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:16.749343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:16.753458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:16.913079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:16.933606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:16.948236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:16.951858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac146cab-0cd7-441a-9ad9-21ccbcaf566d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1870 microversion: 2.32 time: 0.578265 Oct 26 05:27:16.969779 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2908/5810] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:16 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1870 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:17.222732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:17.232447 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa4611b2-f8d0-42df-841e-7d059b839528 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.522875 Oct 26 05:27:17.234083 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2903/5811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:16 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:17.983017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:17.984571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:17.988371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=54 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:18.007577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:18.008312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:18.008937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:18.009869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:18.010947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:18.011984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:18.264312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:18.266380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:18.311822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:18.313341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:18.314078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:18.315003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:18.316121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:18.316738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:18.476147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:18.511984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:18.525039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:18.527023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17dc6e1f-0608-468f-9182-af35a49efa3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1891 microversion: 2.32 time: 0.547990 Oct 26 05:27:18.528148 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2909/5812] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:17 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1891 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:18.547216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4c15311c-8186-42f0-a98b-6ef4774aa865 req-2f192817-7c3c-4b63-97f4-f0bfddb3e5fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "ee4a74ea-53cf-4b86-b64f-6e9b3d1620ad"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:18.562922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4c15311c-8186-42f0-a98b-6ef4774aa865 req-2f192817-7c3c-4b63-97f4-f0bfddb3e5fa service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:18.563398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4c15311c-8186-42f0-a98b-6ef4774aa865 req-2f192817-7c3c-4b63-97f4-f0bfddb3e5fa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:18.563826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4c15311c-8186-42f0-a98b-6ef4774aa865 req-2f192817-7c3c-4b63-97f4-f0bfddb3e5fa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:18.587044 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4c15311c-8186-42f0-a98b-6ef4774aa865 req-2f192817-7c3c-4b63-97f4-f0bfddb3e5fa service nova] Creating event network-changed:ee4a74ea-53cf-4b86-b64f-6e9b3d1620ad for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:18.605600 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4c15311c-8186-42f0-a98b-6ef4774aa865 req-2f192817-7c3c-4b63-97f4-f0bfddb3e5fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075910 Oct 26 05:27:18.607190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:18.609588 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2910/5813] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:18.635600 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca12fc48-1ad0-475c-a5f1-2b9c475ddc6f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.376261 Oct 26 05:27:18.641617 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2904/5814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:18 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:19.559780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:19.560726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:19.574313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:19.574815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:19.575260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:19.575972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:19.576427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:19.576928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:19.669594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:19.670914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:19.674237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=56 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:19.692513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:19.693243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:19.694322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:19.695052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:19.695514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:19.696184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:20.039718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:20.056913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:20.060338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:20.062234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fac9a507-49e5-4050-99bc-028ff2cafbf7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1891 microversion: 2.32 time: 0.507032 Oct 26 05:27:20.063501 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2911/5815] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:19 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1891 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:20.107192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:20.118946 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4434c08-3d3f-418f-8ad0-292b31330207 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.453307 Oct 26 05:27:20.121463 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2905/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:19 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:20.923102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-41d672b1-6ca5-4b90-8660-dffd28a09080 req-c4ffc547-ee0b-4708-b0cb-7abf6d7fe10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "41b9f014-cb69-4f35-8f03-af1f2053ab94"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:20.955480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41d672b1-6ca5-4b90-8660-dffd28a09080 req-c4ffc547-ee0b-4708-b0cb-7abf6d7fe10e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:20.957197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41d672b1-6ca5-4b90-8660-dffd28a09080 req-c4ffc547-ee0b-4708-b0cb-7abf6d7fe10e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:20.958289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41d672b1-6ca5-4b90-8660-dffd28a09080 req-c4ffc547-ee0b-4708-b0cb-7abf6d7fe10e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:20.979664 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-41d672b1-6ca5-4b90-8660-dffd28a09080 req-c4ffc547-ee0b-4708-b0cb-7abf6d7fe10e service nova] Creating event network-changed:41b9f014-cb69-4f35-8f03-af1f2053ab94 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:21.001023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-41d672b1-6ca5-4b90-8660-dffd28a09080 req-c4ffc547-ee0b-4708-b0cb-7abf6d7fe10e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084741 Oct 26 05:27:21.004697 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2912/5817] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:21.092299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:21.092921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:21.103520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:21.112096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:21.112843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:21.113817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:21.114519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:21.115125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:21.144199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:21.145209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:21.161749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:21.165386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:21.166576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:21.167710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:21.168347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:21.170742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:21.974387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:21.984661 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db41cd8b-e81c-49fc-a52c-ddbb1e163e38 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.845971 Oct 26 05:27:21.985450 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2913/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:21 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:22.004936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfc37242-b127-479f-bac4-1ab172fb12ef"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:22.009210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:22.030732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:22.044997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:22.049522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:22.053960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:22.057374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:22.060107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:22.061493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:22.064846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:22.069537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:22.075329 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64e48e90-ebf5-45fc-aa3b-66d1516f2480 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.986157 Oct 26 05:27:22.081688 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2906/5819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:21 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:22.519076 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3030bb49-f1b8-45b2-abe5-935dc282f723 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531468 Oct 26 05:27:22.520958 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2914/5820] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:27:21 2022] POST /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:23.008397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:23.009752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:23.024100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:23.024722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:23.026033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:23.027110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:23.027801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:23.030760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:23.114549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:23.118561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:23.132572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:23.133257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:23.133672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:23.134410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:23.138244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:23.138699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:23.874164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:23.890299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:23.892000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:23.913305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c22105b5-d6ec-4b4d-890b-c97484067659 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.804704 Oct 26 05:27:23.934052 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2915/5821] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:23 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:23.946370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ce10e165-a36f-4fd3-97af-8655fcbc4067 req-3dedebf6-5e6e-483f-8209-be4356880ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "bca7f2b0-658e-4f41-9753-1c4d0ba279e8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:23.957855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ce10e165-a36f-4fd3-97af-8655fcbc4067 req-3dedebf6-5e6e-483f-8209-be4356880ad2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:23.958666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ce10e165-a36f-4fd3-97af-8655fcbc4067 req-3dedebf6-5e6e-483f-8209-be4356880ad2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:23.959636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ce10e165-a36f-4fd3-97af-8655fcbc4067 req-3dedebf6-5e6e-483f-8209-be4356880ad2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:23.974217 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ce10e165-a36f-4fd3-97af-8655fcbc4067 req-3dedebf6-5e6e-483f-8209-be4356880ad2 service nova] Creating event network-changed:bca7f2b0-658e-4f41-9753-1c4d0ba279e8 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:23.979703 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ce10e165-a36f-4fd3-97af-8655fcbc4067 req-3dedebf6-5e6e-483f-8209-be4356880ad2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044274 Oct 26 05:27:23.980830 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2916/5822] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:23.993285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:24.002730 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6aec330f-6702-48ac-a5a3-a4079f842342 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.998466 Oct 26 05:27:24.004242 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2907/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:23 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:24.956969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:24.959188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:24.976585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:24.977449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:24.978075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:24.979297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:24.981587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:24.982242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:25.031509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:25.032151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:25.050106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:25.050624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:25.051138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:25.051877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:25.052612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:25.056002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:25.968510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:25.991327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:25.998725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:26.009344 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ab4ea53-df7a-4800-8ed8-d0fa9ae67c13 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 1.052167 Oct 26 05:27:26.010038 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2917/5824] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:24 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:26.137840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:26.150152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e42878c-789b-4049-9ac1-769f27a39b59 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 1.121200 Oct 26 05:27:26.173470 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2908/5825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:25 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:26.333797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d4be3efc-e885-46ea-bb61-37ed5f4053d7 req-584245d3-9f0c-44c8-8ee5-ef8fe86e501a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "bfb10baf-e87e-4db2-b1b9-faefe496e2a6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:26.375825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d4be3efc-e885-46ea-bb61-37ed5f4053d7 req-584245d3-9f0c-44c8-8ee5-ef8fe86e501a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:26.382657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d4be3efc-e885-46ea-bb61-37ed5f4053d7 req-584245d3-9f0c-44c8-8ee5-ef8fe86e501a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:26.386932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d4be3efc-e885-46ea-bb61-37ed5f4053d7 req-584245d3-9f0c-44c8-8ee5-ef8fe86e501a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:26.418169 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d4be3efc-e885-46ea-bb61-37ed5f4053d7 req-584245d3-9f0c-44c8-8ee5-ef8fe86e501a service nova] Creating event network-changed:bfb10baf-e87e-4db2-b1b9-faefe496e2a6 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:26.429345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d4be3efc-e885-46ea-bb61-37ed5f4053d7 req-584245d3-9f0c-44c8-8ee5-ef8fe86e501a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103496 Oct 26 05:27:26.453395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2918/5826] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:26.872032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54f50181-13b9-4e8c-b4a8-d6e659f0784b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Action: 'create', calling method: .version_select at 0x7f470a846280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-639495486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfsEfbxbE5ThVTi6vzUws/R7g/24StQMlhWCRayUYKdpSJdlxNMf2efDSGaMyTmCF7fEpaWR+oEzQhLjFSQOg+HIAIqHO2uXzfDJ22FGSlBcVhEnPPM3WTI1eOhffZBVA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:26.892077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-54f50181-13b9-4e8c-b4a8-d6e659f0784b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Getting quotas for project 04e39546631e4ce1ad152b2afebc3737. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:27:26.899184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-54f50181-13b9-4e8c-b4a8-d6e659f0784b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Getting quotas for user ec959d88c9c6423caf0800f18bb824a5 and project 04e39546631e4ce1ad152b2afebc3737. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:27:26.938682 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54f50181-13b9-4e8c-b4a8-d6e659f0784b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.326254 Oct 26 05:27:26.939697 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2909/5827] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:27:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:27:27.037219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:27.038476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:27.047499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:27.049003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:27.050007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:27.051483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:27.052124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:27.053914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:27.183551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:27.184775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:27.197181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:27.200169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:27.202429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:27.205826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:27.206576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:27.207292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:28.911218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:28.932623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f538e28-fb46-4b34-ba7e-56b2b1ae2cec tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 1.743008 Oct 26 05:27:28.934997 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2910/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:27 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:29.057401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:29.070403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:29.077088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:29.078540 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5f89088-6c22-4b9d-8ef0-d0a54372a267 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 2.046463 Oct 26 05:27:29.083283 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2919/5829] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:27 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:29.267855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-80cd99d4-abc5-476c-b229-128d3bd8d3a9 req-1d16bee2-28b4-48d5-9239-df6fd72d4bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "7e3b71f1-3354-47aa-8a12-df6bb75c0f29"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:29.282347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-80cd99d4-abc5-476c-b229-128d3bd8d3a9 req-1d16bee2-28b4-48d5-9239-df6fd72d4bc8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:29.283267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-80cd99d4-abc5-476c-b229-128d3bd8d3a9 req-1d16bee2-28b4-48d5-9239-df6fd72d4bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:29.284111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-80cd99d4-abc5-476c-b229-128d3bd8d3a9 req-1d16bee2-28b4-48d5-9239-df6fd72d4bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:29.301770 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-80cd99d4-abc5-476c-b229-128d3bd8d3a9 req-1d16bee2-28b4-48d5-9239-df6fd72d4bc8 service nova] Creating event network-changed:7e3b71f1-3354-47aa-8a12-df6bb75c0f29 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:27:29.310659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-80cd99d4-abc5-476c-b229-128d3bd8d3a9 req-1d16bee2-28b4-48d5-9239-df6fd72d4bc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048852 Oct 26 05:27:29.312102 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2911/5830] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:29.960563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:29.961190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:29.968087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:29.968495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:29.968955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:29.969690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:29.970171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:29.970621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:30.107979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:30.109573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:30.120441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:30.123376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:30.123858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:30.124580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:30.125340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:30.125532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:30.537266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:30.550857 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9919f62e-a12d-4219-ab44-11c2ecc828aa tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1511 microversion: 2.1 time: 0.594696 Oct 26 05:27:30.554067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2920/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:29 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:30.865274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:30.878764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:30.880252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:30.890693 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-750b428a-4fb0-4d76-bf74-219664decf66 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.787017 Oct 26 05:27:30.905091 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2912/5832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:30 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:31.581449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:31.582094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:31.609715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:31.609715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:31.609715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:31.611009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:31.611547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:31.612035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:31.721493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-779928201", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-639495486", "security_groups": [{"name": "tempest-secgroup-smoke-661533479"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "ced89408-e60f-44d6-8e36-b7a52b0cb7c1"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:31.966559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] validate_networks() for [('ced89408-e60f-44d6-8e36-b7a52b0cb7c1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:27:32.268017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:32.278161 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b0ec0013-9ec6-42e8-aae6-bf540d4f905b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1488 microversion: 2.1 time: 0.702154 Oct 26 05:27:32.279535 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2921/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:31 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1488 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:32.285336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:32.286084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:32.293164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.293810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.294398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.295343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.295922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.296455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.719581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:32.733058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:32.735075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:32.737016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8abd2a90-25e7-4cb3-a98b-2d56d6256e85 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.455979 Oct 26 05:27:32.737840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2922/5834] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:32 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:32.748252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1996385747"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:32.755952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:32.765162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.765794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.766233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.766939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.767394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.767822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.799847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:32.812519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Getting quotas for project 04e39546631e4ce1ad152b2afebc3737. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:27:32.819049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Getting quotas for user ec959d88c9c6423caf0800f18bb824a5 and project 04e39546631e4ce1ad152b2afebc3737. Resources: dict_keys(['metadata_items']) {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:27:32.846654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:27:32.850021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:27:32.850817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:27:32.852748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:27:32.855114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:27:32.870170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.871004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.871742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.872893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.873531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.874279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.886842 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f4c757a-91dd-40fa-875d-77e213af7a0d tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "PUT /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1061 microversion: 2.1 time: 0.147616 Oct 26 05:27:32.887852 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2923/5835] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:27:32 2022] PUT /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1061 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:32.894583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Getting quotas for project 04e39546631e4ce1ad152b2afebc3737. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:27:32.902003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Getting quotas for user ec959d88c9c6423caf0800f18bb824a5 and project 04e39546631e4ce1ad152b2afebc3737. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:27:32.915631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:32.916658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:32.926134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:27:32.930393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.930847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.931281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:32.931992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:32.932274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:27:32.932424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:32.932878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.025719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5f534032-30f6-4010-85bc-4437d586cee3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.311117 Oct 26 05:27:33.033947 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2913/5836] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:27:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:27:33.045842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-197ebdcb-b700-4018-88b7-642295149482 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:33.050055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-197ebdcb-b700-4018-88b7-642295149482 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:33.201795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:33.217390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89ed8c45-0203-4b46-93a4-01643b68bab4 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1488 microversion: 2.1 time: 0.311550 Oct 26 05:27:33.220679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-197ebdcb-b700-4018-88b7-642295149482 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:33.223774 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2924/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:32 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1488 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:33.241164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-197ebdcb-b700-4018-88b7-642295149482 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1301 microversion: 2.1 time: 0.199329 Oct 26 05:27:33.242086 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2914/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:33 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1301 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:33.244054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:33.244763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:33.253144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.253824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.254343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.255410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.256809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.257514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.466106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:33.480368 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e844775a-beef-4d53-8c12-7bd30c45b9cd tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1488 microversion: 2.1 time: 0.242533 Oct 26 05:27:33.485364 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2925/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:33 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1488 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:33.504552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:33.505681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:33.513636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.518260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.519119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.522816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.523842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.524607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.574279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:33.579708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:27:33.716946 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e280dc2-0879-40e7-9fdc-a8564ccf4303 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 204 len: 0 microversion: 2.1 time: 0.215924 Oct 26 05:27:33.717939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2915/5840] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:33 2022] DELETE /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:27:33.728332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:33.730592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:33.745689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.746206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.748771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.749819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.752374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.752845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.765874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:33.766913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:33.787856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.788542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.789347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:33.789852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:33.793210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:33.794108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:34.154265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:34.170009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:34.174120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:34.178439 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-72c94cc0-67ca-48a7-aa55-3a68a71437d8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.417854 Oct 26 05:27:34.179929 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2916/5841] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:33 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:34.269601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:34.270466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:34.271157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:34.279501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:34.280399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:34.281073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:34.281381 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fed5afec-28d7-40b5-a92c-5a53ba035022 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1494 microversion: 2.1 time: 0.558983 Oct 26 05:27:34.281986 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2926/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:33 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1494 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:34.287264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:34.288423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:34.289096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:34.412664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:34.420944 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88d898fa-1b34-48cc-a8d6-7777af335ed0 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1353 microversion: 2.1 time: 0.155873 Oct 26 05:27:34.433805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2917/5843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:34 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:35.210303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:35.210941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:35.217965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:35.218595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:35.218907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:35.219624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:35.220085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:35.220718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:35.305168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:35.305814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:35.313361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:35.314094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:35.314535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:35.315431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:35.316063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:35.316723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:35.536763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:35.547479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:35.549586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:35.551594 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c3444735-26b1-48a5-99d4-4858ac0d744f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.345257 Oct 26 05:27:35.552981 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2927/5844] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:35 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:35.558509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:35.559351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:35.572644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:35.573799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:35.574427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:35.575320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:35.575975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:35.576556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:35.608106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:35.627128 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0df682cc-7c55-4667-94aa-c737fac9e26b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1494 microversion: 2.1 time: 0.325965 Oct 26 05:27:35.627753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2918/5845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:35 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1494 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:35.674194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:35.683773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cfc02df-b5f6-425c-bf09-b07883213d37 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1359 microversion: 2.1 time: 0.129513 Oct 26 05:27:35.684394 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2928/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:35 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1359 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:36.579334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:36.580948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:36.590469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:36.591300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:36.591959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:36.592865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:36.593605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:36.594291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:36.652691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:36.653571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:36.663356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:36.663916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:36.664373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:36.665189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:36.665699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:36.666220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:36.963093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:36.980289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:36.982609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:36.984096 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5eca813c-ad30-4c30-ad90-98ad6ee40055 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.409247 Oct 26 05:27:36.985258 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2919/5847] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:36 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:36.993800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:36.994616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:37.022659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:37.023376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:37.024192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:37.024914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:37.025347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:37.025784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:37.055986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:37.070171 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ff24c2e1-f6a8-4b09-a755-fca8bbdba367 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1494 microversion: 2.1 time: 0.419857 Oct 26 05:27:37.071882 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2929/5848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:36 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1494 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:37.142559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:37.158498 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d605f37-1af8-45d7-b5c0-794d8588e56f tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1359 microversion: 2.1 time: 0.171936 Oct 26 05:27:37.159746 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2920/5849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:36 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:37.783021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-962b016e-f863-49bd-8bc4-326dfcd20ad4 req-13ef3205-95f5-47d2-a49d-26437b886785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdd7b4a-3942-4cf8-99e0-998ee1a6906b", "name": "network-vif-deleted", "tag": "77736840-b3a7-44f1-b25f-a14647cdc874"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:37.793505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-962b016e-f863-49bd-8bc4-326dfcd20ad4 req-13ef3205-95f5-47d2-a49d-26437b886785 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:37.793980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-962b016e-f863-49bd-8bc4-326dfcd20ad4 req-13ef3205-95f5-47d2-a49d-26437b886785 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:37.794646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-962b016e-f863-49bd-8bc4-326dfcd20ad4 req-13ef3205-95f5-47d2-a49d-26437b886785 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:37.812148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-962b016e-f863-49bd-8bc4-326dfcd20ad4 req-13ef3205-95f5-47d2-a49d-26437b886785 service nova] Creating event network-vif-deleted:77736840-b3a7-44f1-b25f-a14647cdc874 for instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b on n-h2-862416-4 Oct 26 05:27:37.817390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-962b016e-f863-49bd-8bc4-326dfcd20ad4 req-13ef3205-95f5-47d2-a49d-26437b886785 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314064 Oct 26 05:27:37.818573 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2930/5850] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:38.021436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:38.022175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:38.034330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.035277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.035797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.036653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.037421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.037888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.103653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:38.112727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:38.121751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.121958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.122655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.123563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.124212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.124830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.163764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.164625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.165493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.166151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lazy-loading 'fault' on Instance uuid bcdd7b4a-3942-4cf8-99e0-998ee1a6906b {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:27:38.221497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:38.238812 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48a45d87-bb47-4986-88b5-6af56ee6c8de tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 200 len: 1310 microversion: 2.1 time: 0.142650 Oct 26 05:27:38.242404 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2931/5851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:38 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 1310 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:38.247995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:38.248885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:38.255959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.256632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.257141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.258023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.258741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.259239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.473832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:38.519121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:38.519506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:38.522239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:38.525131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01817de6-ecf7-42d4-92da-eabd939a48f1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.509668 Oct 26 05:27:38.528142 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2921/5852] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:38 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:38.530222 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9582ea4c-2584-42f4-b2d2-b4b39cc9af12 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.286476 Oct 26 05:27:38.531078 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2932/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:38 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:38.577043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:38.586966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:38.594211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.596255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.596899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.597971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.598899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.600333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.639892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'flavor' on Instance uuid 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:27:38.862490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Calling method '.version_select at 0x7f4709233af0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:38.869841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.871698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.872417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.899417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.900073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.900674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.902507 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5787eacb-6b25-4294-9ce2-2e7938283e78 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/action" status: 200 len: 32 microversion: 2.1 time: 0.372881 Oct 26 05:27:38.904178 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2922/5854] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:27:38 2022] POST /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:27:38.912255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.913063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.913673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.919436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:38.920829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:38.923716 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb6306e0-1f10-44c5-affd-cc6a1be4617f tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064 tempest-PortsAdminExtendedAttrsIpV6TestJSON-418391064-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.363278 Oct 26 05:27:38.935070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2933/5855] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:27:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:27:38.937956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.938480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.938910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:38.939621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:38.940099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:38.940506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.223939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:39.232498 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c0fd1288-4154-4aea-9188-c86a930a7096 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.323120 Oct 26 05:27:39.233086 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2923/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:38 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:39.266930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.267775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.275138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.275862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.276453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.277329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.277996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.278606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.292443 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b HTTP/1.1 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'bcdd7b4a-3942-4cf8-99e0-998ee1a6906b'} Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.294487 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.297632 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.297632 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.297632 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:39.297632 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:39.297632 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.297632 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.299319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:39.300365 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2a2d9946-40b7-437d-89d9-10b5af81d7da tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 404 len: 111 microversion: 2.1 time: 0.037280 Oct 26 05:27:39.305262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2934/5857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:39 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:39.319540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.320187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.327960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.328907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.329577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.330904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.331979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.335061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.358345 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b HTTP/1.1 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'bcdd7b4a-3942-4cf8-99e0-998ee1a6906b'} Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:39.361418 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a67dc14-14cc-49d7-a69b-4497074135a5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 404 len: 111 microversion: 2.1 time: 0.050179 Oct 26 05:27:39.365222 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2924/5858] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:39 2022] DELETE /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:39.376181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.377158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: bcdd7b4a-3942-4cf8-99e0-998ee1a6906b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.396169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.396749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.397256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.399308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.402444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.404608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.430522 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b HTTP/1.1 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'bcdd7b4a-3942-4cf8-99e0-998ee1a6906b'} Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.433738 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.437416 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.437416 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.437416 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:39.437416 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:39.437416 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. Oct 26 05:27:39.437416 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.439980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance bcdd7b4a-3942-4cf8-99e0-998ee1a6906b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:39.441024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15bedeac-faf0-48eb-a5d7-543c46b3051a tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b" status: 404 len: 111 microversion: 2.1 time: 0.072231 Oct 26 05:27:39.441765 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2935/5859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:39 2022] GET /compute/v2.1/servers/bcdd7b4a-3942-4cf8-99e0-998ee1a6906b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:39.452894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.453617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.461811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.462734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.463324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.464569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.465239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.465849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.487112 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 HTTP/1.1 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '44268d78-4109-4398-b3d7-d42f9dcd0c27'} Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:39.489035 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c54262fc-513d-436e-81a9-6db80b2fd683 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 404 len: 111 microversion: 2.1 time: 0.045294 Oct 26 05:27:39.493017 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2925/5860] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:39 2022] DELETE /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:39.501151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.501810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 44268d78-4109-4398-b3d7-d42f9dcd0c27] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.508280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.508781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.509236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.510135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.510604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.511197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.529950 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 HTTP/1.1 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '44268d78-4109-4398-b3d7-d42f9dcd0c27'} Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.531592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 44268d78-4109-4398-b3d7-d42f9dcd0c27 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:39.535608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e135ff3f-4194-43e9-95c0-0bc9e74f8a15 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27" status: 404 len: 111 microversion: 2.1 time: 0.036227 Oct 26 05:27:39.536875 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2936/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:39 2022] GET /compute/v2.1/servers/44268d78-4109-4398-b3d7-d42f9dcd0c27 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:39.543276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.543796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.550540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.551086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.551550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.553073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.553748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.554043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.565974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.566610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.574238 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca HTTP/1.1 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'a80119bd-8693-48e0-8f56-f43dbcd012ca'} Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:39.576017 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bbcf4a89-4233-4f37-b837-10053f80d076 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 404 len: 111 microversion: 2.1 time: 0.038427 Oct 26 05:27:39.579270 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2926/5862] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:39 2022] DELETE /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:39.585709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:39.585892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.586277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.586402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:39.586742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.587496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.590035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.590663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.594316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.595064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.595664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:39.596553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:39.597179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:39.597783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.148268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:40.155189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:40.160439 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-327c7333-941c-405b-9e6f-bc28c2c943da tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.580987 Oct 26 05:27:40.167378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:40.169063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:40.170420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd57648f-0134-4266-8a47-525111fd9745 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.615194 Oct 26 05:27:40.171101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2937/5863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:39 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:40.175389 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2927/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:39 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:40.192559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.193744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: a80119bd-8693-48e0-8f56-f43dbcd012ca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.204441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.204943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.205622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.206490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.206952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.207601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.225561 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca HTTP/1.1 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'a80119bd-8693-48e0-8f56-f43dbcd012ca'} Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.227855 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.231400 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.231400 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.231400 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.231400 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.231400 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. Oct 26 05:27:40.231400 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.232553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance a80119bd-8693-48e0-8f56-f43dbcd012ca could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.233611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67c2c6eb-32a4-4081-bccc-9d8dd96931f0 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca" status: 404 len: 111 microversion: 2.1 time: 0.061398 Oct 26 05:27:40.234618 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2938/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/a80119bd-8693-48e0-8f56-f43dbcd012ca => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.243384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.244599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.256659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.257531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.264237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.265025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.265742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.267799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.269570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.269985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.273170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.273799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.274256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.275724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.276204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.276647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.309078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 HTTP/1.1 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd88a7c78-e082-4ba2-95c7-e942ca4974a0'} Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.311139 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.314597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.316000 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4596a8af-74a0-490f-aa63-eacd265ceda7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 404 len: 111 microversion: 2.1 time: 0.073968 Oct 26 05:27:40.320173 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2928/5866] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:40 2022] DELETE /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.332106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.332945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: d88a7c78-e082-4ba2-95c7-e942ca4974a0] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.346071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.346571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.351601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.352611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.353532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.354160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.374135 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 HTTP/1.1 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd88a7c78-e082-4ba2-95c7-e942ca4974a0'} Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.376059 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.379662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.379662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.379662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.379662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.379662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. Oct 26 05:27:40.379662 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.381237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance d88a7c78-e082-4ba2-95c7-e942ca4974a0 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.382331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2e9a465-7c5f-4dba-835e-9c1686ffe3ee tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0" status: 404 len: 111 microversion: 2.1 time: 0.061022 Oct 26 05:27:40.383086 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2929/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/d88a7c78-e082-4ba2-95c7-e942ca4974a0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.391890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.392584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.402261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.402958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.403909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.405000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.405513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.406396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.426125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 HTTP/1.1 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '39536ca2-aa43-47e9-8c8f-69a6a9f59d00'} Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.436351 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.441167 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.443515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.445417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-248427e5-cde8-4a44-88fc-909cb5f82a5c tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 404 len: 111 microversion: 2.1 time: 0.057418 Oct 26 05:27:40.446552 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2930/5868] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:40 2022] DELETE /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.466150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.469438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 39536ca2-aa43-47e9-8c8f-69a6a9f59d00] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.481336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.483866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.484436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.485435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.486133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.486866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.503976 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 HTTP/1.1 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '39536ca2-aa43-47e9-8c8f-69a6a9f59d00'} Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.507268 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 39536ca2-aa43-47e9-8c8f-69a6a9f59d00 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-06347c05-423c-42ba-a0a0-015982b038d2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00" status: 404 len: 111 microversion: 2.1 time: 0.055192 Oct 26 05:27:40.511605 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2931/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/39536ca2-aa43-47e9-8c8f-69a6a9f59d00 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.520162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.520781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.530912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.531443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.531987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.532990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.533643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.534667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.552150 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 HTTP/1.1 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '14777b85-2844-44d2-a8f0-711890e84a88'} Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.555406 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.558556 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.560533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.561559 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c6aa1ee-2620-4932-af52-a2b782cf5e2b tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 404 len: 111 microversion: 2.1 time: 0.046078 Oct 26 05:27:40.565575 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2932/5870] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:40 2022] DELETE /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.571586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.572470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 14777b85-2844-44d2-a8f0-711890e84a88] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.579834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:40.581996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.582586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.583336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.585637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.586401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.587028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.592537 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-97733e79-c6d6-4ede-ad90-b7c8c0b69f37 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.340264 Oct 26 05:27:40.595247 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2939/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:40.611718 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 HTTP/1.1 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '14777b85-2844-44d2-a8f0-711890e84a88'} Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.613354 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 14777b85-2844-44d2-a8f0-711890e84a88 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-524cd860-77d2-4ae7-9306-2423487070f2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88" status: 404 len: 111 microversion: 2.1 time: 0.048175 Oct 26 05:27:40.616685 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2933/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/14777b85-2844-44d2-a8f0-711890e84a88 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.625096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa43f78b-275a-4f4e-aad2-8065d037c8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.625689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa43f78b-275a-4f4e-aad2-8065d037c8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 75606396-55ad-4280-976b-0f3abcfc21e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.634461 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-fa43f78b-275a-4f4e-aad2-8065d037c8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa43f78b-275a-4f4e-aad2-8065d037c8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 HTTP/1.1 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '75606396-55ad-4280-976b-0f3abcfc21e2'} Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.636029 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa43f78b-275a-4f4e-aad2-8065d037c8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.640088 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa43f78b-275a-4f4e-aad2-8065d037c8e2 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2" status: 404 len: 111 microversion: 2.1 time: 0.016805 Oct 26 05:27:40.647160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f2b7a28-c1a0-4656-b3dc-e0204b5df58f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.647791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f2b7a28-c1a0-4656-b3dc-e0204b5df58f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: 75606396-55ad-4280-976b-0f3abcfc21e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.649555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2940/5873] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:40 2022] DELETE /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.653062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:40.654163 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7f2b7a28-c1a0-4656-b3dc-e0204b5df58f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f2b7a28-c1a0-4656-b3dc-e0204b5df58f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 HTTP/1.1 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '75606396-55ad-4280-976b-0f3abcfc21e2'} Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:40.655858 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f2b7a28-c1a0-4656-b3dc-e0204b5df58f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance 75606396-55ad-4280-976b-0f3abcfc21e2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f2b7a28-c1a0-4656-b3dc-e0204b5df58f tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2" status: 404 len: 111 microversion: 2.1 time: 0.014976 Oct 26 05:27:40.659460 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2934/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/75606396-55ad-4280-976b-0f3abcfc21e2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:40.667357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.668068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.676219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.676748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.677164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.678499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.679139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.679627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.726673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:27:40.809460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:40.843204 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-14093a41-be3e-4862-bb80-2d9faccf7cc7 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 204 len: 0 microversion: 2.1 time: 0.180681 Oct 26 05:27:40.844382 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2941/5875] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:27:40 2022] DELETE /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:27:40.854765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:40.855255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:40.864720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.865802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.866442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.867196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:40.867698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:40.868213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:40.875012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:41.107002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:41.116708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-044bd447-1ca6-4cee-a7e1-1e5919e90909 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1480 microversion: 2.1 time: 0.268240 Oct 26 05:27:41.117352 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2935/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:40 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1480 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:41.191604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:41.193499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:41.204311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:41.204941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:41.205915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.207694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.209332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:41.211470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.212475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.213285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:41.220931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.221472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.221924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:41.222646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.223118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.224191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:41.503497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:41.513588 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6a2a5a97-bd57-4b9c-9123-c4548572e398 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.328790 Oct 26 05:27:41.534190 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2942/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:41 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:41.581525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:41.601454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:41.603479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:41.604686 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92e2b149-758a-4ea6-b424-f77df5ccc435 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.404391 Oct 26 05:27:41.617347 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2936/5878] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:41 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:41.622352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:41.623217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:41.634637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.635279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.636262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:41.637777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.638502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.639127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:41.797253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:41.808291 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0665648e-c941-413f-af9f-1310abbec739 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.194232 Oct 26 05:27:41.808901 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2943/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:41 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:41.966067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1671a0e5-0206-4b50-875e-56c43858b748 req-9f6dd8fd-a712-404a-9c70-47feebd83680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e28cb4d-d869-42ec-9af8-c355a279dcca", "tag": "67a1609a-d65b-486e-8ecd-ae8dab55fe45"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:41.995949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1671a0e5-0206-4b50-875e-56c43858b748 req-9f6dd8fd-a712-404a-9c70-47feebd83680 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:41.996449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1671a0e5-0206-4b50-875e-56c43858b748 req-9f6dd8fd-a712-404a-9c70-47feebd83680 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:41.996894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1671a0e5-0206-4b50-875e-56c43858b748 req-9f6dd8fd-a712-404a-9c70-47feebd83680 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.035310 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1671a0e5-0206-4b50-875e-56c43858b748 req-9f6dd8fd-a712-404a-9c70-47feebd83680 service nova] Creating event network-changed:67a1609a-d65b-486e-8ecd-ae8dab55fe45 for instance 8e28cb4d-d869-42ec-9af8-c355a279dcca on n-h1-862416-4 Oct 26 05:27:42.040941 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1671a0e5-0206-4b50-875e-56c43858b748 req-9f6dd8fd-a712-404a-9c70-47feebd83680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078567 Oct 26 05:27:42.041766 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2937/5880] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:42.143189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:42.144394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:42.202944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.205832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.214591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.219250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.219970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.221970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.462915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:42.471872 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c71abdf4-8c8d-4350-addf-2347899bb113 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1480 microversion: 2.1 time: 0.335395 Oct 26 05:27:42.472791 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2944/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:42 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1480 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:42.540121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:42.541059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:42.548704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.549607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.550048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.550769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.551401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.553257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.636239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:42.636990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:42.645810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.646901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.647514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.648382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.648986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.649586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.845869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:42.855945 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec3fd608-3c9a-45c0-bdb1-053028425393 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.321001 Oct 26 05:27:42.871206 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2938/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:42 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:42.880100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:42.881435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:42.888596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:42.894643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.895439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.895971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:42.903544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:42.904551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:42.905432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:43.060030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:43.076930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:43.079300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:43.082302 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30253398-3e30-4437-a568-3e3b0b9c077f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.453997 Oct 26 05:27:43.083156 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2945/5883] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:42 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:43.171928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:43.185037 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-357b3bd1-3093-48bf-b810-5e4aecdb0e0e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.311842 Oct 26 05:27:43.199743 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2939/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:42 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:43.504769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:43.506113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:43.525603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:43.526211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:43.527010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:43.528650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:43.530024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:43.530870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:43.805241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:43.817768 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-afebd077-3c7d-4e9c-bf25-949d8002b634 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1480 microversion: 2.1 time: 0.323849 Oct 26 05:27:43.819609 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2946/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:43 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1480 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:43.885037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:43.886575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:43.889164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=16 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:43.897022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:43.897610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:43.898056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:43.898776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:43.899246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:43.899681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.101193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-023a1f1a-d0f8-4387-a4c7-af57d66aa328 req-aebffa7d-5b2c-4adf-9c25-dad34098beb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d9967f-1ac1-43cc-8096-9090d86a985a", "name": "network-vif-deleted", "tag": "16f03f9b-a53c-40c7-b2bb-fdc6fb224841"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:44.119653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-023a1f1a-d0f8-4387-a4c7-af57d66aa328 req-aebffa7d-5b2c-4adf-9c25-dad34098beb6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.120135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-023a1f1a-d0f8-4387-a4c7-af57d66aa328 req-aebffa7d-5b2c-4adf-9c25-dad34098beb6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.120977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-023a1f1a-d0f8-4387-a4c7-af57d66aa328 req-aebffa7d-5b2c-4adf-9c25-dad34098beb6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.134376 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-023a1f1a-d0f8-4387-a4c7-af57d66aa328 req-aebffa7d-5b2c-4adf-9c25-dad34098beb6 service nova] Creating event network-vif-deleted:16f03f9b-a53c-40c7-b2bb-fdc6fb224841 for instance f0d9967f-1ac1-43cc-8096-9090d86a985a on n-h1-862416-4 Oct 26 05:27:44.140933 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-023a1f1a-d0f8-4387-a4c7-af57d66aa328 req-aebffa7d-5b2c-4adf-9c25-dad34098beb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043339 Oct 26 05:27:44.142811 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2947/5886] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:27:44.150967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:44.152561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:44.160493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.161136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.161609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.162617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.163055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.163489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.178439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:44.190271 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c2b28ef9-30b2-4834-8350-736174e9b678 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.307070 Oct 26 05:27:44.199341 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2940/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:43 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:44.218855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:44.219412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:44.235758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.236273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.236715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.237462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.237927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.238350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.673740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:44.686646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:44.688371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:44.689879 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4edfe728-2813-42a4-b329-aa9dfe5ec1b4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.545629 Oct 26 05:27:44.690970 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2948/5888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:44 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:44.704868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:44.716375 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92937412-8395-4588-96c4-5aa331c604dd tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.505131 Oct 26 05:27:44.717616 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2941/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:44 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:44.843301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:44.844482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:44.851712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.852420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.853027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.853990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:44.854660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:44.855300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:44.966568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f638704545419a984ecce9b4aa6b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8331fd49139f43338113b159d12eb6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:44.975788 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b2871eb-6aef-4614-913d-1d86f82856d8 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 200 len: 1278 microversion: 2.1 time: 0.136364 Oct 26 05:27:44.976574 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2949/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:44 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:45.222665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:45.225061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:45.241494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:45.242092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:45.242896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:45.243970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:45.245303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:45.246406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:45.558270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:45.569018 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b625934-1db4-462d-9f3b-e1053398bf88 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.350083 Oct 26 05:27:45.581371 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2942/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:45 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:45.716593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:45.725633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:45.742433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:45.744088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:45.744544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:45.745274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:45.745768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:45.745873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:45.746488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:45.748395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:45.764614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:45.765141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:45.765596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:45.770932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:45.772027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:45.772482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:46.159762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:46.173167 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f983c299-671a-4ff1-8dcb-2f27ac94dabb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.431166 Oct 26 05:27:46.173970 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2943/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:45 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:46.181154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:46.182085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] [instance: f0d9967f-1ac1-43cc-8096-9090d86a985a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:46.188452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:46.189130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:46.189923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:46.191239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:46.191979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:46.192557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:46.196297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:46.208698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:46.214290 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] HTTP exception thrown: Instance f0d9967f-1ac1-43cc-8096-9090d86a985a could not be found. Oct 26 05:27:46.214464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:46.215618 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5791303b-561b-4d28-b1d8-8da36880be5f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.503267 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Request method failure captured: Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a HTTP/1.1 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMRnHmMJVE0V2ncnLX3LzAu2Vis9LEiorlYYW2-QMAHnEZwL1amNhaRMU3SIukgwWkp-gKuf3bdyo_8vWuFFY0AH7gUL6Yf-aNJWzyoAmrcVQHi0MCv0N4frWOzTtXnJVv5hQNk-bE8i4Y2ra6LAMu9vrmWduRHV8s0aJRKBLcS_bbE Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8331fd49139f43338113b159d12eb6cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8331fd49139f43338113b159d12eb6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersTestJSON-435103375 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 8331fd49139f43338113b159d12eb6cb Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersTestJSON-435103375 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersTestJSON-435103375-project Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a0f638704545419a984ecce9b4aa6b30 Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersTestJSON-435103375-project Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance f0d9967f-1ac1-43cc-8096-9090d86a985a could not be found. Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'f0d9967f-1ac1-43cc-8096-9090d86a985a'} Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d9967f-1ac1-43cc-8096-9090d86a985a could not be found. Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d9967f-1ac1-43cc-8096-9090d86a985a could not be found. Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:46.217103 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:27:46.220962 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:27:46.220962 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:27:46.220962 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:27:46.220962 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:27:46.220962 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d9967f-1ac1-43cc-8096-9090d86a985a could not be found. Oct 26 05:27:46.220962 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:27:46.221297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2950/5893] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:45 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:46.222329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] Returning 404 to user: Instance f0d9967f-1ac1-43cc-8096-9090d86a985a could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:27:46.224244 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a99edd96-38c5-490e-944e-43dc6990ddc5 tempest-ServersTestJSON-435103375 tempest-ServersTestJSON-435103375-project] 10.222.0.16 "GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a" status: 404 len: 111 microversion: 2.1 time: 0.049105 Oct 26 05:27:46.226127 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2944/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:46 2022] GET /compute/v2.1/servers/f0d9967f-1ac1-43cc-8096-9090d86a985a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:27:46.593232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:46.593890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:46.600727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:46.601230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:46.601702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:46.602626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:46.603636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:46.605366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:47.201340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:47.201957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:47.210678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:47.211539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:47.212208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:47.213343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:47.214054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:47.214799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:47.288689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:47.303125 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d931889c-b905-4fc8-b746-217ad066085c tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.712863 Oct 26 05:27:47.306395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2951/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:46 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:47.323236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:47.325510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:47.354577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:47.355139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:47.356126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:47.356900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:47.358275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:47.358726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:47.593032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:47.604407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-055022c9-3d0c-4d31-aa14-22913a797fc4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.408582 Oct 26 05:27:47.614122 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2945/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:47 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:47.644687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:47.655915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:47.657415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:47.658870 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c43f086-eaa3-48ba-bc8f-5aa65f75c800 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.351330 Oct 26 05:27:47.673335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2952/5897] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:47 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:48.333117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:48.334119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:48.346581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:48.347435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:48.348669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:48.353135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:48.354715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:48.355780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:48.627953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:48.628880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:48.632402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:48.643644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:48.647238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:48.648343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:48.649437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:48.653704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:48.655607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:48.700986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:48.710940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b8c385a-42da-4be9-9c3d-849341bb08e3 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.384286 Oct 26 05:27:48.717638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2946/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:48 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:48.732967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:48.734122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:48.741251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:48.745746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:48.746457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:48.747512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:48.754448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:48.755116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:49.146016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:49.161217 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bfd5e92-111a-4af8-a8c4-4680c2246930 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.536036 Oct 26 05:27:49.164641 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2953/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:48 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:49.239593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:49.258975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:49.260454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:49.267532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b025fcb1-18c9-4852-a3f7-fa8e5cf73959 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.542799 Oct 26 05:27:49.269217 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2947/5900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:48 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:49.743289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:49.743919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:49.757438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:49.757890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:49.758508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:49.759797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:49.761098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:49.762642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:50.056085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:50.066788 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54a472b9-0641-4bcb-add9-f7c771989c38 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.327587 Oct 26 05:27:50.081087 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2954/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:49 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:50.189133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:50.189791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:50.199302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:50.200387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:50.206894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:50.214469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:50.215282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:50.215954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:50.301828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:50.311111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:50.328326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:50.328601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:50.335504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:50.336288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:50.336777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:50.337215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:50.692088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:50.712246 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d796c56f-13d8-4573-9c76-d09d695cb29e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.525536 Oct 26 05:27:50.712880 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2948/5902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:50 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:50.743326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:50.766890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:50.774102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:50.777470 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5fa7db4-9c06-4ca0-a67b-5ce8637d126e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.480159 Oct 26 05:27:50.778885 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2955/5903] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:50 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:51.058811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-bf32b619-aa9b-4988-8656-f7342f0dcd41 req-f68dfb0e-348a-4bde-92ec-fd1670ebd226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e28cb4d-d869-42ec-9af8-c355a279dcca", "name": "network-vif-plugged", "status": "completed", "tag": "67a1609a-d65b-486e-8ecd-ae8dab55fe45"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:51.092415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bf32b619-aa9b-4988-8656-f7342f0dcd41 req-f68dfb0e-348a-4bde-92ec-fd1670ebd226 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.093087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:51.093533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bf32b619-aa9b-4988-8656-f7342f0dcd41 req-f68dfb0e-348a-4bde-92ec-fd1670ebd226 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.094312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bf32b619-aa9b-4988-8656-f7342f0dcd41 req-f68dfb0e-348a-4bde-92ec-fd1670ebd226 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:51.096922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:51.123058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.123646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.124115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:51.124856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.124964 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-bf32b619-aa9b-4988-8656-f7342f0dcd41 req-f68dfb0e-348a-4bde-92ec-fd1670ebd226 service nova] Creating event network-vif-plugged:67a1609a-d65b-486e-8ecd-ae8dab55fe45 for instance 8e28cb4d-d869-42ec-9af8-c355a279dcca on n-h1-862416-4 Oct 26 05:27:51.125336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.125948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:51.138326 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-bf32b619-aa9b-4988-8656-f7342f0dcd41 req-f68dfb0e-348a-4bde-92ec-fd1670ebd226 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112598 Oct 26 05:27:51.140035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2949/5904] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:51.465658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:51.480484 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e75e0a9-8e80-4f35-ad35-5b3c61d6496b tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1426 microversion: 2.1 time: 0.391468 Oct 26 05:27:51.482346 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2956/5905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:51 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1426 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:51.738138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:51.739088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:51.763947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.765466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.780720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:51.788174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.789599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.791683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:51.805412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:51.807329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:51.824765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.825392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.825916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:51.826719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:51.828920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:51.830248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:52.828250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:52.834872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:52.841236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:52.843042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:52.844649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-06b196aa-b424-4870-a98c-9715c63750b9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 1.045188 Oct 26 05:27:52.846054 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2957/5906] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:51 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:52.850578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe568df1-b710-442a-a010-5759851ac47b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 1.115357 Oct 26 05:27:52.865345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2950/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:51 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:52.867524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:52.868800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:52.878814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:52.879331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:52.879783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:52.881041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:52.881819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:52.882503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:53.251801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:53.260865 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a853f213-89a3-4e33-b290-084b3c302344 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1605 microversion: 2.1 time: 0.412978 Oct 26 05:27:53.261952 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2958/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:52 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1605 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:53.285002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:53.285746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:53.296067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:53.296801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:53.297245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:53.298252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:53.298885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:53.299688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:53.587407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:53.595367 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ff3db4ea-d2cc-4116-9f82-9d0734be0f23 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1605 microversion: 2.1 time: 0.314373 Oct 26 05:27:53.596144 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2951/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:53 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:53.621635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:53.622562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:53.630739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:53.631626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:53.632399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:53.633476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:53.634380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:53.635072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:53.662976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:53.878955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:53.879678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:53.901014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:53.901572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:53.903205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:53.905182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:53.905847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:53.909800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:54.078810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:54.095649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb97582a-be9d-455f-8f82-fcc0bc947968 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1605 microversion: 2.1 time: 0.474450 Oct 26 05:27:54.116034 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2959/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:53 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1605 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:54.134393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:54.134393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:54.148542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:54.151339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:54.151992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:54.152893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:54.154304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:54.157189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:54.712150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:54.727256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:54.733686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:54.757878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:54.760784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-440546ba-41fb-4ae8-b550-22510bd3537c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.887305 Oct 26 05:27:54.762613 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2952/5911] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:53 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:27:54.773099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c746b782-32d9-4c4f-85f8-9bf0573f1768 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.655838 Oct 26 05:27:54.776090 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2960/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:54 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:55.793426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:55.794151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:55.806403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:55.807742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:55.822051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:55.822965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:55.826047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:55.826890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:55.828531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:55.829145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:55.830804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:55.831689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:55.835676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:55.836645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:55.837204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:55.839293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:56.361833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:56.374531 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4dcf6dba-d69a-4aff-b3c1-d5ed7de6edef tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.572795 Oct 26 05:27:56.375682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2961/5913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:55 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:27:56.450798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:56.462149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:27:56.467073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:56.473013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:56.474360 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a4b4635-2983-4bd1-a1dc-842d99c28400 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.685623 Oct 26 05:27:56.474927 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2953/5914] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:55 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:57.401306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:57.402218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:57.413567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:57.414109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:57.415428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:57.419984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:57.421474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:57.423484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:57.500752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:57.502278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:57.528710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:57.532222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:57.532873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:57.534465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:57.536805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:57.537984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:57.846534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:57.859793 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8c62c7b1-1487-4146-8deb-ebcb6038491b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.462856 Oct 26 05:27:57.863085 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2962/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:57 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:57.873738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1de8e5ea-b114-44b8-a494-914818134a03 req-d6190b8c-f475-453c-9107-cd846f1c7b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e28cb4d-d869-42ec-9af8-c355a279dcca", "tag": "67a1609a-d65b-486e-8ecd-ae8dab55fe45"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:27:57.905335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1de8e5ea-b114-44b8-a494-914818134a03 req-d6190b8c-f475-453c-9107-cd846f1c7b10 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:57.905980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1de8e5ea-b114-44b8-a494-914818134a03 req-d6190b8c-f475-453c-9107-cd846f1c7b10 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:57.906504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1de8e5ea-b114-44b8-a494-914818134a03 req-d6190b8c-f475-453c-9107-cd846f1c7b10 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:57.942440 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1de8e5ea-b114-44b8-a494-914818134a03 req-d6190b8c-f475-453c-9107-cd846f1c7b10 service nova] Creating event network-changed:67a1609a-d65b-486e-8ecd-ae8dab55fe45 for instance 8e28cb4d-d869-42ec-9af8-c355a279dcca on n-h1-862416-4 Oct 26 05:27:57.959370 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1de8e5ea-b114-44b8-a494-914818134a03 req-d6190b8c-f475-453c-9107-cd846f1c7b10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090264 Oct 26 05:27:57.960815 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2963/5916] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:58.192484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:58.209905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:58.211806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:58.215007 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18363886-5c26-47f6-8922-5304bf6dea86 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.718232 Oct 26 05:27:58.231056 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2954/5917] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:57 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:27:58.570329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fea8e7f5-1bd4-4c41-8f6f-862932c3e7d9 tempest-ExtensionsTest-1541780901 tempest-ExtensionsTest-1541780901-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:58.573049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fea8e7f5-1bd4-4c41-8f6f-862932c3e7d9 tempest-ExtensionsTest-1541780901 tempest-ExtensionsTest-1541780901-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.310519 Oct 26 05:27:58.574288 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2964/5918] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 26 05:27:58 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:58.586352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23ad72d8-5b5a-449a-9d35-30e93e0f1e0a tempest-ExtensionsTest-1541780901 tempest-ExtensionsTest-1541780901-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:58.590395 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23ad72d8-5b5a-449a-9d35-30e93e0f1e0a tempest-ExtensionsTest-1541780901 tempest-ExtensionsTest-1541780901-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010035 Oct 26 05:27:58.591846 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2955/5919] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 26 05:27:58 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:27:58.891582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:58.892548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:58.904188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:58.904695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:58.907471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:58.908281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:58.908769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:58.909217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:59.238225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:59.261910 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fe58ef8-555d-4375-ad79-634f3d228857 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.374500 Oct 26 05:27:59.265040 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2956/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:27:58 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:27:59.282404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:59.286305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:27:59.306059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:59.307322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:59.307977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:59.310319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:59.312987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:59.313497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:59.555371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Calling method '.version_select at 0x7f47097ef670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:27:59.557264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:59.557881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:59.558400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:59.593224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:59.596028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:59.597733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:59.618159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:27:59.619077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:27:59.619711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:27:59.626468 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2506cf16-b8a9-4129-8622-aeb650ea2230 tempest-PortsAdminExtendedAttrsTestJSON-1372687440 tempest-PortsAdminExtendedAttrsTestJSON-1372687440-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.852513 Oct 26 05:27:59.627402 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2965/5921] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:27:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:27:59.856312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:59.875731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:59.879515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:27:59.881827 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ab7e6572-0c5f-4cef-895f-b56400f03bcf tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.610657 Oct 26 05:27:59.882739 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2957/5922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:27:59 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:00.294962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:00.300962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:00.357165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:00.360583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:00.362397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:00.366938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:00.370043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:00.371018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:00.704288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:00.735626 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d30cb09f-49db-4aef-bdcc-9cf99e1ef082 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.442812 Oct 26 05:28:00.736269 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2966/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:00 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:00.915733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:00.916981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:00.929586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:00.934809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:00.936044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:00.937846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:00.938958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:00.939641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:01.516006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:01.539471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:01.542521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:01.545240 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e50663bb-ae40-4724-8dbf-a47b321a749c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.636841 Oct 26 05:28:01.545839 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2958/5924] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:00 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:01.774985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:01.777350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:01.804734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:01.805398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:01.805699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:01.806420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:01.806871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:01.807586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:02.574982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:02.575709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:02.595005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:02.596312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:02.597113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:02.599513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:02.602796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:02.605068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:02.650118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:02.691083 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83beaea9-2d32-4ef7-b0f0-2e06c92acef2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.923404 Oct 26 05:28:02.694668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2967/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:01 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:03.048816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:03.068323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:03.072930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:03.077609 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e63ac984-b6f1-4a99-ab9b-b81451aa3ab2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.505818 Oct 26 05:28:03.079369 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2959/5926] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:02 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:28:03.720429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:03.721921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:03.734624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:03.735327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:03.736186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:03.737618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:03.738754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:03.739886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:04.039864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:04.051373 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f75cc967-b597-4b39-8f27-fc88b47dc392 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.335809 Oct 26 05:28:04.057143 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2968/5927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:03 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:04.105763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:04.107042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:04.116171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:04.116994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:04.117691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:04.119092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:04.119855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:04.120498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:04.472398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:04.494639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:04.496275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:04.500074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ee938e61-5991-445c-8e17-c382d41c99e5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.399282 Oct 26 05:28:04.516114 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2960/5928] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:04 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:05.087292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:05.087993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:05.099145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:05.100918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:05.101823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:05.103358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:05.104274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:05.105698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:05.390032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:05.413066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-969e7e84-4218-4faa-bb25-dae0ebe877b9 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.335304 Oct 26 05:28:05.416287 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2969/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:05 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:05.547817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:05.548471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:05.560435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:05.560932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:05.562721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:05.563460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:05.563929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:05.564363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:06.026837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:06.047027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:06.050813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:06.058936 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1cc0c4a0-e975-4f87-aa64-5b2b9ad0d7d4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.519377 Oct 26 05:28:06.059742 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2961/5930] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:05 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:06.442092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:06.443061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:06.472196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:06.473104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:06.493353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:06.494998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:06.496078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:06.497303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:06.813704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:06.814236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:06.824861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:06.825390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:06.825840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:06.826556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:06.827020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:06.827455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:06.890882 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-21a6f27d-278f-44ec-861a-8f5782e4c7f3 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/ips" status: 200 len: 147 microversion: 2.1 time: 0.698591 Oct 26 05:28:06.891674 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2970/5931] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 05:28:06 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/ips => generated 147 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:06.907067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b8b3d155-8e60-4adf-94ae-94e82d2af770 req-645f0295-a825-4e6d-a3c5-4c9714406d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "bfb10baf-e87e-4db2-b1b9-faefe496e2a6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:06.926605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8b3d155-8e60-4adf-94ae-94e82d2af770 req-645f0295-a825-4e6d-a3c5-4c9714406d21 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:06.927128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8b3d155-8e60-4adf-94ae-94e82d2af770 req-645f0295-a825-4e6d-a3c5-4c9714406d21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:06.927824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8b3d155-8e60-4adf-94ae-94e82d2af770 req-645f0295-a825-4e6d-a3c5-4c9714406d21 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:06.954023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b8b3d155-8e60-4adf-94ae-94e82d2af770 req-645f0295-a825-4e6d-a3c5-4c9714406d21 service nova] Creating event network-vif-plugged:bfb10baf-e87e-4db2-b1b9-faefe496e2a6 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:06.967082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b8b3d155-8e60-4adf-94ae-94e82d2af770 req-645f0295-a825-4e6d-a3c5-4c9714406d21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064181 Oct 26 05:28:06.968412 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2971/5932] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:07.087955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:07.088807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:07.104996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:07.107518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:07.108091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:07.108938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:07.110242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:07.113244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:07.676873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:07.692179 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0fc7d3e1-2618-4428-ae0f-41977341985c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 1.256656 Oct 26 05:28:07.693973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2962/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:06 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:28:07.814322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:07.826756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:07.841908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:07.843261 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7ca3cca0-50ae-463b-8a14-a3a07956028a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.760872 Oct 26 05:28:07.843868 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2972/5934] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:07 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:08.722303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:08.723361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:08.743274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:08.743951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:08.744979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:08.747627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:08.748314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:08.749214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:08.878013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:08.879442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:08.894430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:08.899172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:08.900062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:08.900999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:08.902018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:08.903643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:09.071371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:09.089024 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7afff4e4-4832-4203-9e6d-c3a64b4eeac1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.370760 Oct 26 05:28:09.090167 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2963/5935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:08 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:09.095918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "7e3b71f1-3354-47aa-8a12-df6bb75c0f29"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "bca7f2b0-658e-4f41-9753-1c4d0ba279e8"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "c76aa5e8-aa77-4513-baad-bf666234842a"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "41b9f014-cb69-4f35-8f03-af1f2053ab94"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "ee4a74ea-53cf-4b86-b64f-6e9b3d1620ad"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:09.111303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:09.112115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:09.112717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:09.127376 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Creating event network-vif-plugged:7e3b71f1-3354-47aa-8a12-df6bb75c0f29 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:09.128343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Creating event network-vif-plugged:bca7f2b0-658e-4f41-9753-1c4d0ba279e8 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:09.129052 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Creating event network-vif-plugged:c76aa5e8-aa77-4513-baad-bf666234842a for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:09.130611 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Creating event network-vif-plugged:41b9f014-cb69-4f35-8f03-af1f2053ab94 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:09.131331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] Creating event network-vif-plugged:ee4a74ea-53cf-4b86-b64f-6e9b3d1620ad for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:09.138619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ee0a4caa-edb0-4885-a2c8-b4de5c676662 req-874b432d-f247-4029-a13d-8c1302bb436a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.046742 Oct 26 05:28:09.139468 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2964/5936] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:09.272352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:09.289243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:09.291827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:09.294996 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da52795b-7a4a-44ac-864b-61c84c3fcbc4 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.421201 Oct 26 05:28:09.296500 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2973/5937] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:08 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:09.613643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c178c2a-44db-4faa-9a6b-1b74030f9b3d"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:09.620123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:09.641332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:09.643775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:09.644556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:09.645590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:09.647836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:09.648592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:10.044921 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c3f07d5-aff0-4ee4-9fc1-76c26c1417e8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437999 Oct 26 05:28:10.046280 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2965/5938] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:28:09 2022] POST /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:10.117654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:10.118459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:10.133536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:10.134132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:10.135309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:10.137081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:10.137918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:10.140327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:10.328289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:10.329270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:10.342257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:10.342874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:10.345396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:10.346448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:10.348055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:10.351026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:10.423433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:10.456524 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-412955c9-abe3-4ce8-ac39-e3da28a2faa8 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1736 microversion: 2.1 time: 0.343748 Oct 26 05:28:10.475584 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2974/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:10 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1736 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:10.674680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:10.697107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:10.698821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:10.700035 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c79658aa-18e3-4cc1-b65a-c63f6a6f134c tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.378090 Oct 26 05:28:10.700618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2966/5940] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:10 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:11.171228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a28345d6-9f26-4f02-81ac-549fd76539e9 req-f4196c3e-b69c-4766-bc91-40613559738c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-plugged", "status": "completed", "tag": "1ce8d95a-d297-4c8b-9381-aa9252c03ccb"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:11.229869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a28345d6-9f26-4f02-81ac-549fd76539e9 req-f4196c3e-b69c-4766-bc91-40613559738c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:11.231101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a28345d6-9f26-4f02-81ac-549fd76539e9 req-f4196c3e-b69c-4766-bc91-40613559738c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:11.240774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a28345d6-9f26-4f02-81ac-549fd76539e9 req-f4196c3e-b69c-4766-bc91-40613559738c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:11.284754 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a28345d6-9f26-4f02-81ac-549fd76539e9 req-f4196c3e-b69c-4766-bc91-40613559738c service nova] Creating event network-vif-plugged:1ce8d95a-d297-4c8b-9381-aa9252c03ccb for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:11.308054 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a28345d6-9f26-4f02-81ac-549fd76539e9 req-f4196c3e-b69c-4766-bc91-40613559738c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137992 Oct 26 05:28:11.310463 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2975/5941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:11.480798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:11.481481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:11.484401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=64 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:11.492329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:11.494647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:11.502664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:11.503911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:11.504553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:11.509040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:11.729501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:11.730399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:11.744280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:11.745016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:11.745665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:11.747672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:11.748851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:11.750489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:12.302679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:12.314720 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b2bf7a4-6b13-4496-ba12-eab922008157 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1716 microversion: 2.1 time: 0.837794 Oct 26 05:28:12.322825 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2967/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:11 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1716 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:12.340641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:12.376346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:12.379416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:12.383168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd7ce68e-6c1c-4872-bede-3a4a7719a6f9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1879 microversion: 2.32 time: 0.658747 Oct 26 05:28:12.386139 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2976/5943] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:11 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1879 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:12.589131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:12.590195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:12.606847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:12.608393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:12.608843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:12.610080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:12.610565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:12.611009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:12.750380 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Cannot 'detach_volume' instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 while it is in vm_state rescued Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments/bfc37242-b127-479f-bac4-1ab172fb12ef HTTP/1.1 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'detach_volume' instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 while it is in vm_state rescued Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '7871b5f8-9765-4a97-a309-dfe6d5dcc6a8', 'id': 'bfc37242-b127-479f-bac4-1ab172fb12ef'} Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 while it is in vm_state rescued Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:28:12.756741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 while it is in vm_state rescued Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 409 to user: Cannot 'detach_volume' instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 while it is in vm_state rescued {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6c61dbc2-e2a6-4c16-b781-c9ad5ab3197f tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments/bfc37242-b127-479f-bac4-1ab172fb12ef" status: 409 len: 152 microversion: 2.1 time: 0.178622 Oct 26 05:28:12.761741 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2968/5944] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:28:12 2022] DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments/bfc37242-b127-479f-bac4-1ab172fb12ef => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:28:12.769709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:12.770762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:12.781741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:12.785423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:12.786044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:12.787297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:12.794396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:12.794862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:12.891358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c8cc11e-7476-4743-9f6d-d02097045c3e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/action" status: 202 len: 0 microversion: 2.1 time: 0.125246 Oct 26 05:28:12.893757 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2977/5945] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:28:12 2022] POST /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:28:12.900362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:12.901388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:12.913304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:12.914178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:12.914856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:12.915818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:12.918614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:12.919193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:13.245077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:13.257659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe5a5049-3969-4e35-af4b-7847a74c276e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1724 microversion: 2.1 time: 0.361190 Oct 26 05:28:13.260833 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2969/5946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:12 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:28:13.415284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:13.420051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:13.427734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:13.429264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:13.433367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:13.434385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:13.435023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:13.435625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:13.470532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:14.053709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:14.078422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:14.085494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:14.090076 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9de69a10-341a-42e3-8bd7-2320a85ec8a9 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2834 microversion: 2.32 time: 0.679040 Oct 26 05:28:14.102932 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2978/5947] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:28:13 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2834 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:14.125180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:14.125783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:14.137220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:14.137743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:14.138174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:14.138883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:14.139345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:14.139769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:14.284154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:14.284840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:14.297379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:14.298930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:14.299397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:14.300134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:14.300606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:14.301042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:14.383276 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac0b5e62-fcd6-48fb-861c-0151fecfbe29 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.261995 Oct 26 05:28:14.384507 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2970/5948] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:28:14 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc/os-interface => generated 1832 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:28:15.327112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:15.376234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bcac7f9-42bd-4399-a4a9-fa786e723239 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1724 microversion: 2.1 time: 1.095925 Oct 26 05:28:15.380754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2979/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:14 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1724 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:16.113253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-fd0036c0-5d5c-4f12-9693-d49efe159550 req-634a2f0f-5538-4a11-960c-38d97bf31d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "tag": "c76aa5e8-aa77-4513-baad-bf666234842a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:16.143887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fd0036c0-5d5c-4f12-9693-d49efe159550 req-634a2f0f-5538-4a11-960c-38d97bf31d6a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:16.146397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fd0036c0-5d5c-4f12-9693-d49efe159550 req-634a2f0f-5538-4a11-960c-38d97bf31d6a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:16.147216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-fd0036c0-5d5c-4f12-9693-d49efe159550 req-634a2f0f-5538-4a11-960c-38d97bf31d6a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:16.178987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:16.186693 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-fd0036c0-5d5c-4f12-9693-d49efe159550 req-634a2f0f-5538-4a11-960c-38d97bf31d6a service nova] Creating event network-changed:c76aa5e8-aa77-4513-baad-bf666234842a for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:28:16.202460 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-fd0036c0-5d5c-4f12-9693-d49efe159550 req-634a2f0f-5538-4a11-960c-38d97bf31d6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093213 Oct 26 05:28:16.206807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2971/5950] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:16.402589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:16.403154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:16.422858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:16.423983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:16.424613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:16.430030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:16.430776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:16.431398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:16.683664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:16.697560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6d4d02cb-7be7-4c26-ad5d-0c9c2a58a2d2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1724 microversion: 2.1 time: 0.300455 Oct 26 05:28:16.698170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2980/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:16 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:17.723033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:17.723831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:17.749976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:17.750624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:17.751103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:17.751910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:17.752407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:17.755125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:18.133829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:28:18.147572 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63c3541a-ccfd-4c03-b1ad-b764c280c6c2 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1730 microversion: 2.1 time: 0.428633 Oct 26 05:28:18.163748 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2972/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:28:17 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1730 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:28:18.180811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:18.181539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:18.198144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:18.199361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:18.201137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:18.204557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:18.205634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:18.207301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:18.508630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b95420e-021a-43cf-903e-9c9198840204 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333858 Oct 26 05:28:18.508630 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2981/5953] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:28:18 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:21.900851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-377f5a09-fdd9-4836-a3a0-7f97da5016e5 req-31450401-54ee-4789-9a3d-b4238065e198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7871b5f8-9765-4a97-a309-dfe6d5dcc6a8", "tag": "51f1501d-e68e-456a-8f5a-9f5e4c91fd83"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:21.919282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-377f5a09-fdd9-4836-a3a0-7f97da5016e5 req-31450401-54ee-4789-9a3d-b4238065e198 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:21.920573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-377f5a09-fdd9-4836-a3a0-7f97da5016e5 req-31450401-54ee-4789-9a3d-b4238065e198 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:21.921235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-377f5a09-fdd9-4836-a3a0-7f97da5016e5 req-31450401-54ee-4789-9a3d-b4238065e198 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:21.954508 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-377f5a09-fdd9-4836-a3a0-7f97da5016e5 req-31450401-54ee-4789-9a3d-b4238065e198 service nova] Creating event network-changed:51f1501d-e68e-456a-8f5a-9f5e4c91fd83 for instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 on n-h1-862416-4 Oct 26 05:28:21.964792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-377f5a09-fdd9-4836-a3a0-7f97da5016e5 req-31450401-54ee-4789-9a3d-b4238065e198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069637 Oct 26 05:28:21.966016 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2973/5954] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:24.005421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-25f00e7c-a80c-4375-aa19-b2a5a97557a9 req-e9c1f018-3ebc-4364-adab-bbc8adaf63c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7871b5f8-9765-4a97-a309-dfe6d5dcc6a8", "tag": "51f1501d-e68e-456a-8f5a-9f5e4c91fd83"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:24.016595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=58 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:24.019703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25f00e7c-a80c-4375-aa19-b2a5a97557a9 req-e9c1f018-3ebc-4364-adab-bbc8adaf63c4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:24.020755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25f00e7c-a80c-4375-aa19-b2a5a97557a9 req-e9c1f018-3ebc-4364-adab-bbc8adaf63c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:24.021441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-25f00e7c-a80c-4375-aa19-b2a5a97557a9 req-e9c1f018-3ebc-4364-adab-bbc8adaf63c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:24.065931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-25f00e7c-a80c-4375-aa19-b2a5a97557a9 req-e9c1f018-3ebc-4364-adab-bbc8adaf63c4 service nova] Creating event network-changed:51f1501d-e68e-456a-8f5a-9f5e4c91fd83 for instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 on n-h1-862416-4 Oct 26 05:28:24.090839 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-25f00e7c-a80c-4375-aa19-b2a5a97557a9 req-e9c1f018-3ebc-4364-adab-bbc8adaf63c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079332 Oct 26 05:28:24.090839 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2982/5955] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:24.994273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:24.998205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:25.008197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:25.008987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:25.009740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:25.010667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:25.011480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:25.012828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:25.083646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98e7ac7e-4a4f-4dd0-842e-09bf8f27d654 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088382 Oct 26 05:28:25.084726 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2974/5956] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:24 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:25.099891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:25.100601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:25.127720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:25.129150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:25.137361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:25.139010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:25.140763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:25.143281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:25.244643 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10ea2424-635a-4007-8ebc-052e7c643430 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/7c178c2a-44db-4faa-9a6b-1b74030f9b3d" status: 200 len: 194 microversion: 2.1 time: 0.152379 Oct 26 05:28:25.247214 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2983/5957] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 26 05:28:25 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/7c178c2a-44db-4faa-9a6b-1b74030f9b3d => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:28.195264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8a016ef-d25b-4291-97b5-44923f8a4727"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:28:28.208474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:28.225404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:28.230537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:28.237348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:28.239346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:28.240545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:28.244623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:28.684507 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ba18f69-8716-448d-a0b8-d8499e00708d tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "POST /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526716 Oct 26 05:28:28.687814 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2975/5958] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:28:28 2022] POST /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:34.155184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:34.155745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:34.164849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:34.165357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:34.165816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:34.166535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:34.167054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:34.167555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:34.233011 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-afd39fe7-0883-4f48-bc35-ec5e50bde80e tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.086992 Oct 26 05:28:34.233677 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2984/5959] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 26 05:28:34 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca/os-server-password => generated 116 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:44.650129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:44.653612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:44.664485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=17 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:44.665811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:44.673893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:44.674797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:44.675476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:44.676831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:44.677870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:44.678962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:44.750599 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7050bbe1-f6fa-4818-b558-7b69516e5a3c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.106637 Oct 26 05:28:44.751402 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2976/5960] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:44 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:44.907132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:44.907689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:44.911906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:44.912698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=33 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:28:44.926318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:44.927231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:44.932393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:44.933852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:44.934595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:44.935559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:45.016331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a1e23a6-c386-4171-a56b-7e99eaa91b37 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/7c178c2a-44db-4faa-9a6b-1b74030f9b3d" status: 200 len: 194 microversion: 2.1 time: 0.114532 Oct 26 05:28:45.017136 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2985/5961] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 26 05:28:44 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/7c178c2a-44db-4faa-9a6b-1b74030f9b3d => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:45.029514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:45.030903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:45.060166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:45.060722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:45.061761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:45.069019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:45.069798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:45.070415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:45.246234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lazy-loading 'services' on Instance uuid becc002f-e3bf-4495-8328-d51e854c579d {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:28:45.370560 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef6ab9f8-fa02-4ecf-a254-b6a01e92f299 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/7c178c2a-44db-4faa-9a6b-1b74030f9b3d" status: 202 len: 0 microversion: 2.1 time: 0.345211 Oct 26 05:28:45.371776 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2977/5962] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:28:45 2022] DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/7c178c2a-44db-4faa-9a6b-1b74030f9b3d => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:28:52.156731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:52.157350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:52.176540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:52.177159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:52.177905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:52.178621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:52.179124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:52.179601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:52.431954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'services' on Instance uuid 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:28:52.674303 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23eedbe6-925c-4868-a4fe-6105a35af25c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments/bfc37242-b127-479f-bac4-1ab172fb12ef" status: 202 len: 0 microversion: 2.1 time: 0.521450 Oct 26 05:28:52.686313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:52.691604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:52.692920 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2986/5963] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:28:52 2022] DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments/bfc37242-b127-479f-bac4-1ab172fb12ef => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:28:52.715335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:52.715934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:52.716424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:52.725876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:52.726395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:52.726853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:52.852255 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c028e494-3f38-446b-96e4-a006b00b0f80 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171410 Oct 26 05:28:52.866456 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2978/5964] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:52 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:53.875241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:53.877673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:53.900146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:53.900594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:53.901154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:53.902067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:53.902648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:53.906189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:53.996643 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f416fbf-81d3-4714-88c6-280a6335a866 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126102 Oct 26 05:28:53.998149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2987/5965] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:53 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:54.667794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:54.669877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:54.709164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:54.715077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:54.716025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:54.718014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:54.719574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:54.720922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:54.806479 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ecffe20-ee49-40ba-8a4c-cf7ca1c65b15 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/e8a016ef-d25b-4291-97b5-44923f8a4727" status: 200 len: 194 microversion: 2.1 time: 0.142681 Oct 26 05:28:54.813619 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2979/5966] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 26 05:28:54 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/e8a016ef-d25b-4291-97b5-44923f8a4727 => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:54.820188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:54.821001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:54.844989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:54.848481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:54.849649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:54.853612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:54.857205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:54.859193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:55.012119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:55.014484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:55.033052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:55.033764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:55.034338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:55.035770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:55.037841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:55.039878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:55.138905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lazy-loading 'services' on Instance uuid becc002f-e3bf-4495-8328-d51e854c579d {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:28:55.163466 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31b87ab4-ef8f-4934-8842-6bcb7a8f9386 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156504 Oct 26 05:28:55.170747 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2980/5967] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:55 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:55.350667 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-90b9e5fc-6751-4c2e-bdb1-2ab3b1b979c6 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/e8a016ef-d25b-4291-97b5-44923f8a4727" status: 202 len: 0 microversion: 2.1 time: 0.531129 Oct 26 05:28:55.372282 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2988/5968] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:28:54 2022] DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments/e8a016ef-d25b-4291-97b5-44923f8a4727 => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:28:56.177350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:56.180271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:56.196789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:56.199646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:56.200320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:56.201190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:56.203477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:56.204862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:56.288150 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54f2b43a-536c-4939-9ae9-65c5b5d35c3c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115647 Oct 26 05:28:56.293103 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2981/5969] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:56 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:57.308070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:57.326122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:57.359441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:57.360332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:57.361207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:57.362427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:57.363502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:57.364117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:57.422255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b0d0746-a038-482d-a280-cbd40699a51c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120308 Oct 26 05:28:57.424866 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2989/5970] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:57 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:58.437168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:58.441095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:58.466798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:58.467483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:58.468126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:58.469024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:58.469673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:58.470264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:58.546801 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7bf3c40a-1042-4d07-a1e2-3598fd6f1d9e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114467 Oct 26 05:28:58.556788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2982/5971] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:58 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:28:59.569061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:28:59.573764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:28:59.576820 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:28:59.577189 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments (ip 10.222.0.16) !!! Oct 26 05:28:59.593151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:59.594125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:59.594872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:59.595798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:28:59.596440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:28:59.597892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:28:59.640153 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac6bbad7-1a6b-479a-b16d-43e911cf3041 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075797 Oct 26 05:28:59.641347 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2990/5972] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:28:59 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:29:00.653865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:00.656095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:00.678337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:00.678952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:00.679507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:00.680257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:00.680911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:00.681622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:00.744964 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d050670b-4552-43fd-af6d-26bffff13e69 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095149 Oct 26 05:29:00.749640 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2983/5973] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:29:00 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:29:00.875579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:00.881175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:00.889431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:00.890661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:00.891659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:00.892603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:00.893221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:00.895221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:00.941668 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Cannot 'reboot' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action HTTP/1.1 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 28 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: {"reboot": {"type": "HARD"}} Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: exception: Cannot 'reboot' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'da551da1-9fc7-4baf-9aec-bc52d1749af7', 'body': {'reboot': {'type': 'HARD'}}} Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:29:00.944455 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:00.950327 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:00.954461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 409 to user: Cannot 'reboot' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:00.959033 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43204924-984e-48b8-96b7-a71c5e1954e3 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action" status: 409 len: 145 microversion: 2.1 time: 0.088712 Oct 26 05:29:00.966891 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2991/5974] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:29:00 2022] POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:29:00.971449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:00.975110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:00.996577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:00.997225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:00.998482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:01.000680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:01.004665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:01.005507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:01.072930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Cannot 'rebuild' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action HTTP/1.1 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 65 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: exception: Cannot 'rebuild' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'da551da1-9fc7-4baf-9aec-bc52d1749af7', 'body': {'rebuild': {'imageRef': 'd596d51f-4bb2-4340-8449-72226e2537e8'}}} Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:29:01.076269 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued Oct 26 05:29:01.082827 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:01.083937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 409 to user: Cannot 'rebuild' instance da551da1-9fc7-4baf-9aec-bc52d1749af7 while it is in vm_state rescued {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:01.085538 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d85155f-1cf7-400a-8653-f79de623a863 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action" status: 409 len: 146 microversion: 2.1 time: 0.117847 Oct 26 05:29:01.100278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:01.101009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:01.105151 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2984/5975] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:29:00 2022] POST /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7/action => generated 146 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 05:29:01.113861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:01.118986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:01.119534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:01.120467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:01.121288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:01.121922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:01.178881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:29:01.318502 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4671571-780c-45fe-b7dc-ec4c3d9030db tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 204 len: 0 microversion: 2.1 time: 0.218714 Oct 26 05:29:01.321647 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2992/5976] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:29:01 2022] DELETE /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:29:01.333294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:01.334237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:01.350043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:01.350900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:01.352209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:01.355847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:01.356777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:01.357425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:02.043978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:02.075233 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6287bb8-7757-43bb-bf32-ac4fda10ed92 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1690 microversion: 2.1 time: 0.748222 Oct 26 05:29:02.075860 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2985/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:01 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1690 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:03.110384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:03.111757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:03.132136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:03.135610 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:03.136268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:03.137171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:03.138974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:03.139726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:03.697961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:03.712112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-521bc133-8338-4189-8d19-4ee55b41d921 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1690 microversion: 2.1 time: 0.607361 Oct 26 05:29:03.715639 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2993/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:03 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1690 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:29:04.744106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:04.746445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:04.763635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:04.766555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:04.773768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:04.774779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:04.775596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:04.781859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:05.388073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:05.398934 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c2425e2-1630-4e2c-b9fb-4e66dff790ec tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1690 microversion: 2.1 time: 0.660670 Oct 26 05:29:05.403238 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2986/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:04 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1690 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:06.430088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:06.430762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:06.447994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:06.449658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:06.450530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:06.451602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:06.452356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:06.453097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:07.158969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:07.176560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-14f63b28-8126-48fe-8394-398c915bf368 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1690 microversion: 2.1 time: 0.748643 Oct 26 05:29:07.180608 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2994/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:06 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1690 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:08.095675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-20e7208a-0355-4e43-a17d-d20f201a9ec9 req-75708620-c258-4f20-9ed0-4f09ec46c62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7871b5f8-9765-4a97-a309-dfe6d5dcc6a8", "name": "network-vif-deleted", "tag": "51f1501d-e68e-456a-8f5a-9f5e4c91fd83"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:08.138305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-20e7208a-0355-4e43-a17d-d20f201a9ec9 req-75708620-c258-4f20-9ed0-4f09ec46c62c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.147185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-20e7208a-0355-4e43-a17d-d20f201a9ec9 req-75708620-c258-4f20-9ed0-4f09ec46c62c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.147813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-20e7208a-0355-4e43-a17d-d20f201a9ec9 req-75708620-c258-4f20-9ed0-4f09ec46c62c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.180230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-20e7208a-0355-4e43-a17d-d20f201a9ec9 req-75708620-c258-4f20-9ed0-4f09ec46c62c service nova] Creating event network-vif-deleted:51f1501d-e68e-456a-8f5a-9f5e4c91fd83 for instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 on n-h1-862416-4 Oct 26 05:29:08.193395 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-20e7208a-0355-4e43-a17d-d20f201a9ec9 req-75708620-c258-4f20-9ed0-4f09ec46c62c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100514 Oct 26 05:29:08.194616 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2987/5981] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:29:08.225010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:08.230793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:08.247523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.248408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.249055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.251733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.252393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.255152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.348300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.349232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.351285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.352090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'fault' on Instance uuid 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:29:08.421645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:08.424430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:08.434821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.435824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.436498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.437913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.439798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.440602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.448944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:08.460551 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ac0d4af2-e3b8-4080-891b-7f37db27100b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 200 len: 1335 microversion: 2.1 time: 0.250968 Oct 26 05:29:08.465122 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2995/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:08 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 1335 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:08.486608 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d4deec9-b5b2-4d93-a8f7-6ac73f00fd18 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074280 Oct 26 05:29:08.489554 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2988/5983] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:29:08 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 05:29:08.656840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:08.661267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:08.667853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.668347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.668873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.669614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.670072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.670500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.708374 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d09c33e-100f-45e4-9866-eb3e4f893850 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055688 Oct 26 05:29:08.715246 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2996/5984] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 05:29:08 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 05:29:08.815205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:08.815826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:08.830110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.830623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.841851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.842915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:08.843589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:08.844028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:08.898882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:29:09.037040 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ceb16317-2dad-49fb-854b-e1db0fc5ed36 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 204 len: 0 microversion: 2.1 time: 0.225492 Oct 26 05:29:09.038269 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2989/5985] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:29:08 2022] DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:29:09.047147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:09.047793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:09.056218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:09.056901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:09.057798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:09.058568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:09.059216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:09.059857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:09.400923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:09.402565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:09.415154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:09.418217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:09.418686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:09.419434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:09.419900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:09.420331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:09.537086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:09.549255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e597174-9b57-4e92-82d8-2269c2504ba1 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1673 microversion: 2.1 time: 0.506567 Oct 26 05:29:09.549909 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2997/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:09 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1673 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:09.565183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:09.570373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:09.583485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:09.584245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:09.584883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:09.585809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:09.586430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:09.587025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:09.619372 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 could not be found. Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 HTTP/1.1 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 could not be found. Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7871b5f8-9765-4a97-a309-dfe6d5dcc6a8'} Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 could not be found. Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 could not be found. Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:09.621845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 could not be found. Oct 26 05:29:09.626867 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:09.628240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 404 to user: Instance 7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:09.630514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-259d054c-18fc-4160-a05a-09a42ae317fb tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8" status: 404 len: 111 microversion: 2.1 time: 0.077736 Oct 26 05:29:09.631708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2998/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:09 2022] GET /compute/v2.1/servers/7871b5f8-9765-4a97-a309-dfe6d5dcc6a8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:09.655448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2ce95f98-a68c-4b49-b271-501ab78605dc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '.version_select at 0x7f47098e71f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:09.702332 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2ce95f98-a68c-4b49-b271-501ab78605dc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704473410" status: 202 len: 0 microversion: 2.1 time: 0.065248 Oct 26 05:29:09.703365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 2999/5988] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704473410 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:29:10.090954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:10.103803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:10.108127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:10.110719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abd5673c-55ad-492b-a477-e611d10749b1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2953 microversion: 2.32 time: 0.714760 Oct 26 05:29:10.111312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2990/5989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:09 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2953 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:29:10.138484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:10.139368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:10.146377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:10.147228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:10.147939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:10.148883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:10.149592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:10.150274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:10.155678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:10.506415 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-491af137-40fa-4002-8c61-f8a8e16aeef5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.371929 Oct 26 05:29:10.516939 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3000/5990] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 26 05:29:10 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc/os-interface => generated 1832 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:10.580249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:10.582269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:10.590005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:10.590897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:10.591686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:10.592712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:10.593437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:10.594218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:10.601556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:12.506012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:12.521208 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3879e2ae-f2f8-4bc3-8d6d-b6c453986975 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1673 microversion: 2.1 time: 1.941051 Oct 26 05:29:12.529378 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2991/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:10 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1673 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:13.546196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:13.546828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:13.562213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:13.562724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:13.563175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:13.563899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:13.576295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:13.576971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:13.910920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:13.921874 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b363e085-daf1-4d9a-9da1-ed8c94133879 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1606 microversion: 2.1 time: 0.379596 Oct 26 05:29:13.941117 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3001/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:13 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1606 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:14.948915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:14.949583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:14.952754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:14.970765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:14.974163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:14.974698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:14.975641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:14.977395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:14.977978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:15.441046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:15.450520 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8f9ad31-cc88-4234-b517-9465c8dd6307 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1606 microversion: 2.1 time: 0.506371 Oct 26 05:29:15.455739 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2992/5993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:14 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1606 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:16.277391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a53db8fe-77c7-4f1a-bd90-e75f43bf1641 req-8d7e2718-29d7-4a64-aaca-27991b847697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becc002f-e3bf-4495-8328-d51e854c579d", "name": "network-vif-deleted", "tag": "4a21977f-e502-4728-8ce9-6f5d8bf1c4b8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:16.297848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:16.302112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a53db8fe-77c7-4f1a-bd90-e75f43bf1641 req-8d7e2718-29d7-4a64-aaca-27991b847697 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:16.311714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a53db8fe-77c7-4f1a-bd90-e75f43bf1641 req-8d7e2718-29d7-4a64-aaca-27991b847697 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:16.314018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a53db8fe-77c7-4f1a-bd90-e75f43bf1641 req-8d7e2718-29d7-4a64-aaca-27991b847697 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:16.359011 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a53db8fe-77c7-4f1a-bd90-e75f43bf1641 req-8d7e2718-29d7-4a64-aaca-27991b847697 service nova] Creating event network-vif-deleted:4a21977f-e502-4728-8ce9-6f5d8bf1c4b8 for instance becc002f-e3bf-4495-8328-d51e854c579d on n-h2-862416-4 Oct 26 05:29:16.374220 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a53db8fe-77c7-4f1a-bd90-e75f43bf1641 req-8d7e2718-29d7-4a64-aaca-27991b847697 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101558 Oct 26 05:29:16.375357 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3002/5994] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:29:16.483948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:16.485500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:16.507232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:16.508091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:16.508770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:16.511332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:16.511994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:16.512632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:16.604472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:16.606039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:16.606961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:16.607866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lazy-loading 'fault' on Instance uuid becc002f-e3bf-4495-8328-d51e854c579d {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:29:16.926519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b095e3b8ee8c4fdca403334607c79df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4061413c95466b9bc8c80b8791be6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:16.945830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b05773d7-4ec1-4a9a-b511-3af09f2f2c59 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 200 len: 1326 microversion: 2.1 time: 0.464731 Oct 26 05:29:16.964809 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2993/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:16 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 1326 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:17.972910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:17.973669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:17.991533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:17.992046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:17.997470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:17.998346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:17.998842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:17.999362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:18.033215 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] HTTP exception thrown: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Request method failure captured: Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d HTTP/1.1 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQWf-0DZcjDPK6vE9szFgDmCU6x690eU9o_KQlda_Obi7wVzv7mAr14O0y-qzlL2Cu8DSmHc8JZvnynUVttw6HRL1YrI-dFPF4zfmnbm585vT73ku0b-8vAjqzSiGTQNReH5Ym8wNdyKjZi434An0gIMgS0V7CD9on0yj7DSExsdqs Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: b095e3b8ee8c4fdca403334607c79df2 Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'becc002f-e3bf-4495-8328-d51e854c579d'} Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:18.044962 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:18.049078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Returning 404 to user: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:18.053655 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb30532a-275b-40da-b3a4-d27fa11f9d33 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 404 len: 111 microversion: 2.1 time: 0.085480 Oct 26 05:29:18.057484 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3003/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:17 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:18.065548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90c3c497-cae6-4899-9e32-6ecafc758134 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '.version_select at 0x7f470abc2430>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:18.130276 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90c3c497-cae6-4899-9e32-6ecafc758134 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742758324" status: 202 len: 0 microversion: 2.1 time: 0.070357 Oct 26 05:29:18.134159 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2994/5997] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 26 05:29:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742758324 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:29:21.013679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:21.014784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:21.022914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:21.023654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:21.024263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:21.025137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:21.025774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:21.026829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:21.073149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:29:21.218682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92cb7894-062f-4d08-900c-e85560225ebc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 204 len: 0 microversion: 2.1 time: 0.208529 Oct 26 05:29:21.223971 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3004/5998] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:29:21 2022] DELETE /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:29:21.231395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:21.232076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:21.244585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:21.245447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:21.246116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:21.247226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:21.248347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:21.250351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:21.651590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:21.672593 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf526455-531b-4bcf-87ba-71323a2621ea tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1507 microversion: 2.1 time: 0.445026 Oct 26 05:29:21.679373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2995/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:21 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:22.705859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:22.707004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:22.720444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:22.726330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:22.727164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:22.728258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:22.728838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:22.729562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:23.131278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:23.148231 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6be9737-2ef2-49e5-b95c-139011546b2b tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1507 microversion: 2.1 time: 0.446470 Oct 26 05:29:23.166455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3005/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:22 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:24.180977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:24.182745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:24.197739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:24.199083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:24.200153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:24.202587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:24.204430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:24.205047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:24.415992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-aa366356-638f-4358-af1d-2e9463464fa4 req-dc3f1a2d-c5ff-4130-a7da-c4a1c635d1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da551da1-9fc7-4baf-9aec-bc52d1749af7", "name": "network-vif-deleted", "tag": "92c53345-c1c9-4e9e-b88a-070fd4d8d3bd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:24.436625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-aa366356-638f-4358-af1d-2e9463464fa4 req-dc3f1a2d-c5ff-4130-a7da-c4a1c635d1c4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:24.437399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-aa366356-638f-4358-af1d-2e9463464fa4 req-dc3f1a2d-c5ff-4130-a7da-c4a1c635d1c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:24.437972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-aa366356-638f-4358-af1d-2e9463464fa4 req-dc3f1a2d-c5ff-4130-a7da-c4a1c635d1c4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:24.468889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-aa366356-638f-4358-af1d-2e9463464fa4 req-dc3f1a2d-c5ff-4130-a7da-c4a1c635d1c4 service nova] Creating event network-vif-deleted:92c53345-c1c9-4e9e-b88a-070fd4d8d3bd for instance da551da1-9fc7-4baf-9aec-bc52d1749af7 on n-h2-862416-4 Oct 26 05:29:24.477289 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-aa366356-638f-4358-af1d-2e9463464fa4 req-dc3f1a2d-c5ff-4130-a7da-c4a1c635d1c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068059 Oct 26 05:29:24.482646 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3006/6001] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:29:24.779461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:24.792307 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a14725d8-5b81-4065-8f8d-7c601eefe9b1 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 200 len: 1465 microversion: 2.1 time: 0.615729 Oct 26 05:29:24.793650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2996/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:24 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 1465 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:25.821447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:25.822175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: da551da1-9fc7-4baf-9aec-bc52d1749af7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:25.839085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:25.840204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:25.841088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:25.842030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:25.842841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:25.843585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:25.861539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 could not be found. Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 HTTP/1.1 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 could not be found. Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'da551da1-9fc7-4baf-9aec-bc52d1749af7'} Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 could not be found. Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 could not be found. Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:25.864451 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 could not be found. Oct 26 05:29:25.869168 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:25.871972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 404 to user: Instance da551da1-9fc7-4baf-9aec-bc52d1749af7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:25.872872 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1fd5c1c-d6e6-41cf-a70d-5fb9f7f9ab4d tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7" status: 404 len: 111 microversion: 2.1 time: 0.058888 Oct 26 05:29:25.877259 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3007/6003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:25 2022] GET /compute/v2.1/servers/da551da1-9fc7-4baf-9aec-bc52d1749af7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:25.881949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:25.882466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:25.900335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:25.900862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:25.901338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:25.902099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:25.903144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:25.903596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:25.976345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:29:26.195841 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fdfe65a5-bf3e-4941-b160-c92a477aff5e tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 204 len: 0 microversion: 2.1 time: 0.317526 Oct 26 05:29:26.200166 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2997/6004] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:29:25 2022] DELETE /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:29:26.216558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:26.217362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:26.225134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:26.225966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:26.226862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:26.228042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:26.228804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:26.229779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:27.095645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:27.105398 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28cb5b49-26b5-4843-adf9-08f8903f0d6c tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.899676 Oct 26 05:29:27.105999 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3008/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:26 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:28.134640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:28.135571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:28.159286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:28.160138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:28.160710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:28.161759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:28.163560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:28.164119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:28.991037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:29.008109 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0da637e9-4aeb-4878-b837-d89569495265 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.878524 Oct 26 05:29:29.024832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2998/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:28 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:30.384102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:30.384732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:30.394323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:30.396283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:30.397087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:30.398328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:30.399035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:30.399758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:31.105239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:31.125193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7d38113-af9a-406b-b15c-06378f870abc tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 1.094852 Oct 26 05:29:31.131894 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3009/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:30 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:32.155755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:32.157139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:32.166073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:32.166955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:32.167635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:32.168620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:32.169377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:32.170465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:33.004029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:33.019437 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-63a7674b-4530-4b04-be30-3168d03d000a tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1521 microversion: 2.1 time: 0.866888 Oct 26 05:29:33.041444 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 2999/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:32 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1521 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:33.107161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:33.107702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:33.118846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:33.119364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:33.119828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:33.120558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:33.121022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:33.129665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:33.152345 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] HTTP exception thrown: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Request method failure captured: Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d HTTP/1.1 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQWf-0DZcjDPK6vE9szFgDmCU6x690eU9o_KQlda_Obi7wVzv7mAr14O0y-qzlL2Cu8DSmHc8JZvnynUVttw6HRL1YrI-dFPF4zfmnbm585vT73ku0b-8vAjqzSiGTQNReH5Ym8wNdyKjZi434An0gIMgS0V7CD9on0yj7DSExsdqs Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: b095e3b8ee8c4fdca403334607c79df2 Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'becc002f-e3bf-4495-8328-d51e854c579d'} Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:33.156081 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Returning 404 to user: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:33.163489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8f87293-e7b8-4075-a5af-736f49d52ff8 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 404 len: 111 microversion: 2.1 time: 0.054346 Oct 26 05:29:33.166838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:33.167461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: becc002f-e3bf-4495-8328-d51e854c579d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:33.176154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3010/6009] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:29:33 2022] DELETE /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:33.184538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:33.185283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:33.186169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:33.187135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:33.187836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:33.188487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:33.228662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] HTTP exception thrown: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Request method failure captured: Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d HTTP/1.1 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMQWf-0DZcjDPK6vE9szFgDmCU6x690eU9o_KQlda_Obi7wVzv7mAr14O0y-qzlL2Cu8DSmHc8JZvnynUVttw6HRL1YrI-dFPF4zfmnbm585vT73ku0b-8vAjqzSiGTQNReH5Ym8wNdyKjZi434An0gIMgS0V7CD9on0yj7DSExsdqs Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b095e3b8ee8c4fdca403334607c79df2 Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'becc002f-e3bf-4495-8328-d51e854c579d'} Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:33.234084 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. Oct 26 05:29:33.239302 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:33.240995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Returning 404 to user: Instance becc002f-e3bf-4495-8328-d51e854c579d could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:33.243812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd3a6ed0-c9b8-40f7-b692-023c1e89663c tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d" status: 404 len: 111 microversion: 2.1 time: 0.080862 Oct 26 05:29:33.244702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3000/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:33 2022] GET /compute/v2.1/servers/becc002f-e3bf-4495-8328-d51e854c579d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:33.615395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-761c4f61-4336-4ba7-93b5-3e9f14392a27 req-2de26604-035c-49f0-8ec5-6c486d29ac0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c237b10e-845b-472d-a639-66f8f2db0482", "name": "network-vif-deleted", "tag": "f0f1d44d-e2eb-46c2-ac1b-454083fedc19"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:33.647852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-761c4f61-4336-4ba7-93b5-3e9f14392a27 req-2de26604-035c-49f0-8ec5-6c486d29ac0a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:33.649019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-761c4f61-4336-4ba7-93b5-3e9f14392a27 req-2de26604-035c-49f0-8ec5-6c486d29ac0a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:33.649512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-761c4f61-4336-4ba7-93b5-3e9f14392a27 req-2de26604-035c-49f0-8ec5-6c486d29ac0a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:33.695149 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-761c4f61-4336-4ba7-93b5-3e9f14392a27 req-2de26604-035c-49f0-8ec5-6c486d29ac0a service nova] Creating event network-vif-deleted:f0f1d44d-e2eb-46c2-ac1b-454083fedc19 for instance c237b10e-845b-472d-a639-66f8f2db0482 on n-h2-862416-4 Oct 26 05:29:33.708532 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-761c4f61-4336-4ba7-93b5-3e9f14392a27 req-2de26604-035c-49f0-8ec5-6c486d29ac0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098871 Oct 26 05:29:33.713807 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3011/6011] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:29:34.048129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:34.048762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:34.067513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:34.068028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:34.068483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:34.069214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:34.069713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:34.070156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:34.201163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:34.201828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:34.205444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:34.206625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lazy-loading 'fault' on Instance uuid c237b10e-845b-472d-a639-66f8f2db0482 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:29:34.316141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde934392aab4940960535dd1794b37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce4dd876ace4d35a34d07effb8d6248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:34.326157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6bd39809-c851-4fdc-8db0-295ba48e3069 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 200 len: 1311 microversion: 2.1 time: 0.282063 Oct 26 05:29:34.334612 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3001/6012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:34 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:29:35.364829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:35.366266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] [instance: c237b10e-845b-472d-a639-66f8f2db0482] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:35.378941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:35.390215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:35.391690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:35.393516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:35.398153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:35.402227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:35.421569 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] HTTP exception thrown: Instance c237b10e-845b-472d-a639-66f8f2db0482 could not be found. Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Request method failure captured: Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 HTTP/1.1 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMSN3GeY5TCPspGKN8pq-VsP7Q1MmKugGuTo4wKPouTfLZ9vYjC-g_YtFMshAwL40TIfYkozMNuR6qM1IiujOlHZIf0yAkB8ty9GE_pWCYDTUdX_BlHf1bkeUeo6Hq9ccKcyhTqPV4odZG0Y9aICuBj32Zh3XP_YuD1e8qhPejBcL18 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ce4dd876ace4d35a34d07effb8d6248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ce4dd876ace4d35a34d07effb8d6248 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-380312682 Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: dde934392aab4940960535dd1794b37b Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-380312682-project Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c237b10e-845b-472d-a639-66f8f2db0482 could not be found. Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c237b10e-845b-472d-a639-66f8f2db0482'} Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c237b10e-845b-472d-a639-66f8f2db0482 could not be found. Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c237b10e-845b-472d-a639-66f8f2db0482 could not be found. Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:35.423735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c237b10e-845b-472d-a639-66f8f2db0482 could not be found. Oct 26 05:29:35.428613 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:35.430212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] Returning 404 to user: Instance c237b10e-845b-472d-a639-66f8f2db0482 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:35.431243 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-42c34bf5-994a-4192-b6ee-12419ba0d3c4 tempest-ServerRescueNegativeTestJSON-380312682 tempest-ServerRescueNegativeTestJSON-380312682-project] 10.222.0.16 "GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482" status: 404 len: 111 microversion: 2.1 time: 0.075382 Oct 26 05:29:35.432298 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3012/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:35 2022] GET /compute/v2.1/servers/c237b10e-845b-472d-a639-66f8f2db0482 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:38.909122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:38.910345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:38.930030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:38.930796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:38.931433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:38.932334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:38.932965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:38.933603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:38.959668 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] HTTP exception thrown: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Request method failure captured: Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 HTTP/1.1 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMQWf-0DZcjDPK6vE9szFgDmCU6x690eU9o_KQlda_Obi7wVzv7mAr14O0y-qzlL2Cu8DSmHc8JZvnynUVttw6HRL1YrI-dFPF4zfmnbm585vT73ku0b-8vAjqzSiGTQNReH5Ym8wNdyKjZi434An0gIMgS0V7CD9on0yj7DSExsdqs Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: b095e3b8ee8c4fdca403334607c79df2 Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'b2215f5a-5cbe-477f-b610-9a71bb40c5e7'} Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:38.961096 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Returning 404 to user: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a2d52f5f-2d73-4149-ac9a-fa0eec7cffca tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 404 len: 111 microversion: 2.1 time: 0.057952 Oct 26 05:29:38.964947 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3002/6014] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:29:38 2022] DELETE /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:38.978880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:38.981946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] [instance: b2215f5a-5cbe-477f-b610-9a71bb40c5e7] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:38.997678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:38.998188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:38.998676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:38.999455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:38.999922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:39.000352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:39.020842 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] HTTP exception thrown: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Request method failure captured: Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 HTTP/1.1 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMQWf-0DZcjDPK6vE9szFgDmCU6x690eU9o_KQlda_Obi7wVzv7mAr14O0y-qzlL2Cu8DSmHc8JZvnynUVttw6HRL1YrI-dFPF4zfmnbm585vT73ku0b-8vAjqzSiGTQNReH5Ym8wNdyKjZi434An0gIMgS0V7CD9on0yj7DSExsdqs Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd4061413c95466b9bc8c80b8791be6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: bd4061413c95466b9bc8c80b8791be6a Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1588657345 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: b095e3b8ee8c4fdca403334607c79df2 Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-AttachVolumeTestJSON-1588657345-project Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'b2215f5a-5cbe-477f-b610-9a71bb40c5e7'} Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:29:39.023164 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. Oct 26 05:29:39.027390 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:29:39.029360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] Returning 404 to user: Instance b2215f5a-5cbe-477f-b610-9a71bb40c5e7 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:29:39.030446 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1829b92f-22ee-4bf8-8726-25641e514c39 tempest-AttachVolumeTestJSON-1588657345 tempest-AttachVolumeTestJSON-1588657345-project] 10.222.0.16 "GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7" status: 404 len: 111 microversion: 2.1 time: 0.056108 Oct 26 05:29:39.031201 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3013/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:29:38 2022] GET /compute/v2.1/servers/b2215f5a-5cbe-477f-b610-9a71bb40c5e7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:29:51.152569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:51.154871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:51.379347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-686340353", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": "none"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:51.496862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:29:51.497690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:29:51.498870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:29:51.499629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:29:51.500543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:29:51.517185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:51.518478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:51.520136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:51.521593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:51.522604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:51.537415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:51.582716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Getting quotas for project 9f6dcae2a1274c5a8703c2aca40548ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:29:51.599947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Getting quotas for user 5426e48fb0184be7abaf8998bcd55a8f and project 9f6dcae2a1274c5a8703c2aca40548ee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:29:51.628778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:29:51.631070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:29:51.732597 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [cad98b36-7380-4165-9311-b87e77593280] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 05:29:52.747793 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [cad98b36-7380-4165-9311-b87e77593280] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51020. Oct 26 05:29:52.753834 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc6ff0d3-9e52-4849-bf3e-fb085edca986 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.611991 Oct 26 05:29:52.755166 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3003/6016] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 26 05:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 05:29:52.769191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-145fcbc6-1acd-4e86-9355-f9fd8abef59b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:52.773735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-145fcbc6-1acd-4e86-9355-f9fd8abef59b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:52.786836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:52.789415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:29:52.973481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-145fcbc6-1acd-4e86-9355-f9fd8abef59b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:52.997769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-145fcbc6-1acd-4e86-9355-f9fd8abef59b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:53.003299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-145fcbc6-1acd-4e86-9355-f9fd8abef59b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:53.012507 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-145fcbc6-1acd-4e86-9355-f9fd8abef59b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1277 microversion: 2.57 time: 0.249386 Oct 26 05:29:53.013945 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3014/6017] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:52 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:54.042855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:54.043486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:54.051211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:54.051863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:54.052330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:54.053864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:54.054696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:54.055041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:54.205413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:54.225766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:54.229838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:54.233892 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8231372d-60f6-49e5-91ae-d30702f33f03 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1329 microversion: 2.57 time: 0.197017 Oct 26 05:29:54.234539 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3004/6018] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:54 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1329 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:55.268946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:55.269727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:55.279083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:55.279822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:55.281200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:55.282194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:55.282876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:55.283597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:55.388828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:55.400948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:55.403994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:55.405843 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8540bb07-43b9-4270-93b9-201954917682 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1335 microversion: 2.57 time: 0.142047 Oct 26 05:29:55.407111 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3015/6019] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:55 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1335 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:56.447702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:56.448355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:56.472558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:56.473108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:56.473732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:56.474477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:56.474961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:56.476794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:56.727881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:56.762465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:56.766371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:56.769929 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dc726f5-b915-46b4-9a73-413c4bef83f1 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1335 microversion: 2.57 time: 0.337226 Oct 26 05:29:56.770572 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3005/6020] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:56 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1335 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:57.803081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:57.804474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:57.816391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:57.817279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:57.818050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:57.819041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:57.819807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:57.820741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:58.032426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:58.043711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:58.057437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:58.060401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba907702-1c47-4b8f-8e6d-5ab7f176f97d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1335 microversion: 2.57 time: 0.263966 Oct 26 05:29:58.061459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3016/6021] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:57 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1335 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:59.090197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:59.092167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:59.109354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.110378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.113950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.115997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.118328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.118793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.344679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:59.355077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:59.363292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:29:59.364260 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bcfcca98-8cb0-479c-a639-5272f79e1fd3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1356 microversion: 2.57 time: 0.279746 Oct 26 05:29:59.364845 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3006/6022] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:59 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1356 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:29:59.393591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:29:59.397881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:59.419516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.421061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.425202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.428462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.430196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.430559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.630425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:29:59.631317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:29:59.631984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:29:59.632556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:29:59.633342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:29:59.758924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:59.768477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.769201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.770624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.771537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.772229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.772828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.810298 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71e6dbf1-381d-40b0-9676-661de1f4a5cc tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "POST /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02/action" status: 202 len: 1137 microversion: 2.57 time: 0.421274 Oct 26 05:29:59.811684 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3017/6023] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Oct 26 05:29:59 2022] POST /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02/action => generated 1137 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 26 05:29:59.834415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:29:59.835029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:29:59.849027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.849759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.850363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:29:59.851243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:29:59.855049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:29:59.855695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:00.370467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:00.388708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:00.391092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:00.394005 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65739317-05d1-4209-8f5c-838697d3fe08 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.564375 Oct 26 05:30:00.395306 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3007/6024] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:29:59 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:01.426558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:01.432458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:01.440843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:01.442788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:01.445020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:01.448015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:01.452846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:01.453501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:01.647619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:01.668669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:01.671754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:01.677227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8db3da05-5900-4c33-a4a7-647d455e1ef6 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.255791 Oct 26 05:30:01.679861 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3018/6025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:01 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:02.716547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:02.717150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:02.721534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:02.725050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:02.734119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:02.734621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:02.735068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:02.735779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:02.738410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:02.738851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:02.968157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:03.005104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:03.018507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:03.020526 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b47911c3-847c-4a2f-b107-d64ca070870d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.307923 Oct 26 05:30:03.021666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3008/6026] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:02 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:04.052101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:04.053916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:04.058803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:04.075519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:04.085777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:04.086826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:04.091369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:04.092421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:04.093940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:04.456314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:04.473056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:04.474833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:04.483650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f9d963d0-1cb9-4855-8983-664ef4d67dc5 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.433065 Oct 26 05:30:04.484295 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3019/6027] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:04 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:05.517513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:05.518757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:05.529631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:05.530133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:05.530583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:05.531309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:05.531765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:05.536269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:05.810059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:05.835311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:05.838147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:05.840415 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6473c6f8-e2e2-40d8-9b45-2824d8cd844b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.326842 Oct 26 05:30:05.854767 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3009/6028] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:05 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:06.873471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:06.874786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:06.885409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:06.886441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:06.887272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:06.888434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:06.889519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:06.890519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:07.168127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:07.182354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:07.187596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:07.193447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbd2d655-be09-4af9-9b1b-0a2337fde1ec tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.326278 Oct 26 05:30:07.194854 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3020/6029] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:06 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:08.221364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:08.222765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:08.238813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:08.239372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:08.239940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:08.240973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:08.241483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:08.241925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:08.378608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:08.390736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:08.393735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:08.395464 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-179b13f8-d4c1-4c1d-b37f-1ce69f108541 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.179007 Oct 26 05:30:08.397939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3010/6030] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:08 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:09.424514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:09.425689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:09.435666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:09.436159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:09.436604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:09.437340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:09.441972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:09.442434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:09.637420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:09.657399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:09.660353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:09.664770 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc0b0b61-0967-4819-9d3a-4ed3e49c4d4e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.244580 Oct 26 05:30:09.666084 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3021/6031] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:09 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:10.695751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:10.696776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:10.715909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:10.716936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:10.726162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:10.729869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:10.731585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:10.733974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:11.420434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:11.438484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:11.443940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:11.445595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e968353e-8b2f-4297-8af4-4f41fdbd23a3 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.754878 Oct 26 05:30:11.466302 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3011/6032] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:10 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:12.476706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:12.478213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:12.508351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:12.511034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:12.511648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:12.513627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:12.514849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:12.516988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:12.817987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:12.871321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:12.905906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:12.908568 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1a2a8475-de56-477a-a9c6-952f6ad61ecb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.439746 Oct 26 05:30:12.909169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3022/6033] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:12 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:13.936182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:13.937687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:13.957777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:13.958678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:13.962785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:13.963846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:13.964495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:13.965973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:14.099036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:14.108672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:14.110300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:14.112939 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-74424207-018f-4238-ad08-0466668bd614 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.181737 Oct 26 05:30:14.114024 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3012/6034] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:13 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:15.139598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:15.140214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:15.160297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:15.160795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:15.161463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:15.162578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:15.163204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:15.164102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:15.324456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:15.353994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:15.354721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:15.357295 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7fb972e8-2857-4530-96bd-aebd56d866a0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.221710 Oct 26 05:30:15.382930 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3023/6035] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:15 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:16.388171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:16.389525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:16.406134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:16.406702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:16.407162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:16.411136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:16.412075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:16.412764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:16.631076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:16.652659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:16.659940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:16.661285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2706eb5b-62cc-43a4-83c2-3cf307e73c6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.277091 Oct 26 05:30:16.680454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3013/6036] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:16 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:17.692217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:17.692840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:17.702258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:17.702937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:17.703629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:17.704483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:17.705429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:17.705951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:18.099956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:18.113414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:18.115179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:18.116742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4a6efea2-2d17-40f9-bdd4-d0206c1da295 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.429105 Oct 26 05:30:18.138592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3024/6037] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:17 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:19.161734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:19.162504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:19.174702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:19.175347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:19.175796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:19.176744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:19.177215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:19.178376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:19.461998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:19.477357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:19.487410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:19.488903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb997c3b-45c6-440a-943a-9f7c7cfcc6e4 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.338802 Oct 26 05:30:19.505962 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3014/6038] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:19 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:20.522544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:20.523784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:20.540216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:20.543583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:20.544276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:20.545203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:20.547247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:20.550207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:20.777714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:20.787534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:20.789011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:20.790246 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b588c71-d7bf-498d-919b-6b192721de6d tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.271893 Oct 26 05:30:20.790891 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3025/6039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:20 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:21.818836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:21.819981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:21.834774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:21.838677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:21.839543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:21.841509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:21.842496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:21.843739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:21.847473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:21.871133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=69 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:22.080614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:22.091391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:22.099818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:22.101097 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79ff61e9-5c5c-4448-a164-cfb194892407 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.287452 Oct 26 05:30:22.103235 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3015/6040] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:21 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:23.132130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:23.132759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:23.147962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=31 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:23.151202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:23.151701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:23.152148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:23.152889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:23.157669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:23.166626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:23.174666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:30:23.449030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:23.465765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:23.479515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:23.482825 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7938bdb8-6a11-4c73-8cc7-82ffac668b6a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.352912 Oct 26 05:30:23.484910 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3026/6041] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:23 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:24.516095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:24.519533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:24.535017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:24.537682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:24.538438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:24.542619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:24.545148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:24.545841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:24.849135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:24.858720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:24.860189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:24.874479 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9a187cf-322d-4894-93ad-5f7525d7bb04 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.364793 Oct 26 05:30:24.875425 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3016/6042] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:24 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:25.904315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:25.905001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:25.920428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:25.926438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:25.926438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:25.926438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:25.926438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:25.926438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:26.133033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:26.154504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:26.159590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:26.165198 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94fb637f-74f3-482e-979b-862af20db867 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1365 microversion: 2.57 time: 0.265336 Oct 26 05:30:26.169185 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3027/6043] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:25 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:27.198355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:27.198979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:27.232259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:27.232259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:27.232259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:27.232259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:27.232259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:27.233997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:27.368733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:27.383389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:27.390632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:27.408128 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eaf99acb-c52a-4730-9e3c-dc1a0047bd9b tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1371 microversion: 2.57 time: 0.212810 Oct 26 05:30:27.422037 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3017/6044] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:27 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:28.453201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:28.456123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:28.467027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:28.477690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:28.482029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:28.485893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:28.489624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:28.496001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:28.655674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:28.694530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:28.697861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:28.710520 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b5d18bc5-aedf-4e44-9cf5-e7684e44a0f9 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1371 microversion: 2.57 time: 0.271210 Oct 26 05:30:28.717154 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3028/6045] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:28 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:29.741867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:29.742415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:29.755477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:29.755980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:29.756904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:29.757844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:29.759549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:29.774241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:29.991986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:30.003551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:30.005114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:30.006394 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac187eca-f7ff-4285-9600-9aec8f2839cb tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1371 microversion: 2.57 time: 0.269017 Oct 26 05:30:30.016765 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3018/6046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:29 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:31.036830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:31.037843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:31.075431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:31.076220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:31.076826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:31.078208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:31.078839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:31.080219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:31.508811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:31.524280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:31.534351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:31.535616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d9bbcaa-bc29-405a-8623-6ea6d8804fd0 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1356 microversion: 2.57 time: 0.503897 Oct 26 05:30:31.536835 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3029/6047] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:31 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1356 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:31.570807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:31.572038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:31.589804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:31.590663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:31.591380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:31.596319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:31.597090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:31.598369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:31.653068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:30:31.834263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37a64096-7ed0-4555-a76d-a3ca63213960 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 204 len: 0 microversion: 2.57 time: 0.267285 Oct 26 05:30:31.838416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3019/6048] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:30:31 2022] DELETE /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:30:31.846741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:31.849184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:31.863001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:31.865274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:31.866112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:31.867011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:31.867627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:31.868418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:32.065300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:32.088850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:32.094155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:32.096321 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f57de230-fd59-457d-a533-cc34f037f60f tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1362 microversion: 2.57 time: 0.256870 Oct 26 05:30:32.099586 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3030/6049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:31 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:30:33.132165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:33.133607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:33.152095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:33.153101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:33.153725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:33.161053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:33.161668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:33.162192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:33.289210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:33.303879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:33.305381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:33.315495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de3ea45e-cc5c-481c-a87e-556891f16d5e tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1362 microversion: 2.57 time: 0.187994 Oct 26 05:30:33.318362 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3020/6050] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:33 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:34.346657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:34.352861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:34.382701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:34.393377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:34.393873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:34.394907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:34.395093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:34.397489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:34.479001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:34.481662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:34.482330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:34.486308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lazy-loading 'fault' on Instance uuid 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:30:34.583176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:34.600450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:34.630298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5426e48fb0184be7abaf8998bcd55a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6dcae2a1274c5a8703c2aca40548ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:30:34.632983 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e7b72097-910d-4e07-8264-dc737b91bef7 tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 200 len: 1367 microversion: 2.57 time: 0.292631 Oct 26 05:30:34.652558 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3031/6051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:34 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:30:35.676815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:35.682798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] [instance: 92f6af33-a4b6-48f3-81d1-7edb4ca55e02] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:30:35.707495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:35.710471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:35.713304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:35.714322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:30:35.715595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:30:35.716489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:30:35.747166 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] HTTP exception thrown: Instance 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 could not be found. Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Request method failure captured: Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 HTTP/1.1 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMXOb588bgJ9LgGRdOuB2dJYBpBYXmtjSaKK6hvKw1tni5Evc1HsiE9LZMh5076v0oAcNZ3v8tijhJBAUeqXvxuhQ89d8sIE21BiWbvpHohl7iaCw2sAM4eqvD9O6nmKAE1ZwDpsS5f7DPoqVkkOTJKju6kRlaUCuYBZk-UprrgfjSA Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.57 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 9f6dcae2a1274c5a8703c2aca40548ee Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerShowV257Test-1125683175 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f6dcae2a1274c5a8703c2aca40548ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f6dcae2a1274c5a8703c2aca40548ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f6dcae2a1274c5a8703c2aca40548ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f6dcae2a1274c5a8703c2aca40548ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerShowV257Test-1125683175 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 9f6dcae2a1274c5a8703c2aca40548ee Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerShowV257Test-1125683175 Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerShowV257Test-1125683175-project Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 5426e48fb0184be7abaf8998bcd55a8f Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerShowV257Test-1125683175-project Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 could not be found. Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '92f6af33-a4b6-48f3-81d1-7edb4ca55e02'} Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 could not be found. Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 could not be found. Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:30:35.751104 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 could not be found. Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] Returning 404 to user: Instance 92f6af33-a4b6-48f3-81d1-7edb4ca55e02 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69468856-cb35-4369-a5ba-274c4908633a tempest-ServerShowV257Test-1125683175 tempest-ServerShowV257Test-1125683175-project] 10.222.0.16 "GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02" status: 404 len: 111 microversion: 2.57 time: 0.091042 Oct 26 05:30:35.755591 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3021/6052] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:30:35 2022] GET /compute/v2.1/servers/92f6af33-a4b6-48f3-81d1-7edb4ca55e02 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:30:39.943790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9b27c74-70b2-4ea0-b25b-6095132ffd4b tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] Calling method '.version_select at 0x7f47098e7160>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:40.638084 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9b27c74-70b2-4ea0-b25b-6095132ffd4b tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e/defaults" status: 200 len: 371 microversion: 2.1 time: 1.099948 Oct 26 05:30:40.645224 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3032/6053] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:30:39 2022] GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e/defaults => generated 371 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:30:40.651791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-560787ca-4f6d-4bf5-a917-6df737168277 tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] Calling method '.version_select at 0x7f4709eb6a60>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:41.192824 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-560787ca-4f6d-4bf5-a917-6df737168277 tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e" status: 200 len: 371 microversion: 2.1 time: 0.544925 Oct 26 05:30:41.194247 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3022/6054] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:30:40 2022] GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e => generated 371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:30:41.210057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a1972459-45e3-4fb4-83df-dea6050abd4e tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] Calling method '.version_select at 0x7f470927b1f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:41.495297 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a1972459-45e3-4fb4-83df-dea6050abd4e tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.288909 Oct 26 05:30:41.498401 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3033/6055] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 05:30:41 2022] GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e/defaults => generated 371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:30:41.544567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c4d312e2-9fc9-4263-bd2a-514866603a69 tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] Calling method '.version_select at 0x7f4709a755e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:41.973566 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c4d312e2-9fc9-4263-bd2a-514866603a69 tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e" status: 200 len: 371 microversion: 2.1 time: 0.456230 Oct 26 05:30:41.975060 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3023/6056] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:30:41 2022] GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e => generated 371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:30:41.988729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee837db2-dd28-4067-b24d-0e502c3d1063 tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] Calling method '.version_select at 0x7f4709965c10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:30:42.254298 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee837db2-dd28-4067-b24d-0e502c3d1063 tempest-QuotasTestJSON-526253042 tempest-QuotasTestJSON-526253042-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e?user_id=8b664391fac542a78e5d96fa24347818" status: 200 len: 371 microversion: 2.1 time: 0.271812 Oct 26 05:30:42.256220 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3034/6057] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Oct 26 05:30:41 2022] GET /compute/v2.1/os-quota-sets/28fe150125654cf5ac6bd548c6cae71e?user_id=8b664391fac542a78e5d96fa24347818 => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:31:14.564665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:14.568571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:14.570218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:15.052438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:15.053281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:15.077728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:15.079062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:15.080249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:15.085341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:15.085341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:15.085783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:15.160355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:31:15.351219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42c08eab-0a82-41ff-a8a6-ca81fe8830ea tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 204 len: 0 microversion: 2.32 time: 0.800592 Oct 26 05:31:15.352417 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3024/6058] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:31:14 2022] DELETE /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 0 bytes in 804 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 26 05:31:15.366957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:15.367649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:15.371080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=37 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:15.378121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:15.379608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=23 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:15.385015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:15.386008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:15.386686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:15.387613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:15.388364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:15.388957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:16.447110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:16.472951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:16.488240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:16.491616 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da87932a-7762-4802-bbb6-52d6cc606c3e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2959 microversion: 2.32 time: 1.134856 Oct 26 05:31:16.495519 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3035/6059] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:15 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2959 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:17.529369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:17.530152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:17.552459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:17.553515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:17.554198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:17.555178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:17.555877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:17.556524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:19.177478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:19.193243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:19.195072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:19.197367 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a638c69-1560-47e5-aa9c-1ba95d016c0f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2959 microversion: 2.32 time: 1.672357 Oct 26 05:31:19.200898 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3025/6060] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:17 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2959 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:20.238290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:20.239280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:20.256462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:20.258359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:20.260600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:20.262924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:20.265117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:20.267420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:20.818114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:20.844324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:20.848925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:20.853398 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-856c7026-8fdd-43f7-a683-c42b5a0e21b8 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2959 microversion: 2.32 time: 0.620225 Oct 26 05:31:20.856150 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3036/6061] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:20 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2959 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:21.536092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-414ee3bd-d5f8-41dd-bfdb-855ccb369802 req-75f25473-85b6-4888-ad74-4c157b0a0bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb10baf-e87e-4db2-b1b9-faefe496e2a6"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:21.557550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-414ee3bd-d5f8-41dd-bfdb-855ccb369802 req-75f25473-85b6-4888-ad74-4c157b0a0bcb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:21.558042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-414ee3bd-d5f8-41dd-bfdb-855ccb369802 req-75f25473-85b6-4888-ad74-4c157b0a0bcb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:21.558492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-414ee3bd-d5f8-41dd-bfdb-855ccb369802 req-75f25473-85b6-4888-ad74-4c157b0a0bcb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:21.589805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-414ee3bd-d5f8-41dd-bfdb-855ccb369802 req-75f25473-85b6-4888-ad74-4c157b0a0bcb service nova] Creating event network-vif-unplugged:bfb10baf-e87e-4db2-b1b9-faefe496e2a6 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:21.602458 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-414ee3bd-d5f8-41dd-bfdb-855ccb369802 req-75f25473-85b6-4888-ad74-4c157b0a0bcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069338 Oct 26 05:31:21.603285 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3026/6062] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:31:21.887820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:21.888439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:21.905025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:21.905558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:21.906061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:21.915568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:21.916060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:21.916513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:23.013468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:23.034802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:23.037883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:23.041745 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-834ac3e1-d6ac-4122-8aca-eb1615e45ac1 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2938 microversion: 2.32 time: 1.157732 Oct 26 05:31:23.042972 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3037/6063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:21 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2938 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:23.649102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-unplugged", "status": "completed", "tag": "c76aa5e8-aa77-4513-baad-bf666234842a"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-unplugged", "status": "completed", "tag": "bca7f2b0-658e-4f41-9753-1c4d0ba279e8"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-unplugged", "status": "completed", "tag": "7e3b71f1-3354-47aa-8a12-df6bb75c0f29"}, {"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-unplugged", "status": "completed", "tag": "41b9f014-cb69-4f35-8f03-af1f2053ab94"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:23.681505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:23.683230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:23.684061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:23.704771 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Creating event network-vif-unplugged:c76aa5e8-aa77-4513-baad-bf666234842a for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:23.705902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Creating event network-vif-unplugged:bca7f2b0-658e-4f41-9753-1c4d0ba279e8 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:23.706668 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Creating event network-vif-unplugged:7e3b71f1-3354-47aa-8a12-df6bb75c0f29 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:23.707631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] Creating event network-vif-unplugged:41b9f014-cb69-4f35-8f03-af1f2053ab94 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:23.717911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-df80b22b-12c9-40cf-a668-5fe052120035 req-c93a8b68-99c3-4852-8024-93109ce1b02f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.075209 Oct 26 05:31:23.720058 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3027/6064] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:31:24.074553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:24.075133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:24.098000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:24.098707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:24.099335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:24.100233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:24.100853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:24.101473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:24.597961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:24.611910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:24.613565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:24.614923 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be24baa5-c827-4dde-a0ca-05c784d7de1b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2917 microversion: 2.32 time: 0.544807 Oct 26 05:31:24.633347 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3038/6065] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:24 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2917 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:25.652846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:25.653986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:25.677468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:25.681783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:25.682406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:25.683315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:25.684549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:25.685113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:26.130455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:26.146916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:26.155242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:26.157561 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-98a474a0-8686-4345-96bf-82eb332d12be tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2917 microversion: 2.32 time: 0.509036 Oct 26 05:31:26.158617 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3028/6066] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:25 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2917 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:27.188866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:27.189535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:27.206558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:27.207077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:27.207530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:27.213111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:27.213659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:27.214111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:27.630235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4a41c11d-3b77-40e4-ac18-ac4accf6ce5b req-3ebc9048-43cd-453c-b15b-5b6fdcb418c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-deleted", "tag": "41b9f014-cb69-4f35-8f03-af1f2053ab94"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:27.638291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:27.652848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a41c11d-3b77-40e4-ac18-ac4accf6ce5b req-3ebc9048-43cd-453c-b15b-5b6fdcb418c9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:27.653673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a41c11d-3b77-40e4-ac18-ac4accf6ce5b req-3ebc9048-43cd-453c-b15b-5b6fdcb418c9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:27.657404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a41c11d-3b77-40e4-ac18-ac4accf6ce5b req-3ebc9048-43cd-453c-b15b-5b6fdcb418c9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:27.663981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:27.667848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:27.685461 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b52a63a-2ace-4f00-8e13-87458a4966aa tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2870 microversion: 2.32 time: 0.489235 Oct 26 05:31:27.686479 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3039/6067] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:27 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2870 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:27.697652 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4a41c11d-3b77-40e4-ac18-ac4accf6ce5b req-3ebc9048-43cd-453c-b15b-5b6fdcb418c9 service nova] Creating event network-vif-deleted:41b9f014-cb69-4f35-8f03-af1f2053ab94 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:27.712132 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4a41c11d-3b77-40e4-ac18-ac4accf6ce5b req-3ebc9048-43cd-453c-b15b-5b6fdcb418c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084481 Oct 26 05:31:27.712832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3029/6068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:31:28.716260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:28.716894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:28.732141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:28.732893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:28.733596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:28.734893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:28.737989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:28.740493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:29.132561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:29.150632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:29.152814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:29.154537 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-034fe9d1-a2c6-406e-8315-c628cb5eb59d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2757 microversion: 2.32 time: 0.442290 Oct 26 05:31:29.179243 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3040/6069] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:28 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2757 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:30.188786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:30.189628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:30.211687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:30.213646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:30.214107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:30.218446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:30.218946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:30.219507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:31.076505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:31.114787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-70499377-9ce7-4fdb-aca7-abf0dd9a6943 req-41dc7b8a-1726-4667-96e8-e34978879470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-deleted", "tag": "bfb10baf-e87e-4db2-b1b9-faefe496e2a6"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:31.131768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:31.133621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:31.137052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70499377-9ce7-4fdb-aca7-abf0dd9a6943 req-41dc7b8a-1726-4667-96e8-e34978879470 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:31.138009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70499377-9ce7-4fdb-aca7-abf0dd9a6943 req-41dc7b8a-1726-4667-96e8-e34978879470 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:31.139495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1ef815f-9acc-4bd2-9529-c357d8e32f3d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2757 microversion: 2.32 time: 0.954118 Oct 26 05:31:31.141795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-70499377-9ce7-4fdb-aca7-abf0dd9a6943 req-41dc7b8a-1726-4667-96e8-e34978879470 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:31.143050 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3030/6070] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:30 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2757 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:31.175824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-70499377-9ce7-4fdb-aca7-abf0dd9a6943 req-41dc7b8a-1726-4667-96e8-e34978879470 service nova] Creating event network-vif-deleted:bfb10baf-e87e-4db2-b1b9-faefe496e2a6 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:31.187046 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-70499377-9ce7-4fdb-aca7-abf0dd9a6943 req-41dc7b8a-1726-4667-96e8-e34978879470 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076029 Oct 26 05:31:31.188790 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3041/6071] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:31:32.186318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:32.189128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:32.212802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:32.215325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:32.216244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:32.221526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:32.222200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:32.225909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:33.309016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cd68e003-e8d1-4f9b-88e0-f9afe4bc7415 req-21deb857-e244-45c4-8ff7-bcc9efd1d452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-deleted", "tag": "bca7f2b0-658e-4f41-9753-1c4d0ba279e8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:33.340870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cd68e003-e8d1-4f9b-88e0-f9afe4bc7415 req-21deb857-e244-45c4-8ff7-bcc9efd1d452 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:33.342920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cd68e003-e8d1-4f9b-88e0-f9afe4bc7415 req-21deb857-e244-45c4-8ff7-bcc9efd1d452 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:33.344450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cd68e003-e8d1-4f9b-88e0-f9afe4bc7415 req-21deb857-e244-45c4-8ff7-bcc9efd1d452 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:33.386380 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cd68e003-e8d1-4f9b-88e0-f9afe4bc7415 req-21deb857-e244-45c4-8ff7-bcc9efd1d452 service nova] Creating event network-vif-deleted:bca7f2b0-658e-4f41-9753-1c4d0ba279e8 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:33.410766 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cd68e003-e8d1-4f9b-88e0-f9afe4bc7415 req-21deb857-e244-45c4-8ff7-bcc9efd1d452 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107611 Oct 26 05:31:33.413753 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3042/6072] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:31:33.498473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:33.528403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:33.534963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:33.539682 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2656c1e-26a9-4b73-b9fe-9af97776cefc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2549 microversion: 2.32 time: 1.363084 Oct 26 05:31:33.545252 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3031/6073] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:32 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2549 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:34.582104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:34.583505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:34.591567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:34.594146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:34.597020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:34.598475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:34.600960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:34.601656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:35.377025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:35.401452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:35.402993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:35.404261 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ffaa3bf-018a-4000-822f-124c147fc63e tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2388 microversion: 2.32 time: 0.830680 Oct 26 05:31:35.411255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3043/6074] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:34 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2388 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:36.463862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:36.464584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:36.490554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:36.491082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:36.491520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:36.497250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:36.497957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:36.498597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:36.916306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-780b084d-ddc5-4789-9fbd-d8313c0b1399 req-310446e9-3271-46ab-882b-20857b4e15b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-deleted", "tag": "c76aa5e8-aa77-4513-baad-bf666234842a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:36.949066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-780b084d-ddc5-4789-9fbd-d8313c0b1399 req-310446e9-3271-46ab-882b-20857b4e15b5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:36.953284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-780b084d-ddc5-4789-9fbd-d8313c0b1399 req-310446e9-3271-46ab-882b-20857b4e15b5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:36.962257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-780b084d-ddc5-4789-9fbd-d8313c0b1399 req-310446e9-3271-46ab-882b-20857b4e15b5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:37.003974 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-780b084d-ddc5-4789-9fbd-d8313c0b1399 req-310446e9-3271-46ab-882b-20857b4e15b5 service nova] Creating event network-vif-deleted:c76aa5e8-aa77-4513-baad-bf666234842a for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:37.021847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-780b084d-ddc5-4789-9fbd-d8313c0b1399 req-310446e9-3271-46ab-882b-20857b4e15b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109602 Oct 26 05:31:37.028829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3044/6075] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:31:38.011220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:38.027646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:38.029593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:38.031758 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cae5abd-6ebd-4f0d-b18c-79f005399739 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2388 microversion: 2.32 time: 1.584241 Oct 26 05:31:38.035356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3032/6076] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:36 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2388 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:39.066638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:39.068239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:39.084462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:39.086044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:39.089556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:39.091667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:39.095023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:39.095957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:39.310283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b7e89dbc-390b-41d8-b37e-a8951f4a6aff req-cced8344-f371-4cdb-b336-afdff613f36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013bd524-4767-4fcd-8864-1986ef2723bc", "name": "network-vif-deleted", "tag": "7e3b71f1-3354-47aa-8a12-df6bb75c0f29"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:31:39.336770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:39.341633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b7e89dbc-390b-41d8-b37e-a8951f4a6aff req-cced8344-f371-4cdb-b336-afdff613f36d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:39.349019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b7e89dbc-390b-41d8-b37e-a8951f4a6aff req-cced8344-f371-4cdb-b336-afdff613f36d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:39.350585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b7e89dbc-390b-41d8-b37e-a8951f4a6aff req-cced8344-f371-4cdb-b336-afdff613f36d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:39.353532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:39.359825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:39.368763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ecb74e70-f657-46ea-a85c-18cd17c592ce tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 2032 microversion: 2.32 time: 0.308822 Oct 26 05:31:39.372926 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3045/6077] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:39 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 2032 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:39.419391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b7e89dbc-390b-41d8-b37e-a8951f4a6aff req-cced8344-f371-4cdb-b336-afdff613f36d service nova] Creating event network-vif-deleted:7e3b71f1-3354-47aa-8a12-df6bb75c0f29 for instance 013bd524-4767-4fcd-8864-1986ef2723bc on n-h1-862416-4 Oct 26 05:31:39.443138 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b7e89dbc-390b-41d8-b37e-a8951f4a6aff req-cced8344-f371-4cdb-b336-afdff613f36d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142431 Oct 26 05:31:39.443805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3033/6078] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:31:40.406382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:40.408539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:40.449528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:40.450321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:40.450930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:40.451825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:40.454453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:40.455092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:40.862305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:40.879528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:40.881008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:40.883699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8394bfc0-5e82-4862-b0cd-5194e9f21186 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.484971 Oct 26 05:31:40.908490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3046/6079] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:40 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:41.926614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:41.928508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:41.978255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:41.978833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:41.979292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:41.980283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:41.980752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:41.981191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:42.239846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:42.256371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:42.258842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:42.261287 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4f88ce3-ac09-48fd-b682-5da7375066c2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.345185 Oct 26 05:31:42.262486 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3034/6080] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:41 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:43.291311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:43.292597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:43.317147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:43.320761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:43.322159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:43.326909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:43.330458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:43.331688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:44.158081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:44.173480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:44.178599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:44.182033 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7d44a32b-3723-4adc-aa96-b5a39c53d56f tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.894757 Oct 26 05:31:44.188870 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3047/6081] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:43 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:45.219278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:45.219758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:45.222976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:45.243037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:45.247026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:45.248706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:45.250300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:45.253267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:45.255189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:45.317051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:45.526536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:45.541632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:45.543549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:45.550839 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dbf626e-7c45-4912-b1a4-b7252b601e84 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.336635 Oct 26 05:31:45.562398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3035/6082] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:45 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:46.584004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:46.584625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:46.587543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=27 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:46.601549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:46.605510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:46.610003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:46.611048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:46.611601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:46.612211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:46.616695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=67 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:31:46.750178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:46.777684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:46.779467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:46.782991 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b6c817e-2f56-460e-b13a-cdae53fce4f0 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.202949 Oct 26 05:31:46.784101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3048/6083] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:46 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:47.818103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:47.821505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:47.835212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:47.836604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:47.853940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:47.860258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:47.861465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:47.865435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:48.144779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:48.165852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:48.179251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:48.190354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e74b1ff-91c4-421a-877c-1971576a2ddb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.381819 Oct 26 05:31:48.207377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3036/6084] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:47 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:49.225099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:49.228633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:49.256156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:49.256656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:49.257105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:49.257853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:49.258314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:49.258745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:49.651742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:49.670564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:49.673515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:49.683166 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4d5a2de7-8153-408c-8518-bf8c17d3569b tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.465785 Oct 26 05:31:49.686454 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3049/6085] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:49 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:50.721338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:50.723339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:50.732695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:50.733903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:50.734467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:50.735385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:50.735993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:50.736664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:51.152260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:51.215662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:51.219279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:51.223347 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6527c763-366d-44ea-908c-2390c95295bc tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.503758 Oct 26 05:31:51.239307 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3037/6086] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:50 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:52.252967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:52.255454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:52.278324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:52.279178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:52.282290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:52.286281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:52.287032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:52.287675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:52.600283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:52.644946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:52.676681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:52.685409 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fb424e7-25fc-438a-955a-dc9f6d5dc638 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.436882 Oct 26 05:31:52.704998 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3050/6087] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:52 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:53.727797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:53.728426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:53.753421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:53.753421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:53.753421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:53.753421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:53.753421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:53.753421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:53.912662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:53.924975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:53.939370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:53.941125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-635f73b4-51f4-48ac-ae1d-7e01044f7108 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.217296 Oct 26 05:31:53.942084 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3038/6088] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:53 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:54.972598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:54.974112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:54.991963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:55.002428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:55.003295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:55.004394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:55.005143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:55.005915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:55.392363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:55.403805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:55.421085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:55.428078 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d001d57-df6b-49af-9555-d23cf5714087 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.459329 Oct 26 05:31:55.429869 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3051/6089] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:54 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:31:56.460615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:56.461955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:56.479975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:56.480696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:56.481742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:56.485301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:56.487694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:56.488260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:57.799283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:57.824041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:57.827497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:57.829191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2a6ec58-9e83-42e5-9090-c44b11d8551d tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 1.372869 Oct 26 05:31:57.830406 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3039/6090] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:56 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:31:58.861772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:31:58.863200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:31:58.875526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:58.879420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:58.880140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:58.881276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:31:58.894114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:31:58.894976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:31:59.110953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:59.161064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:59.170889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:31:59.172164 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20258f15-86c1-449f-b5c0-b4921a0502bb tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.315449 Oct 26 05:31:59.177041 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3052/6091] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:31:58 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:00.222974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:00.224335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:00.243197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:00.247659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:00.248350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:00.252117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:00.252858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:00.253537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:00.620047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:00.646924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:00.648718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:00.650173 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d466d70a-4b43-4c01-9990-ef5d3faf7337 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.445981 Oct 26 05:32:00.668189 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3040/6092] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:00 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 05:32:01.678815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:01.679478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:01.697207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:01.703577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:01.707196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:01.708006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:01.709685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:01.714225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:02.095864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:02.158754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:02.164092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:02.167775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a2a07bd-3c1b-4e51-9ec4-e570e9c421e3 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.493383 Oct 26 05:32:02.179448 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3053/6093] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:01 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:03.202534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:03.203948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:03.216011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:03.216771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:03.223854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:03.224926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:03.225616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:03.226218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:03.544459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:03.604304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:03.620712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:03.643968 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64cfa72d-f801-439f-bfe5-b822e9062880 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.445714 Oct 26 05:32:03.657345 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3041/6094] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:03 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:04.674996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:04.675621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:04.698896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:04.699402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:04.725542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:04.727373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:04.728446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:04.728899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:04.980646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:05.011545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:05.021790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:05.027598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16c8279e-ab93-48ad-aad1-e870e0425701 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.357168 Oct 26 05:32:05.034771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3054/6095] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:04 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:06.063860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:06.064486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:06.083272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:06.085924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:06.088575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:06.095883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:06.102621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:06.107332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:06.565665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:06.595635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:06.600135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:06.604212 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7856b3bd-7605-4b43-820f-24bd42fdc9e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.544871 Oct 26 05:32:06.610832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3042/6096] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:06 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:07.645389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:07.648081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:07.669976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:07.673428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:07.677241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:07.680129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:07.681030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:07.683038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:08.006384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:08.017833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:08.027900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:08.032546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3de739d1-9f04-4970-9a15-14ec70f753e7 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.395815 Oct 26 05:32:08.035366 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3055/6097] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:07 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:09.066163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:09.066798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:09.097457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:09.098542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:09.099820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:09.102196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:09.103874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:09.109816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:09.410457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:09.420787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:09.439307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05121fe0d9804c11a7403ddffd37f42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821c88694a6546eebf13b429a34bf057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:09.440732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0eeee082-3598-4f40-98ab-210007199d14 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 200 len: 1604 microversion: 2.32 time: 0.381776 Oct 26 05:32:09.443749 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3043/6098] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:09 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 1604 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 05:32:10.481427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:10.483855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:10.520942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:10.522942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:10.525539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:10.530817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:10.532008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:10.532624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:10.600193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] HTTP exception thrown: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Request method failure captured: Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc HTTP/1.1 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMTCnpY6xJSwe62WQHoV5uGlM4lfYyQu-sxhz3zEoFphUzz34_2CsUWfgNhbCTioaQaPmHFZ6nbtd_iTWYpWQU8YYPBN_vROQ24OqI8aI3At_e4mj7zuDOiWpj1EF-tyGOMdLqlaQl7YobYFIVrC0pUjbHpPzD7CyGkolAIzsuw6sxI Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.32 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 821c88694a6546eebf13b429a34bf057 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_821c88694a6546eebf13b429a34bf057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/821c88694a6546eebf13b429a34bf057"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/821c88694a6546eebf13b429a34bf057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/821c88694a6546eebf13b429a34bf057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 821c88694a6546eebf13b429a34bf057 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TaggedBootDevicesTest-464290028-project Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 05121fe0d9804c11a7403ddffd37f42f Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TaggedBootDevicesTest-464290028-project Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '013bd524-4767-4fcd-8864-1986ef2723bc'} Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:10.603806 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:10.611358 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:10.614694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Returning 404 to user: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:32:10.616252 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-828aa3c5-97ee-4d9e-9e13-8eecb61f62a5 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 404 len: 111 microversion: 2.32 time: 0.145426 Oct 26 05:32:10.617381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3056/6099] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:10 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:32:10.628289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bac76770-af74-45db-8539-7e9a60c46d4a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '.version_select at 0x7f4709abf820>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:10.633768 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bac76770-af74-45db-8539-7e9a60c46d4a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 05:32:11.646000 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-bac76770-af74-45db-8539-7e9a60c46d4a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54124. Oct 26 05:32:11.695361 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bac76770-af74-45db-8539-7e9a60c46d4a tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812566541" status: 204 len: 0 microversion: 2.32 time: 1.073201 Oct 26 05:32:11.696736 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3044/6100] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 26 05:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812566541 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 05:32:25.569237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:25.570702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:25.585813 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:32:25.586790 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc (ip 10.222.0.16) !!! Oct 26 05:32:25.595417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=17 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:25.597063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=49 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:25.639980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:25.642220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:25.644993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:25.647395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:25.650603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:25.651999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:25.690293 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] HTTP exception thrown: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Request method failure captured: Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc HTTP/1.1 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMTCnpY6xJSwe62WQHoV5uGlM4lfYyQu-sxhz3zEoFphUzz34_2CsUWfgNhbCTioaQaPmHFZ6nbtd_iTWYpWQU8YYPBN_vROQ24OqI8aI3At_e4mj7zuDOiWpj1EF-tyGOMdLqlaQl7YobYFIVrC0pUjbHpPzD7CyGkolAIzsuw6sxI Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Openstack-Nova-Api-Version: 2.32 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 821c88694a6546eebf13b429a34bf057 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_821c88694a6546eebf13b429a34bf057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/821c88694a6546eebf13b429a34bf057"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/821c88694a6546eebf13b429a34bf057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/821c88694a6546eebf13b429a34bf057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 821c88694a6546eebf13b429a34bf057 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TaggedBootDevicesTest-464290028-project Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 05121fe0d9804c11a7403ddffd37f42f Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TaggedBootDevicesTest-464290028-project Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '013bd524-4767-4fcd-8864-1986ef2723bc'} Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:32:25.692044 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.697001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Returning 404 to user: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:32:25.697965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10bb138c-80c9-4935-b12c-f92e236fbb32 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 404 len: 111 microversion: 2.32 time: 0.131759 Oct 26 05:32:25.702462 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3057/6101] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 26 05:32:25 2022] DELETE /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 05:32:25.708555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=53 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:25.710633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:25.715379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:25.717521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] [instance: 013bd524-4767-4fcd-8864-1986ef2723bc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:25.725191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:25.726482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:25.728017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:25.728948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:25.729616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:25.730214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:25.756235 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] HTTP exception thrown: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Request method failure captured: Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc HTTP/1.1 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMTCnpY6xJSwe62WQHoV5uGlM4lfYyQu-sxhz3zEoFphUzz34_2CsUWfgNhbCTioaQaPmHFZ6nbtd_iTWYpWQU8YYPBN_vROQ24OqI8aI3At_e4mj7zuDOiWpj1EF-tyGOMdLqlaQl7YobYFIVrC0pUjbHpPzD7CyGkolAIzsuw6sxI Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Openstack-Nova-Api-Version: 2.32 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 821c88694a6546eebf13b429a34bf057 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_821c88694a6546eebf13b429a34bf057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/821c88694a6546eebf13b429a34bf057"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/821c88694a6546eebf13b429a34bf057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/821c88694a6546eebf13b429a34bf057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 821c88694a6546eebf13b429a34bf057 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TaggedBootDevicesTest-464290028 Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TaggedBootDevicesTest-464290028-project Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 05121fe0d9804c11a7403ddffd37f42f Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TaggedBootDevicesTest-464290028-project Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '013bd524-4767-4fcd-8864-1986ef2723bc'} Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:25.758857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] Returning 404 to user: Instance 013bd524-4767-4fcd-8864-1986ef2723bc could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:32:25.763986 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-06021397-a00f-4a9e-86d0-746859013bc2 tempest-TaggedBootDevicesTest-464290028 tempest-TaggedBootDevicesTest-464290028-project] 10.222.0.16 "GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc" status: 404 len: 111 microversion: 2.32 time: 0.053915 Oct 26 05:32:25.775773 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3045/6102] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 26 05:32:25 2022] GET /compute/v2.1/servers/013bd524-4767-4fcd-8864-1986ef2723bc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 05:32:37.807859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:37.810666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:38.382775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:38.383048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:38.397867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:38.401732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:38.405771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:38.406554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:38.407033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:38.407472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:38.495536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:32:38.770428 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2f098343-7de1-43ab-b1d2-7f3cc46e605a tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 204 len: 0 microversion: 2.1 time: 0.971848 Oct 26 05:32:38.799578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:38.804537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:38.809377 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3058/6103] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:32:37 2022] DELETE /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 0 bytes in 976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:32:38.822295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:32:38.825234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:38.826952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:38.828996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:38.831027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:38.831717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:38.835585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:39.249052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:39.259758 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3df0992d-c609-4f4d-99a2-c4ad1b481295 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1730 microversion: 2.1 time: 0.474062 Oct 26 05:32:39.260480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3046/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:38 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1730 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:32:40.317133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:40.318544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:40.354706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:40.355432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:40.358832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:40.360004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:40.360655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:40.363825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:40.881523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:40.921198 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24d69cc7-f389-4d8a-83ed-f57757113035 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1730 microversion: 2.1 time: 0.605845 Oct 26 05:32:40.922356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3059/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:40 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1730 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:32:41.950254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:41.952226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:41.993676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:41.994450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:42.002450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:42.003820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:42.008120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:42.008879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:43.009544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:43.036491 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a138b1e-801f-4edb-bd24-09f1b57e4967 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1730 microversion: 2.1 time: 1.092175 Oct 26 05:32:43.041793 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3047/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:41 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1730 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:32:44.081727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:44.082448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:44.140868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:44.144631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:44.153725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:44.165408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:44.167434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:44.173697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:44.584512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8768922b-9cc7-4a03-a53a-df38fd8022b6 req-36486784-ac65-422b-8f27-343dd524c91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e28cb4d-d869-42ec-9af8-c355a279dcca", "name": "network-vif-unplugged", "status": "completed", "tag": "67a1609a-d65b-486e-8ecd-ae8dab55fe45"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:32:44.604770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8768922b-9cc7-4a03-a53a-df38fd8022b6 req-36486784-ac65-422b-8f27-343dd524c91a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:44.605699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8768922b-9cc7-4a03-a53a-df38fd8022b6 req-36486784-ac65-422b-8f27-343dd524c91a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:44.606321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8768922b-9cc7-4a03-a53a-df38fd8022b6 req-36486784-ac65-422b-8f27-343dd524c91a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:44.622382 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8768922b-9cc7-4a03-a53a-df38fd8022b6 req-36486784-ac65-422b-8f27-343dd524c91a service nova] Creating event network-vif-unplugged:67a1609a-d65b-486e-8ecd-ae8dab55fe45 for instance 8e28cb4d-d869-42ec-9af8-c355a279dcca on n-h1-862416-4 Oct 26 05:32:44.630016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:44.631041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8768922b-9cc7-4a03-a53a-df38fd8022b6 req-36486784-ac65-422b-8f27-343dd524c91a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.733309 Oct 26 05:32:44.631840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3060/6107] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:32:44.640573 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bcbb4960-24c6-412d-a5af-53aa8b90322d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1730 microversion: 2.1 time: 0.571926 Oct 26 05:32:44.658290 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3048/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:44 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1730 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:32:45.665754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:45.666474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:45.680281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:45.680786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:45.681241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:45.682008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:45.682470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:45.693260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:46.505353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0f7aa41c-288e-439a-a723-797117a0877f req-47df2e88-42b7-4d9a-b916-22f9d2a3e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e28cb4d-d869-42ec-9af8-c355a279dcca", "name": "network-vif-deleted", "tag": "67a1609a-d65b-486e-8ecd-ae8dab55fe45"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:32:46.521585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0f7aa41c-288e-439a-a723-797117a0877f req-47df2e88-42b7-4d9a-b916-22f9d2a3e1ca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:46.522069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0f7aa41c-288e-439a-a723-797117a0877f req-47df2e88-42b7-4d9a-b916-22f9d2a3e1ca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:46.542951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0f7aa41c-288e-439a-a723-797117a0877f req-47df2e88-42b7-4d9a-b916-22f9d2a3e1ca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:46.556865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec959d88c9c6423caf0800f18bb824a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e39546631e4ce1ad152b2afebc3737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:32:46.568739 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0f7aa41c-288e-439a-a723-797117a0877f req-47df2e88-42b7-4d9a-b916-22f9d2a3e1ca service nova] Creating event network-vif-deleted:67a1609a-d65b-486e-8ecd-ae8dab55fe45 for instance 8e28cb4d-d869-42ec-9af8-c355a279dcca on n-h1-862416-4 Oct 26 05:32:46.575089 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81aa7755-8013-4777-8b42-611cd51afc76 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 200 len: 1663 microversion: 2.1 time: 0.914729 Oct 26 05:32:46.578865 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3061/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:45 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 1663 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:32:46.594009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0f7aa41c-288e-439a-a723-797117a0877f req-47df2e88-42b7-4d9a-b916-22f9d2a3e1ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.676718 Oct 26 05:32:46.594009 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3049/6110] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:32:47.606707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:47.607426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:47.619555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:47.620324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:47.622268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:47.627740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:47.628250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:47.628703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:47.669141 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] HTTP exception thrown: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Request method failure captured: Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca HTTP/1.1 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMUspZCCS2JzQGnIvvZPpkNmsA8sglPan4SpMaWcUHDubAOVm1ir0gROMQtKIdrB3sGo5tpBrxhX5RIcluqKb03ZW1c4jl4SnKrpjn49ek7ChiRLbi8TaLSUKFXE05tWyGdC6W7WyvSiyeYkZPJ3uuI4sWqA6Xf0pg1Elgb4aC-mhIU Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 04e39546631e4ce1ad152b2afebc3737 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 04e39546631e4ce1ad152b2afebc3737 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestServerBasicOps-1517927978-project Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ec959d88c9c6423caf0800f18bb824a5 Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestServerBasicOps-1517927978-project Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8e28cb4d-d869-42ec-9af8-c355a279dcca'} Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:47.674219 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:47.679614 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:47.687874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Returning 404 to user: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:32:47.688979 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7155126-fcd3-4944-888d-562fde502fc4 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 404 len: 111 microversion: 2.1 time: 0.086225 Oct 26 05:32:47.689999 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3062/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:47 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:32:50.861648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:50.862836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:50.882527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:50.883445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:50.884060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:50.886265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:50.896374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:50.897111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:50.932495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] HTTP exception thrown: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Request method failure captured: Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca HTTP/1.1 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMUspZCCS2JzQGnIvvZPpkNmsA8sglPan4SpMaWcUHDubAOVm1ir0gROMQtKIdrB3sGo5tpBrxhX5RIcluqKb03ZW1c4jl4SnKrpjn49ek7ChiRLbi8TaLSUKFXE05tWyGdC6W7WyvSiyeYkZPJ3uuI4sWqA6Xf0pg1Elgb4aC-mhIU Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 04e39546631e4ce1ad152b2afebc3737 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 04e39546631e4ce1ad152b2afebc3737 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestServerBasicOps-1517927978-project Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: ec959d88c9c6423caf0800f18bb824a5 Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestServerBasicOps-1517927978-project Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '8e28cb4d-d869-42ec-9af8-c355a279dcca'} Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:32:50.934256 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:32:50.939581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Returning 404 to user: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:32:50.953635 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b82f8b77-ea75-442f-8cc3-773ee4903e03 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 404 len: 111 microversion: 2.1 time: 0.092211 Oct 26 05:32:50.957209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3050/6112] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:32:50 2022] DELETE /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:32:50.962361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:50.962981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] [instance: 8e28cb4d-d869-42ec-9af8-c355a279dcca] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:32:50.981118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:50.982568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:50.983028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:50.983788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:32:50.984246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:32:50.984675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:32:51.019695 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] HTTP exception thrown: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Request method failure captured: Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca HTTP/1.1 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMUspZCCS2JzQGnIvvZPpkNmsA8sglPan4SpMaWcUHDubAOVm1ir0gROMQtKIdrB3sGo5tpBrxhX5RIcluqKb03ZW1c4jl4SnKrpjn49ek7ChiRLbi8TaLSUKFXE05tWyGdC6W7WyvSiyeYkZPJ3uuI4sWqA6Xf0pg1Elgb4aC-mhIU Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 04e39546631e4ce1ad152b2afebc3737 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04e39546631e4ce1ad152b2afebc3737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 04e39546631e4ce1ad152b2afebc3737 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestServerBasicOps-1517927978 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestServerBasicOps-1517927978-project Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: ec959d88c9c6423caf0800f18bb824a5 Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestServerBasicOps-1517927978-project Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '8e28cb4d-d869-42ec-9af8-c355a279dcca'} Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:32:51.025444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Returning 404 to user: Instance 8e28cb4d-d869-42ec-9af8-c355a279dcca could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:32:51.030623 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca" status: 404 len: 111 microversion: 2.1 time: 0.068418 Oct 26 05:32:51.032330 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3063/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:32:50 2022] GET /compute/v2.1/servers/8e28cb4d-d869-42ec-9af8-c355a279dcca => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:32:51.730976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-873d6b8d-180a-4093-bbc6-4dc25ea4233d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '.version_select at 0x7f4709eea9d0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:32:51.771989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-873d6b8d-180a-4093-bbc6-4dc25ea4233d tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-639495486" status: 202 len: 0 microversion: 2.1 time: 0.044942 Oct 26 05:32:51.772897 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3051/6114] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 26 05:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-639495486 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:33:24.851888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:33:24.853002 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e1f3fe4-68bb-42bb-85a9-343b9fc26ae5 tempest-TestServerBasicOps-1517927978 tempest-TestServerBasicOps-1517927978-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001378 Oct 26 05:33:24.853451 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3064/6115] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 26 05:33:24 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 26 05:34:19.700236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=22 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:34:19.701026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:34:20.287169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7e24814-b7fa-433b-ac4f-ec6b04800253 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1784435233", "availability_zone": "foo_zone"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:34:20.291841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.aggregate [None req-c7e24814-b7fa-433b-ac4f-ec6b04800253 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Generated uuid 1aa6e305-6c73-4f2d-a2ba-d6be1c190d79 for aggregate {{(pid=120586) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 26 05:34:20.356118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7e24814-b7fa-433b-ac4f-ec6b04800253 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.663694 Oct 26 05:34:20.357244 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3052/6116] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 26 05:34:19 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:20.376579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:34:20.386799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:34:20.405946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fdb03499-edea-48ef-83bf-d2fe15488a1e tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:34:20.551206 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fdb03499-edea-48ef-83bf-d2fe15488a1e tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.175492 Oct 26 05:34:20.563128 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3065/6117] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:34:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:20.566822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:34:20.570500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:34:20.571001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:34:20.571454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:34:20.583660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:34:20.584346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:34:20.584804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:34:20.659969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8c54899-6b2d-4aca-ae44-27e3a7f54b96 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097605 Oct 26 05:34:20.660981 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3053/6118] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 26 05:34:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:20.672928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16e8524c-6d65-4953-a063-2e4c05e47048 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:34:20.700058 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16e8524c-6d65-4953-a063-2e4c05e47048 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.029838 Oct 26 05:34:20.703070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3066/6119] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 26 05:34:20 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:20.720800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d804cc98-f23c-4935-80f2-67a94d12c189 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-4"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:34:20.756426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d804cc98-f23c-4935-80f2-67a94d12c189 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:34:20.759391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d804cc98-f23c-4935-80f2-67a94d12c189 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:34:20.760078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d804cc98-f23c-4935-80f2-67a94d12c189 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:34:21.463305 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d804cc98-f23c-4935-80f2-67a94d12c189 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.748179 Oct 26 05:34:21.463953 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3054/6120] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:34:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:21.481464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11483e37-fc7d-4515-979c-00b3e68e4b88 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:34:21.509971 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11483e37-fc7d-4515-979c-00b3e68e4b88 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.038291 Oct 26 05:34:21.510674 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3067/6121] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:34:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:21.523739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5156d58-b800-4a46-820b-db6c84ed38ae tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-4248200", "availability_zone": "foo_zone"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:34:21.631877 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5156d58-b800-4a46-820b-db6c84ed38ae tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 339 microversion: 2.1 time: 0.111746 Oct 26 05:34:21.632725 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3055/6122] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 26 05:34:21 2022] PUT /compute/v2.1/os-aggregates/19 => generated 339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:21.645678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-489aecb8-50d9-415d-9fa1-31b9539af79f tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:34:21.691562 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-489aecb8-50d9-415d-9fa1-31b9539af79f tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 353 microversion: 2.1 time: 0.050510 Oct 26 05:34:21.692526 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3068/6123] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:34:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:21.704792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35f6d387-9b16-4021-b7a0-1874a0b6824f tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:34:21.756260 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35f6d387-9b16-4021-b7a0-1874a0b6824f tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 353 microversion: 2.1 time: 0.054974 Oct 26 05:34:21.760790 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3056/6124] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 26 05:34:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:21.779387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ca46d3d-bcde-4a3f-9ee5-7ca76b60fdb1 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-4"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:34:21.814273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca46d3d-bcde-4a3f-9ee5-7ca76b60fdb1 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:34:21.814934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca46d3d-bcde-4a3f-9ee5-7ca76b60fdb1 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:34:21.815966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ca46d3d-bcde-4a3f-9ee5-7ca76b60fdb1 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:34:22.378353 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ca46d3d-bcde-4a3f-9ee5-7ca76b60fdb1 tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 338 microversion: 2.1 time: 0.611654 Oct 26 05:34:22.381763 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3069/6125] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 26 05:34:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 338 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:34:22.394326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6291e9c1-9cf1-46fd-be41-e7b467df2f2c tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:34:22.468758 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6291e9c1-9cf1-46fd-be41-e7b467df2f2c tempest-TestAggregatesBasicOps-1432383967 tempest-TestAggregatesBasicOps-1432383967-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.078119 Oct 26 05:34:22.470748 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3057/6126] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 26 05:34:22 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 26 05:35:41.101407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:41.102196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:41.107270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1263132500", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "69b3e4c1-a360-4a53-9776-7365068ef074", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:35:41.313726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:35:45.080463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:35:45.081679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:35:45.082406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:35:45.084853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:35:45.086627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:35:45.124373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:45.128419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:45.129100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:45.132533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:45.133490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:45.140662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:45.214640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:35:45.240440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:35:45.421989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:35:45.424218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69b3e4c1-a360-4a53-9776-7365068ef074',volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:35:45.885178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24839b4a-5c5a-46f6-a8f7-65d088d2e2de tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.786054 Oct 26 05:35:45.892018 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3070/6127] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:35:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:35:45.895874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:45.897623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:45.898659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:45.909976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-452e35fa-e805-43a3-a66d-99884404950c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:45.910645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-452e35fa-e805-43a3-a66d-99884404950c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:46.143020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-452e35fa-e805-43a3-a66d-99884404950c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:46.156001 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-452e35fa-e805-43a3-a66d-99884404950c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1057 microversion: 2.1 time: 0.262529 Oct 26 05:35:46.158928 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3058/6128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:45 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1057 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:47.185304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c416edb9-b02d-464a-b129-1bfb349e4d1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:47.186627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c416edb9-b02d-464a-b129-1bfb349e4d1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:47.338656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c416edb9-b02d-464a-b129-1bfb349e4d1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:47.355650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c416edb9-b02d-464a-b129-1bfb349e4d1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1057 microversion: 2.1 time: 0.175521 Oct 26 05:35:47.356616 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3071/6129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:47 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1057 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:48.394413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:48.395828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:48.466891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:48.474785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:48.475434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:48.500891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:48.501221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:48.505442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:49.460651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:49.494089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69404bb2-7df7-4cc3-b7fc-3fbdab241f61 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1155 microversion: 2.1 time: 1.090077 Oct 26 05:35:49.507979 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3059/6130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:48 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1155 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:50.530188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:50.531516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:50.555637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:50.555637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:50.558155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:50.560132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:50.561168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:50.562041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:50.830444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:50.847582 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-defa830c-3ca1-4d36-9814-c60709d62dc5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1173 microversion: 2.1 time: 0.323296 Oct 26 05:35:50.855390 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3072/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:50 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1173 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:51.884624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:51.885270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:51.922163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:51.922670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:51.933782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:51.934607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:51.944008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:51.947522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:52.542339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:52.572804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57cc9288-00cc-478b-88ad-d0b9caf996dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.697958 Oct 26 05:35:52.576762 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3060/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:51 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:53.599411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:53.600749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:53.619518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:53.624547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:53.625862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:53.626784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:53.630054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:53.632459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:54.221594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:54.234405 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e0f5cc99-3299-49ec-ab39-18d67a7a1f9e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.635275 Oct 26 05:35:54.251215 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3073/6133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:53 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:55.264744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:55.265398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:55.283023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:55.283822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:55.284675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:55.288109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:55.291066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:55.291939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:55.798411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:55.818108 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe1de99b-31d4-4556-8044-a520d2fad569 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.549010 Oct 26 05:35:55.819672 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3061/6134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:55 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:35:56.848662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:56.858308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:56.864390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:56.894899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:56.904555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:56.905234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:56.907471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:56.909267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:56.909883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:57.355144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:57.746246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:57.759313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ee4b003-9f99-47d3-97cb-1da09828cfc8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.916433 Oct 26 05:35:57.762993 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3074/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:56 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:35:57.789501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061b73ad-989e-4a57-9882-8fc6c53f747e", "tag": "de121ab3-cf38-451b-b73f-be0a70a115da"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:35:57.820510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:35:57.828126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:57.828626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:57.829067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:57.888942 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] Creating event network-changed:de121ab3-cf38-451b-b73f-be0a70a115da for instance 061b73ad-989e-4a57-9882-8fc6c53f747e on n-h1-862416-4 Oct 26 05:35:57.909553 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] [6cde92c1-c5db-4131-9943-89ae017f520b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 05:35:58.790047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:35:58.791191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:35:58.806468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:58.811334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:58.812649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:58.817859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:35:58.818535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:35:58.820774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:35:58.917941 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] [6cde92c1-c5db-4131-9943-89ae017f520b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 32792. Oct 26 05:35:58.921896 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-22218a6f-f6ed-477d-85a9-71980faa74bb req-c2c3e2a6-d295-4961-b8af-63ae7ad77cf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.136510 Oct 26 05:35:58.922713 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3062/6136] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:35:59.291444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:35:59.300519 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc155ff5-995c-4fea-a3eb-f295991ac4ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.516380 Oct 26 05:35:59.311455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3075/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:35:58 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:36:00.341294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:00.342036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:00.363360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:00.371780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:00.372366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:00.376252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:00.376762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:00.378363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:01.081928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:01.096408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9472eb85-2e4c-4a42-9c20-4d219543f14a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.761051 Oct 26 05:36:01.097787 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3063/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:00 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:02.120540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:02.121167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:02.133946 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:36:02.134103 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:36:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e (ip 10.222.0.16) !!! Oct 26 05:36:02.148490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:02.162954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:02.163990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:02.164417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:02.164899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:02.165359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:02.892768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:02.907405 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-578901b5-a2da-4fbc-bad8-08ba286da6a3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.789419 Oct 26 05:36:02.910703 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3076/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:02 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:03.935381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:03.936770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:03.953095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:03.954126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:03.954926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:03.955985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:03.956833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:03.957692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:05.124590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:05.139912 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5cd736b0-28f9-481e-a27b-7f903759fc04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 1.207915 Oct 26 05:36:05.141997 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3064/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:03 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:06.171768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:06.176741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:06.218905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:06.220334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:06.224280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:06.240799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:06.243152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:06.244251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:06.742628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:06.764610 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c1d1548-df8f-401d-bfaa-bcbda3b2a69e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1215 microversion: 2.1 time: 0.601696 Oct 26 05:36:06.765243 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3077/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:06 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1215 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:07.793164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:07.794835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:07.826907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:07.828059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:07.845190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:07.848706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:07.850456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:07.852604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:08.196940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:08.209406 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f653013e-ffdb-46f3-b7d7-27d23c37abe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 0.420546 Oct 26 05:36:08.211580 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3065/6142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:07 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:09.234837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:09.235629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:09.249836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:09.250582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:09.251145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:09.254021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:09.265711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:09.266426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:10.316423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:10.326598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf2a6388-c0cb-41fb-ac6c-5a95b4852352 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 1.095654 Oct 26 05:36:10.330339 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3078/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:09 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:11.353860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:11.355064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:11.368598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:11.368955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:11.369466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:11.370187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:11.370646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:11.371071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:12.122984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:12.134972 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e2af3ef-5b9d-4a03-9602-2b4828c4021d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 0.785299 Oct 26 05:36:12.137073 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3066/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:11 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:13.164476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:13.165792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:13.172078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:13.177559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:13.178599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:13.179305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:13.180068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:13.180553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:13.181182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:13.185293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=45 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:14.225461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:14.233650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4ea83af-cb7c-438b-ab6e-8f8d0a2a3b02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 1.075089 Oct 26 05:36:14.252551 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3079/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:13 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:15.256501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:15.257808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:15.289661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:15.301295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:15.304630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:15.308270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:15.311411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:15.313855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:16.227982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:16.236284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=49 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:16.245021 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bfe9d80d-0c3c-4942-9244-d0d038905c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 0.992819 Oct 26 05:36:16.267038 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3067/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:15 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:17.258346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7a172661-b23d-48bd-bb0b-06f1a7ed31ad req-32971501-9c76-470f-9e0c-f907e735b0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061b73ad-989e-4a57-9882-8fc6c53f747e", "name": "network-vif-plugged", "status": "completed", "tag": "de121ab3-cf38-451b-b73f-be0a70a115da"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:36:17.291613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:17.292295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:17.299875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=23 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:17.308515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7a172661-b23d-48bd-bb0b-06f1a7ed31ad req-32971501-9c76-470f-9e0c-f907e735b0e1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:17.312695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7a172661-b23d-48bd-bb0b-06f1a7ed31ad req-32971501-9c76-470f-9e0c-f907e735b0e1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:17.314621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7a172661-b23d-48bd-bb0b-06f1a7ed31ad req-32971501-9c76-470f-9e0c-f907e735b0e1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:17.326148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:17.326922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:17.329986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:17.338353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:17.339280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:17.343210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:17.375480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7a172661-b23d-48bd-bb0b-06f1a7ed31ad req-32971501-9c76-470f-9e0c-f907e735b0e1 service nova] Creating event network-vif-plugged:de121ab3-cf38-451b-b73f-be0a70a115da for instance 061b73ad-989e-4a57-9882-8fc6c53f747e on n-h1-862416-4 Oct 26 05:36:17.398737 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7a172661-b23d-48bd-bb0b-06f1a7ed31ad req-32971501-9c76-470f-9e0c-f907e735b0e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142259 Oct 26 05:36:17.401713 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3080/6147] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:36:18.003206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:18.016363 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8a03eb3-7ec6-4c70-bc42-5f66aa85df7d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 0.738281 Oct 26 05:36:18.016966 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3068/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:17 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:36:19.067557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:19.069907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:19.081847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:19.082607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:19.083297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:19.091289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:19.092122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:19.092789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:20.140400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:20.153448 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bbd833b5-3a72-4ffb-b098-35784665f2d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1203 microversion: 2.1 time: 1.108666 Oct 26 05:36:20.156079 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3081/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:19 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1203 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:21.181975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:21.183113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:21.206178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:21.206714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:21.211938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:21.212729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:21.213208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:21.213689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:22.126132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:22.141161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b5afb253-aa5e-4c3a-9190-f5ced47826bc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1390 microversion: 2.1 time: 0.963874 Oct 26 05:36:22.180916 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3069/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:21 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1390 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:22.195105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:22.198208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:22.215134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:22.219512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:22.220488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:22.223516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:22.230736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:22.231660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:22.824645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:22.838440 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27a03a6e-9618-416d-a9bc-535ade0981e9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1390 microversion: 2.1 time: 0.652092 Oct 26 05:36:22.859020 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3082/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:22 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1390 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:22.871504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:22.872860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:22.884435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:22.887228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:22.890203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:22.891304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:22.893727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:22.894401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:23.760499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:23.775567 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4f7e728e-8c14-4ecc-8382-f0278188deb0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1390 microversion: 2.1 time: 0.908150 Oct 26 05:36:23.778578 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3070/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:22 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1390 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:23.808333 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 05:36:23.813239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:23.814617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:23.824073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:23.826823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:23.827595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:23.828789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:23.829350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:23.829886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:23.910173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:36:24.179172 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eab35172-ece0-4602-aac8-6467372ca9d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 204 len: 0 microversion: 2.1 time: 0.371778 Oct 26 05:36:24.184719 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3083/6153] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:36:23 2022] DELETE /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:36:24.189653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:24.190273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:24.203499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:24.204019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:24.204465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:24.213629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:24.214271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:24.214726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:24.904107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:24.919916 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b13a56dd-c3b8-42a3-a15d-f26413095939 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1396 microversion: 2.1 time: 0.734112 Oct 26 05:36:24.923889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3071/6154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:24 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1396 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:36:25.955762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:25.957161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:25.977878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:25.982381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:25.986515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:25.988962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:25.993387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:25.994307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:26.019043 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33638. Oct 26 05:36:26.371234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:26.383614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fbd23eea-bc1c-4421-be6a-5771afc3e089 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1396 microversion: 2.1 time: 0.432225 Oct 26 05:36:26.385867 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3084/6155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:25 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1396 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:27.410352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:27.415519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:27.432386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:27.432907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:27.433443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:27.450252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:27.452814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:27.457262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:27.961403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:27.974337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-986570be-3e34-4aa3-8b1a-06b6d77b5e12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1396 microversion: 2.1 time: 0.569989 Oct 26 05:36:27.997225 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3072/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:27 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1396 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:28.707079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9140255c-ef6a-4b2e-b3bf-eca4337155d6 req-02bcebd3-9443-4e5e-9b08-7c91fcb17b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061b73ad-989e-4a57-9882-8fc6c53f747e", "name": "network-vif-deleted", "tag": "de121ab3-cf38-451b-b73f-be0a70a115da"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:36:28.733962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9140255c-ef6a-4b2e-b3bf-eca4337155d6 req-02bcebd3-9443-4e5e-9b08-7c91fcb17b73 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:28.736454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9140255c-ef6a-4b2e-b3bf-eca4337155d6 req-02bcebd3-9443-4e5e-9b08-7c91fcb17b73 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:28.737580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9140255c-ef6a-4b2e-b3bf-eca4337155d6 req-02bcebd3-9443-4e5e-9b08-7c91fcb17b73 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:28.754061 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9140255c-ef6a-4b2e-b3bf-eca4337155d6 req-02bcebd3-9443-4e5e-9b08-7c91fcb17b73 service nova] Creating event network-vif-deleted:de121ab3-cf38-451b-b73f-be0a70a115da for instance 061b73ad-989e-4a57-9882-8fc6c53f747e on n-h1-862416-4 Oct 26 05:36:28.761962 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9140255c-ef6a-4b2e-b3bf-eca4337155d6 req-02bcebd3-9443-4e5e-9b08-7c91fcb17b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061385 Oct 26 05:36:28.763994 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3085/6157] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:36:29.004916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:29.006350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:29.028714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:29.030105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:29.030828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:29.031987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:29.032654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:29.033432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:29.242818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:29.264291 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e2af8a54-3b37-4706-95ad-b35366a885fe tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.262839 Oct 26 05:36:29.273638 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3073/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:28 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:30.300937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:30.302200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:30.352216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:30.353678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:30.354692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:30.360714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:30.360714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:30.360714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:30.693869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:30.707646 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fdb39c4b-a143-4f79-b0b0-3dd3aa185bef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.412913 Oct 26 05:36:30.715557 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3086/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:30 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:31.732530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:31.733158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:31.770583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:31.771096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:31.776744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:31.785337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:31.786508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:31.794033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:32.087405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:32.103477 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78058204-0532-4134-b287-4c3931c29a06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.375540 Oct 26 05:36:32.104089 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3074/6160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:31 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:33.137576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:33.138389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:33.155404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:33.156302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:33.156850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:33.158829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:33.159655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:33.160779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:33.401076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:33.410601 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5069b62e-f9ad-412b-aeb7-b58d27435db3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.285032 Oct 26 05:36:33.437762 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3087/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:33 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:34.465165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:34.465918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:34.479646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:34.480303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:34.483159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:34.484202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:34.487958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:34.489430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:34.655959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:34.673502 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d49f7f8-707a-4e0e-95fd-d6f5506dbb8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.214260 Oct 26 05:36:34.675391 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3075/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:34 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:35.710351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:35.713201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:35.776989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:35.777548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:35.794381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:35.801905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:35.802416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:35.804156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:36.168826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:36.182003 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f7b0b5f-4a29-4a7f-b965-b33ee26fff15 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.484295 Oct 26 05:36:36.183912 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3088/6163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:35 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:37.212823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:37.213746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:37.235859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:37.244710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:37.247689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:37.249581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:37.251519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:37.254638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:37.832225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:37.867332 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b50ccb40-14ea-49f0-9d97-613c6eeec004 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.660187 Oct 26 05:36:37.876754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3076/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:37 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:38.894471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:38.895152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:38.914929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:38.918445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:38.918904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:38.928936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:38.929524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:38.929984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:39.130045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:39.147103 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f86ab17-80c9-48c8-8d82-83caec271018 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.255890 Oct 26 05:36:39.148792 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3089/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:38 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:40.176644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:40.177273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:40.229788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:40.233007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:40.234562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:40.239479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:40.240275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:40.242526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:40.633774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:40.653381 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df40392c-590c-4ae3-ba6d-e8ccb7aa5ce8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.480631 Oct 26 05:36:40.656448 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3077/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:40 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:41.679220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:41.680587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:41.714464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:41.718073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:41.718814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:41.726100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:41.728416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:41.729128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:41.939200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:41.950070 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-45b72795-b978-4828-861b-19659d729694 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1188 microversion: 2.1 time: 0.275403 Oct 26 05:36:41.950671 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3090/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:41 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:42.979199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:42.983748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:43.021571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:43.022870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:43.023642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:43.026639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:43.031640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:43.032649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:43.179388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:43.180082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:43.182853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:43.183543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lazy-loading 'fault' on Instance uuid 061b73ad-989e-4a57-9882-8fc6c53f747e {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:36:43.324464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:36:43.337717 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9c328540-0f91-44db-b23d-8ede82b12580 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 200 len: 1193 microversion: 2.1 time: 0.362824 Oct 26 05:36:43.339335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3078/6168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:42 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 1193 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:36:44.368004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:36:44.369299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 061b73ad-989e-4a57-9882-8fc6c53f747e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:36:44.380431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:44.388553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:44.405094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:44.406135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:44.414123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:36:44.422352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:36:44.424226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:36:44.521932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:44.523622 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 061b73ad-989e-4a57-9882-8fc6c53f747e could not be found. Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e HTTP/1.1 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 061b73ad-989e-4a57-9882-8fc6c53f747e could not be found. Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '061b73ad-989e-4a57-9882-8fc6c53f747e'} Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061b73ad-989e-4a57-9882-8fc6c53f747e could not be found. Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061b73ad-989e-4a57-9882-8fc6c53f747e could not be found. Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:36:44.544845 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061b73ad-989e-4a57-9882-8fc6c53f747e could not be found. Oct 26 05:36:44.548527 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:36:44.549880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 061b73ad-989e-4a57-9882-8fc6c53f747e could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:36:44.558864 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f135a1a6-bb2c-4bfe-9640-aab05faa3343 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e" status: 404 len: 111 microversion: 2.1 time: 0.193354 Oct 26 05:36:44.566013 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3091/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:36:44 2022] GET /compute/v2.1/servers/061b73ad-989e-4a57-9882-8fc6c53f747e => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:36:59.116098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-26667718", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d6a2885b-c7d4-4138-9274-fdfb4c285e1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:36:59.163244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=23 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:59.164324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=69 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:36:59.332166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:37:01.910043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-728542474", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:02.034417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:37:02.121197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:37:02.121712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:37:02.122309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:37:02.122841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:37:02.123355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:37:02.144305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:02.149173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:02.149738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:02.150635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:02.157435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:02.165917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:02.245662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:37:02.271800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:37:02.462737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:37:02.466046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6a2885b-c7d4-4138-9274-fdfb4c285e1b',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:37:02.879256 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [cad98b36-7380-4165-9311-b87e77593280] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 05:37:03.244161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:37:03.245178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:37:03.245935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:37:03.246494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:37:03.247060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:37:03.285194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:03.292232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:03.294239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:03.295080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:03.295653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:03.295994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:03.386149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Getting quotas for project 4b5717e2429846b7a3a905aff892b118. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:37:03.414421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Getting quotas for user dd6845ac26f045869ab395210d316526 and project 4b5717e2429846b7a3a905aff892b118. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:37:03.496966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:37:03.500013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:37:03.631212 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8bab8dca-8864-461c-9133-cd16375e06b4 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724645 Oct 26 05:37:03.634447 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3092/6170] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:37:03.648270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-38b04ef5-1525-493d-ad1e-404eccb28afd tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:03.658266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-38b04ef5-1525-493d-ad1e-404eccb28afd tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:03.825068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-38b04ef5-1525-493d-ad1e-404eccb28afd tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:03.835205 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-38b04ef5-1525-493d-ad1e-404eccb28afd tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1213 microversion: 2.1 time: 0.193477 Oct 26 05:37:03.838465 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3093/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:03 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:03.893242 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [cad98b36-7380-4165-9311-b87e77593280] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34698. Oct 26 05:37:03.899895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abe12151-0d38-4759-80ba-09e5b3518c40 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.787561 Oct 26 05:37:03.900798 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3079/6172] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:36:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:37:03.913438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8699a98d-b4be-4488-aa81-cc5836d725db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:03.914332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8699a98d-b4be-4488-aa81-cc5836d725db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:04.112907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8699a98d-b4be-4488-aa81-cc5836d725db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:04.123718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8699a98d-b4be-4488-aa81-cc5836d725db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1055 microversion: 2.1 time: 0.215385 Oct 26 05:37:04.126673 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3094/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:03 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1055 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:04.870168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:04.871013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:04.883617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:04.884113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:04.884557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:04.894396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:04.899981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:04.905646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:05.133090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:05.155396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6848481b-ab60-4686-be94-3a8355694354 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:05.156018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6848481b-ab60-4686-be94-3a8355694354 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:05.165513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7b287449-e911-481a-bcfa-e2b63a2f8c60 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1217 microversion: 2.1 time: 0.300534 Oct 26 05:37:05.177568 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3080/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:04 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:05.472550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6848481b-ab60-4686-be94-3a8355694354 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:05.486461 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6848481b-ab60-4686-be94-3a8355694354 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1055 microversion: 2.1 time: 0.335020 Oct 26 05:37:05.499309 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3095/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:05 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1055 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:37:06.193467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:06.194877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:06.216795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:06.219434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:06.220396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:06.222133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:06.223058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:06.224476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:06.407641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:06.426731 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05108b91-94df-468a-b39f-d42f2c9840b0 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1273 microversion: 2.1 time: 0.238436 Oct 26 05:37:06.427952 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3081/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:06 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:06.519160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:06.520462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:06.533809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:06.534878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:06.535729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:06.537113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:06.539594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:06.540279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:06.666772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:06.676511 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b4bd462-fd34-46fa-9aba-54e5f85ba33a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1153 microversion: 2.1 time: 0.162657 Oct 26 05:37:06.685835 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3096/6177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:06 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1153 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:07.454642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:07.455893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:07.471723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:07.472542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:07.473204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:07.474303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:07.475334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:07.475988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:07.650508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:07.682733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-faebc6e2-6d49-4c8f-9b76-088503b48ea5 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1271 microversion: 2.1 time: 0.232696 Oct 26 05:37:07.703480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3082/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:07 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1271 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:07.709282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:07.710757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:07.725903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:07.727697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:07.728792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:07.731135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:07.732912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:07.733645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:07.923023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:07.939167 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e772aa0-26b3-4fc0-a159-41c2745b586a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1171 microversion: 2.1 time: 0.230402 Oct 26 05:37:07.942679 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3097/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:07 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1171 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:08.716516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:08.717779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:08.753152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:08.756484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:08.760931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:08.766494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:08.767137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:08.779821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:08.970843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:08.971850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:09.010637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:09.011169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:09.011631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:09.012391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:09.012845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:09.013279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:09.066307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:09.085224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-257b87e4-7876-4bc7-af41-3395dea3e559 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1271 microversion: 2.1 time: 0.374013 Oct 26 05:37:09.088152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3083/6180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:08 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1271 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:09.361708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:09.371717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2bf511b6-bad5-4359-ab81-b63cf4a91335 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1171 microversion: 2.1 time: 0.407799 Oct 26 05:37:09.384660 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3098/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:08 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1171 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:37:10.119060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:10.120288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:10.134747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:10.136432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:10.139151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:10.140598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:10.143757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:10.144477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:10.398415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:10.420699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:10.479123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:10.480353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:10.482794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:10.483766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:10.484700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:10.487505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:10.848546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:10.867434 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5280797b-862e-40c6-95f5-45a5965753ad tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1171 microversion: 2.1 time: 0.475479 Oct 26 05:37:10.890717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3099/6182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:10 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1171 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:10.903082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:10.912548 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7dd51531-f51f-45d8-bbf9-a5d8e9e0579f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.801572 Oct 26 05:37:10.917570 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3084/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:10 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:11.903551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:11.904717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:11.921140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:11.925744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:11.928017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:11.934818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:11.936484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:11.937016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:11.945476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:11.947115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:11.967509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:11.973984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:11.974579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:11.978990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:11.980348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:11.981953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:12.205296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:12.292901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:12.690464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:12.704189 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3a813b0-4e61-49c8-a816-a689ddb22b54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.802608 Oct 26 05:37:12.705628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3100/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:11 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:12.739411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:12.754215 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d230c86d-5897-48c7-aff0-3649ff36f208 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.813977 Oct 26 05:37:12.757380 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3085/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:11 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:37:13.730589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:13.731419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:13.743905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:13.748434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:13.748973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:13.751754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:13.752629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:13.753937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:13.754399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:13.787708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:13.790813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:13.808089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:13.809007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:13.810274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:13.811807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:13.813682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:13.815772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:14.288252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:14.301004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7bdedc9d-7ec9-445e-8334-1cda1046d585 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.518362 Oct 26 05:37:14.301946 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3086/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:13 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:14.377443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:14.391780 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d33b36c-4d90-4801-a15c-29c3b8435468 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.665686 Oct 26 05:37:14.406528 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3101/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:13 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:15.330999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:15.332246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:15.350715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:15.351476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:15.357051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:15.358196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:15.359804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:15.361660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:15.423204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:15.424080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:15.444835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:15.446505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:15.448171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:15.453830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:15.454644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:15.455287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:15.518401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:16.095907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:16.115409 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7fa43971-f0ef-472b-a8a7-23dd98cd3df9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.696443 Oct 26 05:37:16.119821 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3102/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:15 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:16.251808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:16.275043 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35131c21-03e2-4238-b95f-2ab80b56ec71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.935003 Oct 26 05:37:16.286657 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3087/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:15 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:16.321623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d53cf14d-c0dd-433c-a6c7-82183ba1a272 req-9b7f3c2f-a018-4c86-b4c9-0b29b82406bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93409d3-9aa5-4909-be9a-9613ec06865b", "tag": "6c41b90c-782e-4e70-9c01-e06b48e7fb00"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:16.398143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d53cf14d-c0dd-433c-a6c7-82183ba1a272 req-9b7f3c2f-a018-4c86-b4c9-0b29b82406bd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:16.398648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d53cf14d-c0dd-433c-a6c7-82183ba1a272 req-9b7f3c2f-a018-4c86-b4c9-0b29b82406bd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:16.399121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d53cf14d-c0dd-433c-a6c7-82183ba1a272 req-9b7f3c2f-a018-4c86-b4c9-0b29b82406bd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:16.446871 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d53cf14d-c0dd-433c-a6c7-82183ba1a272 req-9b7f3c2f-a018-4c86-b4c9-0b29b82406bd service nova] Creating event network-changed:6c41b90c-782e-4e70-9c01-e06b48e7fb00 for instance d93409d3-9aa5-4909-be9a-9613ec06865b on n-h1-862416-4 Oct 26 05:37:16.454781 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d53cf14d-c0dd-433c-a6c7-82183ba1a272 req-9b7f3c2f-a018-4c86-b4c9-0b29b82406bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153969 Oct 26 05:37:16.459887 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3103/6190] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:37:17.150917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:17.151604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:17.165533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:17.167405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:17.168146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:17.169334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:17.170460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:17.171115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:17.317112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:17.318362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:17.339509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:17.340240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:17.340728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:17.342156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:17.343242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:17.343866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:17.962846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:17.976677 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-44f95cf3-e109-4c86-8544-f6832f18974b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.831251 Oct 26 05:37:17.991010 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3088/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:17 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:18.210179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:18.227352 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-880e3dee-abbe-445b-9ac8-6f619d2be9a3 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.916997 Oct 26 05:37:18.231878 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3104/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:17 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:37:18.628610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b343e668-b03d-4878-a2f4-e8593509ead4 req-13057ab4-5905-4cf7-9520-e30483211f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a95d1c-c008-482f-a789-dd6dd4852067", "tag": "13f8859a-570e-4593-9aa8-1b8b12def376"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:18.679094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b343e668-b03d-4878-a2f4-e8593509ead4 req-13057ab4-5905-4cf7-9520-e30483211f17 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:18.683861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b343e668-b03d-4878-a2f4-e8593509ead4 req-13057ab4-5905-4cf7-9520-e30483211f17 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:18.690919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b343e668-b03d-4878-a2f4-e8593509ead4 req-13057ab4-5905-4cf7-9520-e30483211f17 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:18.717781 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b343e668-b03d-4878-a2f4-e8593509ead4 req-13057ab4-5905-4cf7-9520-e30483211f17 service nova] Creating event network-changed:13f8859a-570e-4593-9aa8-1b8b12def376 for instance c6a95d1c-c008-482f-a789-dd6dd4852067 on n-h1-862416-4 Oct 26 05:37:18.724523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b343e668-b03d-4878-a2f4-e8593509ead4 req-13057ab4-5905-4cf7-9520-e30483211f17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111917 Oct 26 05:37:18.729172 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3089/6193] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:37:19.004323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:19.006291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:19.029189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:19.030090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:19.033347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:19.035407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:19.037299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:19.042025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:19.254590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:19.255453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:19.279032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:19.279537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:19.279979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:19.280689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:19.281146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:19.281600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:19.402761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:19.444487 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1eefe84d-d696-49ee-afbb-fa27957a5b93 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.431167 Oct 26 05:37:19.447161 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3105/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:18 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:19.776228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:19.784227 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ea919fa4-383f-4620-b9a4-fd174e786509 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.533942 Oct 26 05:37:19.794957 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3090/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:19 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:37:20.472070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:20.473342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:20.487600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:20.488362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:20.490633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:20.491616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:20.493905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:20.494515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:20.766917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:20.782903 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-faf157b6-5ad0-4bd8-8e10-fd8c1e53b4c9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.316011 Oct 26 05:37:20.796977 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3106/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:20 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:20.818858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:20.820195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:20.832926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:20.839528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:20.840235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:20.842602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:20.848512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:20.849896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:21.316193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:21.327741 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bcd12c5f-688a-4522-9ecd-d899fb932ef8 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.514626 Oct 26 05:37:21.337299 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3091/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:20 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:21.814900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:21.816642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:21.833662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:21.834664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:21.835335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:21.837167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:21.840451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:21.841199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:22.324958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:22.340746 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cdbc9431-279b-4faa-90e8-a16a49c98033 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 0.531538 Oct 26 05:37:22.341959 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3107/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:21 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:22.355923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:22.357235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:22.371073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:22.373466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:22.374169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:22.376420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:22.377957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:22.382003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:22.817349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:22.832666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dacd76b2-c848-453e-b074-a7723a69960f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.478249 Oct 26 05:37:22.838163 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3092/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:22 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:23.369859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:23.370678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:23.385825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:23.390506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:23.396878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:23.397869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:23.400368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:23.400945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:23.524969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9b434b04-c811-4e88-b835-6999bc7e9888 req-6381d0b1-4ece-4254-8f85-127358c6c591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93409d3-9aa5-4909-be9a-9613ec06865b", "name": "network-vif-plugged", "status": "completed", "tag": "6c41b90c-782e-4e70-9c01-e06b48e7fb00"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:23.550882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9b434b04-c811-4e88-b835-6999bc7e9888 req-6381d0b1-4ece-4254-8f85-127358c6c591 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:23.569356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9b434b04-c811-4e88-b835-6999bc7e9888 req-6381d0b1-4ece-4254-8f85-127358c6c591 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:23.569356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9b434b04-c811-4e88-b835-6999bc7e9888 req-6381d0b1-4ece-4254-8f85-127358c6c591 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:23.593513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9b434b04-c811-4e88-b835-6999bc7e9888 req-6381d0b1-4ece-4254-8f85-127358c6c591 service nova] Creating event network-vif-plugged:6c41b90c-782e-4e70-9c01-e06b48e7fb00 for instance d93409d3-9aa5-4909-be9a-9613ec06865b on n-h1-862416-4 Oct 26 05:37:23.610932 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9b434b04-c811-4e88-b835-6999bc7e9888 req-6381d0b1-4ece-4254-8f85-127358c6c591 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090447 Oct 26 05:37:23.622097 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3093/6200] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:37:23.866150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:23.866575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:23.879232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:23.882030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:23.882834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:23.883885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:23.885541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:23.892285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:24.428576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:24.441698 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-250dae78-8f11-4c6e-9cc8-10cf038e9a1b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1213 microversion: 2.1 time: 1.075872 Oct 26 05:37:24.447225 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3108/6201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:23 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1213 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:24.585119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:24.625768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5af8a3a9-4d9f-42a9-a0fd-586d5fb58272 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.765069 Oct 26 05:37:24.628084 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3094/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:23 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:25.473781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:25.475005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:25.496557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:25.497286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:25.498345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:25.499304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:25.500162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:25.500855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:25.658245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:25.659123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:25.705734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:25.709101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:25.709610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:25.715280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:25.715833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:25.716370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:25.764516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:25.779284 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69f5094a-3a3b-48f5-9a7e-f35b2ec553b3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.309547 Oct 26 05:37:25.786798 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3109/6203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:25 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:26.135071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:26.154440 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d131c2f2-959e-44bf-a03b-c532c4b542ec tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1313 microversion: 2.1 time: 0.502912 Oct 26 05:37:26.155373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3095/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:25 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:26.822813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:26.824767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:26.841642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:26.843658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:26.845821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:26.846820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:26.848133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:26.850921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:27.127691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:27.141742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92e097a5-2a2c-49f6-8eb4-60b9f8429df6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.333447 Oct 26 05:37:27.144206 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3110/6205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:26 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:27.183200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:27.185038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:27.198027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:27.198881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:27.199843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:27.201000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:27.201933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:27.202603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:27.463549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:27.478262 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05826651-e419-47bf-9025-b55fe99775ca tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1463 microversion: 2.1 time: 0.302248 Oct 26 05:37:27.487071 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3096/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:27 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:27.516623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ad24a8d-64fe-443e-aac9-2faf847bbb08", "device": "/dev/sdb"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:27.521020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:27.534382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:27.537376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:27.539339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:27.540386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:27.546771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:27.547821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:27.964797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:28.023124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-439203d6-2752-40e8-b158-2ad1379355ea tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "POST /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513394 Oct 26 05:37:28.024139 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3111/6207] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:37:27 2022] POST /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b/os-volume_attachments => generated 194 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:37:28.179685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:28.180532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:28.196389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:28.197850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:28.198268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:28.198998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:28.199468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:28.199904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:28.265189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:28.718326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:28.727176 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dc6fd2b2-435e-4f70-bdce-fa24e4d69e06 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.552110 Oct 26 05:37:28.732181 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3097/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:28 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:29.763047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:29.764053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:29.779384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:29.786530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:29.787206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:29.788084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:29.788694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:29.789226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:30.204624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:30.215753 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd8f7dc1-fb3e-4892-8889-d9039a33f859 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.467287 Oct 26 05:37:30.223236 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3112/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:29 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:31.249361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:31.250694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:31.269981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:31.279735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:31.285123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:31.285760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:31.287535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:31.291086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:31.293703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:31.814373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:31.836580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a48dd888-5195-4fe4-a60e-50e7abbbd1f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.584084 Oct 26 05:37:31.842373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3098/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:31 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:32.868095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:32.868879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:32.885637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:37:32.890008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:32.890521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:32.894267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:32.895048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:32.895588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:32.901508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:33.420005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:33.431585 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ca37758-5d37-46d9-b56d-9f78ed08c5e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.568303 Oct 26 05:37:33.470306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3113/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:32 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:34.484887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:34.486151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:34.500737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:34.510424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:34.511198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:34.512421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:34.512906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:34.513376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:34.893977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:34.905434 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35c9b867-82d1-466a-808d-d31c7202da2f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.424523 Oct 26 05:37:34.908257 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3099/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:34 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:35.221578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6be3c2b6-b47e-46b2-aef7-bcf052dad008 req-dbfa0718-01f3-4ae4-8395-7b7bce4a6bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a95d1c-c008-482f-a789-dd6dd4852067", "name": "network-vif-plugged", "status": "completed", "tag": "13f8859a-570e-4593-9aa8-1b8b12def376"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:35.273519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6be3c2b6-b47e-46b2-aef7-bcf052dad008 req-dbfa0718-01f3-4ae4-8395-7b7bce4a6bc2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:35.275624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6be3c2b6-b47e-46b2-aef7-bcf052dad008 req-dbfa0718-01f3-4ae4-8395-7b7bce4a6bc2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:35.277383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6be3c2b6-b47e-46b2-aef7-bcf052dad008 req-dbfa0718-01f3-4ae4-8395-7b7bce4a6bc2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:35.314479 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6be3c2b6-b47e-46b2-aef7-bcf052dad008 req-dbfa0718-01f3-4ae4-8395-7b7bce4a6bc2 service nova] Creating event network-vif-plugged:13f8859a-570e-4593-9aa8-1b8b12def376 for instance c6a95d1c-c008-482f-a789-dd6dd4852067 on n-h1-862416-4 Oct 26 05:37:35.325942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6be3c2b6-b47e-46b2-aef7-bcf052dad008 req-dbfa0718-01f3-4ae4-8395-7b7bce4a6bc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109400 Oct 26 05:37:35.327105 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3114/6213] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:37:35.936217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:35.937942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:35.959056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:35.959793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:35.960403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:35.961301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:35.961966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:35.962572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:36.252263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:36.269410 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e1a3afb-8b10-4f16-900b-4da9366484b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1201 microversion: 2.1 time: 0.337757 Oct 26 05:37:36.271666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3100/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:35 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1201 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:37.296845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:37.300641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:37.321088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:37.322089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:37.322729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:37.323860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:37.324516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:37.325798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:37.819922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:37.836889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b2f04cb3-e568-4d62-bf01-edab13c40e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1389 microversion: 2.1 time: 0.542049 Oct 26 05:37:37.842193 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3115/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:37 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1389 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:37.866200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:37.867972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:37.900044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:37.911566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:37.927299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:37.939144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:37.939960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:37.940628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:38.356071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:38.369162 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ecd176f7-c3a0-466f-b0a0-a9b880ab1c6e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1389 microversion: 2.1 time: 0.508405 Oct 26 05:37:38.372501 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3101/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:37 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1389 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:38.404005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:38.405226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:38.423695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:38.424846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:38.429461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:38.430500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:38.454231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:38.454911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:38.840227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:38.850227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d22b364-6eb1-42d8-af6a-0d867d14505d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1389 microversion: 2.1 time: 0.452911 Oct 26 05:37:38.850833 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3116/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:38 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1389 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:38.879041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:38.879685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:38.889552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:38.890058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:38.890510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:38.891229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:38.891698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:38.892137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:38.980242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:37:39.213648 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cba57c6-1aed-46a9-897f-e6a5cc19ff78 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 204 len: 0 microversion: 2.1 time: 0.339848 Oct 26 05:37:39.214734 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3102/6218] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:37:38 2022] DELETE /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:37:39.224093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:39.224727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:39.237669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:39.238177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:39.240667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:39.248945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:39.251190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:39.251831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:39.812918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:39.855990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2bbd8aa-d0a9-431c-81ee-b01606a3b26a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1395 microversion: 2.1 time: 0.633450 Oct 26 05:37:39.856785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3117/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:39 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1395 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:40.885149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:40.885886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:40.905162 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:37:40.905707 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 05:37:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 (ip 10.222.0.16) !!! Oct 26 05:37:40.920301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:40.920826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:40.921281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:40.922041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:40.922506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:40.922940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:41.490987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:41.528656 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e0b1881-6cce-4fa2-ab9f-9c7bb985308b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1395 microversion: 2.1 time: 0.639169 Oct 26 05:37:41.530752 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3103/6220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:40 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1395 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:42.466016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3bcc9e1c-b5a8-4672-b933-069f28f08205 req-e0512af5-134e-4494-9627-9d7729d978eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a95d1c-c008-482f-a789-dd6dd4852067", "name": "network-vif-deleted", "tag": "13f8859a-570e-4593-9aa8-1b8b12def376"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:37:42.500327 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:37:42.501868 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 26 05:37:42.505694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3bcc9e1c-b5a8-4672-b933-069f28f08205 req-e0512af5-134e-4494-9627-9d7729d978eb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:42.506404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3bcc9e1c-b5a8-4672-b933-069f28f08205 req-e0512af5-134e-4494-9627-9d7729d978eb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:42.507416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3bcc9e1c-b5a8-4672-b933-069f28f08205 req-e0512af5-134e-4494-9627-9d7729d978eb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:42.539495 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3bcc9e1c-b5a8-4672-b933-069f28f08205 req-e0512af5-134e-4494-9627-9d7729d978eb service nova] Creating event network-vif-deleted:13f8859a-570e-4593-9aa8-1b8b12def376 for instance c6a95d1c-c008-482f-a789-dd6dd4852067 on n-h1-862416-4 Oct 26 05:37:42.558627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:42.559246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:42.559848 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3bcc9e1c-b5a8-4672-b933-069f28f08205 req-e0512af5-134e-4494-9627-9d7729d978eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097582 Oct 26 05:37:42.561235 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3118/6221] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:37:42.571588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:42.572061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:42.572507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:42.573227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:42.587220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:42.587686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:42.809046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:42.823641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2aa39ab5-14e9-4985-a87e-cb871b197b6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.269263 Oct 26 05:37:42.848749 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3104/6222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:42 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:37:43.854154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:43.854883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:43.875137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:43.880527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:43.883732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:43.885383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:43.887581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:43.889003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:44.110981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:44.120106 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19cd5a2f-18ea-47a5-9aaf-e6128cb8e185 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.271565 Oct 26 05:37:44.120725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3119/6223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:43 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:45.150886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:45.151506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:45.163592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:45.172394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:45.179217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:45.180519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:45.183357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:45.184064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:45.413711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:45.424880 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46f9d49d-3eb3-493f-972f-f81b3c622716 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.277839 Oct 26 05:37:45.430793 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3105/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:45 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:46.455835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:46.456582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:46.471297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:46.483532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:46.484349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:46.485463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:46.486615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:46.493367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:46.703142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:46.719380 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7d53294-f500-4d69-8797-82cf062c0b4b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.269712 Oct 26 05:37:46.727485 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3120/6225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:46 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:47.748655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:47.749903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:47.777418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:47.783114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:47.788480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:47.794184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:47.794771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:47.800410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:48.051726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:48.065729 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9079aeaf-8fe1-447c-af57-f2f7d83d33dc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.319016 Oct 26 05:37:48.078352 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3106/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:47 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:49.106071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:49.106772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:49.126429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:49.136024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:49.138568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:49.150533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:49.153108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:49.153619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:49.566424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:49.586987 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce90fc70-1984-4fc4-b2b1-cf72792ac2ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.485223 Oct 26 05:37:49.608206 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3121/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:49 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:50.615649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:50.616423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:50.635564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:50.637992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:50.642789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:50.649235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:50.669778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:50.673260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:51.115129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:51.127687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a53d62c-8c40-4f97-96a1-e221713a18f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.516528 Oct 26 05:37:51.138212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3107/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:50 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:52.163766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:52.165114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:52.175545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:52.182015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:52.186143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:52.187174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:52.189577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:52.191012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:52.350178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:52.360745 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47c4ba11-7e9b-45a7-9815-9ef9d075bb45 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.200282 Oct 26 05:37:52.373944 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3122/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:52 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:53.385605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:53.386390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:53.415314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:53.416138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:53.416698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:53.418611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:53.421654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:53.422252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:53.665436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:53.676659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-52c50f69-de9b-4c2d-9235-11bb9a10fc12 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.294741 Oct 26 05:37:53.681472 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3108/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:53 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:54.704597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:54.706102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:54.725949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:54.729281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:54.729946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:54.730871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:54.734526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:54.735791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:54.969716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:54.981900 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ede265b2-7381-4d28-99c3-0e88329be6b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.281389 Oct 26 05:37:54.987516 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3123/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:54 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:56.008875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:56.010304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:56.095230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:56.095753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:56.096198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:56.096923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:56.132058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:56.132731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:56.584334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:37:56.602044 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42a3bac4-1dcf-413c-9c47-5a51af555bb7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 200 len: 1186 microversion: 2.1 time: 0.593693 Oct 26 05:37:56.603006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3109/6232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:56 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 1186 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:37:57.635134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:37:57.636315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: c6a95d1c-c008-482f-a789-dd6dd4852067] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:37:57.655251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:57.662236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:57.663335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:57.664459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:37:57.669072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:37:57.672264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:37:57.719972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance c6a95d1c-c008-482f-a789-dd6dd4852067 could not be found. Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 HTTP/1.1 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c6a95d1c-c008-482f-a789-dd6dd4852067 could not be found. Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c6a95d1c-c008-482f-a789-dd6dd4852067'} Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a95d1c-c008-482f-a789-dd6dd4852067 could not be found. Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a95d1c-c008-482f-a789-dd6dd4852067 could not be found. Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:37:57.725457 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a95d1c-c008-482f-a789-dd6dd4852067 could not be found. Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:37:57.731047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance c6a95d1c-c008-482f-a789-dd6dd4852067 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:37:57.733070 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34b2826f-0414-43e8-9984-25a25f899393 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067" status: 404 len: 111 microversion: 2.1 time: 0.102025 Oct 26 05:37:57.737464 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3124/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:37:57 2022] GET /compute/v2.1/servers/c6a95d1c-c008-482f-a789-dd6dd4852067 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:38:24.210710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-714147325", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "e9b3542e-eef5-4ed1-8f6c-bb8ed4759cce"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:24.236604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:24.237072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:24.368814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] validate_networks() for [('e9b3542e-eef5-4ed1-8f6c-bb8ed4759cce', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:38:25.820402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:38:25.821625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:38:25.822268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:38:25.822833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:38:25.823415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:38:25.840959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:25.841784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:25.844915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:25.845921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:25.848532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:25.849280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:25.897145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Getting quotas for project b5eba23930f74f19bdca41a615f24842. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:38:25.913157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Getting quotas for user 72da49d3df10411a82c0bcd456725533 and project b5eba23930f74f19bdca41a615f24842. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:38:25.967140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:38:25.974478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:38:26.114084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aba09bbb-f707-4aa5-8600-b6b5935f7465 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920850 Oct 26 05:38:26.127141 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3110/6234] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:38:26.129477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-77a8fb3c-6fad-421b-8f0f-e2aed3495676 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:26.130114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77a8fb3c-6fad-421b-8f0f-e2aed3495676 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:26.133038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=23 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:26.133931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:26.381088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-77a8fb3c-6fad-421b-8f0f-e2aed3495676 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:26.406192 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-77a8fb3c-6fad-421b-8f0f-e2aed3495676 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1213 microversion: 2.1 time: 0.266135 Oct 26 05:38:26.408832 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3125/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:26 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:27.459031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:27.459664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:27.471511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:27.474125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:27.474599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:27.475351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:27.475828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:27.476477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:27.603668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:27.639640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-03a30791-8c4a-44ad-a006-b449c10f4b58 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1217 microversion: 2.1 time: 0.184852 Oct 26 05:38:27.642518 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3111/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:27 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:28.679977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:28.680548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:28.690619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:28.691430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:28.693013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:28.694867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:28.695699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:28.696330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:28.809831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:28.833196 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8912326-83cd-44a0-aee2-a7aaf05f1478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1271 microversion: 2.1 time: 0.162003 Oct 26 05:38:28.849337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3126/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:28 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:29.862274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:29.863749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:29.879244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:29.879763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:29.880213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:29.880941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:29.881437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:29.881873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:30.654725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:30.675745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1e0805dc-4574-4d8a-bf15-618bb0c69eee tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.810829 Oct 26 05:38:30.676670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3112/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:29 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:31.699497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:31.700106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:31.712071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:31.717901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:31.720476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:31.721570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:31.722588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:31.723034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:32.036094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:32.046127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2f8ccca-b9cd-4a53-bd56-162e91a32c29 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.350414 Oct 26 05:38:32.047833 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3127/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:31 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:33.080513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:33.082942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:33.094935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:33.095637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:33.096412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:33.097610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:33.098242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:33.098833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:33.616746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-246a6da1-faa3-40f4-a96c-bfd6a056b5f6 req-6da4cbd7-05ca-4c40-b84d-8a9cc30d9714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbe2a51-783b-46b0-87a7-b8016585fc71", "tag": "48dedf88-7794-49b0-8374-72452c3676d8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:33.654592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-246a6da1-faa3-40f4-a96c-bfd6a056b5f6 req-6da4cbd7-05ca-4c40-b84d-8a9cc30d9714 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:33.657561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-246a6da1-faa3-40f4-a96c-bfd6a056b5f6 req-6da4cbd7-05ca-4c40-b84d-8a9cc30d9714 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:33.658331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-246a6da1-faa3-40f4-a96c-bfd6a056b5f6 req-6da4cbd7-05ca-4c40-b84d-8a9cc30d9714 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:33.693720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-246a6da1-faa3-40f4-a96c-bfd6a056b5f6 req-6da4cbd7-05ca-4c40-b84d-8a9cc30d9714 service nova] Creating event network-changed:48dedf88-7794-49b0-8374-72452c3676d8 for instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 on n-h2-862416-4 Oct 26 05:38:33.707951 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-246a6da1-faa3-40f4-a96c-bfd6a056b5f6 req-6da4cbd7-05ca-4c40-b84d-8a9cc30d9714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.397654 Oct 26 05:38:33.725647 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3128/6240] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:38:33.815031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:33.824069 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d095c2bb-c536-4a01-b450-c54fabff0478 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.748608 Oct 26 05:38:33.830820 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3113/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:33 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:34.852798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:34.853551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:34.866136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:34.866975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:34.867726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:34.869936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:34.870911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:34.875600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:35.432639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:35.459763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e63431f7-0f08-473f-ab50-8623f10b3462 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.611257 Oct 26 05:38:35.473786 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3129/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:34 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:36.492514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:36.493176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:36.497004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:36.501833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:36.513085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:36.515430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:36.515946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:36.520815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:36.521443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:36.522807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:36.821181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:36.835922 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3a729f3-dd11-4439-b24e-3cd636bf4ca8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.354845 Oct 26 05:38:36.837747 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3114/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:36 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:37.858940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:37.859919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:37.870138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:37.875981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:37.876633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:37.877576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:37.879607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:37.885974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:37.887135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:38.193441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:38.202101 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-18abbba1-f9f5-4e61-868d-9d58a173b2f2 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.347060 Oct 26 05:38:38.218306 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3130/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:37 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:39.228431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:39.229761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:39.244028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:39.244519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:39.244960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:39.245700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:39.246158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:39.246580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:39.268457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-20aab5ef-c589-4cd4-bada-768348892d65 req-3332365c-b5ee-430d-8c52-841698219ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbe2a51-783b-46b0-87a7-b8016585fc71", "name": "network-vif-plugged", "status": "completed", "tag": "48dedf88-7794-49b0-8374-72452c3676d8"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:39.286922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-20aab5ef-c589-4cd4-bada-768348892d65 req-3332365c-b5ee-430d-8c52-841698219ba6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:39.293459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-20aab5ef-c589-4cd4-bada-768348892d65 req-3332365c-b5ee-430d-8c52-841698219ba6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:39.294221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-20aab5ef-c589-4cd4-bada-768348892d65 req-3332365c-b5ee-430d-8c52-841698219ba6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:39.309678 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-20aab5ef-c589-4cd4-bada-768348892d65 req-3332365c-b5ee-430d-8c52-841698219ba6 service nova] Creating event network-vif-plugged:48dedf88-7794-49b0-8374-72452c3676d8 for instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 on n-h2-862416-4 Oct 26 05:38:39.328774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-20aab5ef-c589-4cd4-bada-768348892d65 req-3332365c-b5ee-430d-8c52-841698219ba6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263085 Oct 26 05:38:39.334398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3115/6245] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:38:39.714408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:39.723308 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2219423e-7227-4d92-803a-85f62270f3f4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 0.498753 Oct 26 05:38:39.729544 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3131/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:39 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:38:40.755053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:40.755818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:40.786668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:40.787174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:40.787626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:40.788347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:40.788821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:40.789263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:42.214211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:42.228738 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2740fbdf-71c1-4ffe-9e35-fd7367818ac3 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1313 microversion: 2.1 time: 1.475142 Oct 26 05:38:42.229442 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3116/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:40 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1313 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:43.257107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:43.257996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:43.273860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:43.277765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:43.279722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:43.286404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:43.294357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:43.295193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:43.838731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:43.864760 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-003784d5-2892-4927-a376-2dd8192a0c99 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1496 microversion: 2.1 time: 0.611993 Oct 26 05:38:43.877349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3132/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:43 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1496 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:44.918893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:44.919411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:44.932843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:44.933369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:44.933822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:44.934537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:44.935029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:44.947987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:45.055418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:38:45.317541 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48515c93-29a9-4fb2-8e52-73653e4edf7b tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 204 len: 0 microversion: 2.1 time: 0.402674 Oct 26 05:38:45.318167 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3117/6249] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:38:44 2022] DELETE /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:38:45.326951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:45.327573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:45.361181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:45.361826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:45.362881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:45.363962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:45.385077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:45.387777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:45.973038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:45.988667 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43dcadbe-54c0-4050-a53f-940e1dd29a1c tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1502 microversion: 2.1 time: 0.666112 Oct 26 05:38:45.990784 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3133/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:45 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1502 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:47.026564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:47.027898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:47.041043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:47.044049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:47.044674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:47.045593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:47.048757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:47.049947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:47.654293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:47.664195 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-17cf67ff-efe5-4e6f-a903-7457432b85fe tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1502 microversion: 2.1 time: 0.644386 Oct 26 05:38:47.664803 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3118/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:47 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1502 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:48.490604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-672bfda8-45c8-47bb-8f84-41f1e7eb6104 req-f2d1c97b-d98a-48b5-a687-9d04a10e681b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbe2a51-783b-46b0-87a7-b8016585fc71", "name": "network-vif-deleted", "tag": "48dedf88-7794-49b0-8374-72452c3676d8"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:48.526033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-672bfda8-45c8-47bb-8f84-41f1e7eb6104 req-f2d1c97b-d98a-48b5-a687-9d04a10e681b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:48.526517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-672bfda8-45c8-47bb-8f84-41f1e7eb6104 req-f2d1c97b-d98a-48b5-a687-9d04a10e681b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:48.552339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-672bfda8-45c8-47bb-8f84-41f1e7eb6104 req-f2d1c97b-d98a-48b5-a687-9d04a10e681b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:48.590961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-672bfda8-45c8-47bb-8f84-41f1e7eb6104 req-f2d1c97b-d98a-48b5-a687-9d04a10e681b service nova] Creating event network-vif-deleted:48dedf88-7794-49b0-8374-72452c3676d8 for instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 on n-h2-862416-4 Oct 26 05:38:48.611412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-672bfda8-45c8-47bb-8f84-41f1e7eb6104 req-f2d1c97b-d98a-48b5-a687-9d04a10e681b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128079 Oct 26 05:38:48.618110 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3134/6252] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:38:48.700711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:48.704806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:48.716266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:48.716959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:48.717647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:48.718471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:48.719323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:48.720069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:48.793266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:48.811374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:48.812171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:48.824154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lazy-loading 'fault' on Instance uuid 1fbe2a51-783b-46b0-87a7-b8016585fc71 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:38:49.029762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:49.058495 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e510d83-9831-4996-8dc3-7b1309b4b715 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 200 len: 1303 microversion: 2.1 time: 0.369808 Oct 26 05:38:49.060873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3119/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:48 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 1303 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:50.091542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:50.092994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: 1fbe2a51-783b-46b0-87a7-b8016585fc71] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:50.117951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:50.118883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:50.121823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:50.122773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:50.138541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:50.139167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:50.210512 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] HTTP exception thrown: Instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 could not be found. Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Request method failure captured: Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 HTTP/1.1 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMfMwV1kRMy_cla55t8Yewu7QRjIdXCp6YLTr0KmSprZdDPcUBzpPm2NcGisIV6kluI7qetyz4_C2EhktRWqZrikFyjcghxlQ9VsA8UW6Xo_pR_jlVZ2P1cm3kYjzrpWMeI8mUS6EavZ_R6y-NU5_e1Z71bINNua6l1OC2y1Pk5yekY Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b5eba23930f74f19bdca41a615f24842 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesActionsTest-121867631 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5eba23930f74f19bdca41a615f24842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5eba23930f74f19bdca41a615f24842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5eba23930f74f19bdca41a615f24842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5eba23930f74f19bdca41a615f24842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesActionsTest-121867631 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b5eba23930f74f19bdca41a615f24842 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesActionsTest-121867631 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesActionsTest-121867631-project Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 72da49d3df10411a82c0bcd456725533 Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesActionsTest-121867631-project Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 could not be found. Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1fbe2a51-783b-46b0-87a7-b8016585fc71'} Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 could not be found. Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 could not be found. Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:38:50.232118 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 could not be found. Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Returning 404 to user: Instance 1fbe2a51-783b-46b0-87a7-b8016585fc71 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:38:50.236113 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22956245-d794-4fa8-a63e-1230a98522ca tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71" status: 404 len: 111 microversion: 2.1 time: 0.147353 Oct 26 05:38:50.247014 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3135/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:50 2022] GET /compute/v2.1/servers/1fbe2a51-783b-46b0-87a7-b8016585fc71 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:38:50.496316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-123017296", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "e9b3542e-eef5-4ed1-8f6c-bb8ed4759cce"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:50.621090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] validate_networks() for [('e9b3542e-eef5-4ed1-8f6c-bb8ed4759cce', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:38:51.509463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:38:51.510106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:38:51.511053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:38:51.511891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:38:51.512688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:38:51.540639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:51.541806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:51.542382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:51.544199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:51.545349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:51.546778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:51.600208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Getting quotas for project b5eba23930f74f19bdca41a615f24842. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:38:51.615406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Getting quotas for user 72da49d3df10411a82c0bcd456725533 and project b5eba23930f74f19bdca41a615f24842. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:38:51.657382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:38:51.692177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:38:51.844627 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f4feb690-3c73-474b-8fab-433240c5a7cf tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350293 Oct 26 05:38:51.853834 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3120/6255] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:38:51.865814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-acbe3c5a-214a-4943-b932-4ea31e74f325 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:51.866414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-acbe3c5a-214a-4943-b932-4ea31e74f325 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:52.446984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-acbe3c5a-214a-4943-b932-4ea31e74f325 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:52.487690 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-acbe3c5a-214a-4943-b932-4ea31e74f325 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1213 microversion: 2.1 time: 0.632204 Oct 26 05:38:52.496340 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3136/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:51 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1213 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:53.524455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:53.524886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:53.550181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:53.552111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:53.554311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:53.560246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:53.560853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:53.561487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:53.704267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:53.712868 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-14e8f5ae-bed4-440f-b892-0d896a3c5b6a tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1265 microversion: 2.1 time: 0.194225 Oct 26 05:38:53.720713 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3121/6257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:53 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:54.741160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:54.741822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:54.764753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:54.764855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:54.765228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:54.771255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:54.771753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:54.772443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:54.913278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:54.926977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3e6ebf9-f102-40ec-aeec-f3e988cecfa5 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1271 microversion: 2.1 time: 0.190590 Oct 26 05:38:54.929989 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3137/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:54 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:55.955223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:55.957126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:55.965925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:55.984315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:55.984859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:55.985306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:56.011417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:56.012003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:56.012482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:56.021697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:56.151489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:56.163428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c7efc7c-a01b-42d6-b1b5-79cd354e7d93 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1271 microversion: 2.1 time: 0.213156 Oct 26 05:38:56.164459 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3122/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:55 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:57.195255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:57.208370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=31 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:57.245415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:57.248268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=55 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:38:57.656789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:57.667850 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7df72b2f-b3e1-4934-9a8f-a5f4828b69e0 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.480620 Oct 26 05:38:57.668639 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3138/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:57 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:38:58.696806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:38:58.697490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:38:58.715370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:58.717119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:58.719905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:58.720672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:58.726623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:58.727325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:58.831161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-06cf0617-36fe-4fe9-b2e2-761d1cb03ef9 req-a6274ec3-0de9-48ec-8897-8f0b4ae43a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36ceafb-6cff-4548-ae4b-d62aa5e3b79e", "tag": "304b2f35-128d-4f6b-b828-be203d958399"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:58.851825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-06cf0617-36fe-4fe9-b2e2-761d1cb03ef9 req-a6274ec3-0de9-48ec-8897-8f0b4ae43a3a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:38:58.852705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-06cf0617-36fe-4fe9-b2e2-761d1cb03ef9 req-a6274ec3-0de9-48ec-8897-8f0b4ae43a3a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:38:58.855968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-06cf0617-36fe-4fe9-b2e2-761d1cb03ef9 req-a6274ec3-0de9-48ec-8897-8f0b4ae43a3a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:38:58.882822 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-06cf0617-36fe-4fe9-b2e2-761d1cb03ef9 req-a6274ec3-0de9-48ec-8897-8f0b4ae43a3a service nova] Creating event network-changed:304b2f35-128d-4f6b-b828-be203d958399 for instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e on n-h2-862416-4 Oct 26 05:38:58.899590 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-06cf0617-36fe-4fe9-b2e2-761d1cb03ef9 req-a6274ec3-0de9-48ec-8897-8f0b4ae43a3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072942 Oct 26 05:38:58.904063 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3139/6261] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:38:59.311209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:38:59.325889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f6ce065-e5de-463a-894f-67e31a195ae4 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.631690 Oct 26 05:38:59.328137 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3123/6262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:38:58 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:38:59.511841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1399165523", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "24963386-bbe2-4907-8f65-a302f8591241", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:38:59.738408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:39:00.370012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:00.371360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:00.387148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:00.388271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:00.388893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:00.389815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:00.391237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:00.391849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:00.779275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:39:00.779753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:39:00.780178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:39:00.780592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:39:00.781435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:39:00.806824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:00.807331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:00.808542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:00.809303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:00.810013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:00.814448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:00.858555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:00.869627 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d8e76f9-1f11-433a-9758-a5be032ab9ac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.504079 Oct 26 05:39:00.874565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:39:00.875447 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3124/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:00 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:00.882654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:39:00.907402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:39:00.913598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='24963386-bbe2-4907-8f65-a302f8591241',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:39:01.090100 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dbd325c1-3eae-4f8d-87a9-474920d2cce1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.583298 Oct 26 05:39:01.098673 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3140/6264] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:39:01.117020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ac6dd38-317f-47fe-926f-2898cdd448cc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:01.118041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ac6dd38-317f-47fe-926f-2898cdd448cc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:01.284549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ac6dd38-317f-47fe-926f-2898cdd448cc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:01.318531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ac6dd38-317f-47fe-926f-2898cdd448cc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1057 microversion: 2.1 time: 0.207388 Oct 26 05:39:01.339126 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3125/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:01 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1057 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:01.904151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:01.904776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:01.952086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:01.952588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:01.953036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:01.970470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:01.971524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:01.971977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:02.341268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:02.347352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:02.348314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:02.395313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:02.396211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:02.397944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:02.399932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:02.404292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:02.404980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:02.536815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:02.556621 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0793a30f-6eb8-41d7-84b7-5b3e059523cb tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.649936 Oct 26 05:39:02.557342 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3141/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:01 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:02.718088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:02.734707 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e9bca0e-e19f-4fd7-8e32-591c1852ff89 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1053 microversion: 2.1 time: 0.394941 Oct 26 05:39:02.735312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3126/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:02 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1053 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:03.587188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:03.587188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:03.597736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:03.609224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:03.616113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:03.620509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:03.621618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:03.622234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:03.763629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:03.765157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:03.813169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:03.824200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:03.827798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:03.832861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:03.863595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:03.867209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:04.210537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:04.239176 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da088f0b-b2cc-4508-9c0d-549b41315d09 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1117 microversion: 2.1 time: 0.480781 Oct 26 05:39:04.239799 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3127/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:03 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1117 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:04.403470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:04.422242 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1067282d-e467-4146-bc17-d04ba0dc2b77 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.841454 Oct 26 05:39:04.481418 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3142/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:03 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:05.265453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:05.266934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:05.292872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:05.293683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:05.294566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:05.303638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:05.304418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:05.305605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:05.452990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:05.454237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:05.468835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:05.470097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:05.471392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:05.474118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:05.480855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:05.481761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:06.849069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:06.862795 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67439de6-c99c-4464-8e42-97f3f2a49bef tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 1.415340 Oct 26 05:39:06.866090 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3143/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:05 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:06.870521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:06.895525 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac6b9eb3-0cde-4b5b-909b-fb4407f4d735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 1.629156 Oct 26 05:39:06.905792 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3128/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:05 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:07.896400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:07.898092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:07.913482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:07.929587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:07.930775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:07.938811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:07.940826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:07.961040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:07.961593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:07.962255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:07.971634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:07.982198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:08.000700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:08.010012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:08.014678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:08.014678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:08.782382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:08.798531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:08.807442 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e3ce944-ec4b-48c0-b787-07663632dab1 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.922698 Oct 26 05:39:08.809438 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b71cb50a-b756-4a14-be28-31603bd5f5ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.886304 Oct 26 05:39:08.821342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3129/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:07 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:08.821658 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3144/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:07 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:09.327240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-db18674f-eccd-4fbd-a681-75f5c650c590 req-52e8f831-7352-4867-8a42-568931f7187f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e2adad-94c3-4afe-82f3-a57c298ba786", "tag": "17b73096-fa87-43e9-a4da-9b0062540c68"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:09.357282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-db18674f-eccd-4fbd-a681-75f5c650c590 req-52e8f831-7352-4867-8a42-568931f7187f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:09.357804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-db18674f-eccd-4fbd-a681-75f5c650c590 req-52e8f831-7352-4867-8a42-568931f7187f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:09.358246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-db18674f-eccd-4fbd-a681-75f5c650c590 req-52e8f831-7352-4867-8a42-568931f7187f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:09.421353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-db18674f-eccd-4fbd-a681-75f5c650c590 req-52e8f831-7352-4867-8a42-568931f7187f service nova] Creating event network-changed:17b73096-fa87-43e9-a4da-9b0062540c68 for instance 13e2adad-94c3-4afe-82f3-a57c298ba786 on n-h1-862416-4 Oct 26 05:39:09.459755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-db18674f-eccd-4fbd-a681-75f5c650c590 req-52e8f831-7352-4867-8a42-568931f7187f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136091 Oct 26 05:39:09.460386 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3130/6274] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:39:09.841577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:09.842468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:09.844180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:09.847358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:09.861095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:09.863917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:09.865188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:09.865846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:09.866746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:09.867592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:09.868222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:09.870191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:09.870797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:09.871685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:09.873621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:09.877953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:10.408622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:10.427456 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f6673d95-e96b-4947-bfae-17a984078c05 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.600134 Oct 26 05:39:10.429374 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3145/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:09 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:10.441961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-81a77726-d792-4ee9-9abd-1ed282a44a17 req-2ac507fa-2ef5-461b-af82-8c6b3a206cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36ceafb-6cff-4548-ae4b-d62aa5e3b79e", "name": "network-vif-plugged", "status": "completed", "tag": "304b2f35-128d-4f6b-b828-be203d958399"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:10.483584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81a77726-d792-4ee9-9abd-1ed282a44a17 req-2ac507fa-2ef5-461b-af82-8c6b3a206cef service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:10.484072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81a77726-d792-4ee9-9abd-1ed282a44a17 req-2ac507fa-2ef5-461b-af82-8c6b3a206cef service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:10.484511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81a77726-d792-4ee9-9abd-1ed282a44a17 req-2ac507fa-2ef5-461b-af82-8c6b3a206cef service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:10.533571 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-81a77726-d792-4ee9-9abd-1ed282a44a17 req-2ac507fa-2ef5-461b-af82-8c6b3a206cef service nova] Creating event network-vif-plugged:304b2f35-128d-4f6b-b828-be203d958399 for instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e on n-h2-862416-4 Oct 26 05:39:10.540498 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-81a77726-d792-4ee9-9abd-1ed282a44a17 req-2ac507fa-2ef5-461b-af82-8c6b3a206cef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105674 Oct 26 05:39:10.541426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3146/6276] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:39:10.741207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:10.760927 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a91d052b-3f89-446f-8f30-117fec0250ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.928465 Oct 26 05:39:10.761441 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3131/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:09 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:11.457232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:11.457679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:11.480009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:11.481571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:11.484898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:11.486001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:11.487114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:11.488083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:11.488713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:11.489498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:11.785912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:11.787192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:11.797942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:11.804572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:11.809628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:11.810450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:11.811454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:11.812138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:11.815666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:11.957977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:11.974002 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a53fc98-b476-4650-b92e-1000beda8ec9 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.521445 Oct 26 05:39:11.996285 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3147/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:11 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:12.148154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:12.161585 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e461350a-3c39-4a6e-859b-f68ca7a98a14 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.381564 Oct 26 05:39:12.177685 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3132/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:11 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:13.003349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:13.004736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:13.018461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:13.019277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:13.020134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:13.021223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:13.021955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:13.022663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:13.186620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:13.189066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:13.224595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:13.233530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:13.234050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:13.237126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:13.249673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:13.250431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:13.697650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:13.712924 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3418433-7d22-4fef-a41f-5748dd90e0d7 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1313 microversion: 2.1 time: 0.714179 Oct 26 05:39:13.719068 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3148/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:12 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:13.865440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:13.893876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78d15efd-05ba-47e1-83ed-ab2199e8d34a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.712803 Oct 26 05:39:13.910085 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3133/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:13 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:14.747245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:14.747866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:14.769738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:14.785083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:14.786110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:14.791326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:14.792215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:14.796139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:14.932428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:14.933050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:14.945084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:14.946503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:14.947454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:14.948933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:14.950693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:14.952189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:15.184853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:15.194898 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c67b2c8a-0cac-473c-9ec4-25ce907e9402 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1497 microversion: 2.1 time: 0.452742 Oct 26 05:39:15.214644 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3149/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:14 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1497 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:15.344081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:15.364222 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2875220-c490-48a7-b039-09508be5d6d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.435657 Oct 26 05:39:15.365621 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3134/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:14 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:16.394717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:16.395328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:16.417061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:16.428649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:16.433859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:16.438416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:16.443232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:16.444169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:16.452852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:16.454641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:16.470309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:16.472188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:16.476550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:16.478937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:16.482346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:16.487219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:16.590139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:39:16.832149 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a837956-ba2c-49c0-9d51-ab41e33a2441 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 204 len: 0 microversion: 2.1 time: 0.382831 Oct 26 05:39:16.832774 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3135/6284] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:39:16 2022] DELETE /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:39:16.842303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:16.843077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:16.858307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:16.858812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:16.859255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:16.859972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:16.860437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:16.860869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:17.179623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:17.190516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79b547be-d978-483e-b667-9f5371abe32d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.800228 Oct 26 05:39:17.191608 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3150/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:16 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:17.554582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:17.569038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3efecad6-e511-4cf1-a58e-cb58b97282f8 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1503 microversion: 2.1 time: 0.729093 Oct 26 05:39:17.571395 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3136/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:16 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1503 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:18.250052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:18.256063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:18.304835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:18.305849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:18.306312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:18.313228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:18.323560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:18.324387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:18.596322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:18.598529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:18.607598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:18.608520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:18.609120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:18.610865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:18.612294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:18.612904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:19.504722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:19.509510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72da49d3df10411a82c0bcd456725533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5eba23930f74f19bdca41a615f24842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:19.519400 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16052601-6b26-4b01-a8b8-9b411bb48377 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 1.291469 Oct 26 05:39:19.522646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2066eb57-e117-406b-9f59-12a04a361cac tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 200 len: 1503 microversion: 2.1 time: 0.930212 Oct 26 05:39:19.524255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3151/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:18 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:19.554800 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3137/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:18 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 1503 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:19.584420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1eaff449-75b6-49ee-b548-6a3d7b304b9a req-411d6c6f-aa18-4bbc-acad-b79597d752df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36ceafb-6cff-4548-ae4b-d62aa5e3b79e", "name": "network-vif-deleted", "tag": "304b2f35-128d-4f6b-b828-be203d958399"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:19.596621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1eaff449-75b6-49ee-b548-6a3d7b304b9a req-411d6c6f-aa18-4bbc-acad-b79597d752df service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:19.597672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1eaff449-75b6-49ee-b548-6a3d7b304b9a req-411d6c6f-aa18-4bbc-acad-b79597d752df service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:19.598259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1eaff449-75b6-49ee-b548-6a3d7b304b9a req-411d6c6f-aa18-4bbc-acad-b79597d752df service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:19.613860 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1eaff449-75b6-49ee-b548-6a3d7b304b9a req-411d6c6f-aa18-4bbc-acad-b79597d752df service nova] Creating event network-vif-deleted:304b2f35-128d-4f6b-b828-be203d958399 for instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e on n-h2-862416-4 Oct 26 05:39:19.626215 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1eaff449-75b6-49ee-b548-6a3d7b304b9a req-411d6c6f-aa18-4bbc-acad-b79597d752df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051363 Oct 26 05:39:19.654756 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3152/6289] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:39:20.556777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:20.569521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:20.577615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:20.578416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:20.578932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:20.581656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:20.582088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] [instance: c36ceafb-6cff-4548-ae4b-d62aa5e3b79e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:20.582879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:20.583583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:20.586001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:20.646638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:20.647159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:20.649252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:20.650386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:20.651179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:20.651889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:20.715433 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] HTTP exception thrown: Instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e could not be found. Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Request method failure captured: Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e HTTP/1.1 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMfMwV1kRMy_cla55t8Yewu7QRjIdXCp6YLTr0KmSprZdDPcUBzpPm2NcGisIV6kluI7qetyz4_C2EhktRWqZrikFyjcghxlQ9VsA8UW6Xo_pR_jlVZ2P1cm3kYjzrpWMeI8mUS6EavZ_R6y-NU5_e1Z71bINNua6l1OC2y1Pk5yekY Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b5eba23930f74f19bdca41a615f24842 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesActionsTest-121867631 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b5eba23930f74f19bdca41a615f24842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5eba23930f74f19bdca41a615f24842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b5eba23930f74f19bdca41a615f24842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b5eba23930f74f19bdca41a615f24842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesActionsTest-121867631 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b5eba23930f74f19bdca41a615f24842 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesActionsTest-121867631 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesActionsTest-121867631-project Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 72da49d3df10411a82c0bcd456725533 Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesActionsTest-121867631-project Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e could not be found. Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c36ceafb-6cff-4548-ae4b-d62aa5e3b79e'} Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e could not be found. Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e could not be found. Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:39:20.717736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e could not be found. Oct 26 05:39:20.726477 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:39:20.732562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] Returning 404 to user: Instance c36ceafb-6cff-4548-ae4b-d62aa5e3b79e could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:39:20.735485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3b4d6f03-bcd0-4e03-bcd9-e5d80d56aa38 tempest-VolumesActionsTest-121867631 tempest-VolumesActionsTest-121867631-project] 10.222.0.16 "GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e" status: 404 len: 111 microversion: 2.1 time: 0.162759 Oct 26 05:39:20.748300 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3153/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:20 2022] GET /compute/v2.1/servers/c36ceafb-6cff-4548-ae4b-d62aa5e3b79e => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:39:20.960432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:20.963646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:21.026909 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a4ec4d7-bd25-4504-88d3-e2f7b21af0ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.474724 Oct 26 05:39:21.067615 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3138/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:20 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:22.106171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:22.106835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:22.123920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:22.128649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:22.132300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:22.138754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:22.144653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:22.145919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:22.624460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:22.661732 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ec5df520-8189-4255-90e9-2fc30feb0e58 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.564390 Oct 26 05:39:22.675777 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3154/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:22 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:23.698095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:23.698882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:23.740283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:23.753224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:23.754063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:23.755557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:23.766093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:23.768521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:24.201104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:24.216658 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8fe235f-579c-4098-88fa-b3795c6db23c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.532093 Oct 26 05:39:24.227975 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3139/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:23 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:24.734400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1dea6fc2-0381-4a70-b5b9-c61a09123944 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Action: 'create', calling method: .version_select at 0x7f470995d4c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-532755590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Vhykn6f3tzKDiLUFwiC2RLGwGsNjWUJoopwE83cL1YDt1qK3jIj+V+ijn7gC/QSURqgHjiNli0dzRV1pxj+2OxbhgGafIj8MccX7TW/CTr+IpUatEiKHOIYNrXSqZFQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:24.777559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1dea6fc2-0381-4a70-b5b9-c61a09123944 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Getting quotas for project 9fc607ea7b994659b8aa180528a846bd. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:39:24.784729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1dea6fc2-0381-4a70-b5b9-c61a09123944 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Getting quotas for user 4dbdd8580955425bad6cf7a9a33f4fe0 and project 9fc607ea7b994659b8aa180528a846bd. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:39:24.871586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1dea6fc2-0381-4a70-b5b9-c61a09123944 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.130342 Oct 26 05:39:24.872356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3155/6294] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:39:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:39:25.253486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:25.254234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:25.279451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:25.281609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:25.286974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:25.288092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:25.288539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:25.289092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:26.121646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:26.139890 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f1baed05-5800-4716-abab-8138bfbc876b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.891557 Oct 26 05:39:26.163933 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3140/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:25 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:27.173812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:27.174848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:27.181611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:27.191988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:27.192724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:27.193689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:27.194320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:27.194946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:27.286372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=85 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:28.003758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:28.020515 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-12f8843b-5e94-4b9b-8094-3ca03d786890 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.847434 Oct 26 05:39:28.021828 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3156/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:27 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:28.108099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-504935185", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d97a00a7-8a2e-46ec-9e99-45b6a35e6a5a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-532755590", "security_groups": [{"name": "tempest-secgroup-smoke-71238057"}], "networks": [{"uuid": "9de78927-6827-4526-b4e7-9f6764e41bf9"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:28.134967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:28.420669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] validate_networks() for [('9de78927-6827-4526-b4e7-9f6764e41bf9', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:39:29.049184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:29.049898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:29.055689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:29.074717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:29.075151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:29.081821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:29.086001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:29.086777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:29.088264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:29.200371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:39:29.201039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:39:29.201450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:39:29.201871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:39:29.202290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:39:29.225020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:29.225972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:29.226590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:29.227588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:29.238307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:29.238307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:29.306516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Getting quotas for project 9fc607ea7b994659b8aa180528a846bd. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:39:29.314966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Getting quotas for user 4dbdd8580955425bad6cf7a9a33f4fe0 and project 9fc607ea7b994659b8aa180528a846bd. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:39:29.647030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:39:29.649628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d97a00a7-8a2e-46ec-9e99-45b6a35e6a5a',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:39:29.766231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:29.782181 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e24656e-78e4-4987-a39b-3d994d416c6a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.738011 Oct 26 05:39:29.799152 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3157/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:29 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:30.074261 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2741c190-5023-4980-b9a8-30fae135f769 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.970308 Oct 26 05:39:30.077650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3141/6298] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:39:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:39:30.087271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1eac8e33-7f03-47c4-9a1b-7a4d221e91d9 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:30.088583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1eac8e33-7f03-47c4-9a1b-7a4d221e91d9 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:30.282033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1eac8e33-7f03-47c4-9a1b-7a4d221e91d9 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:30.295594 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1eac8e33-7f03-47c4-9a1b-7a4d221e91d9 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1097 microversion: 2.1 time: 0.212491 Oct 26 05:39:30.305348 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3158/6299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:30 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1097 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:30.810007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:30.810732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:30.827242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:30.835380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:30.836172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:30.840128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:30.843412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:30.847355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:31.322464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:31.324063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:31.333187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:31.372625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6fc873de-7b1a-41b1-bec5-545358288664 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.566983 Oct 26 05:39:31.379315 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3142/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:30 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:31.401039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:31.404282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:31.405174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:31.410097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:31.410909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:31.412527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:31.739859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:31.756057 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9dca9fa2-418e-45ae-837e-5a9168072fb0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1147 microversion: 2.1 time: 0.439210 Oct 26 05:39:31.781512 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3159/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:31 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1147 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:32.399298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:32.400657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:32.437855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:32.438362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:32.456160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:32.456942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:32.457466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:32.457913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:32.788162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:32.788893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:32.803805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:32.804530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:32.806219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:32.807194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:32.811289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:32.811938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:33.209299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:33.218729 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46b0cdc7-11d7-40e7-93ce-f193796e79ba tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1213 microversion: 2.1 time: 0.434439 Oct 26 05:39:33.221925 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3160/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:32 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1213 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:33.477439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:33.502434 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-188337b1-2bb2-4153-b5c9-e7a4c2fd7028 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 1.106548 Oct 26 05:39:33.506251 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3143/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:32 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:34.245344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:34.246069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:34.259878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:34.260923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:34.261582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:34.270565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:34.271353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:34.271967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:34.535977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:34.536613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:34.553641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:34.555701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:34.557968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:34.558938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:34.560033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:34.564901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:35.387426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:35.397189 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9922da06-a88d-4e95-a2da-6b649e58be0b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 1.155729 Oct 26 05:39:35.402219 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3161/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:34 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:35.472344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:35.485360 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b20ef766-7360-4ccf-bab1-b2fa268ab5f5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.959190 Oct 26 05:39:35.497972 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3144/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:34 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:36.426764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:36.428352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:36.479332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:36.479844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:36.480290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:36.481565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:36.482035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:36.482468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:36.508788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:36.510052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:36.545230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:36.545937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:36.546620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:36.551030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:36.551419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:36.551911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:37.197051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:37.208630 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e3afb484-427e-402f-9a39-7b93d7368037 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1169 microversion: 2.1 time: 0.703719 Oct 26 05:39:37.211427 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3145/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:36 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1169 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:37.222439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a7d9d56f-c87d-4e61-a878-4048315882d2 req-9acf6807-a3e3-4909-bb8c-1ff27432a890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:37.246726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:37.260162 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1cdc6a0a-1245-4b22-a5ab-98dd192d1d2b tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.838145 Oct 26 05:39:37.264901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a7d9d56f-c87d-4e61-a878-4048315882d2 req-9acf6807-a3e3-4909-bb8c-1ff27432a890 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:37.265422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a7d9d56f-c87d-4e61-a878-4048315882d2 req-9acf6807-a3e3-4909-bb8c-1ff27432a890 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:37.265861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a7d9d56f-c87d-4e61-a878-4048315882d2 req-9acf6807-a3e3-4909-bb8c-1ff27432a890 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:37.282882 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3162/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:36 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:37.321408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a7d9d56f-c87d-4e61-a878-4048315882d2 req-9acf6807-a3e3-4909-bb8c-1ff27432a890 service nova] Creating event network-changed:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:39:37.333188 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a7d9d56f-c87d-4e61-a878-4048315882d2 req-9acf6807-a3e3-4909-bb8c-1ff27432a890 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118718 Oct 26 05:39:37.334694 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3146/6308] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:39:38.236192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:38.238734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:38.262721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:38.263384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:38.264617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:38.271408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:38.272021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:38.272580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:38.296813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:38.297555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:38.311987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:38.323107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:38.325545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:38.333783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:38.340778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:38.341244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:39.017016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:39.031756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85a74b5a-032e-4c31-9a2c-305e1a839579 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.740244 Oct 26 05:39:39.034832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3147/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:38 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:39.100342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:39.122898 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bf52d6a1-6166-405a-a566-884b88bc0b16 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1215 microversion: 2.1 time: 0.885489 Oct 26 05:39:39.125880 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3163/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:38 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1215 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:40.057293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:40.057920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:40.068034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:40.073995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:40.076480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:40.076986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:40.077467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:40.085023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:40.085574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:40.086043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:40.153900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:40.155390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:40.179892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:40.183285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:40.184506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:40.195863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:40.199021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:40.199652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:40.288910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:40.933881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:40.949391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6d992dc-0a0d-4097-8ca8-33373cb8f266 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.897090 Oct 26 05:39:40.971754 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3148/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:40 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:41.063362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:41.077395 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17375269-822c-4b05-93bd-d04d171e8d27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.928922 Oct 26 05:39:41.078029 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3164/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:40 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:41.975974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:41.977357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:41.993467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:41.994300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:41.995525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:41.998612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:41.999510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:42.000329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:42.102831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:42.103661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:42.120898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:42.122078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:42.124142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:42.126714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:42.134049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:42.134714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:42.373701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:42.389080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed4d7a39-f823-442d-b5ae-a848b0e631b0 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.419107 Oct 26 05:39:42.408057 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3149/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:41 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:42.644224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:42.653884 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a8c29cff-f6db-4a6b-a18e-5e2240b43d66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.555545 Oct 26 05:39:42.666181 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3165/6314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:42 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:43.421273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:43.423529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:43.441260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:43.442156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:43.448574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:43.455247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:43.456064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:43.457401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:43.680467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:43.681045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:43.699731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:43.700237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:43.700681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:43.702600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:43.709880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:43.716358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:43.771291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:43.783574 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-872bae62-9361-4f89-86de-f1f6c0872f8a tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.369616 Oct 26 05:39:43.801743 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3150/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:43 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:44.057674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:44.072876 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ecac2e2b-7a39-4807-83e2-0d4284fa9bee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.396482 Oct 26 05:39:44.077384 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3166/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:43 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:44.807622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:44.808239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:44.817603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:44.818097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:44.818536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:44.819241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:44.819749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:44.820111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:45.103560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:45.104138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:45.124510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:45.134613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:45.135335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:45.136248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:45.136870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:45.140558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:45.174246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:45.194723 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d43920c9-ee8d-4241-8da2-32962b881a4d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.379171 Oct 26 05:39:45.195519 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3151/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:44 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:45.529726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:45.542514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98f4a154-3f1d-4ca4-a630-fcc59139c749 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.444256 Oct 26 05:39:45.543449 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3167/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:45 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:46.221481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:46.222115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:46.233461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:46.233953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:46.234392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:46.235628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:46.236199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:46.236683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:46.566648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:46.567260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:46.577026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:46.578747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:46.582669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:46.584513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:46.586148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:46.588532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:46.698676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:46.718296 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba0c91aa-e722-463e-ab9c-9830e6f415e7 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1279 microversion: 2.1 time: 0.500213 Oct 26 05:39:46.721580 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3152/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:46 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1279 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:46.993708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:47.002186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e75128a-c8f8-4236-a462-00436508565e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.439840 Oct 26 05:39:47.009735 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3168/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:46 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:47.754837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:47.755619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:47.777484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:47.778003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:47.778447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:47.795685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:47.797752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:47.798277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:48.029549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:48.030828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:48.067013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:48.068872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:48.071054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:48.092400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:48.095997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:48.098628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:48.365640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:48.381796 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79618653-c96a-41d6-9f1b-feabe358bd0e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 0.641039 Oct 26 05:39:48.383145 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3153/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:47 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:48.423262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:48.444111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-578050ec-874a-41d7-a080-05b7f36e311d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.418093 Oct 26 05:39:48.446918 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3169/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:48 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:49.409329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:49.410277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:49.426292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:49.428671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:49.429798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:49.431349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:49.433917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:49.435693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:49.475513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:49.476895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:49.492420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:49.504836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:49.506889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:49.510582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:49.517536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:49.522499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:49.898986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:49.911309 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-569d0355-3430-4b88-a7ee-523b679b5b16 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 0.507067 Oct 26 05:39:49.917790 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3154/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:49 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:49.994556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:50.009193 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a3707e08-df39-423e-9978-7e0474b4b9ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 0.538145 Oct 26 05:39:50.010508 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3170/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:49 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:50.440029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-482eafe6-c49c-41fb-b644-7ddef9ff0ea3 req-36fa2fa4-a700-4a87-b95c-f0ab0aabd503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e2adad-94c3-4afe-82f3-a57c298ba786", "name": "network-vif-plugged", "status": "completed", "tag": "17b73096-fa87-43e9-a4da-9b0062540c68"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:50.456046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-482eafe6-c49c-41fb-b644-7ddef9ff0ea3 req-36fa2fa4-a700-4a87-b95c-f0ab0aabd503 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:50.456987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-482eafe6-c49c-41fb-b644-7ddef9ff0ea3 req-36fa2fa4-a700-4a87-b95c-f0ab0aabd503 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:50.457775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-482eafe6-c49c-41fb-b644-7ddef9ff0ea3 req-36fa2fa4-a700-4a87-b95c-f0ab0aabd503 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:50.492092 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-482eafe6-c49c-41fb-b644-7ddef9ff0ea3 req-36fa2fa4-a700-4a87-b95c-f0ab0aabd503 service nova] Creating event network-vif-plugged:17b73096-fa87-43e9-a4da-9b0062540c68 for instance 13e2adad-94c3-4afe-82f3-a57c298ba786 on n-h1-862416-4 Oct 26 05:39:50.503066 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-482eafe6-c49c-41fb-b644-7ddef9ff0ea3 req-36fa2fa4-a700-4a87-b95c-f0ab0aabd503 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081074 Oct 26 05:39:50.510192 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3155/6325] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:39:50.942745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:50.943822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:50.961055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:50.962507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:50.964368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:50.967053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:50.967561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:50.968014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:51.038751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:51.040134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:51.055597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:51.057477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:51.059102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:51.060019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:51.064890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:51.065733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:51.937861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:51.967581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79bcc653-77fd-4f0b-85ea-4df27370b6c5 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 1.031379 Oct 26 05:39:51.973558 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3171/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:50 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:52.361338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:52.376779 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5bb1b0d0-ccea-45f4-bb06-ab8f3e030aef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1203 microversion: 2.1 time: 1.343571 Oct 26 05:39:52.380424 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3156/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:51 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1203 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:52.996739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:52.997528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:53.014892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:53.018051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:53.020570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:53.022872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:53.026691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:53.027468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:53.407870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:53.408485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:53.423848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:53.455094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:53.455565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:53.456329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:53.456799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:53.457237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:53.462547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:53.477260 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54f8c42a-b887-43bf-a582-6e8a65433fb1 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 0.484975 Oct 26 05:39:53.482345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3172/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:52 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:53.538244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:53.987537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:54.019904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39a97060-a9a3-40a7-bdcd-11c3e9570098 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1390 microversion: 2.1 time: 0.616356 Oct 26 05:39:54.025454 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3157/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:53 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1390 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:54.051192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:54.052483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:54.065386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:54.080823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:54.081545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:54.084698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:54.088660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:54.089289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:54.507695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:54.511388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:54.558273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:54.559258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:54.559970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:54.561383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:54.564096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:54.567805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:54.691724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:54.702708 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea737539-1389-44ea-ba27-8af175077ace tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1390 microversion: 2.1 time: 0.656140 Oct 26 05:39:54.721757 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3173/6330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:54 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1390 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:54.749082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:54.749785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:54.770077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:54.770570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:54.773980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:54.774957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:54.783428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:54.789949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:54.851669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=100 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:55.191976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:55.203469 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b065de22-ba5d-4ecd-9a61-3ce0ccdf138d tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 0.700569 Oct 26 05:39:55.207735 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3158/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:54 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:55.772780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:55.787598 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7e26302-5fe4-470a-ad8a-5ff77b25d9d9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1390 microversion: 2.1 time: 1.061477 Oct 26 05:39:55.789689 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3174/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:54 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1390 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:55.951573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:55.952329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:55.967055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:55.967926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:55.968597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:55.979895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:55.981527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:55.982304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:56.078611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:39:56.232057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:56.232990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:56.251589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:56.266536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:56.267024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:56.267793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:56.269267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:56.271312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:56.359321 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf8d8b2c-d358-4f4f-b9fd-a35cfd5cf88c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 204 len: 0 microversion: 2.1 time: 0.412237 Oct 26 05:39:56.365775 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3159/6333] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:39:55 2022] DELETE /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:39:56.374345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:56.375344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:56.387683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:56.388200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:56.388646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:56.389397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:56.389875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:56.390313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:57.284610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:57.311417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:57.343576 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ce23f91-7e7c-4bce-8846-a02cc2cf8e1d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1396 microversion: 2.1 time: 0.973440 Oct 26 05:39:57.346220 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-56c9f00a-f81b-4e74-a319-ece8299f77e4 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 1.118260 Oct 26 05:39:57.353197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3160/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:56 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1396 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:39:57.361494 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3175/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:56 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:58.385119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:58.385856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:58.388801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:39:58.390172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:39:58.407520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:58.427727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:58.432161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:58.433069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:58.433467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:58.433947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:58.434383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:58.446327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:58.446790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:58.447323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:58.453864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:58.454378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:58.454830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:39:59.211403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:59.219805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-850892fb-7026-457f-bb8b-1180f2888b95 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 0.846107 Oct 26 05:39:59.220398 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3176/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:58 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:59.227141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:39:59.236706 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09b9d914-0fff-4940-b55b-e9709b11c84d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1396 microversion: 2.1 time: 0.873197 Oct 26 05:39:59.244803 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3161/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:39:58 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1396 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:39:59.955590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-43403100-a54e-4b8a-b1ba-b30c4df1f028 req-cd0822b8-3f70-43f6-ad9b-1c8de5624fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e2adad-94c3-4afe-82f3-a57c298ba786", "name": "network-vif-deleted", "tag": "17b73096-fa87-43e9-a4da-9b0062540c68"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:39:59.985574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=46 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:39:59.993777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-43403100-a54e-4b8a-b1ba-b30c4df1f028 req-cd0822b8-3f70-43f6-ad9b-1c8de5624fc3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:39:59.996455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-43403100-a54e-4b8a-b1ba-b30c4df1f028 req-cd0822b8-3f70-43f6-ad9b-1c8de5624fc3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:39:59.997593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-43403100-a54e-4b8a-b1ba-b30c4df1f028 req-cd0822b8-3f70-43f6-ad9b-1c8de5624fc3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:00.034166 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-43403100-a54e-4b8a-b1ba-b30c4df1f028 req-cd0822b8-3f70-43f6-ad9b-1c8de5624fc3 service nova] Creating event network-vif-deleted:17b73096-fa87-43e9-a4da-9b0062540c68 for instance 13e2adad-94c3-4afe-82f3-a57c298ba786 on n-h1-862416-4 Oct 26 05:40:00.051821 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-43403100-a54e-4b8a-b1ba-b30c4df1f028 req-cd0822b8-3f70-43f6-ad9b-1c8de5624fc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104948 Oct 26 05:40:00.055853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3177/6338] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:40:00.248421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:00.249043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:00.264382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:00.269597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:00.280640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:00.281284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:00.283301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:00.284037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:00.285328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:00.285835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:00.286907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:00.288553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:00.289305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:00.290199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:00.290725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:00.295020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:01.403670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:01.418833 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ccc3f006-df02-433a-b594-138a2bf114c7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1188 microversion: 2.1 time: 1.157585 Oct 26 05:40:01.429783 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3178/6339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:00 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1188 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:01.445594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6f9dc706-668b-48af-96c6-8f31cb384c46 req-f11aafa4-512e-46b9-af82-3df871c74ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "name": "network-vif-plugged", "status": "completed", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:01.481162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6f9dc706-668b-48af-96c6-8f31cb384c46 req-f11aafa4-512e-46b9-af82-3df871c74ca7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:01.487507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6f9dc706-668b-48af-96c6-8f31cb384c46 req-f11aafa4-512e-46b9-af82-3df871c74ca7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:01.487831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6f9dc706-668b-48af-96c6-8f31cb384c46 req-f11aafa4-512e-46b9-af82-3df871c74ca7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:01.525799 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6f9dc706-668b-48af-96c6-8f31cb384c46 req-f11aafa4-512e-46b9-af82-3df871c74ca7 service nova] Creating event network-vif-plugged:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:40:01.538847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6f9dc706-668b-48af-96c6-8f31cb384c46 req-f11aafa4-512e-46b9-af82-3df871c74ca7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116594 Oct 26 05:40:01.544029 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3179/6340] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:40:01.826331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:01.839898 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eeb0c541-8ed8-47b7-9550-4f874c88adda tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 1.596154 Oct 26 05:40:01.840788 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3162/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:00 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:02.445743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:02.446466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:02.464562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:02.465217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:02.466103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:02.466455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:02.466919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:02.467357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:02.680644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:02.695490 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7563bf92-315a-4d1b-9ff3-bdfd62b2fa91 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1188 microversion: 2.1 time: 0.254419 Oct 26 05:40:02.699075 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3180/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:02 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1188 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:02.863343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:02.865011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:02.881521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:02.882497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:02.884213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:02.887323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:02.888026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:02.893726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:03.365991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:03.374277 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe828794-15a0-40e2-aace-2d1754a4b722 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1267 microversion: 2.1 time: 0.515159 Oct 26 05:40:03.374873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3163/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:02 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1267 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:03.731425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:03.733101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:03.761868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:03.770632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:03.773104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:03.777455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:03.782150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:03.785802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:04.050969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:04.065849 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08706a70-8411-445e-a0f9-8e1bb3bbbf5c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1188 microversion: 2.1 time: 0.348131 Oct 26 05:40:04.066462 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3181/6344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:03 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:04.398205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:04.399118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:04.432213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:04.462537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:04.464549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:04.465344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:04.465834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:04.467150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:04.847915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:04.867743 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd4ce806-d9cf-4bc7-86c9-f6b1223ad18f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1457 microversion: 2.1 time: 0.475094 Oct 26 05:40:04.878736 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3164/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:04 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1457 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:04.905771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:04.906390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:04.926759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:04.927805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:04.929927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:04.932590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:04.933657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:04.934540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:05.095403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:05.096040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:05.115167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:05.115685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:05.116134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:05.116862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:05.117346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:05.117788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:05.244153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:05.261169 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3aae5d9f-79ba-45be-a9da-a4c5d2347f07 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1188 microversion: 2.1 time: 0.173310 Oct 26 05:40:05.264439 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3165/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:05 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:05.296380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:05.321775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29e182f1-1791-4032-a1b2-57d8c43ec31c tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1457 microversion: 2.1 time: 0.420431 Oct 26 05:40:05.328270 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3182/6347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:04 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1457 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:06.289461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:06.290888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:06.299413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:06.300448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:06.300965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:06.302304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:06.303012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:06.303946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:06.378047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:06.386716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-03af5a9d-59d0-4988-83e6-4fff8d116383 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1188 microversion: 2.1 time: 0.101200 Oct 26 05:40:06.403642 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3166/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:06 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:06.502773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:06.503929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:06.512081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:06.522082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:06.522647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:06.523465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:06.524000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:06.524507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:06.679968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lazy-loading 'services' on Instance uuid d93409d3-9aa5-4909-be9a-9613ec06865b {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:40:06.802462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39c38375-eeff-4325-9c0d-27f874b26554 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b/os-volume_attachments/4ad24a8d-64fe-443e-aac9-2faf847bbb08" status: 202 len: 0 microversion: 2.1 time: 0.303757 Oct 26 05:40:06.811779 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3183/6349] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:40:06 2022] DELETE /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b/os-volume_attachments/4ad24a8d-64fe-443e-aac9-2faf847bbb08 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:40:07.415694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:07.416440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:07.425229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:07.426857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:07.427900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:07.429202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:07.429949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:07.430618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:07.582143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:07.590214 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0230a63e-b104-49f6-9b02-80374dd7994a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1188 microversion: 2.1 time: 0.181356 Oct 26 05:40:07.591059 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3167/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:07 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1188 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:08.614623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:08.615386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:08.623393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:08.623993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:08.624652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:08.627051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:08.627597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:08.628127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:08.661005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:08.661918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:08.662739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:08.663353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lazy-loading 'fault' on Instance uuid 13e2adad-94c3-4afe-82f3-a57c298ba786 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:40:08.713533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:08.724054 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfce89af-b46c-4721-9ca9-786cf9bd9382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 200 len: 1193 microversion: 2.1 time: 0.115549 Oct 26 05:40:08.724653 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3184/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:08 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 1193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:09.747139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:09.747765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:09.760105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:09.760940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:09.761616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:09.764658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:09.765147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:09.765636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:09.783449 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 HTTP/1.1 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '13e2adad-94c3-4afe-82f3-a57c298ba786'} Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:09.785857 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:40:09.790838 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c172a989-5f20-4143-b74e-9109bc23854f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 404 len: 111 microversion: 2.1 time: 0.044667 Oct 26 05:40:09.792668 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3168/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:09 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:40:10.014943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1e156d82-162f-4def-9cd9-3a2bcfadbbff req-3a3f6549-04f6-4721-8156-2de1d788d465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:10.082060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1e156d82-162f-4def-9cd9-3a2bcfadbbff req-3a3f6549-04f6-4721-8156-2de1d788d465 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:10.082551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1e156d82-162f-4def-9cd9-3a2bcfadbbff req-3a3f6549-04f6-4721-8156-2de1d788d465 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:10.082984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1e156d82-162f-4def-9cd9-3a2bcfadbbff req-3a3f6549-04f6-4721-8156-2de1d788d465 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:10.111097 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1e156d82-162f-4def-9cd9-3a2bcfadbbff req-3a3f6549-04f6-4721-8156-2de1d788d465 service nova] Creating event network-changed:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:40:10.132204 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1e156d82-162f-4def-9cd9-3a2bcfadbbff req-3a3f6549-04f6-4721-8156-2de1d788d465 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122291 Oct 26 05:40:10.135419 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3185/6353] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:40:13.132676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-01120856-bb4d-43b9-a61a-aecd48eac51b req-c198e74e-5da8-4eee-865f-d5182d2cb0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:13.145577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-01120856-bb4d-43b9-a61a-aecd48eac51b req-c198e74e-5da8-4eee-865f-d5182d2cb0c2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:13.146064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-01120856-bb4d-43b9-a61a-aecd48eac51b req-c198e74e-5da8-4eee-865f-d5182d2cb0c2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:13.146504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-01120856-bb4d-43b9-a61a-aecd48eac51b req-c198e74e-5da8-4eee-865f-d5182d2cb0c2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:13.194608 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-01120856-bb4d-43b9-a61a-aecd48eac51b req-c198e74e-5da8-4eee-865f-d5182d2cb0c2 service nova] Creating event network-changed:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:40:13.212723 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-01120856-bb4d-43b9-a61a-aecd48eac51b req-c198e74e-5da8-4eee-865f-d5182d2cb0c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101088 Oct 26 05:40:13.234097 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3169/6354] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:40:15.342285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-482810fa-1bad-497b-8370-74d28386edd2 req-479612c7-786b-4333-90ed-0e1897be9439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:15.367341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-482810fa-1bad-497b-8370-74d28386edd2 req-479612c7-786b-4333-90ed-0e1897be9439 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:15.373289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-482810fa-1bad-497b-8370-74d28386edd2 req-479612c7-786b-4333-90ed-0e1897be9439 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:15.376975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-482810fa-1bad-497b-8370-74d28386edd2 req-479612c7-786b-4333-90ed-0e1897be9439 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:15.403742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-482810fa-1bad-497b-8370-74d28386edd2 req-479612c7-786b-4333-90ed-0e1897be9439 service nova] Creating event network-changed:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:40:15.415125 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-482810fa-1bad-497b-8370-74d28386edd2 req-479612c7-786b-4333-90ed-0e1897be9439 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077342 Oct 26 05:40:15.416109 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3186/6355] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:40:15.435808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:15.437255 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:15.456393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:15.457641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:15.459461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:15.461144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:15.464555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:15.465492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:15.508511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 HTTP/1.1 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '13e2adad-94c3-4afe-82f3-a57c298ba786'} Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:40:15.514218 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.519720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:40:15.525299 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80c68d0b-6283-4fca-8bcf-97ba77d63761 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 404 len: 111 microversion: 2.1 time: 0.094864 Oct 26 05:40:15.526184 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3170/6356] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:40:15 2022] DELETE /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:40:15.535533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:15.536355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 13e2adad-94c3-4afe-82f3-a57c298ba786] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:15.552565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:15.553497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:15.554029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:15.554838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:15.555807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:15.563813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:15.589437 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 HTTP/1.1 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '13e2adad-94c3-4afe-82f3-a57c298ba786'} Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:15.595058 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. Oct 26 05:40:15.599971 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:40:15.602036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 13e2adad-94c3-4afe-82f3-a57c298ba786 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:40:15.603024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f821406d-c2fd-4ef7-9ba7-184cfbe78af3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786" status: 404 len: 111 microversion: 2.1 time: 0.072196 Oct 26 05:40:15.605392 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3187/6357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:15 2022] GET /compute/v2.1/servers/13e2adad-94c3-4afe-82f3-a57c298ba786 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:40:19.509203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:19.510452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:19.519920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:19.520595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:19.521193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:19.522114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:19.522733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:19.523316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:19.568916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:40:19.747738 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-581f64ea-a601-4b6b-aae2-f46c17050bc6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 204 len: 0 microversion: 2.1 time: 0.241765 Oct 26 05:40:19.750833 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3171/6358] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:40:19 2022] DELETE /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:40:19.759144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:19.759884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:19.772115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:19.772769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:19.773290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:19.776407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:19.777159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:19.781594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:20.031739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:20.041469 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f729207d-ba74-45ef-97ad-1343ab86b34f tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1469 microversion: 2.1 time: 0.286293 Oct 26 05:40:20.044534 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3188/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:19 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:21.068360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:21.070536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:21.082373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:21.084791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:21.085577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:21.087358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:21.094709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:21.095204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:21.299329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:21.303892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:40:21.326120 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d89c109-bc4d-46a6-82bc-4c06bc24c2c6 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1469 microversion: 2.1 time: 0.261395 Oct 26 05:40:21.340555 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3172/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:21 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:22.356446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:22.357761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:22.377304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:22.384752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:22.385557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:22.386557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:22.393431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:22.394212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:22.538624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:22.561382 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11355690-00eb-44d6-8d25-52f6b9180706 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1427 microversion: 2.1 time: 0.209548 Oct 26 05:40:22.572923 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3189/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:22 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:22.730048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d0185c53-7808-4dde-bdce-66b290c8b26f req-1a55a3c5-57e8-4587-8266-5a0b3fe873cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93409d3-9aa5-4909-be9a-9613ec06865b", "name": "network-vif-deleted", "tag": "6c41b90c-782e-4e70-9c01-e06b48e7fb00"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:22.761797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d0185c53-7808-4dde-bdce-66b290c8b26f req-1a55a3c5-57e8-4587-8266-5a0b3fe873cf service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:22.762318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d0185c53-7808-4dde-bdce-66b290c8b26f req-1a55a3c5-57e8-4587-8266-5a0b3fe873cf service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:22.762771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d0185c53-7808-4dde-bdce-66b290c8b26f req-1a55a3c5-57e8-4587-8266-5a0b3fe873cf service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:22.799875 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d0185c53-7808-4dde-bdce-66b290c8b26f req-1a55a3c5-57e8-4587-8266-5a0b3fe873cf service nova] Creating event network-vif-deleted:6c41b90c-782e-4e70-9c01-e06b48e7fb00 for instance d93409d3-9aa5-4909-be9a-9613ec06865b on n-h1-862416-4 Oct 26 05:40:22.813440 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d0185c53-7808-4dde-bdce-66b290c8b26f req-1a55a3c5-57e8-4587-8266-5a0b3fe873cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088805 Oct 26 05:40:22.814049 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3173/6362] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:40:23.596841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:23.603147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:23.618695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:23.619578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:23.622469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:23.623482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:23.625781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:23.628704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:23.718254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:23.720943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:23.723656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:23.726467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lazy-loading 'fault' on Instance uuid d93409d3-9aa5-4909-be9a-9613ec06865b {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:40:23.836859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6845ac26f045869ab395210d316526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5717e2429846b7a3a905aff892b118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:23.848957 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e6d68ef3-ea66-4bc3-ae41-c0bf3f856b71 tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 200 len: 1303 microversion: 2.1 time: 0.256217 Oct 26 05:40:23.857743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3190/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:23 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:24.883442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:24.884581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] [instance: d93409d3-9aa5-4909-be9a-9613ec06865b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:24.899914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:24.900420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:24.901006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:24.902765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:24.904062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:24.904596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:24.957249 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] HTTP exception thrown: Instance d93409d3-9aa5-4909-be9a-9613ec06865b could not be found. Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Request method failure captured: Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b HTTP/1.1 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMd4j02h185Yi4Ccb8iTBhyNkSALq3Wg-mkisISn_Kgv52No95_9l48jar4QaWfMsfth3mjTKD__lqkaO-z9m91LPjRmmoyV1TiXLvNUxyqv9agCDsMzA2WSiGzYy3khx_STB6T5I8fomQuoYZKZupK-FgfLomCIFLYHLaMmdwe2fyg Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 4b5717e2429846b7a3a905aff892b118 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesBackupsTest-1218458202 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b5717e2429846b7a3a905aff892b118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b5717e2429846b7a3a905aff892b118"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b5717e2429846b7a3a905aff892b118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b5717e2429846b7a3a905aff892b118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesBackupsTest-1218458202 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 4b5717e2429846b7a3a905aff892b118 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesBackupsTest-1218458202 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesBackupsTest-1218458202-project Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: dd6845ac26f045869ab395210d316526 Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesBackupsTest-1218458202-project Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d93409d3-9aa5-4909-be9a-9613ec06865b could not be found. Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd93409d3-9aa5-4909-be9a-9613ec06865b'} Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93409d3-9aa5-4909-be9a-9613ec06865b could not be found. Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93409d3-9aa5-4909-be9a-9613ec06865b could not be found. Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:24.958985 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93409d3-9aa5-4909-be9a-9613ec06865b could not be found. Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] Returning 404 to user: Instance d93409d3-9aa5-4909-be9a-9613ec06865b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:40:24.967005 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac9093ee-b120-4653-928a-2d288b76cc6c tempest-VolumesBackupsTest-1218458202 tempest-VolumesBackupsTest-1218458202-project] 10.222.0.16 "GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b" status: 404 len: 111 microversion: 2.1 time: 0.083253 Oct 26 05:40:24.979129 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3174/6364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:24 2022] GET /compute/v2.1/servers/d93409d3-9aa5-4909-be9a-9613ec06865b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:40:39.620609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1387707191", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:39.632676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=31 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:40:39.633751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:40:43.526429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:43.526947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:43.529643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:40:43.530957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=5 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:40:43.538629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:43.539200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:43.539892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:43.540680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:43.541371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:43.542180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:43.576713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:40:43.686372 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c3b76cf1-12d9-4859-892c-340c06f0ae81 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 204 len: 0 microversion: 2.1 time: 0.164093 Oct 26 05:40:43.689440 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3175/6365] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:40:43 2022] DELETE /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:40:43.699837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1be83f4b-d3b9-4936-b90a-35e08cbb4f97 req-21023c69-9093-4d7e-aeec-870b2b1e47bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:43.714996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1be83f4b-d3b9-4936-b90a-35e08cbb4f97 req-21023c69-9093-4d7e-aeec-870b2b1e47bd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:43.715939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1be83f4b-d3b9-4936-b90a-35e08cbb4f97 req-21023c69-9093-4d7e-aeec-870b2b1e47bd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:43.716687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1be83f4b-d3b9-4936-b90a-35e08cbb4f97 req-21023c69-9093-4d7e-aeec-870b2b1e47bd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:43.736595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1be83f4b-d3b9-4936-b90a-35e08cbb4f97 req-21023c69-9093-4d7e-aeec-870b2b1e47bd service nova] Creating event network-changed:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:40:43.744471 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1be83f4b-d3b9-4936-b90a-35e08cbb4f97 req-21023c69-9093-4d7e-aeec-870b2b1e47bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052305 Oct 26 05:40:43.746041 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3176/6366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:40:43.754026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:43.754846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:43.763159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:43.764805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:43.765773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:43.766729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:43.767292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:43.767885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:43.960251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:43.979193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-91c002a4-b7ff-4c7c-928d-78f614623b54 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1581 microversion: 2.1 time: 0.231285 Oct 26 05:40:43.981021 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3177/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:43 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1581 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:45.011546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:45.012176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:45.028331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:45.029116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:45.029763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:45.031530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:45.034971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:45.035701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:45.345454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:45.357868 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-023b7c77-c1f2-478b-8f90-e8b2ba31aa6f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1581 microversion: 2.1 time: 0.350112 Oct 26 05:40:45.360204 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3178/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:45 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1581 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:46.449596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d8c138d0-9f0a-4a9a-8f63-b9e8b8315c94 req-c981fcd0-4a33-4f9a-9a6b-8f3ee58a4a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b75ccf-f51b-4e00-b891-1ad8fbbea768", "name": "network-vif-deleted", "tag": "5104b827-e3b6-4c3a-8bb2-7f0f6e97e636"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:46.469122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d8c138d0-9f0a-4a9a-8f63-b9e8b8315c94 req-c981fcd0-4a33-4f9a-9a6b-8f3ee58a4a65 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:46.470837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d8c138d0-9f0a-4a9a-8f63-b9e8b8315c94 req-c981fcd0-4a33-4f9a-9a6b-8f3ee58a4a65 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:46.471464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d8c138d0-9f0a-4a9a-8f63-b9e8b8315c94 req-c981fcd0-4a33-4f9a-9a6b-8f3ee58a4a65 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:46.504473 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d8c138d0-9f0a-4a9a-8f63-b9e8b8315c94 req-c981fcd0-4a33-4f9a-9a6b-8f3ee58a4a65 service nova] Creating event network-vif-deleted:5104b827-e3b6-4c3a-8bb2-7f0f6e97e636 for instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 on n-h2-862416-4 Oct 26 05:40:46.519099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d8c138d0-9f0a-4a9a-8f63-b9e8b8315c94 req-c981fcd0-4a33-4f9a-9a6b-8f3ee58a4a65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337221 Oct 26 05:40:46.520055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3179/6369] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:40:46.528151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:46.530019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:46.543290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:46.547074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:46.549051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:46.550061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:46.553482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:46.554328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:46.677212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:46.692250 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01a67cd2-da14-424a-a3de-1bb5eca96732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1228 microversion: 2.1 time: 0.170663 Oct 26 05:40:46.703098 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3180/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:46 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1228 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:47.721832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:47.722493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:47.736420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:47.737248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:47.737750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:47.738606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:47.739149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:47.739592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:47.847907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:47.863005 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-250c6515-2c0e-4b96-8ceb-782b8ebc9589 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1228 microversion: 2.1 time: 0.147108 Oct 26 05:40:47.864145 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3181/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:47 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1228 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:48.781169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:40:48.892891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:48.895116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:48.907978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:48.908487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:48.909348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:48.910355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:48.911191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:48.912184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:49.033771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:49.053862 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-825c62b0-8a9d-4def-a463-5ee11ca200e3 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1228 microversion: 2.1 time: 0.163255 Oct 26 05:40:49.055315 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3182/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:48 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1228 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:49.151803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:40:49.152231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:40:49.152904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:40:49.153838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:40:49.154439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:40:49.175088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:49.176408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:49.179106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:49.180393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:49.180880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:49.181353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:49.203678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Getting quotas for project f72b79a80ac745d5ae1db417a1dee760. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:40:49.209555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Getting quotas for user f53ce4fc467a417a9ed6fd4885d54277 and project f72b79a80ac745d5ae1db417a1dee760. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:40:49.224066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:40:49.227923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:40:49.295547 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1636399-cef7-4562-8ad9-b50884d5227d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.680017 Oct 26 05:40:49.302302 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3191/6373] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 9682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:40:49.308575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1960f4d-9f2f-4cfc-9021-16e84101cae8 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:49.309204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1960f4d-9f2f-4cfc-9021-16e84101cae8 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:49.392498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c1960f4d-9f2f-4cfc-9021-16e84101cae8 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:49.402048 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1960f4d-9f2f-4cfc-9021-16e84101cae8 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1215 microversion: 2.1 time: 0.098088 Oct 26 05:40:49.418277 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3183/6374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:49 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:50.084047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:50.084697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:50.099365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:50.099885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:50.100353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:50.101127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:50.101637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:50.102077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:50.246739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:50.261668 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a74a10a6-f38c-4789-a142-fd6c3511b732 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1228 microversion: 2.1 time: 0.182617 Oct 26 05:40:50.282463 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3192/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:50 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:50.430936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:50.432456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:50.455909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:50.456475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:50.466233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:50.467483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:50.468065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:50.472357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:50.615241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:50.623308 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-687d9c6e-7f79-465f-b3fd-b5c6d216e312 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1267 microversion: 2.1 time: 0.196986 Oct 26 05:40:50.623991 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3184/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:50 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:51.284794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:51.285476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:51.305302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:51.306170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:51.306787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:51.307675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:51.308345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:51.308939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:51.467018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:51.476637 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4270755-c2af-441a-bf3c-ca3459529a9e tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1228 microversion: 2.1 time: 0.196407 Oct 26 05:40:51.497537 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3193/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:51 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1228 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:51.651038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:51.651814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:51.664782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:51.665705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:51.670784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:51.671900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:51.672613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:51.673305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:51.843887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:51.855972 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-19538bcc-8d31-4add-bcd5-0aeb11ef33eb tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1273 microversion: 2.1 time: 0.209832 Oct 26 05:40:51.857669 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3185/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:51 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:52.512240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:52.513120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:52.524145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:52.524884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:52.525535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:52.526439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:52.527048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:52.527618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:52.683864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:52.705919 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4170f79-e868-4b45-9b5f-b30a3937f63f tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1228 microversion: 2.1 time: 0.201528 Oct 26 05:40:52.731791 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3194/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:52 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1228 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:52.889185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:52.890928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:52.906630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:52.907330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:52.929262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:52.930273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:52.930923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:52.932221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:53.677076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:53.688568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6c3987f6-48f9-4777-8873-90629f44731b tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.806695 Oct 26 05:40:53.691920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3186/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:52 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:53.743429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:53.743429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:53.759060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:53.760441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:53.761180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:53.762216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:53.762733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:53.765761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:53.836388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:53.850190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:53.851015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:53.851748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lazy-loading 'fault' on Instance uuid d4b75ccf-f51b-4e00-b891-1ad8fbbea768 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:40:53.917877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbdd8580955425bad6cf7a9a33f4fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc607ea7b994659b8aa180528a846bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:53.926402 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7dd0c704-91a5-4c65-8078-035084147479 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 200 len: 1187 microversion: 2.1 time: 0.189311 Oct 26 05:40:53.929408 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3195/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:53 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:40:54.456771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6f4d6f17-fe58-41f8-928e-d4ac41c9befb req-6ea8cd92-6152-479f-97a7-e268f7681094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c897d57-1110-47c1-b883-8cad2670dfdc", "tag": "57d8552f-7d72-48d9-bcef-9fcea9965834"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:40:54.470674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f4d6f17-fe58-41f8-928e-d4ac41c9befb req-6ea8cd92-6152-479f-97a7-e268f7681094 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:54.471158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f4d6f17-fe58-41f8-928e-d4ac41c9befb req-6ea8cd92-6152-479f-97a7-e268f7681094 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:54.471772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f4d6f17-fe58-41f8-928e-d4ac41c9befb req-6ea8cd92-6152-479f-97a7-e268f7681094 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:54.485905 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6f4d6f17-fe58-41f8-928e-d4ac41c9befb req-6ea8cd92-6152-479f-97a7-e268f7681094 service nova] Creating event network-changed:57d8552f-7d72-48d9-bcef-9fcea9965834 for instance 7c897d57-1110-47c1-b883-8cad2670dfdc on n-h1-862416-4 Oct 26 05:40:54.491194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6f4d6f17-fe58-41f8-928e-d4ac41c9befb req-6ea8cd92-6152-479f-97a7-e268f7681094 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040284 Oct 26 05:40:54.491984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3187/6382] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:40:54.714063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:54.716077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:54.727331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:54.728311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:54.728988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:54.730986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:54.735431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:54.739428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:54.958213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:54.959274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] [instance: d4b75ccf-f51b-4e00-b891-1ad8fbbea768] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:54.970579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:54.973941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:54.975946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:54.977939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:54.980029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:54.980763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:55.004486 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] HTTP exception thrown: Instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 could not be found. Oct 26 05:40:55.007713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:55.016194 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37bfb2fa-b9ad-4712-8731-215ca2fa3ace tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.307096 Oct 26 05:40:55.016798 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3196/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:54 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Request method failure captured: Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 HTTP/1.1 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMa90S8yj0gyR38MFoUywwBpu0lrTsCbuuU-HvYHF-V2DKb_eeqcwrdi7l1IXsyz4rwcssgufSq8EYc-9Jp2Wjt7yFGiOU4h9nUZKCNcQYTJY41nfm1HFdVL_GOmVflv9UM5dsr0TcerTNZ9Fen7S-jSMhAUIhb10VWQwlKy14BiIps Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 9fc607ea7b994659b8aa180528a846bd Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBackupRestore-1176024911 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fc607ea7b994659b8aa180528a846bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fc607ea7b994659b8aa180528a846bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fc607ea7b994659b8aa180528a846bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fc607ea7b994659b8aa180528a846bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBackupRestore-1176024911 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 9fc607ea7b994659b8aa180528a846bd Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1176024911 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBackupRestore-1176024911-project Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 4dbdd8580955425bad6cf7a9a33f4fe0 Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBackupRestore-1176024911-project Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 could not be found. Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd4b75ccf-f51b-4e00-b891-1ad8fbbea768'} Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 could not be found. Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 could not be found. Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:40:55.017824 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 could not be found. Oct 26 05:40:55.022970 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:40:55.024017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Returning 404 to user: Instance d4b75ccf-f51b-4e00-b891-1ad8fbbea768 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:40:55.024477 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0804b7a-2df3-4728-a304-d60b25316936 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768" status: 404 len: 111 microversion: 2.1 time: 0.072628 Oct 26 05:40:55.029606 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3188/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:54 2022] GET /compute/v2.1/servers/d4b75ccf-f51b-4e00-b891-1ad8fbbea768 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:40:55.348451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-644248d3-2a95-4653-bae1-0f7ad8d2b863 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] Calling method '.version_select at 0x7f470eba2790>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:55.407068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-644248d3-2a95-4653-bae1-0f7ad8d2b863 tempest-TestVolumeBackupRestore-1176024911 tempest-TestVolumeBackupRestore-1176024911-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-532755590" status: 202 len: 0 microversion: 2.1 time: 0.067104 Oct 26 05:40:55.411731 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3197/6385] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 26 05:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-532755590 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:40:56.043456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:56.044246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:56.060268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:56.061003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:56.062640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:56.064458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:56.065097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:56.065746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:56.314418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:56.324204 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-836b03ac-f1a5-4934-b4e6-739370798e11 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.286217 Oct 26 05:40:56.325859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3189/6386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:56 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:57.350846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:57.351588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:57.373227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:57.378279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:57.379200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:57.380996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:57.386784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:57.387614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:57.829019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:57.843811 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f00803b-1452-4d7e-9886-c285365334b7 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.497099 Oct 26 05:40:57.861953 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3198/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:57 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:40:58.902208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:40:58.902842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:40:58.916093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:58.916587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:58.917030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:58.940081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:40:58.940703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:40:58.945163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:40:59.246518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:40:59.275063 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-37d9125f-1bfb-477c-8d3d-a5403fd84603 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.399835 Oct 26 05:40:59.281306 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3190/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:40:58 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:00.325255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:00.327637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:00.340215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:00.342144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:00.382088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:00.382616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:00.386957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:00.391753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:00.392246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:00.392692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:00.495332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-2ab725d5-7c99-4912-99d7-92a68057f1c1 req-621e1710-f006-4c9b-b568-a0e02b2c75a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c897d57-1110-47c1-b883-8cad2670dfdc", "name": "network-vif-plugged", "status": "completed", "tag": "57d8552f-7d72-48d9-bcef-9fcea9965834"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:00.501001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:00.531002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2ab725d5-7c99-4912-99d7-92a68057f1c1 req-621e1710-f006-4c9b-b568-a0e02b2c75a9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:00.531519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2ab725d5-7c99-4912-99d7-92a68057f1c1 req-621e1710-f006-4c9b-b568-a0e02b2c75a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:00.531966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2ab725d5-7c99-4912-99d7-92a68057f1c1 req-621e1710-f006-4c9b-b568-a0e02b2c75a9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:00.567581 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-2ab725d5-7c99-4912-99d7-92a68057f1c1 req-621e1710-f006-4c9b-b568-a0e02b2c75a9 service nova] Creating event network-vif-plugged:57d8552f-7d72-48d9-bcef-9fcea9965834 for instance 7c897d57-1110-47c1-b883-8cad2670dfdc on n-h1-862416-4 Oct 26 05:41:00.583001 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-2ab725d5-7c99-4912-99d7-92a68057f1c1 req-621e1710-f006-4c9b-b568-a0e02b2c75a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091305 Oct 26 05:41:00.583734 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3191/6389] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:41:00.879248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:00.889823 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ebc97ed-5355-470f-9e67-fbe5aa357e8c tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.586834 Oct 26 05:41:00.890878 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3199/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:00 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:01.917099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:01.918751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:01.937166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1909590290", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b320bbbc-a3da-4c67-94c6-03ca4176a9d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:01.950008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:01.954217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:01.954931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:01.958289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:01.960675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:01.961419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:02.116487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:41:02.736165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:02.747370 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e752c6e-ae0a-4b22-81c6-47c1debfd919 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1315 microversion: 2.1 time: 0.837051 Oct 26 05:41:02.750071 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3192/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:01 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:03.233432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:41:03.237994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:41:03.238781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:41:03.242915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:41:03.243753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:41:03.279446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:03.284123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:03.285201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:03.289960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:03.292077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:03.293079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:03.373496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:41:03.395553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:41:03.606591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:41:03.609096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b320bbbc-a3da-4c67-94c6-03ca4176a9d2',volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:41:03.777434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:03.778649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:03.791748 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:41:03.801627 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 05:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc (ip 10.222.0.16) !!! Oct 26 05:41:03.862939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:03.863512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:03.863975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:03.864728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:03.865199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:03.878717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:04.044103 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b904915-f6a3-4027-91c6-113f01c63802 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106089 Oct 26 05:41:04.054493 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3200/6392] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:41:04.076409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b87cb37b-f88d-4a19-b335-97546886873e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:04.077600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b87cb37b-f88d-4a19-b335-97546886873e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:04.291391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b87cb37b-f88d-4a19-b335-97546886873e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:04.305364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b87cb37b-f88d-4a19-b335-97546886873e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1071 microversion: 2.1 time: 0.249595 Oct 26 05:41:04.310004 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3201/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:04 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1071 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:04.429694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:04.445238 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d9e0693-0b78-4cb6-8e2b-7952c964abb4 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1464 microversion: 2.1 time: 0.670442 Oct 26 05:41:04.448847 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3193/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:03 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1464 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:04.533109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:04.533800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:04.544935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:04.545958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:04.546646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:04.547710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:04.548404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:04.549085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:04.616878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:41:04.883485 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ac11b2a-7153-4972-99c2-4458e7ea66fd tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 204 len: 0 microversion: 2.1 time: 0.355148 Oct 26 05:41:04.884356 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3202/6395] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:41:04 2022] DELETE /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:41:04.897063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:04.899260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:04.917011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:04.917699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:04.918296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:04.922149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:04.922816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:04.923556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:04.998282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:05.266589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:05.277839 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-283ca7fe-8580-451a-9a38-01b374eeb354 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1470 microversion: 2.1 time: 0.388569 Oct 26 05:41:05.279950 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3194/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:04 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:05.338382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:05.339126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:05.354962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:05.355491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:05.355929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:05.356664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:05.357130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:05.359236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:05.500523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:05.523902 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea43660d-4b1a-4d1e-a6a5-1cd9894a9a6b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1121 microversion: 2.1 time: 0.190780 Oct 26 05:41:05.524493 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3203/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:05 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1121 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:06.303982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:06.304565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:06.323108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:06.327139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:06.328016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:06.328509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:06.330209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:06.332776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:06.550690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:06.552101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:06.579799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:06.589078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:06.592790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:06.595235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:06.598878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:06.602883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:06.882823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:06.892855 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-248b235c-5486-42c1-ad4a-f0160e3f0969 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1187 microversion: 2.1 time: 0.347941 Oct 26 05:41:06.914149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3204/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:06 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1187 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:06.918892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:06.930892 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-005eda48-ce61-4c3a-b41a-4e365856b60d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1470 microversion: 2.1 time: 0.630735 Oct 26 05:41:06.945650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3195/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:06 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1470 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:07.918778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:07.920268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:07.945522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:07.946319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:07.947048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:07.947840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:07.948511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:07.949021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:08.014998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:08.016092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:08.030306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:08.031096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:08.032034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:08.034339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:08.035009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:08.035646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:08.177862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:08.196149 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b8a2391-0d1a-44e0-a929-02538fb38c5b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1187 microversion: 2.1 time: 0.280337 Oct 26 05:41:08.198107 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3205/6400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:07 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1187 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:08.295864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:08.312760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb738c29-af48-427d-bd2e-3f0682ed76a5 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1428 microversion: 2.1 time: 0.331832 Oct 26 05:41:08.327633 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3196/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:07 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1428 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:08.470763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2201f7f8-376d-4d22-994f-eac633a3a716 req-47048dbc-d68e-4bdb-8630-76c307929c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c897d57-1110-47c1-b883-8cad2670dfdc", "name": "network-vif-deleted", "tag": "57d8552f-7d72-48d9-bcef-9fcea9965834"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:08.484709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2201f7f8-376d-4d22-994f-eac633a3a716 req-47048dbc-d68e-4bdb-8630-76c307929c82 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:08.485591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2201f7f8-376d-4d22-994f-eac633a3a716 req-47048dbc-d68e-4bdb-8630-76c307929c82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:08.486264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2201f7f8-376d-4d22-994f-eac633a3a716 req-47048dbc-d68e-4bdb-8630-76c307929c82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:08.528744 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2201f7f8-376d-4d22-994f-eac633a3a716 req-47048dbc-d68e-4bdb-8630-76c307929c82 service nova] Creating event network-vif-deleted:57d8552f-7d72-48d9-bcef-9fcea9965834 for instance 7c897d57-1110-47c1-b883-8cad2670dfdc on n-h1-862416-4 Oct 26 05:41:08.546149 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2201f7f8-376d-4d22-994f-eac633a3a716 req-47048dbc-d68e-4bdb-8630-76c307929c82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084656 Oct 26 05:41:08.562628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3206/6402] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:41:09.234247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:09.234890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:09.256730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:09.256954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:09.257834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:09.258723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:09.259539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:09.260135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:09.345208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:09.346085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:09.397760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:09.403564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:09.404590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:09.406935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:09.409740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:09.413452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:09.546802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:09.550902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:09.551529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:09.554549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lazy-loading 'fault' on Instance uuid 7c897d57-1110-47c1-b883-8cad2670dfdc {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:41:09.818411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53ce4fc467a417a9ed6fd4885d54277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b79a80ac745d5ae1db417a1dee760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:09.828061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:09.852218 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1ef7b67-f4a4-47d4-9577-9c5028e65a2d tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 200 len: 1305 microversion: 2.1 time: 0.498422 Oct 26 05:41:09.854645 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3207/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:09 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 1305 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:09.948434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:09.961194 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eac6540f-b4e6-4a96-a3f9-a355bb08f426 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.731647 Oct 26 05:41:09.964596 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3197/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:09 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:10.882332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:10.882944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] [instance: 7c897d57-1110-47c1-b883-8cad2670dfdc] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:10.886223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:10.905611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:10.906153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:10.907786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:10.908628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:10.909688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:10.915536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:10.977160 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] HTTP exception thrown: Instance 7c897d57-1110-47c1-b883-8cad2670dfdc could not be found. Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Request method failure captured: Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc HTTP/1.1 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMhTzUiY9oxhWvRR2lLPGBA8ylwy0Fn__glyWkV5UA6JOB_CqHynsRW6_ZvLbX_y4Mzwb-izwxEPtAQww7KYtSH7WG7ksTJclHXSpVFMi8ZuCysqv1bRsvjnraSfrjyFMKstfVQz_-EkmR99gsoVER6eI_P3jmyXvfs--inotnHXU5Q Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f72b79a80ac745d5ae1db417a1dee760 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesNegativeTest-364858532 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f72b79a80ac745d5ae1db417a1dee760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72b79a80ac745d5ae1db417a1dee760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72b79a80ac745d5ae1db417a1dee760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f72b79a80ac745d5ae1db417a1dee760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesNegativeTest-364858532 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f72b79a80ac745d5ae1db417a1dee760 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesNegativeTest-364858532 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesNegativeTest-364858532-project Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f53ce4fc467a417a9ed6fd4885d54277 Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesNegativeTest-364858532-project Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7c897d57-1110-47c1-b883-8cad2670dfdc could not be found. Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7c897d57-1110-47c1-b883-8cad2670dfdc'} Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c897d57-1110-47c1-b883-8cad2670dfdc could not be found. Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c897d57-1110-47c1-b883-8cad2670dfdc could not be found. Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:41:10.983579 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c897d57-1110-47c1-b883-8cad2670dfdc could not be found. Oct 26 05:41:10.988743 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:41:10.990982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:10.992402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:10.994836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] Returning 404 to user: Instance 7c897d57-1110-47c1-b883-8cad2670dfdc could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:41:10.995756 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c23fe63c-28e5-4c25-ab0e-67222c307b40 tempest-VolumesNegativeTest-364858532 tempest-VolumesNegativeTest-364858532-project] 10.222.0.16 "GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc" status: 404 len: 111 microversion: 2.1 time: 0.119580 Oct 26 05:41:11.002610 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3208/6405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:10 2022] GET /compute/v2.1/servers/7c897d57-1110-47c1-b883-8cad2670dfdc => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:41:11.035685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:11.037882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:11.040160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:11.041108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:11.044518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:11.048296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:11.167433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-456f67a9-872d-4f81-a8b2-882ec6b18c8e req-0ea2ce35-2882-4368-9891-449bef23ba1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cbe89f5-ff51-4763-b2aa-cde85091ebbb", "tag": "16de25d8-f46d-4b76-9b6b-1cdcc9b650dd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:11.201243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-456f67a9-872d-4f81-a8b2-882ec6b18c8e req-0ea2ce35-2882-4368-9891-449bef23ba1d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:11.202633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-456f67a9-872d-4f81-a8b2-882ec6b18c8e req-0ea2ce35-2882-4368-9891-449bef23ba1d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:11.203477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-456f67a9-872d-4f81-a8b2-882ec6b18c8e req-0ea2ce35-2882-4368-9891-449bef23ba1d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:11.252764 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-456f67a9-872d-4f81-a8b2-882ec6b18c8e req-0ea2ce35-2882-4368-9891-449bef23ba1d service nova] Creating event network-changed:16de25d8-f46d-4b76-9b6b-1cdcc9b650dd for instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb on n-h2-862416-4 Oct 26 05:41:11.289002 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-456f67a9-872d-4f81-a8b2-882ec6b18c8e req-0ea2ce35-2882-4368-9891-449bef23ba1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128305 Oct 26 05:41:11.293740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3209/6406] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:41:12.204231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:12.215206 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fce1c7c6-138f-4d1d-a3ab-2cbca6dbaa5a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 1.232334 Oct 26 05:41:12.220207 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3198/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:10 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:13.244853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:13.245700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:13.255711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:13.256656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:13.257694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:13.258622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:13.259306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:13.259966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:13.338848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:13.579488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:13.590221 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c1668db-ea18-436c-8134-1e540223adda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.350639 Oct 26 05:41:13.590800 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3210/6408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:13 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:41:14.614217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:14.614708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:14.623173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:14.627206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:14.631787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:14.632988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:14.633944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:14.636930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:14.638001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:14.884651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:14.894939 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a0f3677-595f-44bc-9f79-4ba223c48924 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.284541 Oct 26 05:41:14.895542 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3199/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:14 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:15.921381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:15.922025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:15.924770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:15.941168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:15.941604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:15.942119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:15.942859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:15.943187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:15.943619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:16.396674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:16.428378 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f623d78b-724f-435e-a53d-fe4b22788515 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.512785 Oct 26 05:41:16.460740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3211/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:15 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:17.491495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:17.492113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:17.506288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:17.506799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:17.507250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:17.508401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:17.510188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:17.514482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:17.673913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:17.684068 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3b15b3f1-08ad-40e9-b20a-b3d82c6717cf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.196375 Oct 26 05:41:17.684667 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3200/6411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:17 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:18.710743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:18.711356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:18.719908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:18.720420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:18.720870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:18.721637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:18.722107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:18.722542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:19.159438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:19.199800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-923149e5-6416-4b79-8498-f3ec99559e02 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.493019 Oct 26 05:41:19.200507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3212/6412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:18 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:20.228147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:20.228756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:20.247106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:20.252209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:20.252906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:20.253851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:20.256810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:20.257482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:20.715211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:20.726776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6f4e4b5-f693-47dd-a49c-de636e6ba3fb tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.501218 Oct 26 05:41:20.727390 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3201/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:20 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:21.753620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:21.754233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:21.763654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:21.765299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:21.765766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:21.766482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:21.766952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:21.767372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:22.292556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:22.302713 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79e9d999-129b-4654-a6c0-8b659e094eb6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1229 microversion: 2.1 time: 0.552038 Oct 26 05:41:22.309884 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3213/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:21 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1229 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:23.332120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:23.332906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:23.340148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:23.340635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:23.341073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:23.342375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:23.342839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:23.343286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:23.679224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:23.687717 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e78e238d-1e74-446c-bf5c-d384ee35d92c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.362588 Oct 26 05:41:23.688303 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3202/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:23 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:24.710921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:24.711776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:24.723041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:24.723671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:24.724240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:24.725056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:24.725703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:24.726432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:24.898421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:24.908148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-55620f91-a93e-4121-9fea-369f7cc8f949 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.201717 Oct 26 05:41:24.908914 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3214/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:24 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:25.935199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:25.936475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:25.943676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:25.944245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:25.944780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:25.945580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:25.946119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:25.946639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:26.092355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:26.101879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78628e7b-f4e0-4d97-b91e-cb14ab87d5ea tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.169935 Oct 26 05:41:26.102736 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3203/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:25 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:27.125909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:27.126533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:27.133112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:27.133674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:27.134132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:27.134854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:27.135315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:27.135752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:27.289200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:27.301511 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4eae5fce-ee80-4bc9-a2cb-0897c9b26f29 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.179889 Oct 26 05:41:27.302695 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3215/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:27 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:28.324720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:28.326562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:28.333643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:28.334317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:28.334956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:28.335830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:28.336461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:28.337061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:28.486123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:28.497269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c754ff3e-bd05-477f-8c2c-b8c54550bfca tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.176306 Oct 26 05:41:28.498958 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3204/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:28 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:29.522043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:29.523410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:29.533170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:29.534204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:29.534881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:29.536000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:29.536693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:29.537418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:29.705730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:29.715990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b2ef3d3d-bc3a-4237-9d62-a416c6997825 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.198241 Oct 26 05:41:29.717162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3216/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:29 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:30.742306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:30.742953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:30.751812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:30.752307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:30.752748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:30.753478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:30.754007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:30.754437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:30.896216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:30.905427 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f0fba20-ce94-4006-a646-94f6f65d9e25 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.166978 Oct 26 05:41:30.906296 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3205/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:30 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:31.936717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:31.938223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:31.946558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:31.950043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:31.953488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:31.954452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:31.955491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:31.956278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:32.106127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:32.119185 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-413aebb5-c339-439e-93c6-35b7071a09ef tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.188221 Oct 26 05:41:32.120578 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3217/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:31 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:33.143162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:33.143811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:33.152347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:33.153122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:33.154388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:33.155489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:33.155984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:33.156924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:33.324668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:33.333848 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4385f2d7-4611-4bbb-b66d-5db1364885da tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.195316 Oct 26 05:41:33.337154 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3206/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:33 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:34.360135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:34.361558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:34.376888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:34.377763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:34.378499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:34.379538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:34.380320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:34.381059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:34.545869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:34.556073 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da825581-2c78-4ead-bcb7-4dfdf388e382 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.200348 Oct 26 05:41:34.556937 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3218/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:34 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:35.504120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-27d9f7d1-213e-4e18-b75a-74c3d5626625 req-fba30e49-d5e7-44c3-b751-96fb097a0bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cbe89f5-ff51-4763-b2aa-cde85091ebbb", "name": "network-vif-plugged", "status": "completed", "tag": "16de25d8-f46d-4b76-9b6b-1cdcc9b650dd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:35.514337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27d9f7d1-213e-4e18-b75a-74c3d5626625 req-fba30e49-d5e7-44c3-b751-96fb097a0bba service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:35.515070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27d9f7d1-213e-4e18-b75a-74c3d5626625 req-fba30e49-d5e7-44c3-b751-96fb097a0bba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:35.515681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-27d9f7d1-213e-4e18-b75a-74c3d5626625 req-fba30e49-d5e7-44c3-b751-96fb097a0bba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:35.518776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=77 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:35.531989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-27d9f7d1-213e-4e18-b75a-74c3d5626625 req-fba30e49-d5e7-44c3-b751-96fb097a0bba service nova] Creating event network-vif-plugged:16de25d8-f46d-4b76-9b6b-1cdcc9b650dd for instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb on n-h2-862416-4 Oct 26 05:41:35.537164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-27d9f7d1-213e-4e18-b75a-74c3d5626625 req-fba30e49-d5e7-44c3-b751-96fb097a0bba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036634 Oct 26 05:41:35.537822 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3207/6425] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:41:35.593926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:35.595880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:35.609828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:35.610596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:35.611262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:35.612318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:35.612884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:35.613551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:35.915300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:35.925065 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b8a6703d-036c-430a-9d72-ce5f3c3d3117 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.347882 Oct 26 05:41:35.925978 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3219/6426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:35 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:36.949871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:36.951369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:36.958159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:36.959037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:36.959897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:36.960828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:36.961527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:36.962166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:37.174530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:37.193918 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b0f34950-b925-406a-afc1-487e75d5ee3b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1217 microversion: 2.1 time: 0.249220 Oct 26 05:41:37.197996 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3208/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:36 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1217 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:38.223002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:38.223789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:38.231594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:38.232635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:38.233385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:38.234348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:38.235268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:38.236130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:38.417276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:38.425470 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-486b217c-017d-4d25-8734-eff5c5a03c0a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1405 microversion: 2.1 time: 0.207454 Oct 26 05:41:38.426222 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3220/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:38 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:38.448924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:38.450456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:38.464226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:38.465201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:38.465685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:38.473604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:38.473604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:38.473604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:38.648881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:38.659365 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2031e26b-3aa1-4278-96df-c1d6cbcaf088 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1405 microversion: 2.1 time: 0.214723 Oct 26 05:41:38.660548 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3209/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:38 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:38.682463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1726592702"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:38.685138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:38.693591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:38.694321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:38.696158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:38.697437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:38.698103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:38.698730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:38.822035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.compute.api [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Attempting to quiesce instance before volume snapshot. Oct 26 05:41:38.908827 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.compute.api [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 26 05:41:39.010234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Creating snapshot from volume b320bbbc-a3da-4c67-94c6-03ca4176a9d2. {{(pid=120585) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 26 05:41:40.224776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7647c4dc-85ec-481b-abe8-73dcad5bfb0f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb/action" status: 202 len: 0 microversion: 2.1 time: 1.546457 Oct 26 05:41:40.226150 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3221/6430] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:41:38 2022] POST /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb/action => generated 0 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 05:41:42.582370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-207598520", "imageRef": "1fd4a5f1-bc91-4dbc-9de5-ba3046d3cde7", "flavorRef": "452", "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:42.654954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:41:43.120121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:41:43.120558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:41:43.121043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:41:43.121490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:41:43.121913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:41:43.133462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:43.133963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:43.134412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:43.135343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:43.135818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:43.136263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:43.161128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:41:43.167100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:41:43.194463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:41:43.197804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='75200742-de1d-41f0-95fb-1709527293ff',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:41:43.292356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84161e79-2c01-4e26-b023-6faa134b97e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716678 Oct 26 05:41:43.293025 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3210/6431] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:41:43.306323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27accaa0-35fb-427b-bb12-c6ed2c036362 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:43.306323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27accaa0-35fb-427b-bb12-c6ed2c036362 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:43.309051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=28 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:43.428371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27accaa0-35fb-427b-bb12-c6ed2c036362 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:43.437346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27accaa0-35fb-427b-bb12-c6ed2c036362 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1229 microversion: 2.1 time: 0.136329 Oct 26 05:41:43.441385 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3222/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:43 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:44.471932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:44.472617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:44.489716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:44.491186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:44.491827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:44.493169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:44.493839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:44.494470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:44.747493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:44.766221 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-492950ec-197e-46ad-884e-4b669356def9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1281 microversion: 2.1 time: 0.302458 Oct 26 05:41:44.766857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3211/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:44 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:45.794722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:45.795855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:45.807041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:45.812054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:45.812739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:45.813623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:45.814541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:45.816733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:45.874613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:45.973189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:45.982664 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17087039-06b3-4496-9bdd-2d8d4ffe2add tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1299 microversion: 2.1 time: 0.194288 Oct 26 05:41:45.983188 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3223/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:45 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:47.016829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:47.022138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:47.031032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:47.071335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:47.071972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:47.072434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:47.073185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:47.073721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:47.074154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:47.320258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:47.329716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f7cecc5-5908-4d49-a1d3-aa070716c680 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.320830 Oct 26 05:41:47.334421 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3212/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:47 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:47.484924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-bd2c136e-72bf-4bd2-abd0-8ae740be033f req-0b80aaaf-cee4-4e27-9187-6b9050a308b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c942949-5258-4859-877c-77b3ee86c21b", "tag": "87198d94-0494-4281-bca3-b19a0d52cf11"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:41:47.505783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd2c136e-72bf-4bd2-abd0-8ae740be033f req-0b80aaaf-cee4-4e27-9187-6b9050a308b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:47.506516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd2c136e-72bf-4bd2-abd0-8ae740be033f req-0b80aaaf-cee4-4e27-9187-6b9050a308b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:47.507133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd2c136e-72bf-4bd2-abd0-8ae740be033f req-0b80aaaf-cee4-4e27-9187-6b9050a308b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:47.527577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-bd2c136e-72bf-4bd2-abd0-8ae740be033f req-0b80aaaf-cee4-4e27-9187-6b9050a308b6 service nova] Creating event network-changed:87198d94-0494-4281-bca3-b19a0d52cf11 for instance 0c942949-5258-4859-877c-77b3ee86c21b on n-h1-862416-4 Oct 26 05:41:47.547692 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-bd2c136e-72bf-4bd2-abd0-8ae740be033f req-0b80aaaf-cee4-4e27-9187-6b9050a308b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066310 Oct 26 05:41:47.548802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3224/6436] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:41:48.364006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:48.365759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:48.381908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:48.383247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:48.384705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:48.385541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:48.389423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:48.389972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:48.712044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:48.721707 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18b02fe8-760c-4e18-b7cf-c724ba8c0aa5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.364653 Oct 26 05:41:48.722308 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3213/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:48 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:49.752207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:49.752936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:49.765247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:49.766201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:49.766707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:49.767466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:49.767949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:49.769069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:49.977287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:49.986886 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be374722-1e3c-4bdd-a6b6-c19db1322c3a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.240152 Oct 26 05:41:50.002245 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3225/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:49 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:51.013846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:51.015238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:51.023165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:51.023951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:51.024630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:51.025584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:51.026254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:51.026694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:51.285696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:51.295379 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e5d6b4cb-8f7f-41d0-b4bb-5805acb7eb7b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.286923 Oct 26 05:41:51.299675 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3214/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:51 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:52.364308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:52.365082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:52.382861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:52.393760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:52.394805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:52.395781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:52.396401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:52.396976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:52.647035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:52.657259 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0291fb4b-f1f0-42c6-bd06-46ccc08634a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.297541 Oct 26 05:41:52.658336 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3226/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:52 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:53.686477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:53.688158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:53.691424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:53.692765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:53.707467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:53.708945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:53.709420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:53.710324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:53.710950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:53.711643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:54.009701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:54.025395 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77b5f372-a45c-4574-8c9a-9388aa61463c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.344126 Oct 26 05:41:54.027563 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3215/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:53 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:55.076885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:55.078753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:55.087392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:41:55.097135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:55.099693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:55.103825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:55.107017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:55.109294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:55.109820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:55.402304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:55.430150 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-834a7980-13c2-42c2-89a3-62c1e78007d5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.358208 Oct 26 05:41:55.439652 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3227/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:55 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:56.471431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:56.472213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:56.483316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:56.487471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:56.492263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:56.493185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:56.493980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:56.499144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:56.751608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:56.760313 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de64a96b-17a4-4a19-8786-454f446f0313 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.294034 Oct 26 05:41:56.761539 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3216/6443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:56 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:57.796379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:57.798158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:57.805984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:57.807036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:57.807907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:57.808968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:57.810363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:57.811050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:58.011165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:58.027917 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c051c32d-d3c8-413a-bcf7-95950250c93a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.237840 Oct 26 05:41:58.028776 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3228/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:57 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:41:59.052008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:41:59.052874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:41:59.068706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:59.068962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:59.069459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:59.070175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:41:59.070636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:41:59.071062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:41:59.623004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:41:59.634674 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e494cae9-ac12-468f-9a9b-a12863b20106 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.586137 Oct 26 05:41:59.654567 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3217/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:41:59 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:00.662754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:00.663384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:00.676747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:00.677847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:00.680295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:00.681234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:00.682581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:00.684676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:01.010332 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:01.020944 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91745846-4ab7-4335-8d14-e00e42efac28 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.362421 Oct 26 05:42:01.021571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3229/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:00 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:02.052470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:02.053836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:02.070511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:02.071454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:02.071893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:02.072886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:02.073761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:02.074630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:02.298196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:02.308397 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69201ad9-f8e1-4adc-912e-387875f785bf tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.261356 Oct 26 05:42:02.310807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3218/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:02 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:03.342761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:03.342761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:03.345599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:03.346206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:03.346667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:03.347604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:03.348224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:03.348863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:03.541217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:03.550707 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0466b4f-aae1-4852-945c-a14f9ad715d8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.218335 Oct 26 05:42:03.551787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3230/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:03 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:04.582007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:04.583154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:04.589443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:04.589952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:04.591316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:04.592252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:04.593114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:04.593797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:04.807688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:04.819339 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6a227b34-6f6d-4d43-9b3f-09d3412c43b5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1341 microversion: 2.1 time: 0.244020 Oct 26 05:42:04.820313 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3219/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:04 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:05.855443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:05.858159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:05.880749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:05.881275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:05.884445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:05.885438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:05.886000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:05.886521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:06.055322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:06.065686 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4fccf7c-87db-4c54-9bf2-571894526eff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.216301 Oct 26 05:42:06.066280 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3231/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:05 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:07.092882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:07.094523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:07.101930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:07.102712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:07.103359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:07.104518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:07.105190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:07.106320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:07.111693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=70 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:07.279404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:07.289708 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d43b8a44-4613-47f9-88ca-fb13cf7738f6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.203127 Oct 26 05:42:07.290671 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3220/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:07 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:08.320448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:08.321775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:08.331708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:08.332462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:08.333088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:08.334046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:08.334687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:08.335298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:08.502576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:08.510795 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-754b9aa7-029f-47e4-b816-88f3664a19e6 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.196311 Oct 26 05:42:08.511381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3232/6452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:08 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:09.535403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:09.536293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:09.543149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:09.544021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:09.544877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:09.546133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:09.547068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:09.547670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:09.818131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:09.829214 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c90d9012-73dd-4dd1-bc8b-744050fea9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.297951 Oct 26 05:42:09.829844 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3221/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:09 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:10.854327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:10.854964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:10.864386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:10.867083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:10.867583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:10.868533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:10.869193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:10.869856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:11.084799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:11.095416 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16316e35-26b7-49f7-8db1-de70a2b8765d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.244812 Oct 26 05:42:11.097486 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3233/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:10 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:12.127098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:12.127764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:12.138801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:12.139760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:12.140430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:12.141898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:12.142749 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:12.143593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:12.345791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:12.356374 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6cb9892-8416-4176-9623-bb29792978e5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.235920 Oct 26 05:42:12.358068 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3222/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:12 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:13.381720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:13.382598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:13.391588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=26 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:13.395894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:13.396570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:13.397118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:13.398166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:13.398657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:13.399114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:13.660111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:13.678370 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-75054045-8008-4186-b0e7-1c6daa5c0f64 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.301730 Oct 26 05:42:13.678969 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3234/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:13 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:14.690151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a4d48484-58d1-41f0-b104-cc3762f56476 req-4b2faae8-6990-4423-a470-c60220595d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c942949-5258-4859-877c-77b3ee86c21b", "name": "network-vif-plugged", "status": "completed", "tag": "87198d94-0494-4281-bca3-b19a0d52cf11"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:14.703497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:14.704245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:14.722536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:14.722869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a4d48484-58d1-41f0-b104-cc3762f56476 req-4b2faae8-6990-4423-a470-c60220595d9f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:14.723624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a4d48484-58d1-41f0-b104-cc3762f56476 req-4b2faae8-6990-4423-a470-c60220595d9f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:14.724629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a4d48484-58d1-41f0-b104-cc3762f56476 req-4b2faae8-6990-4423-a470-c60220595d9f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:14.734125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:14.735208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:14.739706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:14.739706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:14.739706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:14.746745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a4d48484-58d1-41f0-b104-cc3762f56476 req-4b2faae8-6990-4423-a470-c60220595d9f service nova] Creating event network-vif-plugged:87198d94-0494-4281-bca3-b19a0d52cf11 for instance 0c942949-5258-4859-877c-77b3ee86c21b on n-h1-862416-4 Oct 26 05:42:14.753709 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a4d48484-58d1-41f0-b104-cc3762f56476 req-4b2faae8-6990-4423-a470-c60220595d9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069456 Oct 26 05:42:14.755184 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3223/6457] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:42:15.051253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:15.064910 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-467206be-bca8-4fe0-b692-7bc5989703c0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.367598 Oct 26 05:42:15.078480 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3235/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:14 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:16.092364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:16.095289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:16.103692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:16.104204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:16.104657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:16.106302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:16.107462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:16.107932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:16.285700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:16.301235 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fba054e3-8444-44de-a5d2-6c39e3372c2a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1375 microversion: 2.1 time: 0.215062 Oct 26 05:42:16.318845 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3224/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:16 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1375 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:17.052908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-846994617", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "3b495149-3ec5-4e86-898c-edde888aff5f"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:17.115329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] validate_networks() for [('3b495149-3ec5-4e86-898c-edde888aff5f', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:42:17.329636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:17.330920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:17.338402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=26 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:17.340516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:17.341213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:17.347194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:17.352670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:17.353490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:17.354149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:17.607618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:17.623598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8edc532a-4f10-411e-80f3-640e439f0066 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1562 microversion: 2.1 time: 0.298464 Oct 26 05:42:17.624895 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3225/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:17 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1562 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:17.651365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:17.652410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:17.657820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:42:17.658617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:42:17.659312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:42:17.659926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:42:17.660157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:17.660627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:42:17.661156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:17.661854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:17.662830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:17.663651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:17.664311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:17.673559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:17.674407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:17.674882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:17.675686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:17.676172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:17.676720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:17.689904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=74 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:17.703173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Getting quotas for project 46a192618b4b4613a84a4fdbce34be77. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:42:17.725669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Getting quotas for user a5846c0d279e469dac3accc725e2ed0d and project 46a192618b4b4613a84a4fdbce34be77. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:42:17.747689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:42:17.750105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:42:17.812276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb1caf06-14e9-416f-91a3-267f30e557e4 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763233 Oct 26 05:42:17.813533 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3236/6461] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:42:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:42:17.845786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f0129e72-a38f-47ca-b286-b84453607dd0 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:17.854042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f0129e72-a38f-47ca-b286-b84453607dd0 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:17.980531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f0129e72-a38f-47ca-b286-b84453607dd0 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:17.985517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:17.989607 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f0129e72-a38f-47ca-b286-b84453607dd0 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1218 microversion: 2.1 time: 0.162147 Oct 26 05:42:17.991183 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3237/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:17 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:18.013444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7010194b-a86b-41f3-b03d-3ecc9c089dde tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1562 microversion: 2.1 time: 0.363985 Oct 26 05:42:18.021468 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3226/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:17 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1562 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:18.119465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:18.120552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:18.129419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:18.130147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:18.130775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:18.131660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:18.132306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:18.132918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:18.187055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:42:18.301769 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ffced67-696e-4c09-b556-b08290be0ec4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 204 len: 0 microversion: 2.1 time: 0.180169 Oct 26 05:42:18.301769 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3238/6464] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:42:18 2022] DELETE /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:42:18.313963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:18.314612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:18.332025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:18.332698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:18.332981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:18.336650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:18.339138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:18.340017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:18.590527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:18.599187 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82e60097-5313-4cf2-a50e-42f624a86bab tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1568 microversion: 2.1 time: 0.297240 Oct 26 05:42:18.600693 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3227/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:18 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:19.013334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:19.014094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:19.020399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:19.020911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:19.021586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:19.022315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:19.022801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:19.023247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:19.115620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:19.124499 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b210cc87-a79c-40f8-adae-761a7c8db683 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1270 microversion: 2.1 time: 0.116021 Oct 26 05:42:19.127014 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3239/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:19 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:19.629684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:19.630941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:19.640118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:19.641246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:19.641927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:19.642989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:19.645172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:19.646297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:19.886637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:19.902268 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0c7fee13-3509-4c0f-8a02-63859dc09e27 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1568 microversion: 2.1 time: 0.282232 Oct 26 05:42:19.904186 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3228/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:19 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:20.151637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:20.154327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:20.171891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:20.172860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:20.173622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:20.174736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:20.175367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:20.186305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:20.608997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f4837e3b-5468-4391-b369-f8d97c90e141 req-5f8d1ef6-5c15-4199-94cc-65e91b6cee32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c942949-5258-4859-877c-77b3ee86c21b", "name": "network-vif-deleted", "tag": "87198d94-0494-4281-bca3-b19a0d52cf11"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:20.654075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f4837e3b-5468-4391-b369-f8d97c90e141 req-5f8d1ef6-5c15-4199-94cc-65e91b6cee32 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:20.654937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f4837e3b-5468-4391-b369-f8d97c90e141 req-5f8d1ef6-5c15-4199-94cc-65e91b6cee32 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:20.658078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f4837e3b-5468-4391-b369-f8d97c90e141 req-5f8d1ef6-5c15-4199-94cc-65e91b6cee32 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:20.696785 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f4837e3b-5468-4391-b369-f8d97c90e141 req-5f8d1ef6-5c15-4199-94cc-65e91b6cee32 service nova] Creating event network-vif-deleted:87198d94-0494-4281-bca3-b19a0d52cf11 for instance 0c942949-5258-4859-877c-77b3ee86c21b on n-h1-862416-4 Oct 26 05:42:20.703636 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f4837e3b-5468-4391-b369-f8d97c90e141 req-5f8d1ef6-5c15-4199-94cc-65e91b6cee32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099885 Oct 26 05:42:20.704943 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3229/6468] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:42:20.927287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:20.928510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:20.945638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:20.946423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:20.947120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:20.948087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:20.948793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:20.949546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:20.979282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:20.990611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d6c93afb-f1c5-4102-be0a-f99d10193cf8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.843601 Oct 26 05:42:20.994052 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3240/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:20 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:21.052900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:21.064904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8fa047f-e1bf-458a-ad54-d2a8a9aa77a5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1360 microversion: 2.1 time: 0.142006 Oct 26 05:42:21.067507 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3230/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:20 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1360 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:21.935835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-bd2ac615-6f45-466b-ad7a-022ba6ec8b55 req-75ca0fd7-37c1-42e2-94b0-6191bdf16f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46b35a5-7822-4cec-867b-752e764860b8", "tag": "9c0590f2-51b8-4e82-a8b8-edf0ac39b8c0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:21.967446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd2ac615-6f45-466b-ad7a-022ba6ec8b55 req-75ca0fd7-37c1-42e2-94b0-6191bdf16f75 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:21.972808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd2ac615-6f45-466b-ad7a-022ba6ec8b55 req-75ca0fd7-37c1-42e2-94b0-6191bdf16f75 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:21.973694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bd2ac615-6f45-466b-ad7a-022ba6ec8b55 req-75ca0fd7-37c1-42e2-94b0-6191bdf16f75 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:21.993636 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-bd2ac615-6f45-466b-ad7a-022ba6ec8b55 req-75ca0fd7-37c1-42e2-94b0-6191bdf16f75 service nova] Creating event network-changed:9c0590f2-51b8-4e82-a8b8-edf0ac39b8c0 for instance c46b35a5-7822-4cec-867b-752e764860b8 on n-h2-862416-4 Oct 26 05:42:22.002304 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-bd2ac615-6f45-466b-ad7a-022ba6ec8b55 req-75ca0fd7-37c1-42e2-94b0-6191bdf16f75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084770 Oct 26 05:42:22.003170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3241/6471] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:42:22.019748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:22.020380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:22.033005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:22.033665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:22.034190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:22.035070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:22.040422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:22.040975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:22.094063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:22.095220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:22.113794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:22.114438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:22.115004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:22.115834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:22.116415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:22.117004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:22.279663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:22.290838 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dba84ac5-a348-472e-abf7-81a4adf3dce5 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1360 microversion: 2.1 time: 0.202833 Oct 26 05:42:22.294694 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3242/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:22 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:22.344283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:22.362509 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1e97fb6d-48cd-4f8f-9bc7-6b064e47300a tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.346974 Oct 26 05:42:22.365888 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3231/6473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:22 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:23.319732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:23.321420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:23.334722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:23.335964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:23.336592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:23.339164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:23.340658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:23.341541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:23.390746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:23.391993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:23.399828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:23.400560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:23.401550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:23.403125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:23.403918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:23.404526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:23.431900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:23.444305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3f4a0bc-e6fc-4d09-9c09-72ee9a560d33 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1360 microversion: 2.1 time: 0.132229 Oct 26 05:42:23.451080 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3243/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:23 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1360 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:23.587662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:23.595057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-61a47fb6-8a11-43aa-bed6-7cc86f84650c tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.209025 Oct 26 05:42:23.602521 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3232/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:23 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:24.486351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:24.488067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:24.506099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:24.507469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:24.508521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:24.509691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:24.510478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:24.511403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:24.623096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:24.630953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:24.660733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:24.665239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:24.666930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:24.676772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:24.677542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:24.678412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:24.689030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:24.708698 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f41668d-98d4-4431-b147-a6bf122bd1fd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1360 microversion: 2.1 time: 0.237038 Oct 26 05:42:24.731708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3244/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:24 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:25.017424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:25.032839 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac473eea-f1a6-4e76-98ef-969743be8898 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.413328 Oct 26 05:42:25.033773 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3233/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:24 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:25.737566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:25.739549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:25.747913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:25.748452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:25.748933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:25.749741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:25.750243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:25.750695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:25.830446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:25.839031 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-853b1bd9-be02-4309-b3ea-0901dbcc0cb8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1360 microversion: 2.1 time: 0.105344 Oct 26 05:42:25.841061 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3245/6478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:25 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1360 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:26.064508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:26.065467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:26.078852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:26.079500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:26.080298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:26.081541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:26.082347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:26.083096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:26.319665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:26.333078 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0ab7ef86-f3c2-4bda-8775-502f090718c1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.273858 Oct 26 05:42:26.334202 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3234/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:26 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:26.866415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:26.867663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:26.879510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:26.894556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:26.895158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:26.896087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:26.896425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:26.904875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:26.979020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:26.979862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:26.980589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:26.981280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lazy-loading 'fault' on Instance uuid 0c942949-5258-4859-877c-77b3ee86c21b {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:42:27.036301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:27.044982 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d6b8caab-d368-466a-b990-ecd6dbf5d3fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 200 len: 1319 microversion: 2.1 time: 0.182286 Oct 26 05:42:27.053590 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3246/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:26 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:27.359977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:27.360673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:27.403031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:27.404447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:27.406048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:27.407261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:27.408029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:27.408671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:27.597933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:27.606788 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5f468d1-6ff7-4492-b96a-dcaf83cf15b2 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.251880 Oct 26 05:42:27.608148 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3235/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:27 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:28.072336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:28.073760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:28.077304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:28.095485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:28.110444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:28.111181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:28.112579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:28.114766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:28.116791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:28.117632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:28.150048 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b HTTP/1.1 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0c942949-5258-4859-877c-77b3ee86c21b'} Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:28.156992 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:28.163024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:28.166172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:28.167281 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-17f7530b-dfe4-44e8-9940-24f031dd0996 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 404 len: 111 microversion: 2.1 time: 0.099344 Oct 26 05:42:28.171007 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3247/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:28 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:42:28.651948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:28.663890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:28.691058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:28.696114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:28.699882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:28.702535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:28.703344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:28.706150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:28.953396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:28.964610 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1bb4bacd-5376-4acd-bfc1-e7fe91c155f1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.335078 Oct 26 05:42:28.966894 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3236/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:28 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:29.740134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9530bcf8-d358-47a5-9562-e820bc69bdcf req-68a8d7d6-d4cf-4dd4-9f76-b5e022b4a233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46b35a5-7822-4cec-867b-752e764860b8", "name": "network-vif-plugged", "status": "completed", "tag": "9c0590f2-51b8-4e82-a8b8-edf0ac39b8c0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:29.757694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9530bcf8-d358-47a5-9562-e820bc69bdcf req-68a8d7d6-d4cf-4dd4-9f76-b5e022b4a233 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:29.758471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9530bcf8-d358-47a5-9562-e820bc69bdcf req-68a8d7d6-d4cf-4dd4-9f76-b5e022b4a233 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:29.759098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9530bcf8-d358-47a5-9562-e820bc69bdcf req-68a8d7d6-d4cf-4dd4-9f76-b5e022b4a233 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:29.760867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1899897085", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "0dba284e-251c-46b4-9a59-b657f28d2096"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:29.774729 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9530bcf8-d358-47a5-9562-e820bc69bdcf req-68a8d7d6-d4cf-4dd4-9f76-b5e022b4a233 service nova] Creating event network-vif-plugged:9c0590f2-51b8-4e82-a8b8-edf0ac39b8c0 for instance c46b35a5-7822-4cec-867b-752e764860b8 on n-h2-862416-4 Oct 26 05:42:29.787186 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9530bcf8-d358-47a5-9562-e820bc69bdcf req-68a8d7d6-d4cf-4dd4-9f76-b5e022b4a233 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044523 Oct 26 05:42:29.787846 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3237/6484] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:42:29.858270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] validate_networks() for [('0dba284e-251c-46b4-9a59-b657f28d2096', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:42:29.990405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:29.991393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:29.998719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:29.999435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:30.000054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:30.000934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:30.001595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:30.002194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:30.297731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:30.307701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:30.312768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f2bb031-5cba-407b-96b8-6c84987309a1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.326115 Oct 26 05:42:30.314862 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3238/6485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:29 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:30.507996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:42:30.508405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:42:30.509566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:42:30.510003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:42:30.510433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:42:30.521134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:30.521686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:30.522150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:30.522988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:30.523485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:30.524513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:30.561627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Getting quotas for project 34d743a6f7e9415e9113a13c473d62fd. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:42:30.586779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Getting quotas for user 6a28555ebfef452997ef426d3e84629b and project 34d743a6f7e9415e9113a13c473d62fd. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:42:30.605072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:42:30.609174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:42:30.679730 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7aa2e8ce-c568-4150-9d4b-65e1a3e0a33c tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106843 Oct 26 05:42:30.681822 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3248/6486] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:42:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:42:30.692674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c4d7141-b014-4b6e-8155-f793a3842304 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:30.693622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c4d7141-b014-4b6e-8155-f793a3842304 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:30.760839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c4d7141-b014-4b6e-8155-f793a3842304 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:30.779568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c4d7141-b014-4b6e-8155-f793a3842304 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1214 microversion: 2.1 time: 0.090611 Oct 26 05:42:30.780587 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3239/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:30 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:31.336232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:31.337588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:31.345750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:31.346600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:31.347293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:31.348239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:31.348920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:31.349592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:31.607447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:31.617033 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f4cfa26-1741-4709-a30f-47b6d86a6f04 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1318 microversion: 2.1 time: 0.284711 Oct 26 05:42:31.618452 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3249/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:31 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:31.804026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:31.804750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:31.813440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:31.814084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:31.814593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:31.815475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:31.816010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:31.816542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:31.890791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:31.899090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9f79d5c-33f0-439f-9b23-20b800b2af61 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1266 microversion: 2.1 time: 0.099446 Oct 26 05:42:31.899940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3240/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:31 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:32.569071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:32.569744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:32.577024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.577768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.578468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.579273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.579904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.580563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.609503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:42:32.645491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:32.646490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:32.655280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.656325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.656809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.657855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.658576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.659170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.712322 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd8f1362-d9d2-4b39-821a-cf77504996ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 204 len: 0 microversion: 2.1 time: 0.147381 Oct 26 05:42:32.713547 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3250/6490] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:42:32 2022] DELETE /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:42:32.724766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:32.727132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:32.737754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.738360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.739050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.740028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.740721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.741425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.915295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:32.924193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08b84c93-40e2-4dd3-83c3-72915670e1b3 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1507 microversion: 2.1 time: 0.287822 Oct 26 05:42:32.943413 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3241/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:32 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:32.948811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:32.950533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:32.951335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:32.957911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.958710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.959343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:32.960058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:32.960688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:32.961298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:33.004082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4596c01c-e541-417a-b799-3ff81a11a56c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1411 microversion: 2.1 time: 0.285816 Oct 26 05:42:33.018520 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3251/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:32 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1411 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:33.172158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:33.181401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c487154e-9269-4282-98c5-d4fb6534fa3b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1314 microversion: 2.1 time: 0.236636 Oct 26 05:42:33.182532 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3242/6493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:32 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:33.711729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-438c542f-becb-43be-9d3e-8410c3c7af13 req-fb83d622-e45b-4ee4-9d3d-7c259a91dfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1779dcf-ab8c-4ee3-b565-6b0418024a47", "tag": "2972ccf9-7596-4004-a51e-b7a2f44798a0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:33.732548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-438c542f-becb-43be-9d3e-8410c3c7af13 req-fb83d622-e45b-4ee4-9d3d-7c259a91dfd2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:33.733509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-438c542f-becb-43be-9d3e-8410c3c7af13 req-fb83d622-e45b-4ee4-9d3d-7c259a91dfd2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:33.734858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-438c542f-becb-43be-9d3e-8410c3c7af13 req-fb83d622-e45b-4ee4-9d3d-7c259a91dfd2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:33.755369 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-438c542f-becb-43be-9d3e-8410c3c7af13 req-fb83d622-e45b-4ee4-9d3d-7c259a91dfd2 service nova] Creating event network-changed:2972ccf9-7596-4004-a51e-b7a2f44798a0 for instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 on n-h1-862416-4 Oct 26 05:42:33.761133 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-438c542f-becb-43be-9d3e-8410c3c7af13 req-fb83d622-e45b-4ee4-9d3d-7c259a91dfd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062575 Oct 26 05:42:33.763149 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3252/6494] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:42:34.032214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:34.033006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:34.041707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:34.042754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:34.043523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:34.044646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:34.045129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:34.046227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:34.206460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:34.207600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:34.216421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:34.217338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:34.218066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:34.219372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:34.220066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:34.220734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:34.233516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:34.243547 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a69db57b-f517-499b-ac75-9227bbd2f4d3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1411 microversion: 2.1 time: 0.216753 Oct 26 05:42:34.246436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3243/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:34 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1411 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:34.272630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:34.514591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:34.533074 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d8a53ce-ccd1-46a0-8848-69b0d7f40f7f tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1314 microversion: 2.1 time: 0.331587 Oct 26 05:42:34.534098 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3253/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:34 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:35.010380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-02abeafd-dc4f-45dc-904e-8002584b0f1a req-5f1a5c69-5bae-4940-a237-3799e066500e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cbe89f5-ff51-4763-b2aa-cde85091ebbb", "name": "network-vif-deleted", "tag": "16de25d8-f46d-4b76-9b6b-1cdcc9b650dd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:35.020950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-02abeafd-dc4f-45dc-904e-8002584b0f1a req-5f1a5c69-5bae-4940-a237-3799e066500e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:35.021478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-02abeafd-dc4f-45dc-904e-8002584b0f1a req-5f1a5c69-5bae-4940-a237-3799e066500e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:35.021919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-02abeafd-dc4f-45dc-904e-8002584b0f1a req-5f1a5c69-5bae-4940-a237-3799e066500e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:35.038266 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-02abeafd-dc4f-45dc-904e-8002584b0f1a req-5f1a5c69-5bae-4940-a237-3799e066500e service nova] Creating event network-vif-deleted:16de25d8-f46d-4b76-9b6b-1cdcc9b650dd for instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb on n-h2-862416-4 Oct 26 05:42:35.043647 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-02abeafd-dc4f-45dc-904e-8002584b0f1a req-5f1a5c69-5bae-4940-a237-3799e066500e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 Oct 26 05:42:35.044263 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3244/6497] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:42:35.272770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:35.273599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:35.287655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:35.288284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:35.289875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:35.290638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:35.292187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:35.292871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:35.442130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:35.467673 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dec74536-b00e-4ce1-823e-c6233edfb2e4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1202 microversion: 2.1 time: 0.194441 Oct 26 05:42:35.485503 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3254/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:35 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1202 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:35.559406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:35.563501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:35.575273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:35.575776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:35.576278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:35.577322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:35.578217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:35.578818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:35.785765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:35.795155 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c6c3a2c-5605-49a9-bca4-63e2f03aae12 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1314 microversion: 2.1 time: 0.242502 Oct 26 05:42:35.797355 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3245/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:35 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:36.493972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:36.496548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:36.514105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:36.514947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:36.515676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:36.530886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:36.532385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:36.532866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:36.645050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:36.658889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91da7408-b746-4f22-99db-cb3ac3638226 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1202 microversion: 2.1 time: 0.171703 Oct 26 05:42:36.659478 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3255/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:36 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:36.820678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:36.822100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:36.831888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:36.833049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:36.836609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:36.837470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:36.838022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:36.838657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:37.027755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:37.040873 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc50f363-1577-49a2-9bee-e89a9b37574e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1314 microversion: 2.1 time: 0.224596 Oct 26 05:42:37.045499 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3246/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:36 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:37.683447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:37.684243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:37.691226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:37.691823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:37.692351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:37.693149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:37.693731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:37.694397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:37.766850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:37.775411 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bac0366-a378-4e6d-822d-4c77b9b58068 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1202 microversion: 2.1 time: 0.095937 Oct 26 05:42:37.776365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3256/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:37 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:38.065135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:38.066819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:38.076938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:38.077955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:38.078666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:38.079511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:38.080265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:38.080945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:38.241454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:38.256454 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3973c60a-6517-47bb-8a41-799453fa545a tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1314 microversion: 2.1 time: 0.195596 Oct 26 05:42:38.258306 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3247/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:38 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:38.772397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-736eaede-7a0b-448d-8603-f518f55a7649 req-78d1efee-8aad-485b-a972-cd20c1337804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1779dcf-ab8c-4ee3-b565-6b0418024a47", "name": "network-vif-plugged", "status": "completed", "tag": "2972ccf9-7596-4004-a51e-b7a2f44798a0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:38.791565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-736eaede-7a0b-448d-8603-f518f55a7649 req-78d1efee-8aad-485b-a972-cd20c1337804 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:38.793147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-736eaede-7a0b-448d-8603-f518f55a7649 req-78d1efee-8aad-485b-a972-cd20c1337804 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:38.794036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-736eaede-7a0b-448d-8603-f518f55a7649 req-78d1efee-8aad-485b-a972-cd20c1337804 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:38.800164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:38.801047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:38.813399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:38.817569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:38.825999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:38.828999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:38.830575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:38.831318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:38.848642 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-736eaede-7a0b-448d-8603-f518f55a7649 req-78d1efee-8aad-485b-a972-cd20c1337804 service nova] Creating event network-vif-plugged:2972ccf9-7596-4004-a51e-b7a2f44798a0 for instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 on n-h1-862416-4 Oct 26 05:42:38.864206 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-736eaede-7a0b-448d-8603-f518f55a7649 req-78d1efee-8aad-485b-a972-cd20c1337804 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094199 Oct 26 05:42:38.867643 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3257/6504] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:42:38.987561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:38.996544 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08905f60-6c26-48cd-ae30-4dc532dbc717 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1202 microversion: 2.1 time: 0.199667 Oct 26 05:42:38.997261 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3248/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:38 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1202 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:39.290700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:39.291713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:39.299026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:39.299551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:39.299998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:39.300943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:39.301449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:39.301897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:39.458705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:39.466883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22d6488b-2265-4acb-8b64-33958ee1ca01 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1314 microversion: 2.1 time: 0.181282 Oct 26 05:42:39.482010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3258/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:39 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:40.021347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:40.022510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:40.030316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:40.031216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:40.032212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:40.033301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:40.034009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:40.034717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:40.109207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:40.119011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1691f600-f407-446f-a5db-5032f6bc504d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 200 len: 1202 microversion: 2.1 time: 0.101528 Oct 26 05:42:40.129712 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3249/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:40 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:40.490771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:40.491432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:40.499396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:40.499903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:40.500359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:40.501075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:40.501573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:40.502027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:40.548219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:40.597946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:40.666350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:40.675422 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5de07cee-ebf2-4067-b11b-f7c6d00d8949 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1497 microversion: 2.1 time: 0.188415 Oct 26 05:42:40.676310 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3259/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:40 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:41.143836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:41.145367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:41.148405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:41.159733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:41.160303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:41.160895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:41.161778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:41.162342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:41.162864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:41.178514 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb HTTP/1.1 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7cbe89f5-ff51-4763-b2aa-cde85091ebbb'} Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:41.180441 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:41.186717 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b5eabf1a-6095-49af-adf9-4b72528b53b7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 404 len: 111 microversion: 2.1 time: 0.046423 Oct 26 05:42:41.188863 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3250/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:41 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:42:43.442744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:43.443825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:43.451394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:43.453863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:43.454167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:43.454784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:43.455529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:43.456072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:43.456678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:43.492816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:42:43.591667 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-563cd4b2-2149-4e7f-b12d-f85a2dbcee79 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 204 len: 0 microversion: 2.1 time: 0.152534 Oct 26 05:42:43.597754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3260/6510] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:42:43 2022] DELETE /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:42:43.603913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:43.606299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:43.615212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:43.615988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:43.616637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:43.619925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:43.625866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:43.626504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:43.800375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:43.810077 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57c8b22e-0019-4d25-826d-282dce7c7ddf tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1503 microversion: 2.1 time: 0.211484 Oct 26 05:42:43.811655 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3251/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:43 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:42:44.835635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:44.836499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:44.845391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:44.846282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:44.846732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:44.847746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:44.848213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:44.848819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:45.061203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:45.073717 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7a89bfb4-3eed-4cb7-be20-20a09e024ee1 tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1503 microversion: 2.1 time: 0.242869 Oct 26 05:42:45.074936 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3261/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:44 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:45.554013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:45.554617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:45.585756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:45.586594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:45.587237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:45.588167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:45.588808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:45.590641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:45.613943 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b HTTP/1.1 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '0c942949-5258-4859-877c-77b3ee86c21b'} Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:45.616066 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.622097 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.626825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:45.628629 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb84e824-7828-483d-810e-f6a7ad386e95 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 404 len: 111 microversion: 2.1 time: 0.081887 Oct 26 05:42:45.633016 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3252/6513] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:42:45 2022] DELETE /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:42:45.639211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:45.639857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 0c942949-5258-4859-877c-77b3ee86c21b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:45.651272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:45.656195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:45.657122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3fc88b26-72ab-403a-bebe-2fd5959a3293 req-ab6c2653-b39e-4f2b-87e5-2d6f5e4bd995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1779dcf-ab8c-4ee3-b565-6b0418024a47", "name": "network-vif-deleted", "tag": "2972ccf9-7596-4004-a51e-b7a2f44798a0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:45.657902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:45.658815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:45.659308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:45.661583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:45.669081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3fc88b26-72ab-403a-bebe-2fd5959a3293 req-ab6c2653-b39e-4f2b-87e5-2d6f5e4bd995 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:45.669653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3fc88b26-72ab-403a-bebe-2fd5959a3293 req-ab6c2653-b39e-4f2b-87e5-2d6f5e4bd995 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:45.670116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3fc88b26-72ab-403a-bebe-2fd5959a3293 req-ab6c2653-b39e-4f2b-87e5-2d6f5e4bd995 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:45.688017 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b HTTP/1.1 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0c942949-5258-4859-877c-77b3ee86c21b'} Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:45.690140 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. Oct 26 05:42:45.696735 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:45.698255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 0c942949-5258-4859-877c-77b3ee86c21b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:45.699451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1be7297b-f99f-43d2-b311-4457a23f44a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b" status: 404 len: 111 microversion: 2.1 time: 0.065615 Oct 26 05:42:45.700526 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3262/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:45 2022] GET /compute/v2.1/servers/0c942949-5258-4859-877c-77b3ee86c21b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:42:45.707664 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3fc88b26-72ab-403a-bebe-2fd5959a3293 req-ab6c2653-b39e-4f2b-87e5-2d6f5e4bd995 service nova] Creating event network-vif-deleted:2972ccf9-7596-4004-a51e-b7a2f44798a0 for instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 on n-h1-862416-4 Oct 26 05:42:45.712880 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3fc88b26-72ab-403a-bebe-2fd5959a3293 req-ab6c2653-b39e-4f2b-87e5-2d6f5e4bd995 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061622 Oct 26 05:42:45.717960 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3253/6515] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:42:46.098655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:46.100180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:46.108606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.109293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.110290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.111482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.112402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.113127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.161483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.161483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.161790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.162763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lazy-loading 'fault' on Instance uuid f1779dcf-ab8c-4ee3-b565-6b0418024a47 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:42:46.215551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a28555ebfef452997ef426d3e84629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d743a6f7e9415e9113a13c473d62fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:42:46.226789 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2541e78-6a57-4ce9-b582-abd785d24f7e tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 200 len: 1304 microversion: 2.1 time: 0.132102 Oct 26 05:42:46.227837 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3263/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:46 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:42:46.512338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:46.513157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:46.520047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.520554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.521040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.521770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.522478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.523162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.539480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb HTTP/1.1 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7cbe89f5-ff51-4763-b2aa-cde85091ebbb'} Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:46.541230 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:46.546019 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48679504-edec-46be-8ca8-2b1c0f5c3913 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 404 len: 111 microversion: 2.1 time: 0.035870 Oct 26 05:42:46.548400 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3254/6517] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:42:46 2022] DELETE /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:42:46.552614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:46.553701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 7cbe89f5-ff51-4763-b2aa-cde85091ebbb] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:46.560567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.561077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.561567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.562287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:46.562765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:46.563214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:46.576825 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb HTTP/1.1 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7cbe89f5-ff51-4763-b2aa-cde85091ebbb'} Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:46.578467 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 7cbe89f5-ff51-4763-b2aa-cde85091ebbb could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ec75e6e-5d68-4f8e-9b9c-b6e4c620b990 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb" status: 404 len: 111 microversion: 2.1 time: 0.031479 Oct 26 05:42:46.582968 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3264/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:46 2022] GET /compute/v2.1/servers/7cbe89f5-ff51-4763-b2aa-cde85091ebbb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:42:46.664743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73fcd4ea-5edc-49f3-9e3d-b4399fc85048 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: .version_select at 0x7f4709f19ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1141262165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKibsVfupi5Sh2oobMA5afngBe/an0OS5Kz1tPcHytMXsNXSYOz6L/92d9kagfjtOGZp3xtBmieOc2RLdy+ofqjqDGSqvo9VhYAqIB7PulLBX8PAgTrgbhcso+F0t5AXg=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:46.684438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-73fcd4ea-5edc-49f3-9e3d-b4399fc85048 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:42:46.690081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-73fcd4ea-5edc-49f3-9e3d-b4399fc85048 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:42:46.720773 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73fcd4ea-5edc-49f3-9e3d-b4399fc85048 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.059942 Oct 26 05:42:46.721436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3255/6519] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:42:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:42:47.254193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:42:47.256372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] [instance: f1779dcf-ab8c-4ee3-b565-6b0418024a47] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:47.270010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:47.270882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:47.271418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:47.272244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:47.272798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:47.273350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:47.295407 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] HTTP exception thrown: Instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 could not be found. Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Request method failure captured: Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 HTTP/1.1 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMjDRbZABN-7GBLdCA6jMTUymryalYfZWC0jyFSd17Zbvnvtf34W4iVBeos4br1IwOjBGXuuBc6rJPXR4G6_47e7obMSEOMm7FyRYdZpr9wou2R3V3rDMmE0NgxPutJ5VzJdVX1BfwGYmeOx2TCOdeFZxZoZwmb3tFejxnQAYENy2E0 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 34d743a6f7e9415e9113a13c473d62fd Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesActionsTest-650420483 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34d743a6f7e9415e9113a13c473d62fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34d743a6f7e9415e9113a13c473d62fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34d743a6f7e9415e9113a13c473d62fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34d743a6f7e9415e9113a13c473d62fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesActionsTest-650420483 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 34d743a6f7e9415e9113a13c473d62fd Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesActionsTest-650420483 Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesActionsTest-650420483-project Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 6a28555ebfef452997ef426d3e84629b Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesActionsTest-650420483-project Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 could not be found. Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'f1779dcf-ab8c-4ee3-b565-6b0418024a47'} Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 could not be found. Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 could not be found. Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:42:47.297711 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 could not be found. Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] Returning 404 to user: Instance f1779dcf-ab8c-4ee3-b565-6b0418024a47 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a106c20-5681-4bd3-94b4-93753d7d919b tempest-VolumesActionsTest-650420483 tempest-VolumesActionsTest-650420483-project] 10.222.0.16 "GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47" status: 404 len: 111 microversion: 2.1 time: 0.050011 Oct 26 05:42:47.310187 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3265/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:42:47 2022] GET /compute/v2.1/servers/f1779dcf-ab8c-4ee3-b565-6b0418024a47 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:42:55.232619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0be7f0aa-36a6-49e0-b9b6-da0473dcf7c0", "device": "/dev/sdb"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:42:55.235004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:42:55.237282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:42:55.242511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:55.243010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:55.243460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:55.244202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:42:55.244657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:42:55.245117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:42:55.512938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d127f9ee-61b9-4d82-a66f-3ab94a0cca31 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "POST /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286084 Oct 26 05:42:55.513904 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3256/6521] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:42:55 2022] POST /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:43:12.620374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1408378799", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1141262165", "security_groups": [{"name": "tempest-secgroup-smoke-632575950"}], "block_device_mapping_v2": [{"uuid": "1416099e-b305-4cee-94d7-97684f93182d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:12.636410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:12.637519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:12.787438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:43:13.615042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:43:13.615651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:43:13.616194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:43:13.616775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:43:13.617291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:43:13.629615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:13.630317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:13.630791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:13.631547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:13.632209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:13.632827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:13.657424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:43:13.664019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:43:13.746141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:43:13.748344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1416099e-b305-4cee-94d7-97684f93182d',volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:43:13.917907 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be8168b7-a1b5-4efd-bd5c-50018cb82b60 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.301578 Oct 26 05:43:13.918872 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3266/6522] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:43:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:43:13.931281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5e1d824-1e55-48f1-88d3-3a37dbf98873 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:13.932931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c5e1d824-1e55-48f1-88d3-3a37dbf98873 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:13.943838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:13.948932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:13.950263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:14.058081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c5e1d824-1e55-48f1-88d3-3a37dbf98873 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:14.075669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5e1d824-1e55-48f1-88d3-3a37dbf98873 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1095 microversion: 2.1 time: 0.149060 Oct 26 05:43:14.076281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3257/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:13 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1095 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:15.102212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:15.103574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:15.112172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:15.112987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:15.113658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:15.114615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:15.115257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:15.115870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:15.204183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:15.215547 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c7d64c2d-c616-4c1c-80c2-d480fd4bc6a1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1193 microversion: 2.1 time: 0.117182 Oct 26 05:43:15.216941 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3267/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:15 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:16.247646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:16.248260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:16.264806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:16.265683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:16.266341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:16.267268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:16.268131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:16.269883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:16.410386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:16.426882 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e94e4770-7e28-4da5-812f-4853280fbd86 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1211 microversion: 2.1 time: 0.180860 Oct 26 05:43:16.429209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3258/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:16 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:17.452948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:17.457297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:17.468440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:17.472310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:17.473011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:17.473977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:17.474636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:17.475264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:17.739928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:17.750118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d904377a-2cd0-46f9-9235-bead071cc9ae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.301624 Oct 26 05:43:17.751444 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3268/6526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:17 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:17.827393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9908923b-9b74-4d7b-bd6f-4fa41d80aba5 req-f8b98ac7-b042-45cb-83a8-e0fa48b692fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e7fc98-b839-43fb-9934-f73057f52a6b", "tag": "ff06fa0a-40c0-45db-a806-dc2a9d27ac60"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:17.842267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9908923b-9b74-4d7b-bd6f-4fa41d80aba5 req-f8b98ac7-b042-45cb-83a8-e0fa48b692fe service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:17.843163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9908923b-9b74-4d7b-bd6f-4fa41d80aba5 req-f8b98ac7-b042-45cb-83a8-e0fa48b692fe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:17.844696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9908923b-9b74-4d7b-bd6f-4fa41d80aba5 req-f8b98ac7-b042-45cb-83a8-e0fa48b692fe service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:17.866776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9908923b-9b74-4d7b-bd6f-4fa41d80aba5 req-f8b98ac7-b042-45cb-83a8-e0fa48b692fe service nova] Creating event network-changed:ff06fa0a-40c0-45db-a806-dc2a9d27ac60 for instance 92e7fc98-b839-43fb-9934-f73057f52a6b on n-h1-862416-4 Oct 26 05:43:17.873072 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9908923b-9b74-4d7b-bd6f-4fa41d80aba5 req-f8b98ac7-b042-45cb-83a8-e0fa48b692fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049823 Oct 26 05:43:17.874392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3259/6527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:43:18.775433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:18.776705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:18.784255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:18.785107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:18.785831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:18.786816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:18.787516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:18.788188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:18.972443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:18.984509 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15ed1932-9e51-4411-8059-a8fcabdf7735 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.212367 Oct 26 05:43:18.986037 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3269/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:18 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:20.011393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:20.012669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:20.020579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:20.021122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:20.021618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:20.022366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:20.022836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:20.023516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:20.183551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:20.194482 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb12491e-6ae9-4986-a2b9-8a0c83a82c7a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.189570 Oct 26 05:43:20.194806 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3260/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:20 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:21.219361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:21.220186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:21.236825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:21.237639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:21.238286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:21.239718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:21.240402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:21.245656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:21.460127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:21.471726 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-77a59d73-6830-4dd7-b944-4f96f38b268c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.259443 Oct 26 05:43:21.473421 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3270/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:21 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:22.497470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:22.498097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:22.504962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:22.505499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:22.506126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:22.507028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:22.507503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:22.507937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:22.657012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:22.674984 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1fb7509d-94e3-4d36-a2bb-af99ae40ce8d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.182545 Oct 26 05:43:22.688275 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3261/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:22 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:22.768353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:22.769907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:22.777900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:22.778852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:22.779723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:22.780489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:22.780974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:22.781521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:22.889617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lazy-loading 'services' on Instance uuid c46b35a5-7822-4cec-867b-752e764860b8 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:43:22.982270 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-523e4454-f698-48f4-92fd-e3d758e39a44 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8/os-volume_attachments/0be7f0aa-36a6-49e0-b9b6-da0473dcf7c0" status: 202 len: 0 microversion: 2.1 time: 0.217441 Oct 26 05:43:22.983724 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3271/6532] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:43:22 2022] DELETE /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8/os-volume_attachments/0be7f0aa-36a6-49e0-b9b6-da0473dcf7c0 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:43:23.701136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:23.703097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:23.720317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:23.720878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:23.721352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:23.722377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:23.722906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:23.724082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:23.904967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:23.913656 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-211c4e6d-096c-425c-96d0-4aaded16f7e1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.219055 Oct 26 05:43:23.921751 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3262/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:23 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:24.940989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:24.941899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:24.944636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:24.945870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:24.964804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:24.967494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:24.968111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:24.969950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:24.971819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:24.973171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:25.338193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:25.351043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8cb1bde0-dc5d-4988-a760-8c5bad4183e8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1278 microversion: 2.1 time: 0.416485 Oct 26 05:43:25.367576 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3272/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:24 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1278 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:26.377976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:26.378596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:26.386435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:26.397374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:26.398316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:26.399125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:26.399934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:26.400367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:26.400811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:26.595542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:26.605067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e8f48bd-bc07-4381-8acc-9a1e68db2f98 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.230612 Oct 26 05:43:26.606823 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3263/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:26 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:27.630826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:27.631538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:27.639179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:27.639962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:27.640969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:27.646577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:27.647351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:27.648492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:27.855818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:27.863989 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be27c64d-8fb3-43b5-b2fe-65b32737c618 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.237238 Oct 26 05:43:27.864568 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3273/6536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:27 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:28.887373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:28.887964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:28.895001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:28.895711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:28.896167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:28.896883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:28.897376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:28.897818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:29.040612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:29.049346 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ccd8775b-16b2-4eba-bb31-66510741cee8 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.166444 Oct 26 05:43:29.049969 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3264/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:28 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:29.555432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:29.555953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:29.568093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:29.568604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:29.571636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:29.572382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:29.575214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:29.575999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:29.612358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:43:29.697100 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-98beb71f-8e73-45e5-b23a-771c97d007df tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 204 len: 0 microversion: 2.1 time: 0.146354 Oct 26 05:43:29.699966 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3274/6538] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:43:29 2022] DELETE /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:43:29.708212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:29.709771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:29.716241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:29.717016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:29.717739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:29.718661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:29.719318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:29.719960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:29.887107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:29.895352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f5e34b5-7115-4f1c-a705-e37f7a9f90d1 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1513 microversion: 2.1 time: 0.190976 Oct 26 05:43:29.896270 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3265/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:29 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:30.073951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:30.074968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:30.082637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:30.083401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:30.083958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:30.085015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:30.085649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:30.086330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:30.236962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:30.245240 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1fa27007-aade-47b2-9b4f-ade451877eac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.176729 Oct 26 05:43:30.245893 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3275/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:30 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:30.919810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:30.921400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:30.930043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:30.930541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:30.930990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:30.931700 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:30.932170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:30.932602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:31.108023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:31.147364 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffcee7ce-28d8-45e6-bd0f-e6fac7d1a387 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1513 microversion: 2.1 time: 0.232722 Oct 26 05:43:31.148436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3266/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:30 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:31.273353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:31.275831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:31.306025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:31.306765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:31.307396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:31.309792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:31.310277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:31.310727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:31.483951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:31.494406 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-858f9ff3-94a8-4235-96d9-bd6ea2048fc9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.228413 Oct 26 05:43:31.496311 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3276/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:31 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:32.129910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d93c511f-12b7-420b-91db-c500d49f0ead req-3f5b2ead-d1a5-4544-bc3a-37a8423ee36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46b35a5-7822-4cec-867b-752e764860b8", "name": "network-vif-deleted", "tag": "9c0590f2-51b8-4e82-a8b8-edf0ac39b8c0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:32.163478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d93c511f-12b7-420b-91db-c500d49f0ead req-3f5b2ead-d1a5-4544-bc3a-37a8423ee36e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:32.163974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d93c511f-12b7-420b-91db-c500d49f0ead req-3f5b2ead-d1a5-4544-bc3a-37a8423ee36e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:32.164419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d93c511f-12b7-420b-91db-c500d49f0ead req-3f5b2ead-d1a5-4544-bc3a-37a8423ee36e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:32.173626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:32.175005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:32.182700 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d93c511f-12b7-420b-91db-c500d49f0ead req-3f5b2ead-d1a5-4544-bc3a-37a8423ee36e service nova] Creating event network-vif-deleted:9c0590f2-51b8-4e82-a8b8-edf0ac39b8c0 for instance c46b35a5-7822-4cec-867b-752e764860b8 on n-h2-862416-4 Oct 26 05:43:32.185074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:32.185617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:32.186883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:32.187640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:32.189092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:32.190926 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d93c511f-12b7-420b-91db-c500d49f0ead req-3f5b2ead-d1a5-4544-bc3a-37a8423ee36e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065827 Oct 26 05:43:32.191669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:32.194887 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3267/6543] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:43:32.309168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:32.318935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4755a43-da25-4acb-b2d7-870137f8676f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 200 len: 1303 microversion: 2.1 time: 0.151297 Oct 26 05:43:32.320071 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3277/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:32 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:43:32.518805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:32.519708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:32.526189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:32.526915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:32.527376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:32.528089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:32.528554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:32.528994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:32.685935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:32.694687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8e08d6e-45b2-46cc-b7b7-899a3b04e447 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.180049 Oct 26 05:43:32.701689 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3268/6545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:32 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:33.347952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:33.348710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: c46b35a5-7822-4cec-867b-752e764860b8] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:33.357753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:33.358383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:33.358986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:33.359867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:33.360438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:33.361158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:33.376779 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] HTTP exception thrown: Instance c46b35a5-7822-4cec-867b-752e764860b8 could not be found. Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Request method failure captured: Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 HTTP/1.1 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMhf9MRcC9xgWky_HxRcI-Zf1OtuDnRyt0K3NvJ9xz1zPwCFAxLMeXOkhkIbjmGI07AJffvZu_uIoU3xfaFbNZGDstxyIUIc_LiioT1Qf5uDJ9VyaTqxTQYwicjQDEa0XykyYb5LRpELPE9S9sXCKvPUpd3thmhSXY1aNrOWHPdwuk4 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 46a192618b4b4613a84a4fdbce34be77 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331052417 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-VolumesSnapshotTestJSON-331052417 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 46a192618b4b4613a84a4fdbce34be77 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331052417 Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-VolumesSnapshotTestJSON-331052417-project Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a5846c0d279e469dac3accc725e2ed0d Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-VolumesSnapshotTestJSON-331052417-project Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c46b35a5-7822-4cec-867b-752e764860b8 could not be found. Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c46b35a5-7822-4cec-867b-752e764860b8'} Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c46b35a5-7822-4cec-867b-752e764860b8 could not be found. Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c46b35a5-7822-4cec-867b-752e764860b8 could not be found. Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:43:33.378640 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c46b35a5-7822-4cec-867b-752e764860b8 could not be found. Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Returning 404 to user: Instance c46b35a5-7822-4cec-867b-752e764860b8 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30f6a514-cd13-4296-8b18-fa7276f05e96 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8" status: 404 len: 111 microversion: 2.1 time: 0.040026 Oct 26 05:43:33.391489 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3278/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:33 2022] GET /compute/v2.1/servers/c46b35a5-7822-4cec-867b-752e764860b8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:43:33.719914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:33.720545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:33.727022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:33.727805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:33.728260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:33.728982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:33.729486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:33.730049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:33.886585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:33.896343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-46ac0fb1-13f9-484d-b3ea-1cfabe9c2bae tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.181901 Oct 26 05:43:33.897499 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3269/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:33 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:34.920905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:34.921570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:34.938302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:34.938559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:34.938868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:34.939713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:34.940187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:34.940636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:35.206676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:35.220376 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ef8776a-00a9-4d2a-bf32-13266ede887a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.304010 Oct 26 05:43:35.221916 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3279/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:34 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:36.247805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:36.248356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:36.255856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:36.257445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:36.258104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:36.259003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:36.259810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:36.260420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:36.412830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:36.421217 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85c29de5-cc00-4bc9-a85b-6578bf1e190a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.178797 Oct 26 05:43:36.422434 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3270/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:36 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:36.847650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1995124b-5656-48a7-8420-82f906eeb62e req-f5a490a3-d6e3-4672-8254-684d6ebf7727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e7fc98-b839-43fb-9934-f73057f52a6b", "name": "network-vif-plugged", "status": "completed", "tag": "ff06fa0a-40c0-45db-a806-dc2a9d27ac60"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:36.865533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1995124b-5656-48a7-8420-82f906eeb62e req-f5a490a3-d6e3-4672-8254-684d6ebf7727 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:36.867633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1995124b-5656-48a7-8420-82f906eeb62e req-f5a490a3-d6e3-4672-8254-684d6ebf7727 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:36.868169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1995124b-5656-48a7-8420-82f906eeb62e req-f5a490a3-d6e3-4672-8254-684d6ebf7727 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:36.909151 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1995124b-5656-48a7-8420-82f906eeb62e req-f5a490a3-d6e3-4672-8254-684d6ebf7727 service nova] Creating event network-vif-plugged:ff06fa0a-40c0-45db-a806-dc2a9d27ac60 for instance 92e7fc98-b839-43fb-9934-f73057f52a6b on n-h1-862416-4 Oct 26 05:43:36.914460 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1995124b-5656-48a7-8420-82f906eeb62e req-f5a490a3-d6e3-4672-8254-684d6ebf7727 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070826 Oct 26 05:43:36.915326 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3280/6550] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:43:37.446685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:37.447296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:37.456835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:37.457415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:37.457868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:37.458648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:37.459103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:37.459547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:37.629284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:37.638792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6c93415-5e75-42cd-9662-0b4e1478c7d1 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1266 microversion: 2.1 time: 0.196230 Oct 26 05:43:37.639625 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3271/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:37 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:38.669794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:38.673185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:38.685964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:38.686870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:38.687920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:38.689298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:38.690239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:38.691284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:38.886439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:38.901423 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee3c008f-92a3-4d57-b400-81b6651cbd8c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1454 microversion: 2.1 time: 0.241457 Oct 26 05:43:38.913562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3281/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:38 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1454 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:38.928690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:38.929827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:38.938977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:38.939561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:38.940016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:38.940966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:38.941475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:38.941917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:39.137886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:39.147161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0600afe8-7a1b-4942-b1e1-ce5ea96abdd9 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1454 microversion: 2.1 time: 0.223537 Oct 26 05:43:39.148418 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3272/6553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:38 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:40.525908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1446768188", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "3b495149-3ec5-4e86-898c-edde888aff5f"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:40.593153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] validate_networks() for [('3b495149-3ec5-4e86-898c-edde888aff5f', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:43:41.791651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:43:41.792237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:43:41.793044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:43:41.793442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:43:41.794103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:43:41.805357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:41.805953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:41.806479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:41.807577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:41.808964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:41.810007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:41.821504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:41.835531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Getting quotas for project 46a192618b4b4613a84a4fdbce34be77. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:43:41.844603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Getting quotas for user a5846c0d279e469dac3accc725e2ed0d and project 46a192618b4b4613a84a4fdbce34be77. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:43:41.866772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:43:41.870219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:43:41.953554 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8abcf00f-bf38-4c59-a027-c68f2e3473dc tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432424 Oct 26 05:43:41.954230 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3282/6554] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:43:41.966588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cd99722-f284-4fbe-a6dd-cd615a3d5539 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:41.967214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cd99722-f284-4fbe-a6dd-cd615a3d5539 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:42.089793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4cd99722-f284-4fbe-a6dd-cd615a3d5539 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:42.101217 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cd99722-f284-4fbe-a6dd-cd615a3d5539 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1219 microversion: 2.1 time: 0.139046 Oct 26 05:43:42.101857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3273/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:41 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:42.815232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e05e1711-b273-4e53-b4a0-9525b087c7e2 req-705c072d-f36d-4b96-a873-7045e85ff0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e7fc98-b839-43fb-9934-f73057f52a6b", "tag": "ff06fa0a-40c0-45db-a806-dc2a9d27ac60"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:42.847402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:42.850045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e05e1711-b273-4e53-b4a0-9525b087c7e2 req-705c072d-f36d-4b96-a873-7045e85ff0dd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:42.850563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e05e1711-b273-4e53-b4a0-9525b087c7e2 req-705c072d-f36d-4b96-a873-7045e85ff0dd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:42.851005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e05e1711-b273-4e53-b4a0-9525b087c7e2 req-705c072d-f36d-4b96-a873-7045e85ff0dd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:42.907024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e05e1711-b273-4e53-b4a0-9525b087c7e2 req-705c072d-f36d-4b96-a873-7045e85ff0dd service nova] Creating event network-changed:ff06fa0a-40c0-45db-a806-dc2a9d27ac60 for instance 92e7fc98-b839-43fb-9934-f73057f52a6b on n-h1-862416-4 Oct 26 05:43:42.928183 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e05e1711-b273-4e53-b4a0-9525b087c7e2 req-705c072d-f36d-4b96-a873-7045e85ff0dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131829 Oct 26 05:43:42.929083 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3283/6556] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:43:43.124744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:43.126614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:43.134926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:43.135439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:43.136101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:43.137718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:43.138414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:43.138858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:43.242086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:43.253222 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35286c6c-a2c4-4443-89c4-51f43102570b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1271 microversion: 2.1 time: 0.132625 Oct 26 05:43:43.266204 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3274/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:43 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:44.282032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:44.284189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:44.293385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:44.294164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:44.294804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:44.295534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:44.296188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:44.296637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:44.419912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:44.443085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80e9070a-9633-4d7e-94a0-e65a8996368e tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1277 microversion: 2.1 time: 0.168342 Oct 26 05:43:44.444081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3284/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:44 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:45.488283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:45.489369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:45.493344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=41 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:45.500493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:45.501850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:45.502332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:45.503056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:45.503725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:45.504342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:45.509185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=89 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:45.736030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:45.748208 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b849715c-00d6-4cd3-a0da-2bd3a4493032 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.264491 Oct 26 05:43:45.762217 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3275/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:45 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:45.902607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-24366e5a-8cfb-4b90-b32e-e92eecdac2e1 req-b0c81f8f-77c7-4f1e-a86c-822ad4fbc95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0c904b-7d1f-4b67-8155-61b69ecd2fb1", "tag": "822fa3d3-b268-4877-ab15-871e778860d4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:45.924405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-24366e5a-8cfb-4b90-b32e-e92eecdac2e1 req-b0c81f8f-77c7-4f1e-a86c-822ad4fbc95f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:45.924900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-24366e5a-8cfb-4b90-b32e-e92eecdac2e1 req-b0c81f8f-77c7-4f1e-a86c-822ad4fbc95f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:45.925374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-24366e5a-8cfb-4b90-b32e-e92eecdac2e1 req-b0c81f8f-77c7-4f1e-a86c-822ad4fbc95f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:45.949237 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-24366e5a-8cfb-4b90-b32e-e92eecdac2e1 req-b0c81f8f-77c7-4f1e-a86c-822ad4fbc95f service nova] Creating event network-changed:822fa3d3-b268-4877-ab15-871e778860d4 for instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 on n-h2-862416-4 Oct 26 05:43:45.955374 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-24366e5a-8cfb-4b90-b32e-e92eecdac2e1 req-b0c81f8f-77c7-4f1e-a86c-822ad4fbc95f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058149 Oct 26 05:43:45.956773 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3285/6560] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:43:46.773268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:46.773951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:46.781306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:46.781670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:46.782137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:46.782856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:46.783325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:46.783994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:46.930759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d31ade3d-3011-4502-a85d-1b36a9eeeb74 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Action: 'create', calling method: .version_select at 0x7f4709eb6820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1161989573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4G8b+SsdGGtY3RK+GaxCIRhJVz10v4gHNjGfRGjB5FFAulipWh6qyjLoDN3ofZtmHvEbe4voLBvmb5/Ne26eU6pCYAeSBb1fp8Jk2wnEjpHoWqlE3+YrVO0LK+XjVjbA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:46.952326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:46.954345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d31ade3d-3011-4502-a85d-1b36a9eeeb74 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Getting quotas for project 6ba0fcdb422b4bdb82c7dbbfed8d1974. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:43:46.961521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a3e3cdf-c2a7-43b0-93bd-449a475f7778 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.192270 Oct 26 05:43:46.962556 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3286/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:46 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:46.966632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-d31ade3d-3011-4502-a85d-1b36a9eeeb74 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Getting quotas for user bccf4d081c8340bbbc6d449ecfd71585 and project 6ba0fcdb422b4bdb82c7dbbfed8d1974. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:43:46.995402 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d31ade3d-3011-4502-a85d-1b36a9eeeb74 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.256923 Oct 26 05:43:46.996271 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3276/6562] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:43:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:43:47.985796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:47.986430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:47.993274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:47.993820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:47.994283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:47.995025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:47.995507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:47.996556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:48.208077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:48.219316 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7a5947b-47e3-413b-a015-f90156fee9ec tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.237389 Oct 26 05:43:48.220317 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3287/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:47 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:49.244453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:49.245284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:49.253066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:49.253754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:49.255638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:49.256352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:49.256824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:49.257256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:49.592569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:49.602733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-29a9ea99-dcbd-4a94-82db-aebe2390bb9f tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.362266 Oct 26 05:43:49.603302 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3277/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:49 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:50.627915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:50.629583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:50.647119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:50.647823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:50.648401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:50.649251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:50.649856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:50.650548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:50.904067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:50.921306 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-62f738c9-3417-474e-b2f5-e71211324a82 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.296874 Oct 26 05:43:50.932558 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3288/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:50 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:51.947034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:51.947786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:51.971521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:51.973963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:51.974448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:51.975225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:51.975702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:51.976344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:52.298034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:52.307532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57e994c9-9cde-459b-8444-56ba8643e009 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.364607 Oct 26 05:43:52.309350 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3278/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:51 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:52.444967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:52.453405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:43:52.553567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-59a4cc23-b5ea-4080-903b-b682fbddf056 req-25b7db1d-8ed8-4a2c-8980-1841a21b5aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c904b-7d1f-4b67-8155-61b69ecd2fb1", "name": "network-vif-plugged", "status": "completed", "tag": "822fa3d3-b268-4877-ab15-871e778860d4"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:52.565442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-59a4cc23-b5ea-4080-903b-b682fbddf056 req-25b7db1d-8ed8-4a2c-8980-1841a21b5aac service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:52.565950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-59a4cc23-b5ea-4080-903b-b682fbddf056 req-25b7db1d-8ed8-4a2c-8980-1841a21b5aac service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:52.566402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-59a4cc23-b5ea-4080-903b-b682fbddf056 req-25b7db1d-8ed8-4a2c-8980-1841a21b5aac service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:52.588384 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-59a4cc23-b5ea-4080-903b-b682fbddf056 req-25b7db1d-8ed8-4a2c-8980-1841a21b5aac service nova] Creating event network-vif-plugged:822fa3d3-b268-4877-ab15-871e778860d4 for instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 on n-h2-862416-4 Oct 26 05:43:52.601120 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-59a4cc23-b5ea-4080-903b-b682fbddf056 req-25b7db1d-8ed8-4a2c-8980-1841a21b5aac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178786 Oct 26 05:43:52.601829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3289/6567] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:43:53.333985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:53.335238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:53.350162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:53.350678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:53.351129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:53.351867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:53.352340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:53.352776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:53.618174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:53.628369 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3fca3e2f-4b63-4380-944c-5151bf37fb63 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1319 microversion: 2.1 time: 0.298244 Oct 26 05:43:53.632858 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3279/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:53 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:54.657049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:54.658288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:54.665471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:54.671343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:54.672500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:54.674359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:54.676095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:54.676804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:54.694097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-913600035-access_point-708827777", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "00885ed7-dd32-4f70-b2f7-6c776f8b4fa1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1161989573", "security_groups": [{"name": "tempest-secgroup_access--1481606718"}, {"name": "tempest-secgroup_general--27509664"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:54.919768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:54.927817 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2b0510dd-5337-4060-8e25-c10b818b0ba7 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1509 microversion: 2.1 time: 0.276321 Oct 26 05:43:54.942270 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3290/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:54 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:54.954020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93844f12-9c32-4a7a-a3f1-16521783c05f", "device": "/dev/sdb"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:54.956541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:54.962832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:54.963600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:54.964234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:54.965754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:54.966231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:54.966858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:54.988292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] validate_networks() for [('00885ed7-dd32-4f70-b2f7-6c776f8b4fa1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:43:55.297358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9f0f79b-bb7e-48b1-a5a9-84f31cbb7de8 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "POST /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346561 Oct 26 05:43:55.313169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3291/6570] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 05:43:54 2022] POST /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:43:55.607438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:43:55.608084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:43:55.608657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:43:55.609193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:43:55.609746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:43:55.622467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:55.623111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:55.623804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:55.624654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:55.625280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:55.625792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:55.647661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Getting quotas for project 6ba0fcdb422b4bdb82c7dbbfed8d1974. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:43:55.655771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Getting quotas for user bccf4d081c8340bbbc6d449ecfd71585 and project 6ba0fcdb422b4bdb82c7dbbfed8d1974. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:43:55.671942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:43:55.675669 n-d-862416-4 devstack@n-api.service[120586]: WARNING nova.utils [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-913600035-access_point-708827777 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-913600035-acc Oct 26 05:43:55.676718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:43:55.755889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-009b6a66-9017-4c3f-99f6-33c45c718592 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.065650 Oct 26 05:43:55.758803 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3280/6571] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:43:54 2022] POST /compute/v2.1/servers => generated 456 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:43:55.772745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60720815-4159-4182-9b5a-ba6be9ce4316 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:55.773624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-60720815-4159-4182-9b5a-ba6be9ce4316 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:55.882311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-60720815-4159-4182-9b5a-ba6be9ce4316 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:55.891217 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60720815-4159-4182-9b5a-ba6be9ce4316 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1293 microversion: 2.1 time: 0.124613 Oct 26 05:43:55.892123 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3292/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:55 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:56.917958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:56.919076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:56.944467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:56.945538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:56.946286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:56.947404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:56.948449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:56.950017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:57.079952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:57.099723 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-88c135d3-155c-4085-800d-202ff15af54b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1289 microversion: 2.1 time: 0.187971 Oct 26 05:43:57.100618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3281/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:56 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1289 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:58.127139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:58.127960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:58.140820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:58.141393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:58.143742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:58.145429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:58.145919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:58.147530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:58.282938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:58.294977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f20d4d7d-5340-484c-99f8-4bffbd2a7827 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1351 microversion: 2.1 time: 0.172741 Oct 26 05:43:58.310524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3293/6574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:58 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1351 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:59.323138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:43:59.324987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:43:59.333589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:59.334541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:59.335299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:59.336919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:59.337856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:59.338719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:59.582111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:43:59.607263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d77b2d9-21d2-4fe6-ae69-78413b8f745e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1469 microversion: 2.1 time: 0.289633 Oct 26 05:43:59.607868 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3282/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:43:59 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:43:59.676388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-49c3c717-8018-40c7-93d1-12cfd550ae44 req-ccac2c4e-98b7-4249-8b26-2d4ebfd663ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a92592f-c4dc-4e4a-9bf7-98b4306ac260", "tag": "a8902637-743f-410c-b49b-921680d42509"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:43:59.698189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-49c3c717-8018-40c7-93d1-12cfd550ae44 req-ccac2c4e-98b7-4249-8b26-2d4ebfd663ae service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:43:59.699556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-49c3c717-8018-40c7-93d1-12cfd550ae44 req-ccac2c4e-98b7-4249-8b26-2d4ebfd663ae service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:43:59.700572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-49c3c717-8018-40c7-93d1-12cfd550ae44 req-ccac2c4e-98b7-4249-8b26-2d4ebfd663ae service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:43:59.733441 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-49c3c717-8018-40c7-93d1-12cfd550ae44 req-ccac2c4e-98b7-4249-8b26-2d4ebfd663ae service nova] Creating event network-changed:a8902637-743f-410c-b49b-921680d42509 for instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 on n-h1-862416-4 Oct 26 05:43:59.750625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-49c3c717-8018-40c7-93d1-12cfd550ae44 req-ccac2c4e-98b7-4249-8b26-2d4ebfd663ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172072 Oct 26 05:43:59.752371 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3294/6576] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:44:00.631201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:00.631916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:00.639601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:00.640105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:00.640664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:00.641527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:00.642157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:00.642866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:00.806863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:00.816032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-def6d385-5233-420d-945c-cb081ba8a98a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1469 microversion: 2.1 time: 0.188981 Oct 26 05:44:00.816763 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3283/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:00 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:01.842157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:01.843598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:01.849979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:01.850777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:01.851134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:01.851764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:01.852086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:01.852530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:02.019253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:02.030704 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57dd4ee3-8c19-4a92-8524-4709f51acdaa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1469 microversion: 2.1 time: 0.194271 Oct 26 05:44:02.031293 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3295/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:01 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:03.054090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:03.055325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:03.066986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:03.067484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:03.067951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:03.068638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:03.069101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:03.073350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:03.227027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:03.235658 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c18aeab-f033-431c-9655-8fa8b121d0a4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1469 microversion: 2.1 time: 0.185897 Oct 26 05:44:03.249343 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3284/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:03 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:04.260151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:04.260781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:04.267995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:04.268496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:04.268951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:04.269690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:04.270162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:04.270607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:04.424707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:04.434296 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8b3fa4e0-7011-4165-bfa8-eb8b9fad979d tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1469 microversion: 2.1 time: 0.177335 Oct 26 05:44:04.434948 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3296/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:04 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:04.968260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-59bdf8bc-9c97-49ae-82f1-0b556de3a636 req-4409cf43-a6b3-4936-9e04-ca72c86043a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a92592f-c4dc-4e4a-9bf7-98b4306ac260", "name": "network-vif-plugged", "status": "completed", "tag": "a8902637-743f-410c-b49b-921680d42509"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:44:04.979096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-59bdf8bc-9c97-49ae-82f1-0b556de3a636 req-4409cf43-a6b3-4936-9e04-ca72c86043a2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:04.979596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-59bdf8bc-9c97-49ae-82f1-0b556de3a636 req-4409cf43-a6b3-4936-9e04-ca72c86043a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:04.980036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-59bdf8bc-9c97-49ae-82f1-0b556de3a636 req-4409cf43-a6b3-4936-9e04-ca72c86043a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:04.992384 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-59bdf8bc-9c97-49ae-82f1-0b556de3a636 req-4409cf43-a6b3-4936-9e04-ca72c86043a2 service nova] Creating event network-vif-plugged:a8902637-743f-410c-b49b-921680d42509 for instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 on n-h1-862416-4 Oct 26 05:44:04.997792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-59bdf8bc-9c97-49ae-82f1-0b556de3a636 req-4409cf43-a6b3-4936-9e04-ca72c86043a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Oct 26 05:44:04.998615 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3285/6581] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:44:05.456792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:05.457462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:05.464628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:05.465299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:05.465793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:05.466510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:05.466989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:05.467438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:05.612093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:05.620308 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8c2de2e-7469-4c53-a2ad-7b83c4a6f711 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1469 microversion: 2.1 time: 0.167401 Oct 26 05:44:05.620973 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3297/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:05 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:06.641678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:06.642471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:06.647431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:06.648182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:06.655486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:06.655983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:06.656435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:06.657181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:06.657674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:06.658213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:06.818696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:06.828509 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e805feef-364e-492d-82b9-446326b88b90 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1640 microversion: 2.1 time: 0.187905 Oct 26 05:44:06.829091 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3286/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:06 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1640 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:06.852343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:06.852963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:06.855108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:06.861839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:06.862339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:06.862787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:06.863498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:06.863964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:06.864608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:07.023508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:07.031768 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c48fc5b2-12fd-4de9-ab30-1e1f97045ec8 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1640 microversion: 2.1 time: 0.183580 Oct 26 05:44:07.032350 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3298/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:06 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1640 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:07.055358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:07.056327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:07.064051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:07.064609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:07.065058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:07.065893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:07.066404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:07.066843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:07.348129 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf9923d6-3428-4de1-b68f-0312b153f005 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1791 microversion: 2.1 time: 0.296644 Oct 26 05:44:07.348705 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3287/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:07 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1791 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:09.619885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2028d694-f299-4333-a296-b9d1bbe66dcf req-37b6ef8a-7db5-425e-b6e3-21bcb4d23cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a92592f-c4dc-4e4a-9bf7-98b4306ac260", "tag": "a8902637-743f-410c-b49b-921680d42509"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:44:09.642170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2028d694-f299-4333-a296-b9d1bbe66dcf req-37b6ef8a-7db5-425e-b6e3-21bcb4d23cdd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:09.642936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2028d694-f299-4333-a296-b9d1bbe66dcf req-37b6ef8a-7db5-425e-b6e3-21bcb4d23cdd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:09.646297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2028d694-f299-4333-a296-b9d1bbe66dcf req-37b6ef8a-7db5-425e-b6e3-21bcb4d23cdd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:09.672617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2028d694-f299-4333-a296-b9d1bbe66dcf req-37b6ef8a-7db5-425e-b6e3-21bcb4d23cdd service nova] Creating event network-changed:a8902637-743f-410c-b49b-921680d42509 for instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 on n-h1-862416-4 Oct 26 05:44:09.683172 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2028d694-f299-4333-a296-b9d1bbe66dcf req-37b6ef8a-7db5-425e-b6e3-21bcb4d23cdd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067238 Oct 26 05:44:09.688747 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3299/6586] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:44:19.514151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:19.514652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:19.517535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:19.518201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=63 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:19.524241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:19.524733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:19.525175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:19.525916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:19.526376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:19.526803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:19.613115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lazy-loading 'services' on Instance uuid 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:44:19.687966 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42f443e2-b478-4c5c-a4d8-227ef5b07079 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1/os-volume_attachments/93844f12-9c32-4a7a-a3f1-16521783c05f" status: 202 len: 0 microversion: 2.1 time: 0.178907 Oct 26 05:44:19.688893 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3288/6587] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 05:44:19 2022] DELETE /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1/os-volume_attachments/93844f12-9c32-4a7a-a3f1-16521783c05f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:44:26.126281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:26.126865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:26.129584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=35 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:26.130238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:26.137201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:26.137797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:26.138356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:26.139061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:26.139535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:26.139974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:26.167408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:44:26.246139 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dba2fbd5-96bd-425d-b41d-c42af8b6af6d tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 204 len: 0 microversion: 2.1 time: 0.123862 Oct 26 05:44:26.249403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3300/6588] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:44:26 2022] DELETE /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:44:26.257323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:26.258052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:26.265355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:26.266099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:26.266545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:26.267449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:26.268010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:26.268472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:26.408046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:26.416334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ddb57ac-a848-42df-9203-843b276a61bb tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1515 microversion: 2.1 time: 0.164856 Oct 26 05:44:26.416930 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3289/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:26 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:27.442231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:27.443717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:27.451121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:27.452142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:27.452267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:27.452970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:27.453475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:27.453921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:27.594796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:27.602961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-65d9e729-ce3f-4e1f-9aa8-06721c2ddf30 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1515 microversion: 2.1 time: 0.165192 Oct 26 05:44:27.603536 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3301/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:27 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:28.327361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f77f0373-776e-4310-b97e-098f672bcd13 req-1665758c-4a80-4f53-b3d1-168ae3b2ac92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c904b-7d1f-4b67-8155-61b69ecd2fb1", "name": "network-vif-deleted", "tag": "822fa3d3-b268-4877-ab15-871e778860d4"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:44:28.337902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f77f0373-776e-4310-b97e-098f672bcd13 req-1665758c-4a80-4f53-b3d1-168ae3b2ac92 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:28.338396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f77f0373-776e-4310-b97e-098f672bcd13 req-1665758c-4a80-4f53-b3d1-168ae3b2ac92 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:28.338838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f77f0373-776e-4310-b97e-098f672bcd13 req-1665758c-4a80-4f53-b3d1-168ae3b2ac92 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:28.353104 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f77f0373-776e-4310-b97e-098f672bcd13 req-1665758c-4a80-4f53-b3d1-168ae3b2ac92 service nova] Creating event network-vif-deleted:822fa3d3-b268-4877-ab15-871e778860d4 for instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 on n-h2-862416-4 Oct 26 05:44:28.358591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f77f0373-776e-4310-b97e-098f672bcd13 req-1665758c-4a80-4f53-b3d1-168ae3b2ac92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035083 Oct 26 05:44:28.359436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3290/6591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:44:28.626720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:28.627371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:28.634293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:28.634791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:28.635259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:28.636304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:28.636406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:28.636836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:28.675613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:28.676023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:28.676498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:28.676956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lazy-loading 'fault' on Instance uuid 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:44:28.723230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5846c0d279e469dac3accc725e2ed0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a192618b4b4613a84a4fdbce34be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:28.731766 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2072e1f8-32af-491f-802a-2fff9c6b451b tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 200 len: 1309 microversion: 2.1 time: 0.109018 Oct 26 05:44:28.732471 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3302/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:28 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:29.756785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:29.757709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] [instance: 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:29.765430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:29.766053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:29.766351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:29.767115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:29.767631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:29.768090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:29.782850 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] HTTP exception thrown: Instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 could not be found. Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Request method failure captured: Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 HTTP/1.1 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMhf9MRcC9xgWky_HxRcI-Zf1OtuDnRyt0K3NvJ9xz1zPwCFAxLMeXOkhkIbjmGI07AJffvZu_uIoU3xfaFbNZGDstxyIUIc_LiioT1Qf5uDJ9VyaTqxTQYwicjQDEa0XykyYb5LRpELPE9S9sXCKvPUpd3thmhSXY1aNrOWHPdwuk4 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 46a192618b4b4613a84a4fdbce34be77 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331052417 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46a192618b4b4613a84a4fdbce34be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-VolumesSnapshotTestJSON-331052417 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 46a192618b4b4613a84a4fdbce34be77 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331052417 Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-VolumesSnapshotTestJSON-331052417-project Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a5846c0d279e469dac3accc725e2ed0d Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-VolumesSnapshotTestJSON-331052417-project Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 could not be found. Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '6c0c904b-7d1f-4b67-8155-61b69ecd2fb1'} Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 could not be found. Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 could not be found. Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:44:29.784783 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 could not be found. Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] Returning 404 to user: Instance 6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-599bd852-fdab-43bb-94df-1aab9219bc99 tempest-VolumesSnapshotTestJSON-331052417 tempest-VolumesSnapshotTestJSON-331052417-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1" status: 404 len: 111 microversion: 2.1 time: 0.034846 Oct 26 05:44:29.789862 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3291/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:29 2022] GET /compute/v2.1/servers/6c0c904b-7d1f-4b67-8155-61b69ecd2fb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:44:51.714987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1073755932", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "6e4be977-745d-4104-ada9-396570bc524e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1161989573", "security_groups": []}, "os:scheduler_hints": {"different_host": ["9a92592f-c4dc-4e4a-9bf7-98b4306ac260"]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:44:51.740013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:51.741070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:51.788838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] validate_networks() for [('6e4be977-745d-4104-ada9-396570bc524e', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:44:52.471389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:44:52.472270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:44:52.472854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:44:52.476380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:44:52.476944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:44:52.490119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:52.491513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:52.492147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:52.493077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:52.493762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:52.494397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:52.538552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Getting quotas for project 6ba0fcdb422b4bdb82c7dbbfed8d1974. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:44:52.544753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Getting quotas for user bccf4d081c8340bbbc6d449ecfd71585 and project 6ba0fcdb422b4bdb82c7dbbfed8d1974. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:44:52.568596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:44:52.579706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:44:52.646557 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0712f30f-d1ac-4c12-a200-97c4bb939580 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.935314 Oct 26 05:44:52.648029 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3303/6594] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:44:51 2022] POST /compute/v2.1/servers => generated 361 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:44:52.659782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e4a2f691-e47b-462b-81f0-dd86754453bb tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:52.660427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e4a2f691-e47b-462b-81f0-dd86754453bb tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:52.663016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:52.663969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:44:52.755500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e4a2f691-e47b-462b-81f0-dd86754453bb tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:52.766102 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e4a2f691-e47b-462b-81f0-dd86754453bb tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1242 microversion: 2.1 time: 0.110527 Oct 26 05:44:52.766810 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3292/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:52 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:53.792259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:53.793006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:53.806646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:53.812721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:53.813465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:53.818531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:53.820414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:53.823480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:53.944983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:53.958639 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cfb1a0ce-cd48-4190-b6fd-5c8652fb53ff tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1294 microversion: 2.1 time: 0.170218 Oct 26 05:44:53.969988 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3304/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:53 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:54.990821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:54.991928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:55.004271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:55.004779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:55.005227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:55.005982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:55.006452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:55.006892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:55.119052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:55.134501 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54ce7092-655e-4fff-a868-d97ecef781d7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.148996 Oct 26 05:44:55.150167 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3293/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:54 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:56.162774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:56.163406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:56.179463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:56.179980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:56.180436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:56.181185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:56.181679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:56.182123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:56.389523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:56.402330 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1720a9b6-b908-4983-835d-1a4b60bfc70b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.243374 Oct 26 05:44:56.408417 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3305/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:56 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:57.233733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1bc4a4b0-fc8d-45d2-9bb3-214db7199beb req-bd88c8a5-73b6-4284-a125-bb231838f00c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db309ae1-09f8-48ba-89db-f7b8841097ce", "tag": "6b84a6f8-1436-4968-b19e-27e0ea406c58"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:44:57.265931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1bc4a4b0-fc8d-45d2-9bb3-214db7199beb req-bd88c8a5-73b6-4284-a125-bb231838f00c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:57.266928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1bc4a4b0-fc8d-45d2-9bb3-214db7199beb req-bd88c8a5-73b6-4284-a125-bb231838f00c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:57.267633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1bc4a4b0-fc8d-45d2-9bb3-214db7199beb req-bd88c8a5-73b6-4284-a125-bb231838f00c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:57.280784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1bc4a4b0-fc8d-45d2-9bb3-214db7199beb req-bd88c8a5-73b6-4284-a125-bb231838f00c service nova] Creating event network-changed:6b84a6f8-1436-4968-b19e-27e0ea406c58 for instance db309ae1-09f8-48ba-89db-f7b8841097ce on n-h2-862416-4 Oct 26 05:44:57.291065 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1bc4a4b0-fc8d-45d2-9bb3-214db7199beb req-bd88c8a5-73b6-4284-a125-bb231838f00c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069386 Oct 26 05:44:57.291687 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3294/6599] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:44:57.431124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:57.432369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:57.462036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:57.462766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:57.463421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:57.464321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:57.464961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:57.465655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:57.636460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:57.662998 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ad00571-4ee5-45d6-98d4-7b880e59a5cd tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.235691 Oct 26 05:44:57.663740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3306/6600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:57 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:58.724799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:58.725871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:58.734605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:58.735330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:58.736924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:58.738074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:58.738876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:58.739385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:58.837789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:44:58.846784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1e8c3746-a244-4e1b-a365-00f3429e3d7f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.126202 Oct 26 05:44:58.848088 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3295/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:58 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:44:59.871031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:44:59.871824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:44:59.879143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:59.879658 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:59.880125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:59.880863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:44:59.881358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:44:59.881846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:44:59.999684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:00.010129 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1548f569-0e60-494f-8889-d4d8e7a6a679 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.142890 Oct 26 05:45:00.012134 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3307/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:44:59 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:01.040299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:01.041565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:01.048902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:01.049512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:01.050031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:01.050813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:01.051368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:01.052020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:01.145073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:01.153245 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fca60c48-ab68-4aa3-9e40-339cf7736507 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.117082 Oct 26 05:45:01.154055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3296/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:01 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:02.177482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:02.177482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:02.184744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:02.185354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:02.186082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:02.186975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:02.187540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:02.188030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:02.292343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:02.303097 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b885541-a73c-46cd-b0a8-dea497bca31f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.130204 Oct 26 05:45:02.319582 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3308/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:02 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:03.328337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:03.329086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:03.332221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:03.340947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:03.342925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:03.349188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:03.351610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:03.352269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:03.354390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:03.473847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:03.486123 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1934df8e-4c6e-4a93-b715-2230afa8850a tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.161784 Oct 26 05:45:03.487977 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3297/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:03 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:04.415672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-23709e21-543b-492b-9239-edd7b6295e32 req-9168799d-40b2-4c95-bf47-fdd8a2a80891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db309ae1-09f8-48ba-89db-f7b8841097ce", "name": "network-vif-plugged", "status": "completed", "tag": "6b84a6f8-1436-4968-b19e-27e0ea406c58"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:04.422365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:04.423161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:04.429253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-23709e21-543b-492b-9239-edd7b6295e32 req-9168799d-40b2-4c95-bf47-fdd8a2a80891 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:04.430120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-23709e21-543b-492b-9239-edd7b6295e32 req-9168799d-40b2-4c95-bf47-fdd8a2a80891 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:04.430848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-23709e21-543b-492b-9239-edd7b6295e32 req-9168799d-40b2-4c95-bf47-fdd8a2a80891 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:04.446412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-23709e21-543b-492b-9239-edd7b6295e32 req-9168799d-40b2-4c95-bf47-fdd8a2a80891 service nova] Creating event network-vif-plugged:6b84a6f8-1436-4968-b19e-27e0ea406c58 for instance db309ae1-09f8-48ba-89db-f7b8841097ce on n-h2-862416-4 Oct 26 05:45:04.453838 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-23709e21-543b-492b-9239-edd7b6295e32 req-9168799d-40b2-4c95-bf47-fdd8a2a80891 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042050 Oct 26 05:45:04.454447 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3309/6606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:04.510673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:04.511860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:04.520502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:04.521300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:04.522078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:04.523067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:04.539562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:04.540048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:04.646530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:04.655490 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a3c2cd1f-0cbe-49bf-a58c-10af0975d5ea tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.148671 Oct 26 05:45:04.656075 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3298/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:04 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:05.680199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:05.680851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:05.689516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:05.690025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:05.690661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:05.691578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:05.692017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:05.692484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:05.793304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:05.820884 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-18822a27-b9e2-4b41-81d4-901f2fed2ed3 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1300 microversion: 2.1 time: 0.144404 Oct 26 05:45:05.821524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3310/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:05 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:06.847584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:06.848220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:06.866445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:06.866963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:06.867419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:06.868144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:06.870051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:06.871289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.005811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:07.015218 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-766a9091-7bdd-45bc-93ec-4e7c78fe3120 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1473 microversion: 2.1 time: 0.173136 Oct 26 05:45:07.016082 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3299/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:06 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1473 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:07.039138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:07.041158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:07.048461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.048969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.049584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.050467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.051077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.051680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.217081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:07.235734 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0da4ea49-a0af-4e93-bd3a-134abd37b15e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1473 microversion: 2.1 time: 0.198173 Oct 26 05:45:07.239240 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3311/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:07 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1473 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:07.266051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:07.266577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:07.276878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.281418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.285006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.286160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.286946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.288146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.391347 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a96047ad-c2e7-4c53-b6f2-74ba474bdfe5 tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1624 microversion: 2.1 time: 0.129994 Oct 26 05:45:07.397411 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3300/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:07 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1624 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:07.413967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:07.414837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:07.422235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.422743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.423820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.424655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.425088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.425686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.576116 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ddc41ff6-e0e9-4bb9-87eb-8b80ad9e99df tempest-TestSecurityGroupsBasicOps-561666104 tempest-TestSecurityGroupsBasicOps-561666104-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1910 microversion: 2.1 time: 0.165920 Oct 26 05:45:07.576743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3312/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:07 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1910 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:07.644400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:07.644912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:07.651118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.651615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.652065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.652768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.653239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.653714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.683066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:45:07.774772 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8389b9ea-3e08-42d2-9d8a-05e138be4baa tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 204 len: 0 microversion: 2.1 time: 0.133693 Oct 26 05:45:07.776350 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3301/6613] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:45:07 2022] DELETE /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:45:07.786177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:07.787199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:07.793546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.794198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.794857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.796698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:07.797496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:07.798110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:07.885055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:07.893956 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6ab1a38b-f8e5-471b-a8ab-a8815a7a2510 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1479 microversion: 2.1 time: 0.112313 Oct 26 05:45:07.894530 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3313/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:07 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1479 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:08.918136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:08.918956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:08.926134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:08.926623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:08.927058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:08.927776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:08.928233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:08.928694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:09.018952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:09.028824 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-493e4b4e-7fea-4e48-9103-bf1e548199b6 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1479 microversion: 2.1 time: 0.114995 Oct 26 05:45:09.030388 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3302/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:08 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1479 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:09.725715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3f35fdf0-bb1e-4f6b-9679-958d4de55139 req-ae00f2f6-6b48-4bd3-bb6e-d2939437f5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db309ae1-09f8-48ba-89db-f7b8841097ce", "name": "network-vif-deleted", "tag": "6b84a6f8-1436-4968-b19e-27e0ea406c58"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:09.739806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3f35fdf0-bb1e-4f6b-9679-958d4de55139 req-ae00f2f6-6b48-4bd3-bb6e-d2939437f5b3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:09.740550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3f35fdf0-bb1e-4f6b-9679-958d4de55139 req-ae00f2f6-6b48-4bd3-bb6e-d2939437f5b3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:09.741000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3f35fdf0-bb1e-4f6b-9679-958d4de55139 req-ae00f2f6-6b48-4bd3-bb6e-d2939437f5b3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:09.753650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3f35fdf0-bb1e-4f6b-9679-958d4de55139 req-ae00f2f6-6b48-4bd3-bb6e-d2939437f5b3 service nova] Creating event network-vif-deleted:6b84a6f8-1436-4968-b19e-27e0ea406c58 for instance db309ae1-09f8-48ba-89db-f7b8841097ce on n-h2-862416-4 Oct 26 05:45:09.758704 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3f35fdf0-bb1e-4f6b-9679-958d4de55139 req-ae00f2f6-6b48-4bd3-bb6e-d2939437f5b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037278 Oct 26 05:45:09.759898 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3314/6616] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:10.054109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:10.054761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:10.062535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:10.063033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:10.063479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:10.064223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:10.064682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:10.065110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:10.098589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:10.099080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:10.099525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:10.099979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lazy-loading 'fault' on Instance uuid db309ae1-09f8-48ba-89db-f7b8841097ce {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:45:10.144559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:10.154118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01177cc3-70a1-4837-9eda-c8bc17e555c4 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 200 len: 1332 microversion: 2.1 time: 0.102894 Oct 26 05:45:10.157333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3303/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:10 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:11.183747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:11.184745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: db309ae1-09f8-48ba-89db-f7b8841097ce] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:11.191420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:11.191936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:11.192390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:11.193110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:11.193605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:11.194062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:11.209007 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] HTTP exception thrown: Instance db309ae1-09f8-48ba-89db-f7b8841097ce could not be found. Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Request method failure captured: Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce HTTP/1.1 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMkRhtnK0-guy2JpaWjBnTWzQgCAuiKfJjErAbFpIHnBLZEcmizxq01wY8kfTTKObCD2h4FXpkD3ECpx6oryR-VPP_HrsvqciMrextMOaGMiZdkXa_UJJuxqjrJOr1mKcWBV2K8fQFTurxcjVuN4BvWBPVcULr2uhdlC7CT4_SMlUuI Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ba0fcdb422b4bdb82c7dbbfed8d1974 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-913600035 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestSecurityGroupsBasicOps-913600035 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ba0fcdb422b4bdb82c7dbbfed8d1974 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-913600035 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestSecurityGroupsBasicOps-913600035-project Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: bccf4d081c8340bbbc6d449ecfd71585 Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestSecurityGroupsBasicOps-913600035-project Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance db309ae1-09f8-48ba-89db-f7b8841097ce could not be found. Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'db309ae1-09f8-48ba-89db-f7b8841097ce'} Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db309ae1-09f8-48ba-89db-f7b8841097ce could not be found. Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db309ae1-09f8-48ba-89db-f7b8841097ce could not be found. Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:45:11.210722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db309ae1-09f8-48ba-89db-f7b8841097ce could not be found. Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Returning 404 to user: Instance db309ae1-09f8-48ba-89db-f7b8841097ce could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bfe7d2be-43a3-4ee0-bb2a-bcafa41d2ed7 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce" status: 404 len: 111 microversion: 2.1 time: 0.033997 Oct 26 05:45:11.214347 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3315/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:11 2022] GET /compute/v2.1/servers/db309ae1-09f8-48ba-89db-f7b8841097ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:45:17.194777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e5f25470-3840-4f3b-ae9e-2c20d4d46483 req-842f74ba-e580-4d5f-9725-71333fdf0861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a92592f-c4dc-4e4a-9bf7-98b4306ac260", "tag": "a8902637-743f-410c-b49b-921680d42509"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:17.196506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:17.198996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:17.217250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:17.218277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:17.219408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:17.220378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:17.223879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e5f25470-3840-4f3b-ae9e-2c20d4d46483 req-842f74ba-e580-4d5f-9725-71333fdf0861 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:17.224642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e5f25470-3840-4f3b-ae9e-2c20d4d46483 req-842f74ba-e580-4d5f-9725-71333fdf0861 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:17.225185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:17.225547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e5f25470-3840-4f3b-ae9e-2c20d4d46483 req-842f74ba-e580-4d5f-9725-71333fdf0861 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:17.226402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:17.240858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e5f25470-3840-4f3b-ae9e-2c20d4d46483 req-842f74ba-e580-4d5f-9725-71333fdf0861 service nova] Creating event network-changed:a8902637-743f-410c-b49b-921680d42509 for instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 on n-h1-862416-4 Oct 26 05:45:17.247862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e5f25470-3840-4f3b-ae9e-2c20d4d46483 req-842f74ba-e580-4d5f-9725-71333fdf0861 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056045 Oct 26 05:45:17.248964 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3316/6619] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:17.272208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:45:17.402966 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-852719b2-3d44-4572-accb-8cf00e4a862b tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 204 len: 0 microversion: 2.1 time: 0.217085 Oct 26 05:45:17.404334 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3304/6620] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:45:17 2022] DELETE /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:45:17.413632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:17.414380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:17.421323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:17.422184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:17.422941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:17.423833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:17.424546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:17.425147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:17.675039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:17.687200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b7bf2d24-cca4-42a0-8093-d9748e7f8523 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1765 microversion: 2.1 time: 0.277114 Oct 26 05:45:17.687994 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3317/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:17 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1765 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:18.712356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:18.713093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:18.721431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:18.722000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:18.722513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:18.723281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:18.724056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:18.724657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:18.924479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:18.932716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78f06dff-b109-4dda-b099-918c1d0f089e tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1765 microversion: 2.1 time: 0.224717 Oct 26 05:45:18.933659 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3305/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:18 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1765 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:19.619159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e51880fa-463a-463e-ad1b-da7951297728 req-f0167ada-9d26-4529-a58a-fd81c976ca84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a92592f-c4dc-4e4a-9bf7-98b4306ac260", "name": "network-vif-deleted", "tag": "a8902637-743f-410c-b49b-921680d42509"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:19.631143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e51880fa-463a-463e-ad1b-da7951297728 req-f0167ada-9d26-4529-a58a-fd81c976ca84 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:19.631973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e51880fa-463a-463e-ad1b-da7951297728 req-f0167ada-9d26-4529-a58a-fd81c976ca84 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:19.632501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e51880fa-463a-463e-ad1b-da7951297728 req-f0167ada-9d26-4529-a58a-fd81c976ca84 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:19.647763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e51880fa-463a-463e-ad1b-da7951297728 req-f0167ada-9d26-4529-a58a-fd81c976ca84 service nova] Creating event network-vif-deleted:a8902637-743f-410c-b49b-921680d42509 for instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 on n-h1-862416-4 Oct 26 05:45:19.652700 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e51880fa-463a-463e-ad1b-da7951297728 req-f0167ada-9d26-4529-a58a-fd81c976ca84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037217 Oct 26 05:45:19.653331 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3318/6623] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:19.958754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:19.959957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:19.967675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:19.968524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:19.969201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:19.970196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:19.970892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:19.971616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:19.997247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:20.016970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:20.017770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:20.018454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:20.019139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lazy-loading 'fault' on Instance uuid 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:45:20.092003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccf4d081c8340bbbc6d449ecfd71585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba0fcdb422b4bdb82c7dbbfed8d1974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:20.116250 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a37236a-10e5-400a-82f3-6849a870d82f tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 200 len: 1383 microversion: 2.1 time: 0.161263 Oct 26 05:45:20.116990 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3306/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:19 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 1383 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:21.142299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:21.143112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] [instance: 9a92592f-c4dc-4e4a-9bf7-98b4306ac260] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:21.149856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:21.150602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:21.151237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:21.152293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:21.152776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:21.153250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:21.180208 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] HTTP exception thrown: Instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 could not be found. Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Request method failure captured: Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 HTTP/1.1 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMkRhtnK0-guy2JpaWjBnTWzQgCAuiKfJjErAbFpIHnBLZEcmizxq01wY8kfTTKObCD2h4FXpkD3ECpx6oryR-VPP_HrsvqciMrextMOaGMiZdkXa_UJJuxqjrJOr1mKcWBV2K8fQFTurxcjVuN4BvWBPVcULr2uhdlC7CT4_SMlUuI Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ba0fcdb422b4bdb82c7dbbfed8d1974 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-913600035 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ba0fcdb422b4bdb82c7dbbfed8d1974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestSecurityGroupsBasicOps-913600035 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ba0fcdb422b4bdb82c7dbbfed8d1974 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-913600035 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestSecurityGroupsBasicOps-913600035-project Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: bccf4d081c8340bbbc6d449ecfd71585 Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestSecurityGroupsBasicOps-913600035-project Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 could not be found. Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '9a92592f-c4dc-4e4a-9bf7-98b4306ac260'} Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 could not be found. Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 could not be found. Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:45:21.182043 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 could not be found. Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Returning 404 to user: Instance 9a92592f-c4dc-4e4a-9bf7-98b4306ac260 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70ec59ef-1944-4fa7-b81c-5daa8d03e1d5 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260" status: 404 len: 111 microversion: 2.1 time: 0.047139 Oct 26 05:45:21.187881 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3319/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:21 2022] GET /compute/v2.1/servers/9a92592f-c4dc-4e4a-9bf7-98b4306ac260 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:45:26.290459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f92ab5d4-5ec0-49a1-b56b-d0a293f51987 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] Calling method '.version_select at 0x7f4709eea040>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:26.313851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:26.330932 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f92ab5d4-5ec0-49a1-b56b-d0a293f51987 tempest-TestSecurityGroupsBasicOps-913600035 tempest-TestSecurityGroupsBasicOps-913600035-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1161989573" status: 202 len: 0 microversion: 2.1 time: 0.045564 Oct 26 05:45:26.332867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3307/6626] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 26 05:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1161989573 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:45:26.712077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-013d6559-2bb5-47a8-9d64-f79430babc79 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: .version_select at 0x7f470944b310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-372627087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2m8L84TWVKrs5FWpRtluKirN1Tlz0g6+0Z7deYUxXFFYj+x3sjJ2E6EcE/avwHzY5ABfdgMNglAnjBaGVwJXAjSNRdR7e0dTGXZ/Rrl8Lv3/7fOvfrjs6htj1vPJG3xQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:26.719758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:26.734731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-013d6559-2bb5-47a8-9d64-f79430babc79 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:45:26.743583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-013d6559-2bb5-47a8-9d64-f79430babc79 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:45:26.788436 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-013d6559-2bb5-47a8-9d64-f79430babc79 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.336282 Oct 26 05:45:26.797116 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3320/6627] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:45:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:36.999462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:37.004389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1762252926", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "af849784-8c75-49fb-b4cf-cc9be5836300"}], "key_name": "tempest-TestNetworkAdvancedServerOps-372627087", "security_groups": [{"name": "tempest-secgroup-smoke-173391310"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:37.218903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] validate_networks() for [('af849784-8c75-49fb-b4cf-cc9be5836300', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:45:37.791053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=74 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:37.791874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:37.792716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:38.009670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:45:38.010177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:45:38.010668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:45:38.011215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:45:38.011747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:45:38.036022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:38.036529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:38.036986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:38.037762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:38.038236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:38.038682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:38.056751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:38.058520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:38.059202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:38.059818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:38.061015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:38.062217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:38.064381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:38.075025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:45:38.082423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:45:38.101534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:45:38.104808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:45:38.128499 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03a541c2-afa4-4fd5-bd9f-922706b56f43 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.343491 Oct 26 05:45:38.131241 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3321/6628] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 26 05:45:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:45:38.185902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0382f59c-db3f-444e-a35b-5cfa4b38bd56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.188639 Oct 26 05:45:38.193668 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3308/6629] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:45:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:45:38.199359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b89e10e-6638-4a0d-af49-c29b16529f36 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:38.200349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b89e10e-6638-4a0d-af49-c29b16529f36 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:38.284172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-226327218", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "availability_zone": "nova:n-h1-862416-4", "networks": [{"uuid": "fc3f0d67-5dee-4df8-8b43-0d88302df422"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:38.320338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b89e10e-6638-4a0d-af49-c29b16529f36 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:38.328532 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b89e10e-6638-4a0d-af49-c29b16529f36 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1266 microversion: 2.1 time: 0.133826 Oct 26 05:45:38.333286 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3322/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:38 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:38.409959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] validate_networks() for [('fc3f0d67-5dee-4df8-8b43-0d88302df422', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:45:39.051507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:45:39.052215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:45:39.052540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:45:39.052964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:45:39.053516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:45:39.070302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:39.070806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:39.071248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:39.078651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:39.079548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:39.079997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:39.106826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Getting quotas for project a923be3ee6cd4579887879c9408d3bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:45:39.114455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Getting quotas for user 09767d40c4f640f19b0c5acd5b2c6bab and project a923be3ee6cd4579887879c9408d3bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:45:39.140220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:45:39.142570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:45:39.241079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-af700c0f-6290-4757-bbd6-f693db3ebf85 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961998 Oct 26 05:45:39.246973 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3309/6631] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:45:39.279899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50fe296e-d886-4811-977f-c9042d910cd5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:39.281146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50fe296e-d886-4811-977f-c9042d910cd5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:39.353963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:39.354779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:39.363858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:39.368064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:39.369868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:39.370789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:39.375151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:39.375759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:39.429067 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50fe296e-d886-4811-977f-c9042d910cd5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1328 microversion: 2.1 time: 0.174766 Oct 26 05:45:39.434430 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3323/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:39 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:39.579817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:39.590116 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d900576-54dc-4053-9453-bd6d2dd56a1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1262 microversion: 2.1 time: 0.240636 Oct 26 05:45:39.591036 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3310/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:39 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1262 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:40.462303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:40.463020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:40.471258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.472096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.472785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.473837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.474504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.475149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.596162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:40.596683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:40.603601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.604161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.604665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.605431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.605920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.606373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.636786 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da7cf8b0-331b-4c60-95ed-23a3369a25ae tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1415 microversion: 2.1 time: 0.178279 Oct 26 05:45:40.637702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3311/6634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:40 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1415 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:40.644869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:40.648845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:40.657908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:45:40.664226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.664989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.665465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.666635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.667897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.668582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.761497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:40.770298 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5bb21663-de98-4542-8722-4c864e459dac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 204 len: 0 microversion: 2.1 time: 0.382427 Oct 26 05:45:40.774140 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3324/6635] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:45:40 2022] DELETE /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:45:40.775164 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-28e4864b-6992-4fcd-b223-65d70885e1bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1324 microversion: 2.1 time: 0.136178 Oct 26 05:45:40.776085 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3312/6636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:40 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1324 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:40.783117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:40.784195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:40.791346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.791850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.792357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:40.793416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:40.797451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:40.798755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:41.005028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:41.014157 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3a6e764-2386-4f1c-bd0c-53b419c3bf2b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1579 microversion: 2.1 time: 0.237963 Oct 26 05:45:41.015643 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3325/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:40 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1579 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:41.660867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:41.661612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:41.672165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:41.673006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:41.673782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:41.674996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:41.675813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:41.676585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:41.783812 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f089bc2e-9646-4483-817f-9d3a9e98777a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1423 microversion: 2.1 time: 0.126776 Oct 26 05:45:41.784416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3313/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:41 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1423 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:41.802637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:41.803268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:41.818257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:41.818764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:41.819398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:41.820132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:41.820605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:41.821050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:42.040208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:42.041654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:42.049704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:42.050615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:42.051565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:42.059434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:42.063478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:42.064626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:42.065368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:42.084700 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-20d42f4c-4442-42c3-9dca-8e01a8895f51 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.286204 Oct 26 05:45:42.090444 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3326/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:41 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:42.381933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:42.392387 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e24bb09f-904b-4cf9-8dab-ff36f1c139db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1579 microversion: 2.1 time: 0.355944 Oct 26 05:45:42.397861 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3314/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:42 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1579 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:42.423743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-65cc4280-8321-41fa-a0fd-883471eb60fd req-2c1eb3b9-a4f9-413b-88f5-5cdad8594bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:42.439975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65cc4280-8321-41fa-a0fd-883471eb60fd req-2c1eb3b9-a4f9-413b-88f5-5cdad8594bc8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:42.440737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65cc4280-8321-41fa-a0fd-883471eb60fd req-2c1eb3b9-a4f9-413b-88f5-5cdad8594bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:42.441753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65cc4280-8321-41fa-a0fd-883471eb60fd req-2c1eb3b9-a4f9-413b-88f5-5cdad8594bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:42.475712 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-65cc4280-8321-41fa-a0fd-883471eb60fd req-2c1eb3b9-a4f9-413b-88f5-5cdad8594bc8 service nova] Creating event network-changed:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h2-862416-4 Oct 26 05:45:42.485635 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-65cc4280-8321-41fa-a0fd-883471eb60fd req-2c1eb3b9-a4f9-413b-88f5-5cdad8594bc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066250 Oct 26 05:45:42.486580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3327/6641] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:42.824404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:42.825613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:42.836666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:42.837603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:42.838376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:42.839535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:42.840289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:42.841129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:42.953996 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dab0f2ee-2680-4626-b70e-f1bc5c72be3f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1421 microversion: 2.1 time: 0.135957 Oct 26 05:45:42.954621 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3315/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:42 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1421 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:43.113992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:43.114725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:43.120892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:43.121435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:43.121900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:43.122620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:43.123094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:43.123545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:43.266061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:43.274024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e049259-a097-4184-80e7-7e3bd8867645 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.166100 Oct 26 05:45:43.274600 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3328/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:43 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:43.416057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:43.416751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:43.424447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:43.424943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:43.425411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:43.426112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:43.426572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:43.427002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:43.591116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:43.601975 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c406be95-e4ee-45d4-b83b-28f097aaffe0 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1579 microversion: 2.1 time: 0.189538 Oct 26 05:45:43.602954 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3316/6644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:43 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:43.978266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:43.978968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:43.986375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:43.987194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:43.987687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:43.988410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:43.988886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:43.989354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:44.131684 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-63274ff0-15ea-408a-a914-de021895cf2c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.157630 Oct 26 05:45:44.133659 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3329/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:43 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:44.207854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-35e4a6ef-5dcf-4e69-8626-0aa267092803 req-0e2e4327-6be4-4709-b572-c9ae747d5378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e7fc98-b839-43fb-9934-f73057f52a6b", "name": "network-vif-deleted", "tag": "ff06fa0a-40c0-45db-a806-dc2a9d27ac60"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:44.230526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-35e4a6ef-5dcf-4e69-8626-0aa267092803 req-0e2e4327-6be4-4709-b572-c9ae747d5378 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:44.231687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-35e4a6ef-5dcf-4e69-8626-0aa267092803 req-0e2e4327-6be4-4709-b572-c9ae747d5378 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:44.232329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-35e4a6ef-5dcf-4e69-8626-0aa267092803 req-0e2e4327-6be4-4709-b572-c9ae747d5378 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:44.252290 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-35e4a6ef-5dcf-4e69-8626-0aa267092803 req-0e2e4327-6be4-4709-b572-c9ae747d5378 service nova] Creating event network-vif-deleted:ff06fa0a-40c0-45db-a806-dc2a9d27ac60 for instance 92e7fc98-b839-43fb-9934-f73057f52a6b on n-h1-862416-4 Oct 26 05:45:44.261646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-35e4a6ef-5dcf-4e69-8626-0aa267092803 req-0e2e4327-6be4-4709-b572-c9ae747d5378 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056440 Oct 26 05:45:44.263594 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3317/6646] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:44.306482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:44.309716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:44.331280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:44.335967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:44.336899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:44.339114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:44.341220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:44.341965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:44.536977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:44.546139 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab003bc9-9cbd-4bd7-a19c-c60d72c69971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.252097 Oct 26 05:45:44.564643 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3330/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:44 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:44.633341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:44.634262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:44.643143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:44.643966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:44.644671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:44.645585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:44.646266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:44.647274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:44.734715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:44.747090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cdcc37d-3541-4d7b-b981-be7f5ed8458e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1226 microversion: 2.1 time: 0.117548 Oct 26 05:45:44.747948 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3318/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:44 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:45.157269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:45.157927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:45.176077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:45.177264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:45.178709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:45.179628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:45.183865 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:45.184497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:45.423784 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2ce03ba2-4d4e-4838-9fca-f82bf7059cca tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.271493 Oct 26 05:45:45.426476 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3331/6649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:45 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:45.572668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:45.574166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:45.583920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:45.584768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:45.585476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:45.586426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:45.587090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:45.587930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:45.773230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:45.774529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:45.782303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:45.783249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:45.783712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:45.784938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:45.785380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:45.785828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:45.799682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:45.809075 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa8b38a5-de36-41bc-86b8-553d6376393f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.241298 Oct 26 05:45:45.812301 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3319/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:45 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:45.864350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:45.872945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed794ed5-13aa-4be3-a143-9dfedc9c2e54 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1226 microversion: 2.1 time: 0.103973 Oct 26 05:45:45.873759 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3332/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:45 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:46.283747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-2d082e5b-8ddd-4c20-8abb-86744670a827 req-3b4ed41d-84a9-4ed3-8ab9-625dc4fcded3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcadaea4-77c4-4770-9fc0-06ebccdd1bd4", "tag": "ef3da375-c62c-4901-859c-ca92c685817a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:46.294660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2d082e5b-8ddd-4c20-8abb-86744670a827 req-3b4ed41d-84a9-4ed3-8ab9-625dc4fcded3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:46.295159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2d082e5b-8ddd-4c20-8abb-86744670a827 req-3b4ed41d-84a9-4ed3-8ab9-625dc4fcded3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:46.295605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-2d082e5b-8ddd-4c20-8abb-86744670a827 req-3b4ed41d-84a9-4ed3-8ab9-625dc4fcded3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:46.313857 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-2d082e5b-8ddd-4c20-8abb-86744670a827 req-3b4ed41d-84a9-4ed3-8ab9-625dc4fcded3 service nova] Creating event network-changed:ef3da375-c62c-4901-859c-ca92c685817a for instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 on n-h1-862416-4 Oct 26 05:45:46.332524 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-2d082e5b-8ddd-4c20-8abb-86744670a827 req-3b4ed41d-84a9-4ed3-8ab9-625dc4fcded3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058280 Oct 26 05:45:46.333576 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3320/6652] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:46.447632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:46.448796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:46.459533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:46.460041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:46.460507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:46.461243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:46.465937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:46.466608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:46.833263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:46.834007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:46.848427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:46.848923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:46.849663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:46.850384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:46.850845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:46.851338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:47.250259 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73ca33a0-89b2-4438-a189-33fa1cdf6d9a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.806370 Oct 26 05:45:47.254829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3333/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:46 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:47.270775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:47.271771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:47.280968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:47.282187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:47.282882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:47.284779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:47.285556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:47.286118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:47.318118 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:47.330730 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3db4ab3f-240d-416c-8b9b-69526d4e6f2b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.501616 Oct 26 05:45:47.331650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3321/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:46 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:47.381341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:47.390124 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ecb24bac-387c-42d2-b0da-e8a3ba8cad49 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1226 microversion: 2.1 time: 0.132642 Oct 26 05:45:47.390962 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3334/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:47 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:48.280007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:48.281541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:48.288615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.289116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.289592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.290311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.290780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.291222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.359369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:48.360125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:48.362985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:48.370642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.371757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.372222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.372955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.373449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.373925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.428666 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ac83320-e61c-4bcc-a712-5ab5fec65fb1 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.152401 Oct 26 05:45:48.448715 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3322/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:48 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:48.456585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:48.458376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:48.466351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.467075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.468356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.469432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.470052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.470633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.541681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:48.552367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-476965e9-9cae-4d0f-b66a-809b9515bf13 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.197492 Oct 26 05:45:48.553883 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3335/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:48 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:48.574159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:48.582646 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc40afd9-7e61-4d25-8927-b6533fb5084a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 200 len: 1226 microversion: 2.1 time: 0.132504 Oct 26 05:45:48.583224 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3323/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:48 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:48.641956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-43a04fff-aad0-4f58-8f5f-9f83863e2708 req-2406214b-d780-4698-abd1-40dbbe650314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "name": "network-vif-plugged", "status": "completed", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:48.651898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-43a04fff-aad0-4f58-8f5f-9f83863e2708 req-2406214b-d780-4698-abd1-40dbbe650314 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:48.652477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-43a04fff-aad0-4f58-8f5f-9f83863e2708 req-2406214b-d780-4698-abd1-40dbbe650314 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:48.653143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-43a04fff-aad0-4f58-8f5f-9f83863e2708 req-2406214b-d780-4698-abd1-40dbbe650314 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:48.667001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-43a04fff-aad0-4f58-8f5f-9f83863e2708 req-2406214b-d780-4698-abd1-40dbbe650314 service nova] Creating event network-vif-plugged:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h2-862416-4 Oct 26 05:45:48.673426 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-43a04fff-aad0-4f58-8f5f-9f83863e2708 req-2406214b-d780-4698-abd1-40dbbe650314 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035787 Oct 26 05:45:48.674125 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3336/6659] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:49.454850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:49.455569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:49.459483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:49.460363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:49.467296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:49.467990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:49.468571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:49.469248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:49.470405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:49.470405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:49.578754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:49.579524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:49.587617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:49.597280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:49.597934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:49.599721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:49.599721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:49.599903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:49.600253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:49.635432 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-daa21da9-7329-4b68-89ec-b225ab635008 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.184125 Oct 26 05:45:49.636287 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3324/6660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:49 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:49.642543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:49.643418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:49.650510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:49.651941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:49.652710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:49.653478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:49.654216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:49.654841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:49.670038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b HTTP/1.1 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '92e7fc98-b839-43fb-9934-f73057f52a6b'} Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:45:49.672229 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:45:49.675882 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:45:49.677709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:45:49.678935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a15150b-0b2f-4260-9d28-70b2cf3bdb04 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 404 len: 111 microversion: 2.1 time: 0.041553 Oct 26 05:45:49.679524 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3325/6661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:49 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:45:49.743498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1134512636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1141262165", "security_groups": [{"name": "tempest-secgroup-smoke-632575950"}], "block_device_mapping_v2": [{"uuid": "1416099e-b305-4cee-94d7-97684f93182d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:49.759166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:49.769417 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f10ee760-5fff-4d66-84ad-33df58e5e837 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1391 microversion: 2.1 time: 0.196846 Oct 26 05:45:49.770431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3337/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:49 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:49.877138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:45:50.263856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:45:50.264286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:45:50.265483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:45:50.266075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:45:50.266501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:45:50.275477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.275967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.276411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.277151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.277648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.278079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.295219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:45:50.300511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:45:50.359626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:45:50.362224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1416099e-b305-4cee-94d7-97684f93182d',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:45:50.495039 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f113f128-3ab3-49f1-90fd-8770a9da72ac tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.757326 Oct 26 05:45:50.496413 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3326/6663] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:45:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:45:50.507446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f1f6a27-4ce5-45ac-84f5-f89162b57f34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:50.508071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f1f6a27-4ce5-45ac-84f5-f89162b57f34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:50.569491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f1f6a27-4ce5-45ac-84f5-f89162b57f34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:50.576858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f1f6a27-4ce5-45ac-84f5-f89162b57f34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1095 microversion: 2.1 time: 0.073221 Oct 26 05:45:50.578054 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3338/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:50 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:50.659351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:50.659996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:50.666465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.667014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.667458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.668212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.668675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.669108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.793891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:50.794682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:50.803209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.803804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.804334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.805129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.805716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.806244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.808303 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4ebe867-78b8-4f7a-8731-1200dcbe9b25 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.152810 Oct 26 05:45:50.809348 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3327/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:50 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:50.950139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:50.958114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1d65ff9-5981-4c4c-889f-1becfdbfa037 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1563 microversion: 2.1 time: 0.168770 Oct 26 05:45:50.958733 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3339/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:50 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:50.980814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:50.981682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:50.989447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.989977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.990471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:50.991266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:50.991620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:50.992046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:51.014753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:51.140242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:51.148424 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e93aeef6-497c-4c27-81af-5bc8563e7d28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1563 microversion: 2.1 time: 0.171558 Oct 26 05:45:51.149014 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3328/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:50 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:51.540523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-abea4d19-9e0c-4337-83c1-afe9bfef771a req-d56ab3e2-1fce-4a83-b7f9-d0a5e89259ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcadaea4-77c4-4770-9fc0-06ebccdd1bd4", "name": "network-vif-plugged", "status": "completed", "tag": "ef3da375-c62c-4901-859c-ca92c685817a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:51.554580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-abea4d19-9e0c-4337-83c1-afe9bfef771a req-d56ab3e2-1fce-4a83-b7f9-d0a5e89259ea service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:51.555319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-abea4d19-9e0c-4337-83c1-afe9bfef771a req-d56ab3e2-1fce-4a83-b7f9-d0a5e89259ea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:51.555946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-abea4d19-9e0c-4337-83c1-afe9bfef771a req-d56ab3e2-1fce-4a83-b7f9-d0a5e89259ea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:51.569617 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-abea4d19-9e0c-4337-83c1-afe9bfef771a req-d56ab3e2-1fce-4a83-b7f9-d0a5e89259ea service nova] Creating event network-vif-plugged:ef3da375-c62c-4901-859c-ca92c685817a for instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 on n-h1-862416-4 Oct 26 05:45:51.575917 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-abea4d19-9e0c-4337-83c1-afe9bfef771a req-d56ab3e2-1fce-4a83-b7f9-d0a5e89259ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Oct 26 05:45:51.576787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3340/6668] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:51.604011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:51.606490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:51.627087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:51.627898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:51.628435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:51.629248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:51.629856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:51.630377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:51.777649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:51.792870 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ea8093af-9520-41a2-a5ec-2f8a54b98f99 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1193 microversion: 2.1 time: 0.194866 Oct 26 05:45:51.794610 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3329/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:51 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1193 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:51.833929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:51.834740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:51.842149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:51.843004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:51.843621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:51.844664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:51.845288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:51.846060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:51.865418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:52.211570 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-793f8b04-6f30-41ed-9bb9-00bfabc032a6 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1463 microversion: 2.1 time: 0.382712 Oct 26 05:45:52.212616 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3341/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:51 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1463 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:52.820761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:52.822075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:52.833431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:52.834544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:52.835191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:52.836393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:52.837581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:52.838216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:52.963412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:52.971896 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7506bf4f-da2b-463e-9dad-714a5e7e42c3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1211 microversion: 2.1 time: 0.155828 Oct 26 05:45:52.973022 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3330/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:52 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:53.236104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:53.237461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:53.248026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:53.248928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:53.250697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:53.251692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:53.252502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:53.253179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:53.898507 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bae2c908-bb26-48ea-97b4-d12cd83ad457 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1647 microversion: 2.1 time: 0.667686 Oct 26 05:45:53.899298 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3342/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:53 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1647 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:53.922456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:53.923088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:53.929875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:53.930575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:53.931025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:53.931736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:53.932198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:53.932627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:53.996145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:53.996807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:54.004116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.004635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.005095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.005845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.006526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.006983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.315248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c95a467f-8061-49d9-86c1-f142d7aa88f5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1647 microversion: 2.1 time: 0.397069 Oct 26 05:45:54.316618 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3331/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:53 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1647 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:54.338031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:54.341789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:54.344546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:45:54.351676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.352569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.353257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.354297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.355054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.355688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.413803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:54.426182 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a423e6b2-361c-44b2-88e2-3ee45754c083 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1278 microversion: 2.1 time: 0.434393 Oct 26 05:45:54.427682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3343/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:53 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1278 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:54.442080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:54.443348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:54.454414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.461709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.462252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.464016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.464656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.465258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.674704 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e80b83d7-6649-4944-9706-2e545ee59d8b tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1647 microversion: 2.1 time: 0.340512 Oct 26 05:45:54.686346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3332/6675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:54 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1647 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:54.787531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d340a2df-9a6e-45d1-8e25-8ea7df267744 req-1ec089d8-e7d2-4c9d-905b-897a415a2bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:54.792714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:54.798042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d340a2df-9a6e-45d1-8e25-8ea7df267744 req-1ec089d8-e7d2-4c9d-905b-897a415a2bad service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:54.798764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d340a2df-9a6e-45d1-8e25-8ea7df267744 req-1ec089d8-e7d2-4c9d-905b-897a415a2bad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:54.799365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d340a2df-9a6e-45d1-8e25-8ea7df267744 req-1ec089d8-e7d2-4c9d-905b-897a415a2bad service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:54.802701 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb47e903-637e-407d-b436-53c27591e034 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1563 microversion: 2.1 time: 0.373645 Oct 26 05:45:54.811412 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d340a2df-9a6e-45d1-8e25-8ea7df267744 req-1ec089d8-e7d2-4c9d-905b-897a415a2bad service nova] Creating event network-changed:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h2-862416-4 Oct 26 05:45:54.816805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d340a2df-9a6e-45d1-8e25-8ea7df267744 req-1ec089d8-e7d2-4c9d-905b-897a415a2bad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128943 Oct 26 05:45:54.817939 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3333/6676] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:54.819742 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3344/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:54 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1563 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:54.824602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-88397463", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "availability_zone": "nova:n-h2-862416-4", "networks": [{"uuid": "fc3f0d67-5dee-4df8-8b43-0d88302df422"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:54.892394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] validate_networks() for [('fc3f0d67-5dee-4df8-8b43-0d88302df422', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:45:55.451155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:55.451803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:55.463052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:55.463329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:55.463995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:55.470156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:55.470653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:55.471136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:55.766661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:45:55.767856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:45:55.768635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:45:55.769266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:45:55.771242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:45:55.795078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:55.798694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:55.799186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:55.799979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:55.800634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:55.801074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:55.816739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:55.825213 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79d931c6-4e88-485e-80f2-d444a98ba607 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1278 microversion: 2.1 time: 0.378222 Oct 26 05:45:55.825638 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3345/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:55 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:55.846227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Getting quotas for project a923be3ee6cd4579887879c9408d3bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:45:55.852052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Getting quotas for user 09767d40c4f640f19b0c5acd5b2c6bab and project a923be3ee6cd4579887879c9408d3bf9. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:45:55.876577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:45:55.879070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:45:55.942135 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82b48e93-b541-42c6-94cb-d3d564bcf2b7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122738 Oct 26 05:45:55.943533 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3334/6679] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:45:55.954489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80db1571-64bd-454f-b900-a8652fe239be tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:55.955455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80db1571-64bd-454f-b900-a8652fe239be tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:56.081272 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80db1571-64bd-454f-b900-a8652fe239be tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1327 microversion: 2.1 time: 0.122419 Oct 26 05:45:56.082247 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3346/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:55 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:56.834494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c40e159f-6008-4418-b88c-564e0210e216 req-fd0e5e8c-bb20-4337-8a1b-105753fad477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62061da-dcd2-4a57-9762-5a2d6f637972", "tag": "621075c9-df45-437f-b20d-33ada67fae32"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:56.844769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c40e159f-6008-4418-b88c-564e0210e216 req-fd0e5e8c-bb20-4337-8a1b-105753fad477 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:56.845401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c40e159f-6008-4418-b88c-564e0210e216 req-fd0e5e8c-bb20-4337-8a1b-105753fad477 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:56.845912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c40e159f-6008-4418-b88c-564e0210e216 req-fd0e5e8c-bb20-4337-8a1b-105753fad477 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:56.848441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:56.849075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:56.855604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:56.856108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:56.856558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:56.857270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:56.857761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:56.858082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c40e159f-6008-4418-b88c-564e0210e216 req-fd0e5e8c-bb20-4337-8a1b-105753fad477 service nova] Creating event network-changed:621075c9-df45-437f-b20d-33ada67fae32 for instance a62061da-dcd2-4a57-9762-5a2d6f637972 on n-h2-862416-4 Oct 26 05:45:56.858207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:56.863918 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c40e159f-6008-4418-b88c-564e0210e216 req-fd0e5e8c-bb20-4337-8a1b-105753fad477 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033214 Oct 26 05:45:56.864733 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3335/6681] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:57.016014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:57.026352 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-331a49fc-3ac6-4912-bba4-7a3e07e75395 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1278 microversion: 2.1 time: 0.181434 Oct 26 05:45:57.027517 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3347/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:56 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:45:57.107196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:57.108268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:57.115369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:57.116206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:57.116892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:57.117980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:57.118657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:57.119292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:57.239192 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84a35a70-abe0-4f68-a26e-7b2c1fc9181a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1422 microversion: 2.1 time: 0.137094 Oct 26 05:45:57.240098 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3336/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:57 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:58.051754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:58.052408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:58.059429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:58.059878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:58.060339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:58.061051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:58.061965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:58.062419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:58.199503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:58.207248 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0e464685-3dc6-47fc-add0-65a800265a2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.159451 Oct 26 05:45:58.207822 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3348/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:58 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:58.263846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:58.264467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:58.271498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:58.271992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:58.272454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:58.273140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:58.273638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:58.274079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:58.399603 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c48616f6-d7d1-4ed8-bf78-863ac9777b00 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.139434 Oct 26 05:45:58.400181 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3337/6685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:58 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:59.109944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-41600e34-110b-4a6f-98ad-dd6bb4d208d6 req-f04b03d6-bcb6-426a-bdeb-e9991ea99065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d3a56cb-f778-4a91-97b7-d149847e964a", "tag": "40cad790-a646-4a63-a996-e15311d55af0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:45:59.121423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41600e34-110b-4a6f-98ad-dd6bb4d208d6 req-f04b03d6-bcb6-426a-bdeb-e9991ea99065 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:59.121927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41600e34-110b-4a6f-98ad-dd6bb4d208d6 req-f04b03d6-bcb6-426a-bdeb-e9991ea99065 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:59.122369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-41600e34-110b-4a6f-98ad-dd6bb4d208d6 req-f04b03d6-bcb6-426a-bdeb-e9991ea99065 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:59.134492 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-41600e34-110b-4a6f-98ad-dd6bb4d208d6 req-f04b03d6-bcb6-426a-bdeb-e9991ea99065 service nova] Creating event network-changed:40cad790-a646-4a63-a996-e15311d55af0 for instance 4d3a56cb-f778-4a91-97b7-d149847e964a on n-h2-862416-4 Oct 26 05:45:59.139611 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-41600e34-110b-4a6f-98ad-dd6bb4d208d6 req-f04b03d6-bcb6-426a-bdeb-e9991ea99065 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033932 Oct 26 05:45:59.141571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3349/6686] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:45:59.230702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:59.231326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:59.237887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:59.238447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:59.238903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:59.239622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:59.240107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:59.240558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:59.375660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:45:59.383605 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d007f581-6c42-446f-87ac-34fd6d1cba87 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.156890 Oct 26 05:45:59.384197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3338/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:59 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:45:59.423136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:45:59.423851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:45:59.429907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:59.430403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:59.430862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:59.431571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:45:59.432033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:45:59.432470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:45:59.570267 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16e2cd9f-3c28-45ce-8ce6-08012113898d tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.151133 Oct 26 05:45:59.570922 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3350/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:45:59 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:00.407927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:00.408544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:00.415482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:00.415969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:00.416411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:00.417102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:00.417592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:00.418022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:00.552651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:00.560417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c31007de-1435-459b-9bee-5367a8b76d34 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.157104 Oct 26 05:46:00.560998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3339/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:00 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:00.592302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:00.593079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:00.600358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:00.600860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:00.601330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:00.602037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:00.602504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:00.602948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:00.734968 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3d475b0f-d9bb-4e14-9b8a-72f209aa0413 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.146422 Oct 26 05:46:00.735545 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3351/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:00 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:01.586492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:01.587112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:01.594645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:01.595144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:01.595592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:01.596299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:01.596767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:01.597205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:01.729239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:01.737181 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c7ced7a4-cafa-4989-b56d-46bce72a022f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.154735 Oct 26 05:46:01.738048 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3340/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:01 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:01.758825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:01.759495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:01.766940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:01.767440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:01.767890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:01.768660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:01.769131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:01.769600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:01.895466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05f1b44e-f4d4-4179-9fda-646d7d03b390 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.141116 Oct 26 05:46:01.896051 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3352/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:01 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:02.761993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:02.762608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:02.769599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:02.770089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:02.770529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:02.771219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:02.771676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:02.772105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:02.910501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:02.918022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:02.918672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:02.918781 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0fb3b02-2dbc-4267-b414-107d12bf1a22 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.160562 Oct 26 05:46:02.919286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3341/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:02 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:02.925526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:02.926027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:02.926488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:02.927192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:02.927665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:02.928104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:03.065796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19aa40cb-7cfa-4cdc-9b86-c6b25138c29f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.151320 Oct 26 05:46:03.066395 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3353/6694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:02 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:46:03.943047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:03.943683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:03.950857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:03.951341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:03.951779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:03.952598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:03.953575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:03.954002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:04.089134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:04.089365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:04.090037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:04.097343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:04.097534 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ec3ff60-bb7d-4982-892f-965393f0608f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.158222 Oct 26 05:46:04.097889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:04.105344 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3342/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:03 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:04.105519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:04.105519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:04.105519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:04.105519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:04.227241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6dcdfe46-71d1-4858-a224-10a172c9c644 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.141577 Oct 26 05:46:04.227816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3354/6696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:04 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:46:04.661043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-808cc498-ded6-4923-8705-98c3286f69d3 req-5df221b8-9199-46f5-9da8-695514c8661f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3a56cb-f778-4a91-97b7-d149847e964a", "name": "network-vif-plugged", "status": "completed", "tag": "40cad790-a646-4a63-a996-e15311d55af0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:46:04.670651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-808cc498-ded6-4923-8705-98c3286f69d3 req-5df221b8-9199-46f5-9da8-695514c8661f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:04.671793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-808cc498-ded6-4923-8705-98c3286f69d3 req-5df221b8-9199-46f5-9da8-695514c8661f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:04.672271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-808cc498-ded6-4923-8705-98c3286f69d3 req-5df221b8-9199-46f5-9da8-695514c8661f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:04.684427 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-808cc498-ded6-4923-8705-98c3286f69d3 req-5df221b8-9199-46f5-9da8-695514c8661f service nova] Creating event network-vif-plugged:40cad790-a646-4a63-a996-e15311d55af0 for instance 4d3a56cb-f778-4a91-97b7-d149847e964a on n-h2-862416-4 Oct 26 05:46:04.690467 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-808cc498-ded6-4923-8705-98c3286f69d3 req-5df221b8-9199-46f5-9da8-695514c8661f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Oct 26 05:46:04.691079 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3343/6697] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:46:05.121320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:05.121970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:05.129223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:05.129776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:05.130235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:05.130967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:05.131501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:05.131944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:05.251169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:05.251883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:05.258658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:05.259148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:05.259596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:05.260295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:05.260803 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:05.261214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:05.264595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:05.272976 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-514abe7a-72e5-4143-af86-5f9be89d29b4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.155675 Oct 26 05:46:05.273604 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3355/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:05 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:05.393170 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b1e72f7-9279-41cc-bfa8-00dff208a75f tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1462 microversion: 2.1 time: 0.146759 Oct 26 05:46:05.393779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3344/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:05 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:06.297004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:06.297775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:06.300082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:06.307681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.308181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.308653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.309423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.309898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.310343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.417202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:06.418344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:06.422976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:06.423852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:06.432129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.432705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.433211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.434115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.434580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.435010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.446136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:06.454460 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-08a6df45-5e2c-4fef-aa99-348fe78e6a11 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.161772 Oct 26 05:46:06.455064 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3356/6700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:06 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:06.576567 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-db43c16f-66bd-40a6-99f5-ff31c4bd0a6e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1647 microversion: 2.1 time: 0.163677 Oct 26 05:46:06.577146 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3345/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:06 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1647 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:46:06.598827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:06.599559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:06.605692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.606294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.606826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.607698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.608246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.609392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.742085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93edc5f3-4d52-4ea7-b376-cc64d1c4ce8a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1647 microversion: 2.1 time: 0.146991 Oct 26 05:46:06.742682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3357/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:06 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1647 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:06.767161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:06.767782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:06.774489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.775096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.775824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.776362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.776910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.777363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.904784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a478734d-361a-4906-a9d0-91b160bb9e5c tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1647 microversion: 2.1 time: 0.142985 Oct 26 05:46:06.905904 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3346/6703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:06 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:06.927078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:06.927618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:06.933781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.934284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.934734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.935433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:06.935909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:06.936356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:06.961980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:46:06.994438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:07.042747 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2093c79-5ab0-4b26-b569-8a48c3d8c0d7 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 204 len: 0 microversion: 2.1 time: 0.119179 Oct 26 05:46:07.043344 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3358/6704] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:46:06 2022] DELETE /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:46:07.052144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:07.052770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:07.059014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:07.059508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:07.059948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:07.060650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:07.061111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:07.062344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:07.187919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:07.193182 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6ff42288-8158-473b-a760-9a8eeb06902a tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1653 microversion: 2.1 time: 0.144943 Oct 26 05:46:07.193821 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3347/6705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:07 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1653 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:07.478147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:07.478923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:07.482387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:07.487003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:07.487506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:07.487963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:07.488672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:07.489142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:07.489612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:07.621435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:07.629790 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5659ac51-7bd2-416a-a553-b9745144c8fc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.155855 Oct 26 05:46:07.630393 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3359/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:07 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:08.215754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:08.216368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:08.224547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:08.225038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:08.225511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:08.226204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:08.226664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:08.227089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:08.356630 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f4f9f76-9d48-42fa-bcaf-aff9bfa6296e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1653 microversion: 2.1 time: 0.144560 Oct 26 05:46:08.357216 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3348/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:08 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1653 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:08.652579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:08.653212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:08.659993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:08.660493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:08.660943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:08.661682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:08.662149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:08.662592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:08.703789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-164179bb-e984-466e-97a4-d86d9c106046 req-b5f08abe-e79d-483a-ad2f-5a1434d03988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62061da-dcd2-4a57-9762-5a2d6f637972", "name": "network-vif-plugged", "status": "completed", "tag": "621075c9-df45-437f-b20d-33ada67fae32"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:46:08.714746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-164179bb-e984-466e-97a4-d86d9c106046 req-b5f08abe-e79d-483a-ad2f-5a1434d03988 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:08.715393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-164179bb-e984-466e-97a4-d86d9c106046 req-b5f08abe-e79d-483a-ad2f-5a1434d03988 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:08.715955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-164179bb-e984-466e-97a4-d86d9c106046 req-b5f08abe-e79d-483a-ad2f-5a1434d03988 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:08.733299 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-164179bb-e984-466e-97a4-d86d9c106046 req-b5f08abe-e79d-483a-ad2f-5a1434d03988 service nova] Creating event network-vif-plugged:621075c9-df45-437f-b20d-33ada67fae32 for instance a62061da-dcd2-4a57-9762-5a2d6f637972 on n-h2-862416-4 Oct 26 05:46:08.739795 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-164179bb-e984-466e-97a4-d86d9c106046 req-b5f08abe-e79d-483a-ad2f-5a1434d03988 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040479 Oct 26 05:46:08.741373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3349/6708] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:46:08.813288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:08.822700 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58def28e-8c85-4f47-9e1a-40faec6c7c1e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.174292 Oct 26 05:46:08.823288 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3360/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:08 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:09.016347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b2ea3390-319b-41be-9e99-bc1789afc5e6 req-43364f23-0419-4594-b2a8-f58e4790e51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3a56cb-f778-4a91-97b7-d149847e964a", "name": "network-vif-deleted", "tag": "40cad790-a646-4a63-a996-e15311d55af0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:46:09.026844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b2ea3390-319b-41be-9e99-bc1789afc5e6 req-43364f23-0419-4594-b2a8-f58e4790e51e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:09.027343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b2ea3390-319b-41be-9e99-bc1789afc5e6 req-43364f23-0419-4594-b2a8-f58e4790e51e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:09.027788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b2ea3390-319b-41be-9e99-bc1789afc5e6 req-43364f23-0419-4594-b2a8-f58e4790e51e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:09.040743 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b2ea3390-319b-41be-9e99-bc1789afc5e6 req-43364f23-0419-4594-b2a8-f58e4790e51e service nova] Creating event network-vif-deleted:40cad790-a646-4a63-a996-e15311d55af0 for instance 4d3a56cb-f778-4a91-97b7-d149847e964a on n-h2-862416-4 Oct 26 05:46:09.045829 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b2ea3390-319b-41be-9e99-bc1789afc5e6 req-43364f23-0419-4594-b2a8-f58e4790e51e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034518 Oct 26 05:46:09.047318 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3350/6710] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:46:09.379984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:09.380608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:09.386750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:09.387267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:09.387720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:09.388453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:09.388901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:09.389392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:09.419920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:09.420410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:09.420860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:09.422114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lazy-loading 'fault' on Instance uuid 4d3a56cb-f778-4a91-97b7-d149847e964a {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:46:09.470812 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-04305d56-1e92-4865-9f99-bcdde1652bb5 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 200 len: 1452 microversion: 2.1 time: 0.094670 Oct 26 05:46:09.471385 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3361/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:09 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:46:09.847714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:09.848418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:09.854494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:09.854983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:09.855434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:09.856111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:09.856570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:09.857000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:09.991017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:09.998719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ab1ce1c-112e-4107-b36b-c53ccd3f6ba4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1266 microversion: 2.1 time: 0.156712 Oct 26 05:46:09.999313 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3351/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:09 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:10.494447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:10.495083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: 4d3a56cb-f778-4a91-97b7-d149847e964a] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:10.502770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:10.503273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:10.503731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:10.504441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:10.504916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:10.505399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:10.519007 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] HTTP exception thrown: Instance 4d3a56cb-f778-4a91-97b7-d149847e964a could not be found. Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Request method failure captured: Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a HTTP/1.1 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMmBL0OFEHqxvQYUT_bCmMs4YftcE9VMcbB19mmfq8Fx91q23tmjuy5Ne-HVOLYciqbqcZymNVj4rONGz4cFViGMwIbAcNPUOqnVjEuVI6P57yFcqnzaskmCf1b6SzoAfzgoZCEnUVpML1ZDSJAR1lH6Mi-bsLXvZ4mobZoK5I68VrM Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: a923be3ee6cd4579887879c9408d3bf9 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestServerMultinode-1935480887 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestServerMultinode-1935480887 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: a923be3ee6cd4579887879c9408d3bf9 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestServerMultinode-1935480887 Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestServerMultinode-1935480887-project-admin Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 09767d40c4f640f19b0c5acd5b2c6bab Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestServerMultinode-1935480887-project-admin Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 4d3a56cb-f778-4a91-97b7-d149847e964a could not be found. Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '4d3a56cb-f778-4a91-97b7-d149847e964a'} Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3a56cb-f778-4a91-97b7-d149847e964a could not be found. Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3a56cb-f778-4a91-97b7-d149847e964a could not be found. Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:46:10.520639 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3a56cb-f778-4a91-97b7-d149847e964a could not be found. Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Returning 404 to user: Instance 4d3a56cb-f778-4a91-97b7-d149847e964a could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03426631-a1dc-49ed-860c-ca5b9f0d1f03 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a" status: 404 len: 111 microversion: 2.1 time: 0.031435 Oct 26 05:46:10.525131 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3362/6713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:10 2022] GET /compute/v2.1/servers/4d3a56cb-f778-4a91-97b7-d149847e964a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:46:10.530719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:10.531324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:10.537371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:10.537872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:10.538321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:10.539024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:10.539494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:10.539932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:10.566609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:46:10.643944 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a7ebb12c-388b-497e-95b4-150523bf45ec tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 204 len: 0 microversion: 2.1 time: 0.116652 Oct 26 05:46:10.644857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3352/6714] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:46:10 2022] DELETE /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:46:10.653453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:10.654133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:10.661005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:10.661546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:10.662003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:10.662712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:10.663185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:10.663629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:10.792775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c45f0afa-2c82-49f5-87c8-372ed3efbbc3 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1653 microversion: 2.1 time: 0.143080 Oct 26 05:46:10.793360 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3363/6715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:10 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1653 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:11.022519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:11.023358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:11.032602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:11.033098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:11.033622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:11.034273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:11.034733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:11.035160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:11.167371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:11.175417 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51bc0a25-7f05-4544-9173-c58aea0e6dda tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1454 microversion: 2.1 time: 0.158313 Oct 26 05:46:11.176006 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3353/6716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:11 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:46:11.197903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:11.198532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:11.205256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:11.205780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:11.206235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:11.206938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:11.207407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:11.207847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:11.340335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:46:11.348888 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59d75953-cf1f-4cc3-bc0b-f4ccbd9c463e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1454 microversion: 2.1 time: 0.154794 Oct 26 05:46:11.349498 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3364/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:11 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:11.817473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:11.818340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:11.824322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:11.824818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:11.825368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:11.826067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:11.826522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:11.826948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:12.066029 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e59512e6-a6c9-49af-a78e-e94f6f509937 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1653 microversion: 2.1 time: 0.253714 Oct 26 05:46:12.066680 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3354/6718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:11 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1653 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:12.536857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1cbac266-5ac4-4802-8c66-7b5c2e931b18 req-f8b1f06e-45d4-4fd9-a306-34c5e7733522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcadaea4-77c4-4770-9fc0-06ebccdd1bd4", "name": "network-vif-deleted", "tag": "ef3da375-c62c-4901-859c-ca92c685817a"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:46:12.553639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1cbac266-5ac4-4802-8c66-7b5c2e931b18 req-f8b1f06e-45d4-4fd9-a306-34c5e7733522 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:12.554895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1cbac266-5ac4-4802-8c66-7b5c2e931b18 req-f8b1f06e-45d4-4fd9-a306-34c5e7733522 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:12.555828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1cbac266-5ac4-4802-8c66-7b5c2e931b18 req-f8b1f06e-45d4-4fd9-a306-34c5e7733522 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:12.570610 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1cbac266-5ac4-4802-8c66-7b5c2e931b18 req-f8b1f06e-45d4-4fd9-a306-34c5e7733522 service nova] Creating event network-vif-deleted:ef3da375-c62c-4901-859c-ca92c685817a for instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 on n-h1-862416-4 Oct 26 05:46:12.576733 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1cbac266-5ac4-4802-8c66-7b5c2e931b18 req-f8b1f06e-45d4-4fd9-a306-34c5e7733522 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046865 Oct 26 05:46:12.578039 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3365/6719] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:46:13.089512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:13.090162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:13.097580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:13.098074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:13.098517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:13.099215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:13.099671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:13.100098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:13.133278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:13.133792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:13.134232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:13.134686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lazy-loading 'fault' on Instance uuid fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:46:13.199456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18e10811-48fa-488a-afd8-0ddc21ec39c2 tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 200 len: 1453 microversion: 2.1 time: 0.113708 Oct 26 05:46:13.200021 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3355/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:13 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:46:13.433919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-87184d8f-2ea5-47f6-a80b-dc28e290ac6d req-c9c1b8a0-4ce0-41e3-bc4b-225f6964a7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62061da-dcd2-4a57-9762-5a2d6f637972", "tag": "621075c9-df45-437f-b20d-33ada67fae32"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:46:13.444257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-87184d8f-2ea5-47f6-a80b-dc28e290ac6d req-c9c1b8a0-4ce0-41e3-bc4b-225f6964a7f2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:13.444752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-87184d8f-2ea5-47f6-a80b-dc28e290ac6d req-c9c1b8a0-4ce0-41e3-bc4b-225f6964a7f2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:13.445196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-87184d8f-2ea5-47f6-a80b-dc28e290ac6d req-c9c1b8a0-4ce0-41e3-bc4b-225f6964a7f2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:13.458847 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-87184d8f-2ea5-47f6-a80b-dc28e290ac6d req-c9c1b8a0-4ce0-41e3-bc4b-225f6964a7f2 service nova] Creating event network-changed:621075c9-df45-437f-b20d-33ada67fae32 for instance a62061da-dcd2-4a57-9762-5a2d6f637972 on n-h2-862416-4 Oct 26 05:46:13.463767 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-87184d8f-2ea5-47f6-a80b-dc28e290ac6d req-c9c1b8a0-4ce0-41e3-bc4b-225f6964a7f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033913 Oct 26 05:46:13.464381 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3366/6721] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:46:14.223975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:46:14.224930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] [instance: fcadaea4-77c4-4770-9fc0-06ebccdd1bd4] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:14.233341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:14.233985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:14.234433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:14.235278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:14.235651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:14.236029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:14.255248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] HTTP exception thrown: Instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 could not be found. Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Request method failure captured: Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 HTTP/1.1 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMmBL0OFEHqxvQYUT_bCmMs4YftcE9VMcbB19mmfq8Fx91q23tmjuy5Ne-HVOLYciqbqcZymNVj4rONGz4cFViGMwIbAcNPUOqnVjEuVI6P57yFcqnzaskmCf1b6SzoAfzgoZCEnUVpML1ZDSJAR1lH6Mi-bsLXvZ4mobZoK5I68VrM Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: a923be3ee6cd4579887879c9408d3bf9 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestServerMultinode-1935480887 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a923be3ee6cd4579887879c9408d3bf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestServerMultinode-1935480887 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: a923be3ee6cd4579887879c9408d3bf9 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestServerMultinode-1935480887 Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestServerMultinode-1935480887-project-admin Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 09767d40c4f640f19b0c5acd5b2c6bab Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestServerMultinode-1935480887-project-admin Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 could not be found. Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'fcadaea4-77c4-4770-9fc0-06ebccdd1bd4'} Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 could not be found. Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 could not be found. Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:46:14.257303 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 could not be found. Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] Returning 404 to user: Instance fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d37e5c5b-fa94-4bb4-8320-f7499aca844e tempest-TestServerMultinode-1935480887 tempest-TestServerMultinode-1935480887-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4" status: 404 len: 111 microversion: 2.1 time: 0.039064 Oct 26 05:46:14.260874 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3356/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:46:14 2022] GET /compute/v2.1/servers/fcadaea4-77c4-4770-9fc0-06ebccdd1bd4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:46:26.208441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=16 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:26.210856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:46:26.217100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:46:26.222340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:46:26.232912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:26.233769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:26.234925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:26.235984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:46:26.236896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:46:26.237748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:46:26.308657 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53ac5d8e-3e12-4116-9a5d-4c39dc51028f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action" status: 200 len: 24564 microversion: 2.1 time: 0.102231 Oct 26 05:46:26.309737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3367/6723] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:46:26 2022] POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action => generated 24564 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:47:05.343060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:05.343709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:05.346246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:05.346950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:05.353828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:05.354324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:05.354791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:05.355483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:05.355940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:05.356366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:05.787775 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4439e5a5-00c0-4945-a45b-581557c97be6 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1832 microversion: 2.1 time: 0.448617 Oct 26 05:47:05.790050 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3357/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:05 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1832 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:05.811858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:05.812599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:05.815557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:05.816262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:05.823016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:05.823524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:05.823967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:05.824675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:05.825137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:05.825609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.023061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:06.031203 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71ba8546-ec4e-4f95-998c-c353c2f3669b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1681 microversion: 2.1 time: 0.223577 Oct 26 05:47:06.031778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3368/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:05 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:06.130121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:06.132529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:06.138486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:06.138971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:06.139412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.140105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:06.140562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:06.140987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.196205 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a72d4956-136f-4180-b7d7-37ff3f1f4663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action" status: 200 len: 32636 microversion: 2.1 time: 0.070079 Oct 26 05:47:06.196843 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3358/6726] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:47:06 2022] POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action => generated 32636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:47:06.373457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:06.374072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:06.380633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:06.381445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:06.382399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.383138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:06.383608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:06.384049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.474197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f011349847ce4c5fa458487e14ed3f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506b6da943864ce5878d3f30f4de41aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:06.474820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] flavor_id is None. Assuming migration. {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 05:47:06.475281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:47:06.702462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-200c7ee0-d864-4c8a-90ae-2b316c885aab tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action" status: 202 len: 0 microversion: 2.1 time: 0.332859 Oct 26 05:47:06.703068 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3369/6727] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:47:06 2022] POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:47:06.712142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:06.712851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:06.720530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:06.721025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:06.721697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.722412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:06.723497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:06.723938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:06.900578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:06.908193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6eb8f677-4233-4f32-8861-d90aadd9bb42 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1690 microversion: 2.1 time: 0.200727 Oct 26 05:47:06.908771 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3359/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:06 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:07.933287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:07.933970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:07.940243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:07.940748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:07.941210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:07.941947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:07.942425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:07.942871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:08.079232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:08.087422 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-845eb659-3a2c-4691-b8dc-3acfcb23d689 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1690 microversion: 2.1 time: 0.159144 Oct 26 05:47:08.088012 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3370/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:07 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:09.111393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:09.111999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:09.118826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:09.119318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:09.119762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:09.120460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:09.120921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:09.121383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:09.255067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:09.263509 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f07e15dc-d368-4f6b-bfc9-e62d43d8f595 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.156104 Oct 26 05:47:09.264087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3360/6730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:09 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:10.287661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:10.289289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:10.295899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:10.296405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:10.296862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:10.297596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:10.298074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:10.298521 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:10.434984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:10.443337 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c234a283-2cba-488f-b31e-e6760901d72e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.159573 Oct 26 05:47:10.443923 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3371/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:10 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:11.467247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:11.468163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:11.475418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:11.475910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:11.476353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:11.477055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:11.477547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:11.477979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:11.613705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:11.622137 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2bf14a25-443c-4fee-b38e-764c6f26fe28 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.158888 Oct 26 05:47:11.622721 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3361/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:11 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:12.645458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:12.646087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:12.653219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:12.653765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:12.654224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:12.654937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:12.655410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:12.655853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:12.790389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:12.798127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bc378ae-bfe1-4324-beec-b37a2dea4281 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.156579 Oct 26 05:47:12.798711 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3372/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:12 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:13.822511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:13.823135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:13.830010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:13.830508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:13.830957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:13.831657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:13.832125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:13.832560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:13.972021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:13.980453 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-922c6935-adaa-404b-b262-6b5fc7dd1928 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.162047 Oct 26 05:47:13.981030 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3362/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:13 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:15.003707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:15.004334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:15.011682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:15.012186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:15.012643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:15.013377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:15.013855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:15.014298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:15.144565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:15.153614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5f26d573-9bdb-4dbd-8295-ca343470d520 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.153718 Oct 26 05:47:15.154193 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3373/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:14 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:16.177692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:16.178230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:16.186314 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:16.186804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:16.187244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:16.187945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:16.188402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:16.188831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:16.328906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:16.336857 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a44bc01-49b3-4685-8563-e6118d37b4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.163275 Oct 26 05:47:16.337466 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3363/6736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:16 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:17.360471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:17.361103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:17.368212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:17.368712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:17.369167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:17.369905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:17.370374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:17.370820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:17.503345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:17.511597 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5093241d-e243-48ff-b053-5411bba5dfbe tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.155044 Oct 26 05:47:17.512171 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3374/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:17 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:18.536520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:18.537148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:18.544937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:18.545468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:18.545918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:18.546628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:18.547100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:18.547537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:18.683867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:18.692053 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8e792bf-6cad-42d7-b564-156d023b9bc0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.159570 Oct 26 05:47:18.692640 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3364/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:18 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:19.716441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:19.716962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:19.723759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:19.724262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:19.724767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:19.725494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:19.726177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:19.726630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:19.863161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:19.871687 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c139ac23-eddb-4082-9d97-e1f923171bbf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.159240 Oct 26 05:47:19.872288 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3375/6739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:19 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:20.895509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:20.896133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:20.903231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:20.903725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:20.904173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:20.904875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:20.905364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:20.905802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:21.037897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:21.047032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39f17727-95db-4ecf-bf9c-5dfa46f66555 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.155464 Oct 26 05:47:21.047631 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3365/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:20 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:22.071810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:22.072503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:22.079363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:22.079862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:22.080316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:22.081020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:22.081524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:22.081966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:22.219003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:22.227396 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a8e340b7-59f7-4980-ae53-5383cf57d39e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.160103 Oct 26 05:47:22.227961 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3376/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:22 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:23.250878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:23.251498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:23.259067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:23.259556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:23.260003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:23.260705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:23.261163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:23.261643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:23.392504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:23.400986 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b5aa02d-e0fa-49d8-a8e5-fbef0b419399 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.154115 Oct 26 05:47:23.401590 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3366/6742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:23 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:24.424081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:24.424711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:24.431998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:24.432501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:24.433165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:24.433909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:24.434387 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:24.434832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:24.571884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:24.579661 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5bdb5e5-61fb-42e5-b07b-587cc07f06d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.159491 Oct 26 05:47:24.580228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3377/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:24 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:25.603600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:25.604220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:25.611112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:25.611607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:25.612054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:25.612750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:25.613218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:25.613675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:25.747745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:25.755209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a2070739-4764-463f-891f-9ea4912e6dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1695 microversion: 2.1 time: 0.156010 Oct 26 05:47:25.762912 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3367/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:25 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:26.691543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "name": "network-vif-unplugged", "status": "completed", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:26.712196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:26.712875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:26.713352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:26.733190 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] Creating event network-vif-unplugged:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h1-862416-4 Oct 26 05:47:26.739688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] Instance 0c67da6b-a8af-4b29-a442-f64b96227858 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:47:26.754328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2d90a070-bbcb-4248-bd34-8c3d1a59802e req-42ba10ff-fd1e-49ff-807c-f76778542b6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066890 Oct 26 05:47:26.754942 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3378/6745] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:47:26.779763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:26.780384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:26.787659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:26.788120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:26.788609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:26.789346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:26.790626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:26.790626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:26.927477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:26.936205 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0eaf92f0-6b13-42a5-8017-173823882c9f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1694 microversion: 2.1 time: 0.160348 Oct 26 05:47:26.936793 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3368/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:26 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:27.962003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:27.962718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:27.968802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:27.969296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:27.969777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:27.970473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:27.970938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:27.971375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:28.108173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:28.115987 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3d61230a-16b1-40b6-aba4-4202b28a14a1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1692 microversion: 2.1 time: 0.159751 Oct 26 05:47:28.117180 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3379/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:27 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:28.802967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:28.813279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:28.813797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:28.814237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:28.826904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] Creating event network-changed:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h1-862416-4 Oct 26 05:47:28.832309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] Instance 0c67da6b-a8af-4b29-a442-f64b96227858 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:47:28.844308 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-642ad056-b44e-49f5-94a4-1018b259b51a req-f4e0db96-cacb-42df-99e1-d85811d64156 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045084 Oct 26 05:47:28.844920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3369/6748] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:47:29.140279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:29.141695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:29.150033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:29.150549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:29.151219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:29.151940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:29.152408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:29.152850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:29.294753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:29.302626 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-77df8ffe-a878-4ccc-893b-b7741f7c3848 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1692 microversion: 2.1 time: 0.166451 Oct 26 05:47:29.303220 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3380/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:29 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:30.328073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:30.328812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:30.335073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:30.336184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:30.336786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:30.337535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:30.338004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:30.338443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:30.484234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:30.492359 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f0c0f7e-587d-4f43-9298-8a9bebd31749 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1689 microversion: 2.1 time: 0.169389 Oct 26 05:47:30.492940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3370/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:30 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:30.514969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:30.515522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:30.522376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:30.523571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:30.523941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:30.524651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:30.525126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:30.525616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:30.584742 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf8f30cd-c7af-4605-b343-99edc1078466 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action" status: 204 len: 0 microversion: 2.1 time: 0.073422 Oct 26 05:47:30.586414 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3381/6751] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:47:30 2022] POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:47:30.594726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:30.595353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:30.602116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:30.602620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:30.603164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:30.603860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:30.604335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:30.604855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:30.740346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:30.749073 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ed9d14d-4784-48f8-9e8e-a24cd4e3e97e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1689 microversion: 2.1 time: 0.158223 Oct 26 05:47:30.749912 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3371/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:30 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:31.775036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:31.775757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:31.782939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:31.783449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:31.783913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:31.784627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:31.785094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:31.785594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:31.800834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:31.940489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:31.950154 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-14f2442b-cc68-4d14-9258-f58af717b69a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1681 microversion: 2.1 time: 0.180310 Oct 26 05:47:31.951347 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3382/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:31 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:32.119511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-10463989-b53f-4f96-a384-f273e5a0c9e3 req-b754a93a-d898-4161-a367-5601837065b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "name": "network-vif-plugged", "status": "completed", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:32.133336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10463989-b53f-4f96-a384-f273e5a0c9e3 req-b754a93a-d898-4161-a367-5601837065b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:32.133820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10463989-b53f-4f96-a384-f273e5a0c9e3 req-b754a93a-d898-4161-a367-5601837065b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:32.134254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10463989-b53f-4f96-a384-f273e5a0c9e3 req-b754a93a-d898-4161-a367-5601837065b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:32.148755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-10463989-b53f-4f96-a384-f273e5a0c9e3 req-b754a93a-d898-4161-a367-5601837065b6 service nova] Creating event network-vif-plugged:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h1-862416-4 Oct 26 05:47:32.154225 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-10463989-b53f-4f96-a384-f273e5a0c9e3 req-b754a93a-d898-4161-a367-5601837065b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038396 Oct 26 05:47:32.154851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3372/6754] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:47:52.299648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1339067413", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1141262165", "security_groups": [{"name": "tempest-secgroup-smoke-632575950"}], "block_device_mapping_v2": [{"uuid": "cd7e06a6-87c1-4686-b15f-af48f1224ce4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:52.311437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=32 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:52.312098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:52.313195 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:47:52.313395 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 26 05:47:52.425471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] validate_networks() for [('b6f6aecc-c32e-4016-8ad4-7dfb6c0a533d', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:47:52.807653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:47:52.808094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:47:52.808579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:47:52.809000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:47:52.809460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:47:52.818437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:52.818931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:52.819381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:52.820151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:52.820608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:52.821046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:52.837935 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:47:52.843097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Getting quotas for user 25f10f2d38ae40feb5c04a344907b807 and project 93bb2962e7f94c67b95be1be49f54946. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:47:52.902121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:47:52.904238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd7e06a6-87c1-4686-b15f-af48f1224ce4',volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:47:53.032743 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc84001c-a341-4a46-a943-89b1673b8010 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737092 Oct 26 05:47:53.033426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3383/6755] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:47:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:47:53.045703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cb86e6e-47f0-4887-aa85-dd8d77ce21ec tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:53.046443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cb86e6e-47f0-4887-aa85-dd8d77ce21ec tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:53.051831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=32 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:53.052679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=88 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:47:53.107656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4cb86e6e-47f0-4887-aa85-dd8d77ce21ec tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:53.115697 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cb86e6e-47f0-4887-aa85-dd8d77ce21ec tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1095 microversion: 2.1 time: 0.074065 Oct 26 05:47:53.116900 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3373/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:53 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:54.143908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:54.144731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:54.152646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:54.153209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:54.153706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:54.154439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:54.154911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:54.155357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:54.230124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:54.241260 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6c0bf0d1-c453-4f51-95c0-962a38015166 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1201 microversion: 2.1 time: 0.101781 Oct 26 05:47:54.242314 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3384/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:54 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:55.266569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:55.267202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:55.275647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:55.276155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:55.276595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:55.277357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:55.277832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:55.278228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:55.425270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:55.436326 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-027c69a2-abea-4c73-9d45-cf7a3660c971 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1278 microversion: 2.1 time: 0.174156 Oct 26 05:47:55.437701 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3374/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:55 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:55.872674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-05599550-9572-4475-b0c0-6723c28243c6 req-f1b76d8c-7717-4507-988b-21baf7b74fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f", "tag": "2984d4e5-9d0d-45e3-8848-62c1e5d7cb14"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:55.885998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05599550-9572-4475-b0c0-6723c28243c6 req-f1b76d8c-7717-4507-988b-21baf7b74fe5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:55.887189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05599550-9572-4475-b0c0-6723c28243c6 req-f1b76d8c-7717-4507-988b-21baf7b74fe5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:55.887767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05599550-9572-4475-b0c0-6723c28243c6 req-f1b76d8c-7717-4507-988b-21baf7b74fe5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:55.900429 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-05599550-9572-4475-b0c0-6723c28243c6 req-f1b76d8c-7717-4507-988b-21baf7b74fe5 service nova] Creating event network-changed:2984d4e5-9d0d-45e3-8848-62c1e5d7cb14 for instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f on n-h1-862416-4 Oct 26 05:47:55.905882 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-05599550-9572-4475-b0c0-6723c28243c6 req-f1b76d8c-7717-4507-988b-21baf7b74fe5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038358 Oct 26 05:47:55.906709 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3385/6759] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:47:56.161642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:47:56.164429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:56.171191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:56.172021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:56.172476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:56.173229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:56.173919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:56.174525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:56.232162 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb855576-044b-4ece-ac8b-d712145aba94 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action" status: 200 len: 24579 microversion: 2.1 time: 0.074727 Oct 26 05:47:56.232893 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3375/6760] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:47:56 2022] POST /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858/action => generated 24579 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:47:56.460754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:56.462526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:56.469124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:56.469603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:56.470426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:56.470845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:56.471321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:56.471801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:56.615488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:56.625648 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-984e5242-ae1c-4b0a-b572-493b9087edfa tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1278 microversion: 2.1 time: 0.169080 Oct 26 05:47:56.626281 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3386/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:56 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:57.648724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:57.650390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:57.657816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:57.658320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:57.658767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:57.659605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:57.660076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:57.660512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:57.798330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:57.806580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-25fe5308-43c3-47aa-a219-8145a825886e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1278 microversion: 2.1 time: 0.162067 Oct 26 05:47:57.807165 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3376/6762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:57 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:47:58.830358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:47:58.830980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:47:58.838991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:58.839493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:58.839947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:58.840647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:47:58.841110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:47:58.841575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:47:58.984280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:47:58.993395 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-903b0ad1-b065-431a-9865-51614d8e6ffc tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1278 microversion: 2.1 time: 0.166237 Oct 26 05:47:58.993994 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3387/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:47:58 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:00.016376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:00.016996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:00.023866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:00.025039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:00.025457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:00.026163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:00.026627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:00.027061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:00.157299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:00.165631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-70df9134-a64d-4d85-8b13-bfdf98ee2d80 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.152592 Oct 26 05:48:00.166206 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3377/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:00 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:01.188462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:01.189083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:01.196649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:01.197154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:01.197736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:01.198526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:01.198996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:01.199435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:01.334699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:01.348108 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a91e637-b671-432a-9395-b9a58a099b8a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.162991 Oct 26 05:48:01.348705 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3388/6765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:01 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:02.372726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:02.373384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:02.380448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:02.380950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:02.381413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:02.382132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:02.382774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:02.383179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:02.450757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:02.451392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:02.458667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:02.458667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:02.459106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:02.460168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:02.460964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:02.462250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:02.557222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:02.565334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4cedc2ca-5136-4b08-8309-97d14e65d120 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.197689 Oct 26 05:48:02.566414 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3378/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:02 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:02.620656 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b9d36c2-e367-43f0-8ca3-587d761ef03c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1832 microversion: 2.1 time: 0.173620 Oct 26 05:48:02.621244 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3389/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:02 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1832 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:03.524427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-40cca795-0b2d-49ba-8aa0-3aa1a8496c6b req-ca611118-bcef-4220-bb82-df8c2d6907a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:03.531484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:03.532001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:03.534697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:03.540861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.541859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:03.542662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:03.551030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40cca795-0b2d-49ba-8aa0-3aa1a8496c6b req-ca611118-bcef-4220-bb82-df8c2d6907a2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.551552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40cca795-0b2d-49ba-8aa0-3aa1a8496c6b req-ca611118-bcef-4220-bb82-df8c2d6907a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.552116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-40cca795-0b2d-49ba-8aa0-3aa1a8496c6b req-ca611118-bcef-4220-bb82-df8c2d6907a2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.553425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.554000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.554781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.555905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.556390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.572252 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-40cca795-0b2d-49ba-8aa0-3aa1a8496c6b req-ca611118-bcef-4220-bb82-df8c2d6907a2 service nova] Creating event network-changed:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h1-862416-4 Oct 26 05:48:03.578102 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-40cca795-0b2d-49ba-8aa0-3aa1a8496c6b req-ca611118-bcef-4220-bb82-df8c2d6907a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057441 Oct 26 05:48:03.579018 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3390/6768] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:03.589778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:03.590827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:03.597446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:48:03.597656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.598147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.598830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.599715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.600455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.601235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.705872 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-601d936e-6e78-4908-93d5-467ca9f5cd9a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 204 len: 0 microversion: 2.1 time: 0.188915 Oct 26 05:48:03.709885 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3379/6769] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:48:03 2022] DELETE /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:48:03.716645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:03.717390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:03.723707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.724432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.725738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.726671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:03.728759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:03.729466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:03.768533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:03.777089 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cc8efec-2b67-4cab-9dad-0cf65ef015ee tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.192066 Oct 26 05:48:03.790830 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3391/6770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:03 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:48:03.903399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:03.913113 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-891c0136-9f46-4143-872d-73be978718fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1687 microversion: 2.1 time: 0.201795 Oct 26 05:48:03.914026 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3380/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:03 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:04.801899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:04.802532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:04.809331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:04.809846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:04.810301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:04.811005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:04.811478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:04.811923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:04.939887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:04.940536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:04.949396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:04.949922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:04.950372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:04.951134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:04.951822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:04.952395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:04.956795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:04.965981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a02228fa-e3e1-47c9-b6f4-7847852e0fcd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.167831 Oct 26 05:48:04.966637 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3392/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:04 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:05.094031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:05.102993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8149224c-6a21-4811-ba7c-d4c837beba98 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1687 microversion: 2.1 time: 0.167623 Oct 26 05:48:05.103675 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3381/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:04 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:05.990784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:05.991344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:05.999069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:05.999586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:06.000044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:06.000891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:06.001397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:06.001878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:06.128727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:06.129416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:06.139706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:06.140478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:06.141172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:06.141999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:06.142463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:06.143070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:06.146712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:06.155604 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4cbe5ea0-2432-44e8-8a95-29a537703a66 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.168772 Oct 26 05:48:06.156192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3393/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:05 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:06.222277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:06.238657 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5fd0ff94-f63d-435b-8fa7-03a870600be9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 200 len: 1502 microversion: 2.1 time: 0.114171 Oct 26 05:48:06.239605 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3382/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:06 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 1502 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:48:06.283841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a9c469c8-6f6a-4c98-ac78-2ad52bea8ade req-fdcb41d3-0e3c-44d4-876d-577f0a34ea26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c67da6b-a8af-4b29-a442-f64b96227858", "name": "network-vif-deleted", "tag": "af5ba10b-5770-407f-a17e-6ef965d38792"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:06.294280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a9c469c8-6f6a-4c98-ac78-2ad52bea8ade req-fdcb41d3-0e3c-44d4-876d-577f0a34ea26 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:06.294769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a9c469c8-6f6a-4c98-ac78-2ad52bea8ade req-fdcb41d3-0e3c-44d4-876d-577f0a34ea26 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:06.295215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a9c469c8-6f6a-4c98-ac78-2ad52bea8ade req-fdcb41d3-0e3c-44d4-876d-577f0a34ea26 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:06.308492 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a9c469c8-6f6a-4c98-ac78-2ad52bea8ade req-fdcb41d3-0e3c-44d4-876d-577f0a34ea26 service nova] Creating event network-vif-deleted:af5ba10b-5770-407f-a17e-6ef965d38792 for instance 0c67da6b-a8af-4b29-a442-f64b96227858 on n-h1-862416-4 Oct 26 05:48:06.313271 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a9c469c8-6f6a-4c98-ac78-2ad52bea8ade req-fdcb41d3-0e3c-44d4-876d-577f0a34ea26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Oct 26 05:48:06.313896 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3394/6776] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:07.179478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:07.180095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:07.187088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:07.187587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:07.188033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:07.188727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:07.189188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:07.189652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:07.265498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:07.266233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 0c67da6b-a8af-4b29-a442-f64b96227858] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:07.272518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:07.273025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:07.273529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:07.274246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:07.274733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:07.275185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:07.289709 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] HTTP exception thrown: Instance 0c67da6b-a8af-4b29-a442-f64b96227858 could not be found. Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Request method failure captured: Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 HTTP/1.1 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMl1ceVdeaB5esmqIkWZv56IC-fWfxR6Muj4iD4W3N-oi6mq2_r6PjrY_UTVpbB18lv60am780slmoNAsVVfb4JlW2yo_Qmbe3RY3QYSMRII1sKepK3vRa-9ta_pLLcerIJHhg0rvc4UkuRx28m52JpB0mRQABrruRYrt5RFU8DWq0s Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a83d4b60397143bf90254fc3990dc0a5 Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 0c67da6b-a8af-4b29-a442-f64b96227858 could not be found. Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '0c67da6b-a8af-4b29-a442-f64b96227858'} Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c67da6b-a8af-4b29-a442-f64b96227858 could not be found. Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c67da6b-a8af-4b29-a442-f64b96227858 could not be found. Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:48:07.291450 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c67da6b-a8af-4b29-a442-f64b96227858 could not be found. Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Returning 404 to user: Instance 0c67da6b-a8af-4b29-a442-f64b96227858 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b5300328-4795-4503-bba8-75965234c27e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858" status: 404 len: 111 microversion: 2.1 time: 0.033417 Oct 26 05:48:07.299079 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3395/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:07 2022] GET /compute/v2.1/servers/0c67da6b-a8af-4b29-a442-f64b96227858 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:48:07.322181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:07.330719 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fcf4d6ea-c078-4a7b-8247-cfcb7354cb3c tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.155177 Oct 26 05:48:07.331338 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3383/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:07 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:08.353908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:08.354731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:08.361775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:08.362530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:08.363027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:08.363757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:08.364230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:08.364676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:08.526364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:08.534628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89eb5942-333e-4e14-8029-f003f295932e tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.184870 Oct 26 05:48:08.535209 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3396/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:08 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:09.558383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:09.558938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:09.567233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:09.567850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:09.568368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:09.569344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:09.570452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:09.570995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:09.737908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:09.745341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35bb3864-4d17-4ebd-96c7-4cb125e11f2d tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.191755 Oct 26 05:48:09.758146 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3384/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:09 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:10.548642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b06f5867-910d-4b34-8427-e6d51949964c req-909777cf-87c0-4424-aa87-3e0b9aba454e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f", "name": "network-vif-plugged", "status": "completed", "tag": "2984d4e5-9d0d-45e3-8848-62c1e5d7cb14"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:10.561853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b06f5867-910d-4b34-8427-e6d51949964c req-909777cf-87c0-4424-aa87-3e0b9aba454e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:10.562422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b06f5867-910d-4b34-8427-e6d51949964c req-909777cf-87c0-4424-aa87-3e0b9aba454e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:10.563067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b06f5867-910d-4b34-8427-e6d51949964c req-909777cf-87c0-4424-aa87-3e0b9aba454e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:10.575593 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b06f5867-910d-4b34-8427-e6d51949964c req-909777cf-87c0-4424-aa87-3e0b9aba454e service nova] Creating event network-vif-plugged:2984d4e5-9d0d-45e3-8848-62c1e5d7cb14 for instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f on n-h1-862416-4 Oct 26 05:48:10.581276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b06f5867-910d-4b34-8427-e6d51949964c req-909777cf-87c0-4424-aa87-3e0b9aba454e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037683 Oct 26 05:48:10.583333 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3397/6781] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:10.774810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:10.777552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:10.788106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:10.788630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:10.789064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:10.789809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:10.790273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:10.790923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:11.014686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:11.023899 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0f10db43-5961-4aef-bf9f-bae8dc2a5e8f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1266 microversion: 2.1 time: 0.255358 Oct 26 05:48:11.036652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3385/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:10 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:11.061127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7d8e099-f4e5-4a77-85ac-eedc5bd70ff0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '.version_select at 0x7f4709298940>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:11.088442 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7d8e099-f4e5-4a77-85ac-eedc5bd70ff0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-372627087" status: 202 len: 0 microversion: 2.1 time: 0.033272 Oct 26 05:48:11.089117 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3398/6783] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 05:48:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-372627087 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:48:11.117815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ccaf689b-fd35-4f50-8a8d-30232fec2251 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: .version_select at 0x7f470ac54e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-785485053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAfyHXNnDMF5nEmqAoTO/2WsOAaO4mLd7TPBGutH2raUaAyBgAS/ED0DYnyajwzfP0gpHSW+8cw6MtuHyWz2Y3AAw0VquwDJATDKa6SsRDncOXvYOMkYyQkx+zVVlFNow=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:11.134081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ccaf689b-fd35-4f50-8a8d-30232fec2251 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:48:11.140082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ccaf689b-fd35-4f50-8a8d-30232fec2251 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:48:11.173674 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ccaf689b-fd35-4f50-8a8d-30232fec2251 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059723 Oct 26 05:48:11.174318 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3386/6784] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:48:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:12.051213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:12.052165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:12.070586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:12.071206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:12.071731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:12.072976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:12.073483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:12.073925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:12.476438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:12.485730 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71e1d470-9772-4c01-8c5c-b6e6640511a7 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1453 microversion: 2.1 time: 0.439627 Oct 26 05:48:12.486365 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3399/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:12 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1453 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:12.509578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:12.510269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:12.517474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:12.518052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:12.518507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:12.519258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:12.519755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:12.520192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:12.784333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:12.794263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62ecaa40-f07c-4bc5-ae3a-37ef0bf0e359 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1453 microversion: 2.1 time: 0.289634 Oct 26 05:48:12.795071 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3387/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:12 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1453 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:14.546738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9c52f3a0-cfc2-4aac-acbe-9c857721880b req-d4aeda98-23ea-4ef1-9bcf-3e33ab7646b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f", "tag": "2984d4e5-9d0d-45e3-8848-62c1e5d7cb14"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:14.563329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9c52f3a0-cfc2-4aac-acbe-9c857721880b req-d4aeda98-23ea-4ef1-9bcf-3e33ab7646b8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:14.564505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9c52f3a0-cfc2-4aac-acbe-9c857721880b req-d4aeda98-23ea-4ef1-9bcf-3e33ab7646b8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:14.565148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9c52f3a0-cfc2-4aac-acbe-9c857721880b req-d4aeda98-23ea-4ef1-9bcf-3e33ab7646b8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:14.581772 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9c52f3a0-cfc2-4aac-acbe-9c857721880b req-d4aeda98-23ea-4ef1-9bcf-3e33ab7646b8 service nova] Creating event network-changed:2984d4e5-9d0d-45e3-8848-62c1e5d7cb14 for instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f on n-h1-862416-4 Oct 26 05:48:14.589592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9c52f3a0-cfc2-4aac-acbe-9c857721880b req-d4aeda98-23ea-4ef1-9bcf-3e33ab7646b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048985 Oct 26 05:48:14.591625 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3400/6787] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:18.099421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1025247004", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "2e7727d9-3142-4ee3-8fc9-a040e7cc135e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-785485053", "security_groups": [{"name": "tempest-secgroup-smoke-1537284824"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:18.222856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] validate_networks() for [('2e7727d9-3142-4ee3-8fc9-a040e7cc135e', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:48:18.632302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:48:18.632728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:48:18.633597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:48:18.634047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:48:18.635020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:48:18.644302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:18.644937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:18.645528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:18.646278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:18.646776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:18.647420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:18.666442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:48:18.672621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:48:18.687540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:48:18.691666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:48:18.745519 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55ef7ddb-1c72-4eb4-82e4-c6d121530be5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.649941 Oct 26 05:48:18.746209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3388/6788] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:48:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 05:48:18.758716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0e8434c2-79fa-494a-befb-f54b91458283 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:18.759449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0e8434c2-79fa-494a-befb-f54b91458283 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:18.859832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0e8434c2-79fa-494a-befb-f54b91458283 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:18.867912 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0e8434c2-79fa-494a-befb-f54b91458283 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1266 microversion: 2.1 time: 0.113833 Oct 26 05:48:18.869167 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3401/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:18 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:19.896366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:19.896995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:19.904886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:19.917530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:19.918557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:19.919573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:19.920061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:19.920504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:20.003850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:20.012806 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09350956-b304-4520-acbc-627a35a2e8df tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1326 microversion: 2.1 time: 0.121312 Oct 26 05:48:20.026367 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3389/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:19 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:21.037257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:21.038715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:21.050067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:21.050579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:21.051033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:21.051757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:21.052398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:21.052997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:21.201328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:21.209359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64af8262-94c9-4ecb-8aeb-29a58c1b62d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1392 microversion: 2.1 time: 0.176020 Oct 26 05:48:21.210146 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3402/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:21 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:48:21.464538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-bb4d3528-2663-416c-8846-db7450065cb9 req-de682608-8168-43e2-8eaa-77bea9db5f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:21.478339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bb4d3528-2663-416c-8846-db7450065cb9 req-de682608-8168-43e2-8eaa-77bea9db5f36 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:21.479554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bb4d3528-2663-416c-8846-db7450065cb9 req-de682608-8168-43e2-8eaa-77bea9db5f36 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:21.480288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bb4d3528-2663-416c-8846-db7450065cb9 req-de682608-8168-43e2-8eaa-77bea9db5f36 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:21.492988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-bb4d3528-2663-416c-8846-db7450065cb9 req-de682608-8168-43e2-8eaa-77bea9db5f36 service nova] Creating event network-changed:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:48:21.503070 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-bb4d3528-2663-416c-8846-db7450065cb9 req-de682608-8168-43e2-8eaa-77bea9db5f36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043646 Oct 26 05:48:21.503710 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3390/6792] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:22.233507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:22.234110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:22.242146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:22.242777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:22.243165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:22.243898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:22.244979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:22.245874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:22.397017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:22.399497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=85 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:22.407679 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94e23868-3605-4490-800f-91090573d107 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1392 microversion: 2.1 time: 0.178744 Oct 26 05:48:22.408255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3403/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:22 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:23.433646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:23.434968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:23.437030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:23.447747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:23.447885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:23.448281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:23.449706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:23.450340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:23.450739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:23.454172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:23.586009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:23.594060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b7a341d1-bf44-417c-8e54-ed8987a87b1a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1392 microversion: 2.1 time: 0.166585 Oct 26 05:48:23.594667 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3391/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:23 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:24.617953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:24.618588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:24.621678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:24.627136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:24.627655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:24.628128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:24.628854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:24.629384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:24.629864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:24.763025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:24.770824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a569cc6a-0d87-47af-9cfb-0053e2e72891 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1392 microversion: 2.1 time: 0.156804 Oct 26 05:48:24.771397 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3404/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:24 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:25.794096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:25.794717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:25.802333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:25.802706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:25.803158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:25.803915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:25.804384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:25.804850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:25.947286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:25.955830 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ecd91af-a370-499d-b973-3f183ec9d4f3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1392 microversion: 2.1 time: 0.165833 Oct 26 05:48:25.956431 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3392/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:25 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:26.157172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-807c7d84-f71f-477f-a87e-0d2538bd897b req-989040fa-5169-461c-bfb5-e35ec62d1459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "name": "network-vif-plugged", "status": "completed", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:26.168273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-807c7d84-f71f-477f-a87e-0d2538bd897b req-989040fa-5169-461c-bfb5-e35ec62d1459 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:26.168793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-807c7d84-f71f-477f-a87e-0d2538bd897b req-989040fa-5169-461c-bfb5-e35ec62d1459 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:26.169242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-807c7d84-f71f-477f-a87e-0d2538bd897b req-989040fa-5169-461c-bfb5-e35ec62d1459 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:26.180405 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-807c7d84-f71f-477f-a87e-0d2538bd897b req-989040fa-5169-461c-bfb5-e35ec62d1459 service nova] Creating event network-vif-plugged:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:48:26.186054 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-807c7d84-f71f-477f-a87e-0d2538bd897b req-989040fa-5169-461c-bfb5-e35ec62d1459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Oct 26 05:48:26.186656 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3405/6797] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:26.979838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:26.981961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:26.989189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:26.989726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:26.990181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:26.990896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:26.991370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:26.992106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:27.127628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:27.135320 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc3f0ecc-209d-43cd-9058-f6757278d8d8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1392 microversion: 2.1 time: 0.159480 Oct 26 05:48:27.135907 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3393/6798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:26 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:28.160632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:28.161372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:28.167727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:28.168414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:28.168882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:28.169623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:28.170101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:28.170545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:28.305853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:28.313676 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e48acc79-13ed-40a1-98fa-f6a8d49190ff tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1563 microversion: 2.1 time: 0.158144 Oct 26 05:48:28.314250 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3406/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:28 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:28.336893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:28.337493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:28.344614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:28.345171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:28.345659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:28.346402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:28.346903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:28.347351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:28.480091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:28.488293 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bc9f4aae-2cb0-4b82-b316-e9bf38276892 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1563 microversion: 2.1 time: 0.155477 Oct 26 05:48:28.488873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3394/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:28 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:30.258758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:48:30.259951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:30.266751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1e6690cd-78ee-4b6b-9016-38061fdbd88f req-87c2e502-9e2a-44dc-8304-92100a8667cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:30.275377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:30.282724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:30.283652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:30.291285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1e6690cd-78ee-4b6b-9016-38061fdbd88f req-87c2e502-9e2a-44dc-8304-92100a8667cb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:30.291785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1e6690cd-78ee-4b6b-9016-38061fdbd88f req-87c2e502-9e2a-44dc-8304-92100a8667cb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:30.292230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1e6690cd-78ee-4b6b-9016-38061fdbd88f req-87c2e502-9e2a-44dc-8304-92100a8667cb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:30.298019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:30.298543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:30.298996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:30.299790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:30.300238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:30.300666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:30.313282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1e6690cd-78ee-4b6b-9016-38061fdbd88f req-87c2e502-9e2a-44dc-8304-92100a8667cb service nova] Creating event network-changed:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:48:30.320414 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1e6690cd-78ee-4b6b-9016-38061fdbd88f req-87c2e502-9e2a-44dc-8304-92100a8667cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070007 Oct 26 05:48:30.321032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3395/6801] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:48:30.458015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:48:30.467661 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2b2ebd5-72f4-4796-a1b4-72fcf7b9ef85 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1563 microversion: 2.1 time: 0.220520 Oct 26 05:48:30.468983 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3407/6802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:48:30 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:48:53.730563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=9 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:53.731336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=25 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:48:53.735521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:48:53.738389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:48:53.745347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:53.745835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:53.746281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:53.747016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:48:53.747481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:48:53.747915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:48:53.800355 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb37bd36-8904-4e7a-add1-61b9e6b8f502 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action" status: 200 len: 24567 microversion: 2.1 time: 0.071629 Oct 26 05:48:53.801266 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3396/6803] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:48:53 2022] POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action => generated 24567 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:49:04.895787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:04.896393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:04.898794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=7 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:04.899527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=21 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:04.905433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:04.905930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:04.906386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:04.907093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:04.907568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:04.908005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.041475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5d69925-891f-4cac-8672-09fbc4e61b6d tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1833 microversion: 2.1 time: 0.149961 Oct 26 05:49:05.042050 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3408/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:04 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:05.066115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:05.066851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:05.069609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:05.070417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:05.076352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:05.076842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:05.077285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.078006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:05.078462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:05.078890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.225691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:05.233725 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c82a8bfc-2dc3-41a6-875b-a5abcdb9ebef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1682 microversion: 2.1 time: 0.172463 Oct 26 05:49:05.234354 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3397/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:05 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:05.340159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:05.342336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:05.349241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:05.349769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:05.350222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.350927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:05.351393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:05.351831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.405531 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d98687d9-4e80-4478-bbde-2c3eb8ffbe97 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action" status: 200 len: 32642 microversion: 2.1 time: 0.069173 Oct 26 05:49:05.406375 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3409/6806] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:49:05 2022] POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action => generated 32642 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 05:49:05.546186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:05.546767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:05.554362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:05.554849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:05.555307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.555984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:05.556444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:05.556874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:05.779713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f011349847ce4c5fa458487e14ed3f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506b6da943864ce5878d3f30f4de41aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:05.780338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] flavor_id is None. Assuming migration. {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 26 05:49:05.780786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:49:06.030142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2a1bdcf-6a48-4041-9958-9f1e12391688 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action" status: 202 len: 0 microversion: 2.1 time: 0.487690 Oct 26 05:49:06.030667 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3398/6807] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:49:05 2022] POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:49:06.040388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:06.041106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:06.048676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:06.049836 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:06.050290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:06.051003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:06.051491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:06.051962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:06.191117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:06.199148 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e29018b-703c-4a17-83b1-e0d5cec1cd6f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1691 microversion: 2.1 time: 0.162987 Oct 26 05:49:06.199737 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3410/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:06 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:07.225559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:07.226190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:07.233174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:07.233705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:07.234157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:07.234864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:07.235333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:07.235812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:07.380683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:07.388640 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec8ee7b5-27b1-4816-80b5-a552d54e6961 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1691 microversion: 2.1 time: 0.168563 Oct 26 05:49:07.389203 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3399/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:07 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:08.412200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:08.412823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:08.420152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:08.420649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:08.421126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:08.421867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:08.422341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:08.422780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:08.558613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:08.567645 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3155ce0e-32d3-4874-8c54-c923a01214f1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.159505 Oct 26 05:49:08.568490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3411/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:08 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:09.592011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:09.592626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:09.599550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:09.600046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:09.600495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:09.601202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:09.601701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:09.602144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:09.738948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:09.746643 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30dd0f44-176f-4ad3-a615-8dfe645c8947 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.158572 Oct 26 05:49:09.747212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3400/6811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:09 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:10.773290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:10.773868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:10.780737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:10.781236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:10.781739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:10.782448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:10.782919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:10.783362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:10.917027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:10.924869 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-783b56a6-5b10-4618-8e5f-7c74ce579356 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.156105 Oct 26 05:49:10.925470 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3412/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:10 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:11.948662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:11.949275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:11.956489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:11.956972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:11.957444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:11.958258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:11.958713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:11.959137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:12.092582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:12.101618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7c6e412-2890-4335-89a0-a325ff583af2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.156902 Oct 26 05:49:12.102196 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3401/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:11 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:13.126310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:13.127117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:13.137058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:13.137615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:13.138073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:13.138790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:13.139271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:13.139742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:13.276624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:13.284475 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-806b745c-71f2-4ca2-b37f-b315a10408c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.162398 Oct 26 05:49:13.285056 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3413/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:13 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:14.308239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:14.308860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:14.316097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:14.316592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:14.317038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:14.317772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:14.318488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:14.318924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:14.460619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:14.468551 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2b84fd45-13d9-4b33-a95a-9866c1337005 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.164506 Oct 26 05:49:14.469129 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3402/6815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:14 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:15.492094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:15.493900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:15.500893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:15.501422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:15.501873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:15.502576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:15.503072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:15.503512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:15.640102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:15.647883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-885b6523-f325-4826-b51c-af578543cb3d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.159709 Oct 26 05:49:15.648473 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3414/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:15 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:16.672379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:16.672969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:16.682443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:16.682955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:16.683526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:16.684185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:16.684558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:16.684982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:16.828542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:16.836421 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e1aafee-ee1d-434f-b9e4-e6a7c1131398 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.168560 Oct 26 05:49:16.837004 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3403/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:16 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:17.860382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:17.861000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:17.869008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:17.869539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:17.869990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:17.870689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:17.871155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:17.871593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:18.008334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:18.016298 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b2e43eb-b1b4-46c0-94e7-d14a7a3548fc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.159839 Oct 26 05:49:18.016868 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3415/6818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:17 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:19.040804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:19.041480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:19.048304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:19.048802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:19.049252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:19.049980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:19.050451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:19.050888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:19.181575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:19.189347 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1ec58da-501c-4ce1-8a5a-fcf4991d13ef tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.153249 Oct 26 05:49:19.189936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3404/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:19 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:20.213556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:20.214069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:20.220870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:20.221402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:20.221860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:20.222571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:20.223041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:20.223487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:20.353844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:20.362135 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c4244b8d-bb73-4946-a7a3-ac1eefde87c9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.152581 Oct 26 05:49:20.362809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3416/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:20 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:21.386269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:21.386923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:21.394549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:21.395041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:21.395488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:21.396182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:21.396642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:21.397073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:21.534140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:21.542837 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b7dcbc60-39ac-42a7-b548-1948712f2a87 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.160558 Oct 26 05:49:21.543418 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3405/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:21 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:22.565958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:22.566612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:22.573727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:22.574222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:22.574672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:22.575368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:22.575833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:22.576273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:22.706518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:22.714947 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e2c64e87-7509-4922-a2af-e72eb8a0e3f0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.152852 Oct 26 05:49:22.715517 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3417/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:22 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:23.738941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:23.739471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:23.747179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:23.747679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:23.748127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:23.748831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:23.749297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:23.749758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:23.885449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:23.893282 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d263ac72-f080-4ac1-ab27-575d0c6b4453 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.158324 Oct 26 05:49:23.893896 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3406/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:23 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:24.915812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:24.916464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:24.923326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:24.923811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:24.924265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:24.924974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:24.925489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:24.925937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:25.056087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:25.063679 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2803c677-f5e4-4d1d-8596-92874d4ff5fa tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1696 microversion: 2.1 time: 0.151702 Oct 26 05:49:25.064248 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3418/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:24 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:49:26.084751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "name": "network-vif-unplugged", "status": "completed", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:26.094118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:26.097175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:26.097965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:26.098150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:26.099774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:26.110449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:26.111058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:26.111591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:26.112048 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] Creating event network-vif-unplugged:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h2-862416-4 Oct 26 05:49:26.112561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:26.113121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:26.113645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:26.119947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:49:26.132691 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-45100239-5580-4bb0-a974-cf36ee5d7e66 req-dda7ac43-0bde-4026-aba1-0aeaa65da9ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122936 Oct 26 05:49:26.134820 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3407/6825] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:26.250319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:26.257986 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-049dbaac-3fda-4243-9734-61036d9b0dec tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1695 microversion: 2.1 time: 0.171461 Oct 26 05:49:26.259656 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3419/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:26 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:27.283066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:27.283800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:27.291680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:27.292173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:27.292627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:27.293377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:27.293847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:27.294282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:27.434403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:27.442400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4009c585-d3a7-4285-af9a-966d26ad90e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1693 microversion: 2.1 time: 0.163624 Oct 26 05:49:27.442992 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3408/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:27 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:28.156911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:28.167766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:28.168257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:28.168713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:28.180628 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] Creating event network-changed:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h2-862416-4 Oct 26 05:49:28.185614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:49:28.196447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6a51bf94-a6dc-4ac9-959a-683c7f9b58d0 req-f764da6c-d379-4274-a4e9-811d02925fcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043548 Oct 26 05:49:28.197081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3420/6828] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:28.466296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:28.466910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:28.473878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:28.474365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:28.474901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:28.475599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:28.476059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:28.476484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:28.610658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:28.619421 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-721eb26a-f7a8-447b-8e3d-842bc3474971 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1693 microversion: 2.1 time: 0.157779 Oct 26 05:49:28.620010 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3409/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:28 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:29.645683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:29.646393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:29.653053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:29.653589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:29.654046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:29.654855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:29.655418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:29.656030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:29.797891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:29.805993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fee2137d-a847-483f-a6ca-9005ca447bd8 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1693 microversion: 2.1 time: 0.165516 Oct 26 05:49:29.806585 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3421/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:29 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:30.829761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:30.830394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:30.838004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:30.838733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:30.839283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:30.840114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:30.840674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:30.841236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:30.973945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:30.982385 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-188b57ab-9331-4c22-a6b9-787547032678 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1690 microversion: 2.1 time: 0.156559 Oct 26 05:49:30.982976 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3410/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:30 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:31.004789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:31.005352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:31.012698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:31.013191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:31.013674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:31.014376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:31.014844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:31.015278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:31.127174 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d7c141ec-8088-44e8-a38c-7c57038524c2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action" status: 202 len: 0 microversion: 2.1 time: 0.125967 Oct 26 05:49:31.127716 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3422/6832] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:49:30 2022] POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:49:31.136062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:31.136691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:31.142804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:31.143302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:31.143775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:31.144551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:31.145072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:31.145611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:31.284489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:31.293101 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16290734-2ba1-455f-a56d-76c997fba34e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1689 microversion: 2.1 time: 0.161071 Oct 26 05:49:31.293722 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3411/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:31 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:32.319774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:32.320502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:32.327442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:32.327933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:32.328394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:32.329111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:32.329617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:32.330069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:32.346337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:32.764893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:32.772890 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8892019-2306-4fee-a4fd-3803129fb0a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1689 microversion: 2.1 time: 0.458441 Oct 26 05:49:32.773492 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3423/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:32 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1689 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:33.639755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "name": "network-vif-plugged", "status": "completed", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:33.651928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:33.652421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:33.652882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:33.657279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:33.668506 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] Creating event network-vif-plugged:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h2-862416-4 Oct 26 05:49:33.674391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:49:33.688056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-17c47121-dae0-4df4-a4bf-580dd2c154dc req-f724644e-b1f1-49e0-9163-f71748d2ef62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122846 Oct 26 05:49:33.688669 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3412/6835] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:33.796054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:33.796674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:33.803487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:33.804097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:33.804425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:33.805131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:33.805698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:33.806140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:33.939127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:33.949253 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc057168-ae88-4413-aefa-b7afd1919114 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1689 microversion: 2.1 time: 0.157185 Oct 26 05:49:33.949847 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3424/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:33 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:34.676377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "name": "network-vif-unplugged", "status": "completed", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:34.687099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:34.687576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:34.688196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:34.701056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] Creating event network-vif-unplugged:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:49:34.706387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:49:34.717139 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9380a762-78f5-463c-9ede-c6ec00b7b427 req-e8772414-172b-44e3-8d26-a40fb60bfd6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045752 Oct 26 05:49:34.717790 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3413/6837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:34.973881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:34.974656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:34.978576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=39 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:34.985166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:34.985709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:34.986162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:34.987075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:34.987543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:34.987983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:35.126640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:35.135504 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a1098c8f-1a44-4221-98b2-0cafdf6a40ba tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1689 microversion: 2.1 time: 0.166905 Oct 26 05:49:35.136081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3425/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:34 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:36.160343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:36.161048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:36.162998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=37 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:36.169769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:36.170264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:36.170698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:36.171388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:36.171844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:36.172270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:36.303615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:36.311861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-be01cb5c-017f-4394-a2ba-1f5657a8767d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1689 microversion: 2.1 time: 0.156727 Oct 26 05:49:36.312430 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3414/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:36 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:36.752633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:36.764467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:36.764964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:36.765450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:36.777895 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] Creating event network-changed:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:49:36.783104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:49:36.794094 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c3a1cbf2-a409-4edf-bc48-62e2771d6bbb req-e083000a-ef43-4004-bf80-1b376ad78161 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045146 Oct 26 05:49:36.794690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3426/6840] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:37.334676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:37.335294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:37.348078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:37.348983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:37.349571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:37.350724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:37.351686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:37.353108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:37.585484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:37.594210 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8be7bc55-7fe6-4ecf-bbab-196977b1e864 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1689 microversion: 2.1 time: 0.263537 Oct 26 05:49:37.594888 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3415/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:37 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:38.619494 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:38.620209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:38.626491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:38.626991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:38.627441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:38.628145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:38.628617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:38.629060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:38.764694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:38.772725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-156039df-4ec6-4ceb-89c5-b79f61ca687c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1682 microversion: 2.1 time: 0.159018 Oct 26 05:49:38.773336 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3427/6842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:38 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:49:40.600208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e8d902bc-0131-4695-a036-5e0df823351e req-236498cb-c382-47d9-918b-c62dd043114a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "name": "network-vif-plugged", "status": "completed", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:40.611617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e8d902bc-0131-4695-a036-5e0df823351e req-236498cb-c382-47d9-918b-c62dd043114a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:40.612105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e8d902bc-0131-4695-a036-5e0df823351e req-236498cb-c382-47d9-918b-c62dd043114a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:40.612541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e8d902bc-0131-4695-a036-5e0df823351e req-236498cb-c382-47d9-918b-c62dd043114a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:40.626773 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e8d902bc-0131-4695-a036-5e0df823351e req-236498cb-c382-47d9-918b-c62dd043114a service nova] Creating event network-vif-plugged:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:49:40.631776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e8d902bc-0131-4695-a036-5e0df823351e req-236498cb-c382-47d9-918b-c62dd043114a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 Oct 26 05:49:40.632471 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3416/6843] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:54.892275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:54.892822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:54.893844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=5 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:54.894904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=20 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:54.897118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=5 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:54.897831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=25 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:49:54.900877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d20c3a64-522e-4047-bb7a-a68f466573b3 req-07efdc7e-af5d-44f9-aadb-fba9bf689322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f", "tag": "2984d4e5-9d0d-45e3-8848-62c1e5d7cb14"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:54.901448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:54.901945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:54.902931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:54.903159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:54.903791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:54.904247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:54.914184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d20c3a64-522e-4047-bb7a-a68f466573b3 req-07efdc7e-af5d-44f9-aadb-fba9bf689322 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:54.914926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d20c3a64-522e-4047-bb7a-a68f466573b3 req-07efdc7e-af5d-44f9-aadb-fba9bf689322 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:54.915495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d20c3a64-522e-4047-bb7a-a68f466573b3 req-07efdc7e-af5d-44f9-aadb-fba9bf689322 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:54.928968 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d20c3a64-522e-4047-bb7a-a68f466573b3 req-07efdc7e-af5d-44f9-aadb-fba9bf689322 service nova] Creating event network-changed:2984d4e5-9d0d-45e3-8848-62c1e5d7cb14 for instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f on n-h1-862416-4 Oct 26 05:49:54.935285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d20c3a64-522e-4047-bb7a-a68f466573b3 req-07efdc7e-af5d-44f9-aadb-fba9bf689322 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043799 Oct 26 05:49:54.941288 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3417/6844] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:49:54.948476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:49:55.036355 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-638008cf-8c66-49f6-aa30-c99a956d26f4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 204 len: 0 microversion: 2.1 time: 0.147514 Oct 26 05:49:55.041349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3428/6845] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:49:54 2022] DELETE /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:49:55.046986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:55.047710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:55.054070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:55.054576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:55.055025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:55.056569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:55.057053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:55.057524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:55.196304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:55.204426 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-44a9c8b7-ae03-4ed4-847a-08a8a3cf654f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1577 microversion: 2.1 time: 0.161808 Oct 26 05:49:55.205244 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3418/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:55 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:49:56.230017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:56.230767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:56.237279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:56.237799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:56.238252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:56.238946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:56.239414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:56.239852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:56.381995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:56.391302 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-226b6023-ffcb-4a88-9e56-71de9cf9b7dd tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1577 microversion: 2.1 time: 0.166708 Oct 26 05:49:56.392087 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3429/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:56 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:57.145335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-90099772-5ff6-4302-b068-65f8aa98d641 req-a0180ff6-a827-48db-8f1a-8cf8426af93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f", "name": "network-vif-deleted", "tag": "2984d4e5-9d0d-45e3-8848-62c1e5d7cb14"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:49:57.156718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-90099772-5ff6-4302-b068-65f8aa98d641 req-a0180ff6-a827-48db-8f1a-8cf8426af93a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:57.157281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-90099772-5ff6-4302-b068-65f8aa98d641 req-a0180ff6-a827-48db-8f1a-8cf8426af93a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:57.157809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-90099772-5ff6-4302-b068-65f8aa98d641 req-a0180ff6-a827-48db-8f1a-8cf8426af93a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:57.169665 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-90099772-5ff6-4302-b068-65f8aa98d641 req-a0180ff6-a827-48db-8f1a-8cf8426af93a service nova] Creating event network-vif-deleted:2984d4e5-9d0d-45e3-8848-62c1e5d7cb14 for instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f on n-h1-862416-4 Oct 26 05:49:57.174687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-90099772-5ff6-4302-b068-65f8aa98d641 req-a0180ff6-a827-48db-8f1a-8cf8426af93a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033101 Oct 26 05:49:57.175287 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3419/6848] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:49:57.414941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:57.416328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:57.423959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:57.424611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:57.425070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:57.425852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:57.426481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:57.426927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:57.498664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:57.506695 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be306ba4-6ade-4526-ac01-9a848e6352f3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1226 microversion: 2.1 time: 0.095794 Oct 26 05:49:57.507615 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3430/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:57 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:58.532389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:58.533097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:58.539409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:58.539953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:58.540403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:58.541179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:58.541674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:58.542107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:58.605533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:58.613485 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fad2fdb4-25d6-4954-891e-4e4173cc7854 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1226 microversion: 2.1 time: 0.086193 Oct 26 05:49:58.614064 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3420/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:58 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:49:59.637353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:49:59.638002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:49:59.644972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:59.645620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:59.646079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:59.646908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:49:59.647388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:49:59.647839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:49:59.713702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:49:59.721720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fbf6e956-50bc-4d64-93c8-8336d5249d50 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1226 microversion: 2.1 time: 0.088462 Oct 26 05:49:59.722309 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3431/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:49:59 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:00.745846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:00.746400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:00.753219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:00.753735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:00.754172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:00.754865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:00.755325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:00.755754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:00.819480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:00.828667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cba1301e-084f-4a4f-8bb2-fbcf815e3c1f tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 200 len: 1226 microversion: 2.1 time: 0.087593 Oct 26 05:50:00.829241 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3421/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:00 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:50:01.852820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:01.853557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:01.860357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:01.860910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:01.861339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:01.862050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:01.862523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:01.862969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:01.876095 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f could not be found. Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f HTTP/1.1 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f could not be found. Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f'} Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f could not be found. Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f could not be found. Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:01.877824 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f could not be found. Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be07077b-767a-4b62-a83f-ff05cb2bdfb3 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f" status: 404 len: 111 microversion: 2.1 time: 0.031012 Oct 26 05:50:01.882150 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3432/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:01 2022] GET /compute/v2.1/servers/6566f087-cb5c-4e84-9dd2-d5b7d2a9d68f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:50:02.980648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:02.983238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:02.990369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:02.990862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:02.991336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:02.992148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:02.992627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:02.993154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:03.060082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7954746e-33d0-4cea-b6df-c979c416c427 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action" status: 200 len: 63040 microversion: 2.1 time: 0.083139 Oct 26 05:50:03.060752 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3422/6854] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:50:02 2022] POST /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829/action => generated 63040 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:50:08.121921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:08.122717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:08.124724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b846f60e-157e-46e7-829f-e97ed0f17ffe req-8b2821c7-af4e-481b-bb50-0401ac1a9e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62061da-dcd2-4a57-9762-5a2d6f637972", "tag": "621075c9-df45-437f-b20d-33ada67fae32"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:08.130493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:08.131076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:08.131605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:08.132434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:08.132975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:08.134160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:08.136950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b846f60e-157e-46e7-829f-e97ed0f17ffe req-8b2821c7-af4e-481b-bb50-0401ac1a9e35 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:08.137461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b846f60e-157e-46e7-829f-e97ed0f17ffe req-8b2821c7-af4e-481b-bb50-0401ac1a9e35 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:08.137895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b846f60e-157e-46e7-829f-e97ed0f17ffe req-8b2821c7-af4e-481b-bb50-0401ac1a9e35 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:08.149099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b846f60e-157e-46e7-829f-e97ed0f17ffe req-8b2821c7-af4e-481b-bb50-0401ac1a9e35 service nova] Creating event network-changed:621075c9-df45-437f-b20d-33ada67fae32 for instance a62061da-dcd2-4a57-9762-5a2d6f637972 on n-h2-862416-4 Oct 26 05:50:08.155151 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b846f60e-157e-46e7-829f-e97ed0f17ffe req-8b2821c7-af4e-481b-bb50-0401ac1a9e35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034327 Oct 26 05:50:08.156316 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3423/6855] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:50:08.172284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:50:08.257127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-78360109-48ab-4cb9-ad64-73100cda32ff tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 204 len: 0 microversion: 2.1 time: 0.139054 Oct 26 05:50:08.258013 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3433/6856] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:50:08 2022] DELETE /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:50:08.268668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:08.269713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:08.276861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:08.277571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:08.278177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:08.279049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:08.279659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:08.280238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:08.420829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:08.428654 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3514192-a878-4c29-bfed-c3ea9d404934 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1579 microversion: 2.1 time: 0.165030 Oct 26 05:50:08.429624 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3424/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:08 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:09.267491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:09.268199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:09.275123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:09.275642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:09.276092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:09.276800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:09.277268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:09.277755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:09.419753 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9877ab8-a98f-4aba-b61e-508fc7d1868e tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1833 microversion: 2.1 time: 0.155725 Oct 26 05:50:09.420166 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3434/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:09 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1833 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:09.453884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:09.454511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:09.462448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:09.463179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:09.463625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:09.464576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:09.465584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:09.466241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:09.718559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:09.726989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d237a437-f3c5-45d6-bd34-2f1a66d091db tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1579 microversion: 2.1 time: 0.276990 Oct 26 05:50:09.729027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3425/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:09 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1579 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:10.308608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9b3e43bd-bb04-4bea-95dd-4fb61d66d640 req-fd625c76-0ae2-4bbe-9b3a-0d3f792a6807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62061da-dcd2-4a57-9762-5a2d6f637972", "name": "network-vif-deleted", "tag": "621075c9-df45-437f-b20d-33ada67fae32"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:10.322706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9b3e43bd-bb04-4bea-95dd-4fb61d66d640 req-fd625c76-0ae2-4bbe-9b3a-0d3f792a6807 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.323208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9b3e43bd-bb04-4bea-95dd-4fb61d66d640 req-fd625c76-0ae2-4bbe-9b3a-0d3f792a6807 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.323661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9b3e43bd-bb04-4bea-95dd-4fb61d66d640 req-fd625c76-0ae2-4bbe-9b3a-0d3f792a6807 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.339241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9b3e43bd-bb04-4bea-95dd-4fb61d66d640 req-fd625c76-0ae2-4bbe-9b3a-0d3f792a6807 service nova] Creating event network-vif-deleted:621075c9-df45-437f-b20d-33ada67fae32 for instance a62061da-dcd2-4a57-9762-5a2d6f637972 on n-h2-862416-4 Oct 26 05:50:10.346486 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9b3e43bd-bb04-4bea-95dd-4fb61d66d640 req-fd625c76-0ae2-4bbe-9b3a-0d3f792a6807 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041744 Oct 26 05:50:10.346717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3435/6860] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:50:10.380115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:10.380755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:10.384006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1f6caaf3-98cc-46d1-b6b5-8b75ca2e4de7 req-903dec35-179a-4517-b16c-3f5399018725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:10.395456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1f6caaf3-98cc-46d1-b6b5-8b75ca2e4de7 req-903dec35-179a-4517-b16c-3f5399018725 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.396155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1f6caaf3-98cc-46d1-b6b5-8b75ca2e4de7 req-903dec35-179a-4517-b16c-3f5399018725 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.396343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.396611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1f6caaf3-98cc-46d1-b6b5-8b75ca2e4de7 req-903dec35-179a-4517-b16c-3f5399018725 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.397705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.398542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.400683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.406103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.406642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.409417 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1f6caaf3-98cc-46d1-b6b5-8b75ca2e4de7 req-903dec35-179a-4517-b16c-3f5399018725 service nova] Creating event network-changed:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:50:10.416450 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1f6caaf3-98cc-46d1-b6b5-8b75ca2e4de7 req-903dec35-179a-4517-b16c-3f5399018725 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037331 Oct 26 05:50:10.417420 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3436/6861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:50:10.445827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:50:10.545542 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-754bc29c-f858-4af9-8720-f0f20fc14b54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 204 len: 0 microversion: 2.1 time: 0.168351 Oct 26 05:50:10.546643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3426/6862] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:50:10 2022] DELETE /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:50:10.555172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:10.556185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:10.562787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.563515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.564165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.565058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.565727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.566327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.737527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:10.750676 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-155a5264-9f27-45eb-90c6-1a5e745ac22b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1688 microversion: 2.1 time: 0.199606 Oct 26 05:50:10.753069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:10.754051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:10.754271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3437/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:10 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:10.761082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.762048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.762567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.763471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:10.764376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:10.764815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:10.846632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:10.856448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f34d562d-c404-409c-8fd6-822e9062ed75 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1226 microversion: 2.1 time: 0.108191 Oct 26 05:50:10.857974 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3427/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:10 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:11.777925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:11.778712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:11.788633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:11.789081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:11.789564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:11.791437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:11.791907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:11.792349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:11.880008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:11.880707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:11.902711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:11.903599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:11.904262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:11.905226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:11.905934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:11.906581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:11.937045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:11.947126 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3d65b16d-aa0d-4cc8-8334-16da3f63d3e9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1688 microversion: 2.1 time: 0.174035 Oct 26 05:50:11.948419 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3438/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:11 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:11.984305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:11.992563 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cd4151d-3bbe-4d49-97f8-a7003ef6375a tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1226 microversion: 2.1 time: 0.116348 Oct 26 05:50:11.997353 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3428/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:11 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:50:12.586700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-82cee163-66aa-4735-a071-36a469207cc7 req-2f718ab6-cbbe-40f1-824b-2c966aa71c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac6a52b-de23-4a1a-bb2a-5da720201829", "name": "network-vif-deleted", "tag": "e528a939-c4c5-4df7-883d-58503bf58dc0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:12.597769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-82cee163-66aa-4735-a071-36a469207cc7 req-2f718ab6-cbbe-40f1-824b-2c966aa71c74 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:12.598631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-82cee163-66aa-4735-a071-36a469207cc7 req-2f718ab6-cbbe-40f1-824b-2c966aa71c74 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:12.599137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-82cee163-66aa-4735-a071-36a469207cc7 req-2f718ab6-cbbe-40f1-824b-2c966aa71c74 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:12.611784 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-82cee163-66aa-4735-a071-36a469207cc7 req-2f718ab6-cbbe-40f1-824b-2c966aa71c74 service nova] Creating event network-vif-deleted:e528a939-c4c5-4df7-883d-58503bf58dc0 for instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 on n-h1-862416-4 Oct 26 05:50:12.617255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-82cee163-66aa-4735-a071-36a469207cc7 req-2f718ab6-cbbe-40f1-824b-2c966aa71c74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Oct 26 05:50:12.622037 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3439/6867] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:50:12.972529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:12.973822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:12.981997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:12.982496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:12.982943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:12.983663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:12.984128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:12.984563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:13.016695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:13.017461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:13.025339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:13.025972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:13.026575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:13.027388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:13.027958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:13.028496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:13.035766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:13.036273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:13.036728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:13.037197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lazy-loading 'fault' on Instance uuid 1ac6a52b-de23-4a1a-bb2a-5da720201829 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:50:13.092021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:13.100098 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1005dc9-ee2b-498b-a18d-87945cf18cb0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 200 len: 1356 microversion: 2.1 time: 0.131535 Oct 26 05:50:13.115393 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3429/6868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:12 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 1356 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:13.119073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:13.127970 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9a192f8-bb52-4b3d-9911-6759bf5cf927 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1226 microversion: 2.1 time: 0.115817 Oct 26 05:50:13.135491 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3440/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:13 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:50:14.125480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:14.126095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 1ac6a52b-de23-4a1a-bb2a-5da720201829] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:14.132888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:14.133457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:14.134446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:14.135144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:14.135604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:14.136033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:14.150143 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] HTTP exception thrown: Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 could not be found. Oct 26 05:50:14.150807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:14.151438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Request method failure captured: Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 HTTP/1.1 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMl1ceVdeaB5esmqIkWZv56IC-fWfxR6Muj4iD4W3N-oi6mq2_r6PjrY_UTVpbB18lv60am780slmoNAsVVfb4JlW2yo_Qmbe3RY3QYSMRII1sKepK3vRa-9ta_pLLcerIJHhg0rvc4UkuRx28m52JpB0mRQABrruRYrt5RFU8DWq0s Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: a83d4b60397143bf90254fc3990dc0a5 Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 could not be found. Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '1ac6a52b-de23-4a1a-bb2a-5da720201829'} Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 could not be found. Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 could not be found. Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:14.151807 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 could not be found. Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Returning 404 to user: Instance 1ac6a52b-de23-4a1a-bb2a-5da720201829 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8ac88730-f616-4ec9-8731-322df6cfe264 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829" status: 404 len: 111 microversion: 2.1 time: 0.031761 Oct 26 05:50:14.156564 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3430/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:14 2022] GET /compute/v2.1/servers/1ac6a52b-de23-4a1a-bb2a-5da720201829 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:50:14.162751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:14.163258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:14.163715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:14.164433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:14.165998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:14.166255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:14.242533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f10f2d38ae40feb5c04a344907b807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bb2962e7f94c67b95be1be49f54946', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:14.250969 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-772770fd-b5c1-44b8-89b5-68ea045e341b tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 200 len: 1226 microversion: 2.1 time: 0.104227 Oct 26 05:50:14.251657 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3441/6871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:14 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:50:15.275283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:15.275884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: a62061da-dcd2-4a57-9762-5a2d6f637972] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:15.282874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:15.283372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:15.283815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:15.284525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:15.284988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:15.285449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:15.300533 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance a62061da-dcd2-4a57-9762-5a2d6f637972 could not be found. Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 HTTP/1.1 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance a62061da-dcd2-4a57-9762-5a2d6f637972 could not be found. Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'a62061da-dcd2-4a57-9762-5a2d6f637972'} Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62061da-dcd2-4a57-9762-5a2d6f637972 could not be found. Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62061da-dcd2-4a57-9762-5a2d6f637972 could not be found. Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:15.302414 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62061da-dcd2-4a57-9762-5a2d6f637972 could not be found. Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance a62061da-dcd2-4a57-9762-5a2d6f637972 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cdec5fe4-4b37-48ac-a1fd-834595595823 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972" status: 404 len: 111 microversion: 2.1 time: 0.033279 Oct 26 05:50:15.307131 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3431/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:15 2022] GET /compute/v2.1/servers/a62061da-dcd2-4a57-9762-5a2d6f637972 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:50:15.823113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:15.823721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:15.831252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:15.832041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:15.832503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:15.833238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:15.833741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:15.834189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:15.850607 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b HTTP/1.1 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '92e7fc98-b839-43fb-9934-f73057f52a6b'} Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:50:15.852897 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.857397 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.869554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:50:15.870713 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8d9b9707-b2f0-4540-aed6-ff71061cade4 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 404 len: 111 microversion: 2.1 time: 0.052161 Oct 26 05:50:15.876856 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3442/6873] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:50:15 2022] DELETE /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:50:15.884278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:15.886814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] [instance: 92e7fc98-b839-43fb-9934-f73057f52a6b] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:15.894010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:15.894609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:15.895206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:15.895985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:15.896662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:15.897170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:15.916468 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] HTTP exception thrown: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Request method failure captured: Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b HTTP/1.1 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMcSJpY3DYc66P_uztdB92DV5njIZmae9NINMbN3VTzE9O6-ZtBFA6b3eeAFsk-_8401aDrJgJ8tThdvXdByrkVTgPexu6UTQgfYyw1j6378IiFgXs-u5U6PqL6V_v65uUuy4nS2wjyoYU45h8dhhTxn-eogQEAbUkkF0P94iPIvF4o Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93bb2962e7f94c67b95be1be49f54946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 93bb2962e7f94c67b95be1be49f54946 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestVolumeBootPattern-453240989 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 25f10f2d38ae40feb5c04a344907b807 Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestVolumeBootPattern-453240989-project Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '92e7fc98-b839-43fb-9934-f73057f52a6b'} Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:50:15.918076 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Returning 404 to user: Instance 92e7fc98-b839-43fb-9934-f73057f52a6b could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:50:15.921687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-272e82db-9e56-4017-8e39-0be14e984970 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b" status: 404 len: 111 microversion: 2.1 time: 0.041405 Oct 26 05:50:15.924408 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3432/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:15 2022] GET /compute/v2.1/servers/92e7fc98-b839-43fb-9934-f73057f52a6b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:50:17.899560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15442c0d-802d-4e4e-9d86-09c425fb5268 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '.version_select at 0x7f470926b670>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:17.947375 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15442c0d-802d-4e4e-9d86-09c425fb5268 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-785485053" status: 202 len: 0 microversion: 2.1 time: 0.051642 Oct 26 05:50:17.948651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3443/6875] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 05:50:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-785485053 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:50:17.985625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b0376bc3-230e-4a02-8c94-276334b9296b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: .version_select at 0x7f470a15b790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-220669143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ2AEQJUJRXxJaeplMA/COi99iEFkQ+EMLian0sU3HrQIDaFoeexCpQ/4+uq5Q/LMCIIfSya66LFBH/WVRkpokUNTvoa8o66sLUUDooSQyMbBSxObcEH/2KKQW/GOhzGg=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:18.002577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b0376bc3-230e-4a02-8c94-276334b9296b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:50:18.009248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-b0376bc3-230e-4a02-8c94-276334b9296b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:50:18.035723 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b0376bc3-230e-4a02-8c94-276334b9296b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053930 Oct 26 05:50:18.036449 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3433/6876] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:50:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:50:19.466906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-448205a9-3e6b-4fb2-a5f7-a6ffee08e109 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] Calling method '.version_select at 0x7f470ea58310>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:19.512776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-448205a9-3e6b-4fb2-a5f7-a6ffee08e109 tempest-TestVolumeBootPattern-453240989 tempest-TestVolumeBootPattern-453240989-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1141262165" status: 202 len: 0 microversion: 2.1 time: 0.053518 Oct 26 05:50:19.513394 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3444/6877] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 26 05:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1141262165 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:50:25.906037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:25.968485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-225133292", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "20a0abaf-751e-46b5-8bf0-eea041be12d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-220669143", "security_groups": [{"name": "tempest-secgroup-smoke-1535461581"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:25.979419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:26.156115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] validate_networks() for [('20a0abaf-751e-46b5-8bf0-eea041be12d1', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:50:27.009995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:50:27.010584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:50:27.011100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:50:27.011670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:50:27.012250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:50:27.021661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:27.022327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:27.022873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:27.023724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:27.025091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:27.025681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:27.046190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:50:27.051999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:50:27.065858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:50:27.068217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:50:27.127827 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de73975c-7de9-4afd-8df4-eb9564a2f189 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.268969 Oct 26 05:50:27.128497 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3434/6878] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:50:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:50:27.141249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9d9627f-c356-42f0-a067-4319b372b0f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:27.143405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9d9627f-c356-42f0-a067-4319b372b0f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:27.154663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:27.156112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:27.230266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9d9627f-c356-42f0-a067-4319b372b0f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:27.238789 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9d9627f-c356-42f0-a067-4319b372b0f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1265 microversion: 2.1 time: 0.102560 Oct 26 05:50:27.240966 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3445/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:27 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:28.276181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:28.276971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:28.294128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:28.294633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:28.303600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:28.304525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:28.305029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:28.311168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:28.475206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:28.488341 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-18c3fe8e-18e0-4b27-8afe-4b8ab0861ef1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1261 microversion: 2.1 time: 0.227198 Oct 26 05:50:28.489035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3435/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:28 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:29.517043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:29.519104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:29.531907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:29.532808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:29.533557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:29.534509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:29.535167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:29.535871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:29.628147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:29.640031 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-027d7bf5-4ad6-4200-8b59-c45c34df9f25 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1323 microversion: 2.1 time: 0.130029 Oct 26 05:50:29.655408 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3446/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:29 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:30.666826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:30.668161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:30.675781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:30.676664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:30.677359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:30.678529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:30.679106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:30.680021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:30.893047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:30.907020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d74bb857-1d2a-4d07-912d-a9820fc4ab48 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.244841 Oct 26 05:50:30.907702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3436/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:30 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:31.238153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-65cbfd6d-b52b-4016-9cd3-e00ada30f1da req-306c2fbf-701c-4717-8cae-c3907d2d8503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:31.253229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65cbfd6d-b52b-4016-9cd3-e00ada30f1da req-306c2fbf-701c-4717-8cae-c3907d2d8503 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:31.254607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65cbfd6d-b52b-4016-9cd3-e00ada30f1da req-306c2fbf-701c-4717-8cae-c3907d2d8503 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:31.255256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-65cbfd6d-b52b-4016-9cd3-e00ada30f1da req-306c2fbf-701c-4717-8cae-c3907d2d8503 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:31.268220 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-65cbfd6d-b52b-4016-9cd3-e00ada30f1da req-306c2fbf-701c-4717-8cae-c3907d2d8503 service nova] Creating event network-changed:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h1-862416-4 Oct 26 05:50:31.273897 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-65cbfd6d-b52b-4016-9cd3-e00ada30f1da req-306c2fbf-701c-4717-8cae-c3907d2d8503 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040307 Oct 26 05:50:31.275851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3447/6883] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:50:31.931450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:31.932100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:31.939144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:31.939641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:31.940086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:31.940787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:31.941252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:31.941706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:32.077022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:32.084774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cc4af114-9d95-4bf5-93d6-fcf6437241f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.157301 Oct 26 05:50:32.085381 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3437/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:31 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:33.109542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:33.110263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:33.116937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:33.117509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:33.118020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:33.118890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:33.120189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:33.120646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:33.255408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:33.263133 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5509088-866e-4502-91cd-b459dc0282a3 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.157905 Oct 26 05:50:33.263715 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3448/6885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:33 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:34.286748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:34.287354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:34.294577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:34.295066 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:34.295503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:34.296192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:34.296648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:34.297076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:34.435318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:34.446014 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5ef3b1ff-e19c-4616-bc75-109a477979c4 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.162362 Oct 26 05:50:34.446271 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3438/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:34 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:35.468553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:35.469293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:35.476730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:35.477856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:35.478319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:35.479065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:35.479534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:35.480003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:35.610784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:35.619178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-034684df-5232-4f73-86ba-0f1f234b0866 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.154511 Oct 26 05:50:35.619798 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3449/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:35 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:36.641940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:36.642558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:36.650456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:36.650976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:36.651418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:36.652120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:36.652577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:36.653002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:36.682721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b77d69ba-c67d-4ce4-b41b-12f4ed633aac req-260e4b34-b386-4de0-a298-efff18f34864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "name": "network-vif-plugged", "status": "completed", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:36.692973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b77d69ba-c67d-4ce4-b41b-12f4ed633aac req-260e4b34-b386-4de0-a298-efff18f34864 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:36.693530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b77d69ba-c67d-4ce4-b41b-12f4ed633aac req-260e4b34-b386-4de0-a298-efff18f34864 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:36.693979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b77d69ba-c67d-4ce4-b41b-12f4ed633aac req-260e4b34-b386-4de0-a298-efff18f34864 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:36.709931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b77d69ba-c67d-4ce4-b41b-12f4ed633aac req-260e4b34-b386-4de0-a298-efff18f34864 service nova] Creating event network-vif-plugged:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h1-862416-4 Oct 26 05:50:36.715506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b77d69ba-c67d-4ce4-b41b-12f4ed633aac req-260e4b34-b386-4de0-a298-efff18f34864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036464 Oct 26 05:50:36.716114 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3450/6888] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:50:36.798161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:36.806611 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-56a9089c-16bf-4faf-9987-46089af6d7be tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.168347 Oct 26 05:50:36.807206 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3439/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:36 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:37.828071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:37.833378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:37.834098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:37.840492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:37.840993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:37.841481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:37.842187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:37.842657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:37.843097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:37.980192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:37.987973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93ccfefc-2e37-4951-82b5-d0c9981072ae tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1391 microversion: 2.1 time: 0.160880 Oct 26 05:50:37.988569 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3451/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:37 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:39.011977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:39.012613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:39.014507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:39.015179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:50:39.021534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:39.022050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:39.022490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:39.023177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:39.023637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:39.024093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:39.157683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:39.166082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6c793d17-5570-4fe8-95f2-fbd83f350ef9 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1563 microversion: 2.1 time: 0.158635 Oct 26 05:50:39.166666 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3440/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:39 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:50:39.188088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:39.188717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:39.195571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:39.196344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:39.196805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:39.197551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:39.198033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:39.198477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:39.328924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:39.337121 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9c60bb85-3e2f-4f5d-8a53-a115aad477f2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1563 microversion: 2.1 time: 0.152371 Oct 26 05:50:39.337717 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3452/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:39 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:50:41.442668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:50:41.443417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:50:41.455680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:41.456182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:41.456619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:41.456736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0abe670b-c152-4496-a656-8478eca9a9a4 req-de225fb1-2757-425d-bce1-e8feca1fb2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:50:41.457344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:41.457801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:41.458434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:41.476276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0abe670b-c152-4496-a656-8478eca9a9a4 req-de225fb1-2757-425d-bce1-e8feca1fb2dc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:50:41.476768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0abe670b-c152-4496-a656-8478eca9a9a4 req-de225fb1-2757-425d-bce1-e8feca1fb2dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:50:41.477476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0abe670b-c152-4496-a656-8478eca9a9a4 req-de225fb1-2757-425d-bce1-e8feca1fb2dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:50:41.489710 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0abe670b-c152-4496-a656-8478eca9a9a4 req-de225fb1-2757-425d-bce1-e8feca1fb2dc service nova] Creating event network-changed:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h1-862416-4 Oct 26 05:50:41.495659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0abe670b-c152-4496-a656-8478eca9a9a4 req-de225fb1-2757-425d-bce1-e8feca1fb2dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043036 Oct 26 05:50:41.500294 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3453/6893] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:50:41.633697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:50:41.643795 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd73249a-a5b8-49d7-b586-08dc1ffd6d74 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1563 microversion: 2.1 time: 0.205226 Oct 26 05:50:41.644398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3441/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:50:41 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:04.924985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=19 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:04.925906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=36 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:04.931555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:04.933884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:04.940799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:04.941300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:04.941817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:04.942522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:04.942993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:04.943439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:05.000487 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e4fa22ee-5020-4d7c-9a56-52784a0f4dca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action" status: 200 len: 24560 microversion: 2.1 time: 0.077145 Oct 26 05:51:05.001048 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3454/6895] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:51:04 2022] POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action => generated 24560 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:51:16.134883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:16.135625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:16.137591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:16.138265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=44 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:16.145496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.146282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.146732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.147485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.147904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.148340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.281781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:16.289448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1442e44e-5b29-465f-95fb-adbe51950ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1681 microversion: 2.1 time: 0.158780 Oct 26 05:51:16.290030 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3442/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:16 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:16.391945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:16.394252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:16.397070 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:51:16.397213 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:51:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action (ip 10.222.0.16) !!! Oct 26 05:51:16.399036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:16.399666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:16.412200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.412701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.413161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.413902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.414377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.414825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.467773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e70bad9-c327-49ff-8d5c-df48d0be9b14 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action" status: 200 len: 32628 microversion: 2.1 time: 0.079939 Oct 26 05:51:16.468433 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3455/6897] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:51:16 2022] POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action => generated 32628 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:51:16.618895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:16.619999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:16.626708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.627203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.627644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.628339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.628800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.629231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.755019 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32e9b6f6-60f4-4e26-9c47-34e41219675c tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1832 microversion: 2.1 time: 0.139791 Oct 26 05:51:16.755606 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3443/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:16 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1832 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:16.786336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:16.788832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:16.796450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.796944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.797425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.798125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:16.798593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:16.799027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:16.825957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lazy-loading 'flavor' on Instance uuid b41e168d-3934-4cf8-9cb3-59210618f574 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:51:16.837892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Going to try to live migrate instance to another host {{(pid=120585) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 26 05:51:18.324751 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81c7ef29-784e-4e2d-9fc8-f60d8f996f3a tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action" status: 202 len: 0 microversion: 2.1 time: 1.542512 Oct 26 05:51:18.325492 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3456/6899] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:51:16 2022] POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action => generated 0 bytes in 1544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:51:18.334177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:18.334789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:18.342773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:18.343257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:18.343697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:18.344388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:18.344842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:18.345265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:18.495182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:18.505096 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7539466-5460-48a0-906e-92c9581d2a9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.174681 Oct 26 05:51:18.506252 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3444/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:18 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:19.530739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:19.531393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:19.538863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:19.539465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:19.540054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:19.540768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:19.541235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:19.542523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:19.546399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ab7705df-19b4-47d9-ad57-d5c24e30b18e req-67614f55-4e52-4474-8761-7635be8e6efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "name": "network-vif-unplugged", "status": "completed", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:19.558207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ab7705df-19b4-47d9-ad57-d5c24e30b18e req-67614f55-4e52-4474-8761-7635be8e6efa service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:19.558849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ab7705df-19b4-47d9-ad57-d5c24e30b18e req-67614f55-4e52-4474-8761-7635be8e6efa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:19.559391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ab7705df-19b4-47d9-ad57-d5c24e30b18e req-67614f55-4e52-4474-8761-7635be8e6efa service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:19.570917 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ab7705df-19b4-47d9-ad57-d5c24e30b18e req-67614f55-4e52-4474-8761-7635be8e6efa service nova] Creating event network-vif-unplugged:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h1-862416-4 Oct 26 05:51:19.577350 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ab7705df-19b4-47d9-ad57-d5c24e30b18e req-67614f55-4e52-4474-8761-7635be8e6efa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035806 Oct 26 05:51:19.578291 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3445/6901] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:19.682333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:19.690572 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d9e7be6a-640d-421a-960b-84a8af1aa46b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.163751 Oct 26 05:51:19.691147 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3457/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:19 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:20.716471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:20.717109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:20.723396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:20.723891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:20.724340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:20.725042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:20.725557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:20.725980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:20.865221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:20.873665 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32d4d089-3746-40db-ab88-509fb448762d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.162494 Oct 26 05:51:20.874250 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3446/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:20 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:21.593622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-36a3ce0e-8809-4154-9f6f-4953d7381e64 req-7edc20ff-fd3a-437f-becc-cfdd85ffab4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:21.605003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-36a3ce0e-8809-4154-9f6f-4953d7381e64 req-7edc20ff-fd3a-437f-becc-cfdd85ffab4d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:21.605523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-36a3ce0e-8809-4154-9f6f-4953d7381e64 req-7edc20ff-fd3a-437f-becc-cfdd85ffab4d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:21.605968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-36a3ce0e-8809-4154-9f6f-4953d7381e64 req-7edc20ff-fd3a-437f-becc-cfdd85ffab4d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:21.616066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-36a3ce0e-8809-4154-9f6f-4953d7381e64 req-7edc20ff-fd3a-437f-becc-cfdd85ffab4d service nova] Creating event network-changed:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h1-862416-4 Oct 26 05:51:21.621546 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-36a3ce0e-8809-4154-9f6f-4953d7381e64 req-7edc20ff-fd3a-437f-becc-cfdd85ffab4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032074 Oct 26 05:51:21.622113 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3458/6904] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:21.896615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:21.897344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:21.913016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:21.913551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:21.913995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:21.914699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:21.915160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:21.915583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:22.056732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:22.065924 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-355eda14-7484-4431-b194-8e1f66f65ac5 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.173734 Oct 26 05:51:22.066521 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3447/6905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:21 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:23.092855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:23.093620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:23.099889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:23.100390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:23.100847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:23.101594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:23.102067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:23.102510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:23.233691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:23.241472 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5dc3d9a0-2ac3-4e01-bd99-e5b243db9cfd tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.154321 Oct 26 05:51:23.242048 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3459/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:23 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:24.266610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:24.267161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:24.274032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:24.274518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:24.274984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:24.275672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:24.276144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:24.276592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:24.422249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:24.430363 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c20763b-def8-40dc-bb50-a77da01d7f6e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.168108 Oct 26 05:51:24.431173 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3448/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:24 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:25.455207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:25.455870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:25.462660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:25.463169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:25.463624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:25.464394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:25.464982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:25.465463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:25.599144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:25.607513 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b23209c-2ce7-4d20-ac51-b9eb48f30d55 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.156322 Oct 26 05:51:25.608085 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3460/6908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:25 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:26.631495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:26.632105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:26.639916 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:26.640397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:26.640832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:26.641546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:26.642000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:26.642427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:26.777559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:26.785354 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c52d090d-fffe-40bc-bb70-00a2674587bc tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.158087 Oct 26 05:51:26.785931 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3449/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:26 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:27.808625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:27.809256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:27.816348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:27.816854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:27.817337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:27.818051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:27.818536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:27.818984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:27.974969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:27.983615 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92bfdcd3-df2a-4d83-8fbd-86ad2670eb23 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.179011 Oct 26 05:51:27.993355 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3461/6910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:27 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:29.008018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:29.008584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:29.016396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:29.016899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:29.017367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:29.018091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:29.018562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:29.018997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:29.163955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:29.171917 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0888d3cd-beca-4111-90b4-105bd40d6d29 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1691 microversion: 2.1 time: 0.167900 Oct 26 05:51:29.172518 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3450/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:29 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:30.195000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:30.195571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:30.203366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.203872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.204326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.205032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.205539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.205984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.341473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:30.349650 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53b51454-dded-4bbf-83fe-707d0b8bc351 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1681 microversion: 2.1 time: 0.158613 Oct 26 05:51:30.350226 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3462/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:30 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:30.373388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:30.374760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:30.382216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.382717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.383161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.383900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.384362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.384790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.518800 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5598bccc-5400-4d2f-92ab-5eccc4754942 tempest-TestNetworkAdvancedServerOps-479067042 tempest-TestNetworkAdvancedServerOps-479067042-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1832 microversion: 2.1 time: 0.149865 Oct 26 05:51:30.519381 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3451/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:30 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1832 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:30.544414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:30.545039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:30.551146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.551648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.552163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.552868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.553365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.553821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.691972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:30.700418 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e37ea5d-4396-4a3b-a62c-4f591c353f18 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1681 microversion: 2.1 time: 0.160445 Oct 26 05:51:30.701116 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3463/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:30 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:30.799508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:30.801780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:30.808107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.808611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.809164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.809890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:30.810354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:30.810782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:30.862054 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e5c364d-7a78-4fcf-99d2-6670f2121dee tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action" status: 200 len: 38664 microversion: 2.1 time: 0.066267 Oct 26 05:51:30.862934 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3452/6915] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:51:30 2022] POST /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574/action => generated 38664 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:51:31.841463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:31.842001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:31.855923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:31.856947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:31.857437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:31.858167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:31.858782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:31.859259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:32.031166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-faa22eb1-d31f-4b34-8357-4c6819498333 req-aaf020d4-534f-41da-85e9-67f4ed3bb572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:32.043289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-faa22eb1-d31f-4b34-8357-4c6819498333 req-aaf020d4-534f-41da-85e9-67f4ed3bb572 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:32.043882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-faa22eb1-d31f-4b34-8357-4c6819498333 req-aaf020d4-534f-41da-85e9-67f4ed3bb572 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:32.044344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-faa22eb1-d31f-4b34-8357-4c6819498333 req-aaf020d4-534f-41da-85e9-67f4ed3bb572 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:32.055930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-faa22eb1-d31f-4b34-8357-4c6819498333 req-aaf020d4-534f-41da-85e9-67f4ed3bb572 service nova] Creating event network-changed:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h2-862416-4 Oct 26 05:51:32.063170 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-faa22eb1-d31f-4b34-8357-4c6819498333 req-aaf020d4-534f-41da-85e9-67f4ed3bb572 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216225 Oct 26 05:51:32.064348 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3453/6916] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:32.170601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:51:32.262859 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0ca89ec8-4285-4b75-8c7b-a83f19264cf1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 204 len: 0 microversion: 2.1 time: 0.425156 Oct 26 05:51:32.263834 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3464/6917] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:51:31 2022] DELETE /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:51:32.273806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:32.274603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:32.286266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:32.288351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:32.289922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:32.290671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:32.291149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:32.291589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:32.428586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:32.449907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c1c3d2d-78e0-4cc8-a6de-f40aef257c89 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1687 microversion: 2.1 time: 0.181112 Oct 26 05:51:32.450757 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3454/6918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:32 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:33.454195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-11f3f8aa-97a1-4f06-a634-d1d8d1230c75 req-8a950542-cb0d-4899-8842-c43315a09e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41e168d-3934-4cf8-9cb3-59210618f574", "name": "network-vif-deleted", "tag": "c2adf825-33ac-4b20-af72-481c5c098675"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:33.467212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-11f3f8aa-97a1-4f06-a634-d1d8d1230c75 req-8a950542-cb0d-4899-8842-c43315a09e50 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:33.469058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-11f3f8aa-97a1-4f06-a634-d1d8d1230c75 req-8a950542-cb0d-4899-8842-c43315a09e50 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:33.469058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-11f3f8aa-97a1-4f06-a634-d1d8d1230c75 req-8a950542-cb0d-4899-8842-c43315a09e50 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:33.475263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:33.476145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:33.481281 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-11f3f8aa-97a1-4f06-a634-d1d8d1230c75 req-8a950542-cb0d-4899-8842-c43315a09e50 service nova] Creating event network-vif-deleted:c2adf825-33ac-4b20-af72-481c5c098675 for instance b41e168d-3934-4cf8-9cb3-59210618f574 on n-h2-862416-4 Oct 26 05:51:33.484244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:33.484973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:33.485608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:33.486390 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-11f3f8aa-97a1-4f06-a634-d1d8d1230c75 req-8a950542-cb0d-4899-8842-c43315a09e50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036514 Oct 26 05:51:33.486520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:33.486889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:33.487328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:33.487441 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3465/6919] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:33.556375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:33.564876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a884f422-f3e7-4809-8644-6164ac34eae7 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 200 len: 1350 microversion: 2.1 time: 0.094429 Oct 26 05:51:33.565564 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3455/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:33 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:51:34.589920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:34.591220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: b41e168d-3934-4cf8-9cb3-59210618f574] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:34.598320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:34.598816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:34.599267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:34.599971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:34.600436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:34.600883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:34.614592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] HTTP exception thrown: Instance b41e168d-3934-4cf8-9cb3-59210618f574 could not be found. Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Request method failure captured: Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 HTTP/1.1 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMl1ceVdeaB5esmqIkWZv56IC-fWfxR6Muj4iD4W3N-oi6mq2_r6PjrY_UTVpbB18lv60am780slmoNAsVVfb4JlW2yo_Qmbe3RY3QYSMRII1sKepK3vRa-9ta_pLLcerIJHhg0rvc4UkuRx28m52JpB0mRQABrruRYrt5RFU8DWq0s Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a83d4b60397143bf90254fc3990dc0a5 Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance b41e168d-3934-4cf8-9cb3-59210618f574 could not be found. Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'b41e168d-3934-4cf8-9cb3-59210618f574'} Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41e168d-3934-4cf8-9cb3-59210618f574 could not be found. Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41e168d-3934-4cf8-9cb3-59210618f574 could not be found. Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:51:34.616279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41e168d-3934-4cf8-9cb3-59210618f574 could not be found. Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Returning 404 to user: Instance b41e168d-3934-4cf8-9cb3-59210618f574 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9e3592b9-f586-405f-9cfd-034cd2acc48c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574" status: 404 len: 111 microversion: 2.1 time: 0.032624 Oct 26 05:51:34.620730 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3466/6921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:34 2022] GET /compute/v2.1/servers/b41e168d-3934-4cf8-9cb3-59210618f574 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:51:37.925904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c840f1b0-3017-4f0c-a2b4-9544b15a9b32 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '.version_select at 0x7f470a2173a0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:37.948173 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c840f1b0-3017-4f0c-a2b4-9544b15a9b32 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-220669143" status: 202 len: 0 microversion: 2.1 time: 0.026060 Oct 26 05:51:37.949918 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3456/6922] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 05:51:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-220669143 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:51:37.977919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4e7144d3-828d-4223-87a3-59af23ad10ca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: .version_select at 0x7f47092f7550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1514486792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4reqq0R/UQ+aMnWT9n/8eJI69M5JStBXdt0vN/T2mAmoTUFkMM9BJcIww8uxOFystBIxprTDJJsWljMGKcvDHBGbdTZ3EsTVrSuG3tnUUNXmDf9hgU8t67zUSj4HlM+Q=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:37.995793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4e7144d3-828d-4223-87a3-59af23ad10ca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:51:38.001528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4e7144d3-828d-4223-87a3-59af23ad10ca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:51:38.024751 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4e7144d3-828d-4223-87a3-59af23ad10ca tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050801 Oct 26 05:51:38.025359 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3467/6923] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:51:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:43.740560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1213062444", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "c3b40deb-801f-4f63-b626-2097bb0a01f4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1514486792", "security_groups": [{"name": "tempest-secgroup-smoke-2105907220"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:43.764207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=74 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:43.861832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] validate_networks() for [('c3b40deb-801f-4f63-b626-2097bb0a01f4', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:51:44.280515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:51:44.280972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:51:44.281541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:51:44.281954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:51:44.282372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:51:44.291113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:44.291599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:44.292043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:44.293653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:44.294115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:44.294543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:44.312120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:51:44.317546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Getting quotas for user a83d4b60397143bf90254fc3990dc0a5 and project 5a947920a8914b3d903c2732a3a29fee. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:51:44.330895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:51:44.333225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:51:44.381949 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82e84467-2c63-4b0d-a700-2bf7ca487091 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645180 Oct 26 05:51:44.383055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3457/6924] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:51:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:51:44.395171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-049a4d69-52d1-45db-9256-01db12c54ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:44.395802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-049a4d69-52d1-45db-9256-01db12c54ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:44.486419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-049a4d69-52d1-45db-9256-01db12c54ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:44.493593 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-049a4d69-52d1-45db-9256-01db12c54ecf tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1267 microversion: 2.1 time: 0.103187 Oct 26 05:51:44.509633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3468/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:44 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:45.518611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:45.519966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:45.528378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:45.529071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:45.529838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:45.530720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:45.531328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:45.531905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:45.645667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:45.654429 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fc74cfd3-3cfe-414f-933d-d8ffad9faeda tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1327 microversion: 2.1 time: 0.140949 Oct 26 05:51:45.655198 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3458/6926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:45 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:46.680798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:46.681374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:46.683607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:46.685634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:46.695194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:46.695723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:46.696299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:46.697119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:46.698025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:46.698550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:46.848605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:46.857360 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ce79a9c-f23c-4fc7-9546-468519a75a34 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.180783 Oct 26 05:51:46.857915 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3469/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:46 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:47.340984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5ef090c7-4e91-4294-bca6-605137bf8e03 req-f24c11f9-99fd-4dcd-a13a-ed85cd6d2889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d442389-2d1c-4fad-95ff-f24cc1b92c1d", "tag": "a95685ea-310b-4d50-a524-54a563c3d484"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:47.347025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:47.352964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5ef090c7-4e91-4294-bca6-605137bf8e03 req-f24c11f9-99fd-4dcd-a13a-ed85cd6d2889 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:47.353500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5ef090c7-4e91-4294-bca6-605137bf8e03 req-f24c11f9-99fd-4dcd-a13a-ed85cd6d2889 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:47.354107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5ef090c7-4e91-4294-bca6-605137bf8e03 req-f24c11f9-99fd-4dcd-a13a-ed85cd6d2889 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:47.366665 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5ef090c7-4e91-4294-bca6-605137bf8e03 req-f24c11f9-99fd-4dcd-a13a-ed85cd6d2889 service nova] Creating event network-changed:a95685ea-310b-4d50-a524-54a563c3d484 for instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d on n-h1-862416-4 Oct 26 05:51:47.371794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5ef090c7-4e91-4294-bca6-605137bf8e03 req-f24c11f9-99fd-4dcd-a13a-ed85cd6d2889 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035227 Oct 26 05:51:47.372415 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3459/6928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:47.881303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:47.881875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:47.889190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:47.889728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:47.890187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:47.890900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:47.891369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:47.891810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:48.031271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:48.038932 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-55b8b9ce-f43b-4a03-b29b-29566c07afd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.161635 Oct 26 05:51:48.039498 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3470/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:47 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:49.063471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:49.064186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:49.070620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:49.071110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:49.071559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:49.072262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:49.072978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:49.073485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:49.211826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:49.220966 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e252b467-a1be-482a-923b-fcf2ff034e56 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.162442 Oct 26 05:51:49.221847 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3460/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:49 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:50.244375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:50.244903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:50.251955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:50.252464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:50.252925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:50.253678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:50.254157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:50.254611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:50.386941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:50.394679 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2880eb0-c88f-4efd-ac47-af8600562380 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.154322 Oct 26 05:51:50.395262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3471/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:50 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:51.418013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:51.418547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:51.425333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:51.425844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:51.426291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:51.426996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:51.427464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:51.427905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:51.565134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:51.573087 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69fe35fc-c53d-41a3-88b9-8b23730ea13b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.159444 Oct 26 05:51:51.573702 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3461/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:51 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:52.595985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:52.596625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:52.603511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:52.604021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:52.604485 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:52.606073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:52.606563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:52.607017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:52.739718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:52.748243 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd78bbf5-54b0-4111-a590-7af940f1063a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.156154 Oct 26 05:51:52.748850 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3472/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:52 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:52.904165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3e692717-4397-434e-be74-ba36edb9a5e4 req-8b084aa5-5468-4cdd-aebc-805b66569170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d442389-2d1c-4fad-95ff-f24cc1b92c1d", "name": "network-vif-plugged", "status": "completed", "tag": "a95685ea-310b-4d50-a524-54a563c3d484"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:52.914478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3e692717-4397-434e-be74-ba36edb9a5e4 req-8b084aa5-5468-4cdd-aebc-805b66569170 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:52.914973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3e692717-4397-434e-be74-ba36edb9a5e4 req-8b084aa5-5468-4cdd-aebc-805b66569170 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:52.915407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3e692717-4397-434e-be74-ba36edb9a5e4 req-8b084aa5-5468-4cdd-aebc-805b66569170 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:52.926788 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3e692717-4397-434e-be74-ba36edb9a5e4 req-8b084aa5-5468-4cdd-aebc-805b66569170 service nova] Creating event network-vif-plugged:a95685ea-310b-4d50-a524-54a563c3d484 for instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d on n-h1-862416-4 Oct 26 05:51:52.931689 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3e692717-4397-434e-be74-ba36edb9a5e4 req-8b084aa5-5468-4cdd-aebc-805b66569170 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Oct 26 05:51:52.932283 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3462/6934] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:51:53.771201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:53.772074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:53.779507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:53.780013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:53.780471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:53.781184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:53.781691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:53.782139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:53.915778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:53.923975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4148fbe-45d5-42c0-a1bc-db47cb98af54 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1393 microversion: 2.1 time: 0.156916 Oct 26 05:51:53.924547 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3473/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:53 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:54.945798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:54.946590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:54.951975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:54.952730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:54.959774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:54.960263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:54.960702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:54.961422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:54.961890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:54.962320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:55.094215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:55.101817 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-92fb9c32-2d59-4913-8c60-11eaaee6aba1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1564 microversion: 2.1 time: 0.157831 Oct 26 05:51:55.102392 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3463/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:54 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:55.124960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:55.125607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:55.128441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:51:55.133232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:55.133758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:55.134210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:55.134911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:55.135374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:55.135810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:55.269364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:55.277733 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eff113ee-ae23-4584-8026-29cbe533a8a0 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1564 microversion: 2.1 time: 0.157432 Oct 26 05:51:55.278314 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3474/6937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:55 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:51:56.877893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:51:56.878518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:51:56.880321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4696a139-e07e-4f8a-af75-82270e863a03 req-f6d93942-8e5b-4ab1-b42a-455d3b59f969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d442389-2d1c-4fad-95ff-f24cc1b92c1d", "tag": "a95685ea-310b-4d50-a524-54a563c3d484"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:51:56.886139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:56.887482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:56.887482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:56.887927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:56.888562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:56.889152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:56.891839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4696a139-e07e-4f8a-af75-82270e863a03 req-f6d93942-8e5b-4ab1-b42a-455d3b59f969 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:51:56.892399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4696a139-e07e-4f8a-af75-82270e863a03 req-f6d93942-8e5b-4ab1-b42a-455d3b59f969 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:51:56.892927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4696a139-e07e-4f8a-af75-82270e863a03 req-f6d93942-8e5b-4ab1-b42a-455d3b59f969 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:51:56.905001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4696a139-e07e-4f8a-af75-82270e863a03 req-f6d93942-8e5b-4ab1-b42a-455d3b59f969 service nova] Creating event network-changed:a95685ea-310b-4d50-a524-54a563c3d484 for instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d on n-h1-862416-4 Oct 26 05:51:56.910535 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4696a139-e07e-4f8a-af75-82270e863a03 req-f6d93942-8e5b-4ab1-b42a-455d3b59f969 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034322 Oct 26 05:51:56.911266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3475/6938] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:51:57.037973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:51:57.046343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3bef287f-f0ff-46e9-bc55-951c4ca352e1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1564 microversion: 2.1 time: 0.173419 Oct 26 05:51:57.047356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3464/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:51:56 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:20.310403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=13 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:52:20.311160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=38 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:52:20.315555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:52:20.317848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:20.325251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:20.325803 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:20.326294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:20.327010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:20.327486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:20.327936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:20.488592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e95372f2-9025-4280-9f71-619de583cfe2 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d/action" status: 200 len: 24560 microversion: 2.1 time: 0.180162 Oct 26 05:52:20.489418 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3476/6940] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:52:20 2022] POST /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d/action => generated 24560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:52:31.471538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:52:31.474654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:31.476641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=11 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:52:31.477488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:52:31.483641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:31.484127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:31.484571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:31.485260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:31.485741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:31.486887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:31.745953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:52:31.746380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:52:31.746863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:52:31.747274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:52:31.747694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:52:31.807546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:31.813252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:31.813797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:31.814301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:31.815207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:31.815679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:31.816124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:31.848512 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f952bce6-27e5-4e01-a5a4-60823fb79b0e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d/action" status: 202 len: 1137 microversion: 2.1 time: 0.381776 Oct 26 05:52:31.849185 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3465/6941] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:52:31 2022] POST /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d/action => generated 1137 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 26 05:52:31.871002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:31.872495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:31.877520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:52:31.878224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:52:31.884173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:31.884781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:31.885245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:31.886038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:31.886957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:31.887151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:32.098526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:32.106559 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3bd1672-1119-46ba-ac58-e46634a48b9e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.239888 Oct 26 05:52:32.107134 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3477/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:31 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:33.130771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:33.131439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:33.138400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:33.138893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:33.139333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:33.140600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:33.141064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:33.141527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:33.275153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:33.283804 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-547cc1ab-b0c8-4990-9c5f-440bd9a38055 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.156730 Oct 26 05:52:33.284200 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3466/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:33 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:34.306989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:34.307632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:34.315936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:34.316434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:34.316891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:34.317635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:34.318110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:34.318556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:34.452908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:34.461722 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79b8df0b-f101-4016-b768-d18fb437855a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.158516 Oct 26 05:52:34.462385 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3478/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:34 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:35.488290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:35.488899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:35.495488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:35.495972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:35.496414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:35.497443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:35.497908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:35.498334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:35.631114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:35.638846 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-08af0ff2-9461-41fc-8dbd-0780112d674f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.155041 Oct 26 05:52:35.639416 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3467/6945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:35 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:36.662284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:36.662910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:36.669751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:36.670248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:36.670702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:36.671405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:36.671873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:36.672315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:36.808735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:36.817157 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b9d2f534-3e30-47ab-a650-150845d16663 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.158903 Oct 26 05:52:36.817760 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3479/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:36 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:37.841644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:37.842290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:37.849470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:37.849959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:37.850400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:37.851094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:37.851556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:37.851986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:37.982917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:37.990604 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f7b3c1f6-1975-4cb2-a626-5a61523f225a tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.153104 Oct 26 05:52:37.991177 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3468/6947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:37 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:39.014661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:39.015289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:39.022755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:39.023253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:39.023708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:39.024408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:39.024874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:39.025340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:39.155034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:39.163728 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-36c4500d-714d-4402-9b14-8b6bb97007e6 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.153164 Oct 26 05:52:39.164286 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3480/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:39 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:40.187403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:40.188014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:40.194978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:40.195401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:40.195838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:40.196525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:40.196989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:40.197444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:40.331914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:40.339580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0b6c3144-ae41-43a3-81e7-9d01dd369b4e tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.156122 Oct 26 05:52:40.340164 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3469/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:40 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:41.364319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:41.364887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:41.371890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:41.372391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:41.372847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:41.373591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:41.374063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:41.374509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:41.516102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:41.524336 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6262af40-42be-48dd-9189-4d2703560100 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.164155 Oct 26 05:52:41.524914 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3481/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:41 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:42.548001 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:42.549120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:42.556145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:42.556634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:42.557076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:42.557821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:42.558267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:42.558699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:42.694750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:42.702757 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e91c8380-c4b4-4428-bd57-66ccc2b1e56b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1692 microversion: 2.1 time: 0.158683 Oct 26 05:52:42.703346 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3470/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:42 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:43.726818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:43.727385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:43.734349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:43.734856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:43.735320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:43.736034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:43.737098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:43.737576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:43.868885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:43.876659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9c6b3ea-6e96-4fe0-8c8c-cd9535b9bf4d tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1698 microversion: 2.1 time: 0.153917 Oct 26 05:52:43.877242 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3482/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:43 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:52:44.899943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:44.900679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:44.907501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:44.908547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:44.909365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:44.910071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:44.910562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:44.910992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:45.047102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:45.055680 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a56ca40b-576b-4a57-9d83-6a5da6170bce tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1698 microversion: 2.1 time: 0.159523 Oct 26 05:52:45.056263 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3471/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:44 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:52:46.079108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:52:46.079743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:52:46.086805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:46.087310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:46.087766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:46.088481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:46.088953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:46.089422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:46.228448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:52:46.236439 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c88d9d1-82df-44c7-b7ec-a60ae8beba7f tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1683 microversion: 2.1 time: 0.161040 Oct 26 05:52:46.237140 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3483/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:52:46 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:52:49.246614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-3da8f816-7d36-40b2-bdae-e088079932b1 req-54a287de-c7fd-49db-8a56-d1e423bbb4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d442389-2d1c-4fad-95ff-f24cc1b92c1d", "name": "network-vif-plugged", "status": "completed", "tag": "a95685ea-310b-4d50-a524-54a563c3d484"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:52:49.258514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3da8f816-7d36-40b2-bdae-e088079932b1 req-54a287de-c7fd-49db-8a56-d1e423bbb4b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:52:49.259012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3da8f816-7d36-40b2-bdae-e088079932b1 req-54a287de-c7fd-49db-8a56-d1e423bbb4b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:52:49.259453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-3da8f816-7d36-40b2-bdae-e088079932b1 req-54a287de-c7fd-49db-8a56-d1e423bbb4b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:52:49.272456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-3da8f816-7d36-40b2-bdae-e088079932b1 req-54a287de-c7fd-49db-8a56-d1e423bbb4b6 service nova] Creating event network-vif-plugged:a95685ea-310b-4d50-a524-54a563c3d484 for instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d on n-h1-862416-4 Oct 26 05:52:49.278483 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-3da8f816-7d36-40b2-bdae-e088079932b1 req-54a287de-c7fd-49db-8a56-d1e423bbb4b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035379 Oct 26 05:52:49.279105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3472/6955] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:12.450900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:12.453141 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:12.455429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=14 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:12.456149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=42 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:12.463081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:12.463584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:12.464044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:12.464758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:12.465234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:12.465711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:12.518044 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79ed263d-434b-4b64-99dd-ebaa6cdba344 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "POST /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d/action" status: 200 len: 24542 microversion: 2.1 time: 0.071282 Oct 26 05:53:12.518695 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3484/6956] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:53:12 2022] POST /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d/action => generated 24542 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 05:53:24.405518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:24.406154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:24.407404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1256e319-dac7-4a0a-bfb5-84be944baac1 req-c7c59539-abe1-4091-a468-f66425261bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d442389-2d1c-4fad-95ff-f24cc1b92c1d", "tag": "a95685ea-310b-4d50-a524-54a563c3d484"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:24.410067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=20 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:24.410923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:24.416600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:24.416920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:24.417143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:24.417575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:24.417709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:24.418431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:24.418909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:24.419348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:24.423895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1256e319-dac7-4a0a-bfb5-84be944baac1 req-c7c59539-abe1-4091-a468-f66425261bc8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:24.424748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1256e319-dac7-4a0a-bfb5-84be944baac1 req-c7c59539-abe1-4091-a468-f66425261bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:24.425272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1256e319-dac7-4a0a-bfb5-84be944baac1 req-c7c59539-abe1-4091-a468-f66425261bc8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:24.438776 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1256e319-dac7-4a0a-bfb5-84be944baac1 req-c7c59539-abe1-4091-a468-f66425261bc8 service nova] Creating event network-changed:a95685ea-310b-4d50-a524-54a563c3d484 for instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d on n-h1-862416-4 Oct 26 05:53:24.446451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1256e319-dac7-4a0a-bfb5-84be944baac1 req-c7c59539-abe1-4091-a468-f66425261bc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043614 Oct 26 05:53:24.447059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3485/6957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:53:24.460009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:53:24.546151 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa5e281c-229f-4811-815b-6ae0cdb8c4ac tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 204 len: 0 microversion: 2.1 time: 0.145073 Oct 26 05:53:24.547373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3473/6958] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:53:24 2022] DELETE /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:53:24.556929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:24.557987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:24.565641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:24.568028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:24.568854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:24.569806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:24.570447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:24.571059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:24.718896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:24.727622 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ea1ad9b-61ea-42a4-9486-c71bc89d246c tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1689 microversion: 2.1 time: 0.175507 Oct 26 05:53:24.728195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3486/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:24 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:25.752439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:25.753287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:25.760754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:25.761251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:25.761726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:25.762574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:25.763051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:25.763593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:25.901346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:25.909072 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f3362606-7590-46d5-9236-dc021a135bd1 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1689 microversion: 2.1 time: 0.160984 Oct 26 05:53:25.909694 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3474/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:25 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:26.834058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-492981f8-f2ea-4a3f-bef2-43fd99e9a808 req-3813082c-69d8-40ca-b27d-4631b2276053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d442389-2d1c-4fad-95ff-f24cc1b92c1d", "name": "network-vif-deleted", "tag": "a95685ea-310b-4d50-a524-54a563c3d484"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:26.844852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-492981f8-f2ea-4a3f-bef2-43fd99e9a808 req-3813082c-69d8-40ca-b27d-4631b2276053 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:26.845527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-492981f8-f2ea-4a3f-bef2-43fd99e9a808 req-3813082c-69d8-40ca-b27d-4631b2276053 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:26.845983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-492981f8-f2ea-4a3f-bef2-43fd99e9a808 req-3813082c-69d8-40ca-b27d-4631b2276053 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:26.858229 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-492981f8-f2ea-4a3f-bef2-43fd99e9a808 req-3813082c-69d8-40ca-b27d-4631b2276053 service nova] Creating event network-vif-deleted:a95685ea-310b-4d50-a524-54a563c3d484 for instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d on n-h1-862416-4 Oct 26 05:53:26.864025 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-492981f8-f2ea-4a3f-bef2-43fd99e9a808 req-3813082c-69d8-40ca-b27d-4631b2276053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033182 Oct 26 05:53:26.864572 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3487/6961] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:26.932713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:26.933402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:26.940129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:26.940618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:26.941056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:26.942383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:26.942836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:26.943260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:26.976494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:26.976985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:26.977470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:26.977921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lazy-loading 'fault' on Instance uuid 7d442389-2d1c-4fad-95ff-f24cc1b92c1d {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:53:27.021400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a83d4b60397143bf90254fc3990dc0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a947920a8914b3d903c2732a3a29fee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:27.028848 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-61fbc2f9-cd5b-46ac-a4ce-c6bb58bffdab tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 200 len: 1357 microversion: 2.1 time: 0.100067 Oct 26 05:53:27.029457 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3475/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:26 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:28.054815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:28.055556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] [instance: 7d442389-2d1c-4fad-95ff-f24cc1b92c1d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:28.061750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:28.062249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:28.062703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:28.063407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:28.063879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:28.064321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:28.079181 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] HTTP exception thrown: Instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d could not be found. Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Request method failure captured: Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d HTTP/1.1 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMl1ceVdeaB5esmqIkWZv56IC-fWfxR6Muj4iD4W3N-oi6mq2_r6PjrY_UTVpbB18lv60am780slmoNAsVVfb4JlW2yo_Qmbe3RY3QYSMRII1sKepK3vRa-9ta_pLLcerIJHhg0rvc4UkuRx28m52JpB0mRQABrruRYrt5RFU8DWq0s Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a947920a8914b3d903c2732a3a29fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 5a947920a8914b3d903c2732a3a29fee Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1552510803 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: a83d4b60397143bf90254fc3990dc0a5 Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1552510803-project Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d could not be found. Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '7d442389-2d1c-4fad-95ff-f24cc1b92c1d'} Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d could not be found. Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d could not be found. Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:28.080819 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d could not be found. Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Returning 404 to user: Instance 7d442389-2d1c-4fad-95ff-f24cc1b92c1d could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f561f934-9371-4545-a1a9-009cb50e193b tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d" status: 404 len: 111 microversion: 2.1 time: 0.033394 Oct 26 05:53:28.085543 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3488/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:28 2022] GET /compute/v2.1/servers/7d442389-2d1c-4fad-95ff-f24cc1b92c1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:53:31.485776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-69756c63-e6ca-4c88-9968-45bce05c4252 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] Calling method '.version_select at 0x7f4709bdfe50>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:31.508184 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-69756c63-e6ca-4c88-9968-45bce05c4252 tempest-TestNetworkAdvancedServerOps-1552510803 tempest-TestNetworkAdvancedServerOps-1552510803-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1514486792" status: 202 len: 0 microversion: 2.1 time: 0.026493 Oct 26 05:53:31.508920 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3476/6964] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 26 05:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1514486792 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:53:43.685879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:43.686622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:43.798180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-984824165", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:43.851262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] validate_networks() for None {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:53:44.042138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:53:44.042601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:53:44.043115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:53:44.043559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:53:44.043988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:53:44.053278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:44.053828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:44.054323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:44.055087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:44.055565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:44.056015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:44.073188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Getting quotas for project 3f48734c416b45b38665ee3d879bee53. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:53:44.078730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Getting quotas for user 8cfdfa2ca00e4dde9eb5da9dc8b2a42f and project 3f48734c416b45b38665ee3d879bee53. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:53:44.091774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:53:44.094167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:53:44.138604 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cbad9993-4bf8-4d42-a399-6f7f59a65f97 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458099 Oct 26 05:53:44.139253 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3489/6965] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:53:44.151150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:44.151918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:44.158998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-280bae91-da9f-452e-8861-aaab1403633a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:44.159173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-280bae91-da9f-452e-8861-aaab1403633a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:44.227886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-280bae91-da9f-452e-8861-aaab1403633a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:44.235124 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-280bae91-da9f-452e-8861-aaab1403633a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1221 microversion: 2.1 time: 0.086737 Oct 26 05:53:44.235707 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3477/6966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:44 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:45.259582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23fd4bb7-7a00-4141-a740-3897499b0a3b tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:45.260188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23fd4bb7-7a00-4141-a740-3897499b0a3b tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:45.317648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-23fd4bb7-7a00-4141-a740-3897499b0a3b tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:45.324725 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23fd4bb7-7a00-4141-a740-3897499b0a3b tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1221 microversion: 2.1 time: 0.070112 Oct 26 05:53:45.325580 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3490/6967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:45 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:46.348760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6fab173d-5316-4058-b588-29762391fa2a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:46.349452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6fab173d-5316-4058-b588-29762391fa2a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:46.402311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6fab173d-5316-4058-b588-29762391fa2a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:46.409097 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6fab173d-5316-4058-b588-29762391fa2a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1221 microversion: 2.1 time: 0.064217 Oct 26 05:53:46.409715 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3478/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:46 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1221 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:47.432998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:47.433653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:47.440802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:47.441294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:47.441956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:47.442870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:47.444099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:47.444863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:47.509792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:47.517614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-359e5312-3af2-4c41-be81-5dd906e90ee5 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1279 microversion: 2.1 time: 0.088563 Oct 26 05:53:47.518114 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3491/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:47 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:48.541040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:48.541745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:48.552667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:48.553301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:48.554123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:48.554945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:48.555409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:48.555871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:48.693039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:48.702125 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0caca9a-158a-4698-9aec-15e0eb84d9d3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.165116 Oct 26 05:53:48.702797 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3479/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:48 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:48.772152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b8bdee88-1f39-4176-bb34-fce4296c6b99 req-c30e49a9-25b0-484c-97ca-96705d2283e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d8f247-8b66-4275-bc7a-b4e7471e9bd5", "tag": "5fd65f79-8d3e-401b-bbfe-360b8cd1c592"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:48.784793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8bdee88-1f39-4176-bb34-fce4296c6b99 req-c30e49a9-25b0-484c-97ca-96705d2283e7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:48.785336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8bdee88-1f39-4176-bb34-fce4296c6b99 req-c30e49a9-25b0-484c-97ca-96705d2283e7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:48.785809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b8bdee88-1f39-4176-bb34-fce4296c6b99 req-c30e49a9-25b0-484c-97ca-96705d2283e7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:48.797641 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b8bdee88-1f39-4176-bb34-fce4296c6b99 req-c30e49a9-25b0-484c-97ca-96705d2283e7 service nova] Creating event network-changed:5fd65f79-8d3e-401b-bbfe-360b8cd1c592 for instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 on n-h1-862416-4 Oct 26 05:53:48.802700 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b8bdee88-1f39-4176-bb34-fce4296c6b99 req-c30e49a9-25b0-484c-97ca-96705d2283e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035300 Oct 26 05:53:48.803353 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3492/6971] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:49.727312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:49.727851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:49.734590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:49.735090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:49.735534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:49.736235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:49.736696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:49.737127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:49.867225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:49.874911 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9cc26dd3-dc4b-4078-9d2e-57310b332e15 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.152349 Oct 26 05:53:49.875488 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3480/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:49 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:50.899615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:50.900382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:50.906686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:50.907194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:50.907654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:50.908371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:50.908844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:50.909288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:51.044276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:51.052048 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2003391-7779-46f2-b8ef-52d2e617ac8a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.157983 Oct 26 05:53:51.052613 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3493/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:50 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:52.076010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:52.076626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:52.083486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:52.084000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:52.084530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:52.085236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:52.085729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:52.086161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:52.218625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:52.226595 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-04b2676e-306a-4a2e-ac25-7bcf81cd48bc tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.154831 Oct 26 05:53:52.227171 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3481/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:52 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:53.249951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:53.250582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:53.258044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:53.258543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:53.259000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:53.259706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:53.260172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:53.260614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:53.395101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:53.403920 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c9b92f2-a069-4d4d-99b4-c9bf81a2061c tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.157894 Oct 26 05:53:53.404515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3494/6975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:53 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:54.427349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:54.428694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:54.435602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:54.436095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:54.436532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:54.437234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:54.437719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:54.438148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:54.575779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:54.583523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eb984865-1b66-4b17-9ce8-eaa70035481a tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.160048 Oct 26 05:53:54.584210 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3482/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:54 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:55.420418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-6358345b-d6bc-4f8a-a028-e6c71d6ab2c5 req-e6b44ecc-a4e0-4d80-8ee2-cda92afa8390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d8f247-8b66-4275-bc7a-b4e7471e9bd5", "name": "network-vif-plugged", "status": "completed", "tag": "5fd65f79-8d3e-401b-bbfe-360b8cd1c592"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:55.425598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:55.427413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:55.435233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6358345b-d6bc-4f8a-a028-e6c71d6ab2c5 req-e6b44ecc-a4e0-4d80-8ee2-cda92afa8390 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:55.435726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6358345b-d6bc-4f8a-a028-e6c71d6ab2c5 req-e6b44ecc-a4e0-4d80-8ee2-cda92afa8390 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:55.436371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-6358345b-d6bc-4f8a-a028-e6c71d6ab2c5 req-e6b44ecc-a4e0-4d80-8ee2-cda92afa8390 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:55.448047 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-6358345b-d6bc-4f8a-a028-e6c71d6ab2c5 req-e6b44ecc-a4e0-4d80-8ee2-cda92afa8390 service nova] Creating event network-vif-plugged:5fd65f79-8d3e-401b-bbfe-360b8cd1c592 for instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 on n-h1-862416-4 Oct 26 05:53:55.453285 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-6358345b-d6bc-4f8a-a028-e6c71d6ab2c5 req-e6b44ecc-a4e0-4d80-8ee2-cda92afa8390 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Oct 26 05:53:55.453960 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3495/6977] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:55.606553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:55.607174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:55.614155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:55.614656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:55.615108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:55.616629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:55.617106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:55.617568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:55.746912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:55.754853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99157d6d-3866-43e5-afa9-5cbc082e3327 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1321 microversion: 2.1 time: 0.152177 Oct 26 05:53:55.755445 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3483/6978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:55 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:56.783078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:56.783728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:56.791807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:56.792325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:56.793136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:56.793900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:56.794382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:56.794834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:56.930912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:56.938633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e4b4b52-008c-4fe4-8354-274406da5a20 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1470 microversion: 2.1 time: 0.162867 Oct 26 05:53:56.939197 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3496/6979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:56 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:56.964149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:53:57.019485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d05e0b4e-f0b4-44c2-9334-1cb117d7f176 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Calling method '.version_select at 0x7f470acae5e0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.086931 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d05e0b4e-f0b4-44c2-9334-1cb117d7f176 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3498d28d03124b2285fe9801f1fde2c7" status: 200 len: 371 microversion: 2.1 time: 0.127108 Oct 26 05:53:57.087519 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3484/6980] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:53:56 2022] GET /compute/v2.1/os-quota-sets/3498d28d03124b2285fe9801f1fde2c7 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:57.099524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30cee06d-f42d-439c-95bb-aae36508e6b4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1860984168", "id": 1590765432, "os-flavor-access:is_public": "True"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:57.118255 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30cee06d-f42d-439c-95bb-aae36508e6b4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022507 Oct 26 05:53:57.118817 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3497/6981] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:53:57 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:57.131742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1590765432"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:57.134094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:57.140231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.140708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.141154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.141887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.142349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.142786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.229751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e0cbc1619cdd47b688d58c13aaebc84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3498d28d03124b2285fe9801f1fde2c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:57.235691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1860984168 {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:53:57.242860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.243347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.243789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.244521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.244985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.245447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.267519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Getting quotas for project 3f48734c416b45b38665ee3d879bee53. Resources: {'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:53:57.273021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Getting quotas for user 8cfdfa2ca00e4dde9eb5da9dc8b2a42f and project 3f48734c416b45b38665ee3d879bee53. Resources: {'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:53:57.288542 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] ram quota exceeded for 3498d28d03124b2285fe9801f1fde2c7, tried to resize instance. Oct 26 05:53:57.289013 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Request method failure captured: Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5/action HTTP/1.1 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 39 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMtnpnzEeIVBP0zkY86LTNo7mPqbwXZ_B1GUC9sRYfUBqMYkYb5YknpMofuocDpY9e33ZOvcKIJQn_J7CxullINWqKHgMG2qIUQ9ADdpGXYzh5wEgVHArPCEg8nEJ9oR3ynhR3CgIySsJv4L48cFt--YJ9bfpUJsnF02qB8wxwNU5Zc Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 3498d28d03124b2285fe9801f1fde2c7 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1986976521 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,admin,member Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,admin,member Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1986976521 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 3498d28d03124b2285fe9801f1fde2c7 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1986976521 Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersAdminNegativeTestJSON-1986976521-project-admin Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: e0cbc1619cdd47b688d58c13aaebc84f Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1986976521-project-admin Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: {"resize": {"flavorRef": "1590765432"}} Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '13d8f247-8b66-4275-bc7a-b4e7471e9bd5', 'body': {'resize': {'flavorRef': '1590765432'}}} Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:53:57.291122 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ef587b66-c678-45ab-999d-e0d5d41ffd6e tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5/action" status: 403 len: 118 microversion: 2.1 time: 0.165460 Oct 26 05:53:57.295593 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3485/6982] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:53:57 2022] POST /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5/action => generated 118 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:53:57.301437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5ee80640-348d-42f8-ba8e-9224decddd0a tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.319388 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5ee80640-348d-42f8-ba8e-9224decddd0a tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1590765432" status: 202 len: 0 microversion: 2.1 time: 0.020967 Oct 26 05:53:57.319951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3498/6983] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:53:57 2022] DELETE /compute/v2.1/flavors/1590765432 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:53:57.328095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b24b00d4-780c-4a3e-9a6a-e0cec0d6308d tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.347902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b24b00d4-780c-4a3e-9a6a-e0cec0d6308d tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023751 Oct 26 05:53:57.348468 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3486/6984] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:53:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:57.369209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5696c1b7-9cf7-43e3-bc63-7cf52cef7cce tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Calling method '.version_select at 0x7f4709347dc0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.439605 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5696c1b7-9cf7-43e3-bc63-7cf52cef7cce tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3498d28d03124b2285fe9801f1fde2c7" status: 200 len: 371 microversion: 2.1 time: 0.074596 Oct 26 05:53:57.440498 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3499/6985] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 26 05:53:57 2022] GET /compute/v2.1/os-quota-sets/3498d28d03124b2285fe9801f1fde2c7 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:57.452857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71de32bb-f2e6-43ae-ad2d-043349a493fb tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1982988850", "id": 1183587897, "os-flavor-access:is_public": "True"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:57.470850 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71de32bb-f2e6-43ae-ad2d-043349a493fb tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021998 Oct 26 05:53:57.471425 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3487/6986] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:53:57 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:53:57.485001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1183587897"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:57.487416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:57.494372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.494878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.495413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.496150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.496620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.497066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.683827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e0cbc1619cdd47b688d58c13aaebc84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3498d28d03124b2285fe9801f1fde2c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:57.690102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1982988850 {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:53:57.696916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.697443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.697905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.698644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.699112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.699554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.719877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Getting quotas for project 3f48734c416b45b38665ee3d879bee53. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:53:57.725688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Getting quotas for user 8cfdfa2ca00e4dde9eb5da9dc8b2a42f and project 3f48734c416b45b38665ee3d879bee53. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:53:57.737530 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.compute.api [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] cores quota exceeded for 3498d28d03124b2285fe9801f1fde2c7, tried to resize instance. Oct 26 05:53:57.738085 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Request method failure captured: Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5/action HTTP/1.1 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 39 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMtnpnzEeIVBP0zkY86LTNo7mPqbwXZ_B1GUC9sRYfUBqMYkYb5YknpMofuocDpY9e33ZOvcKIJQn_J7CxullINWqKHgMG2qIUQ9ADdpGXYzh5wEgVHArPCEg8nEJ9oR3ynhR3CgIySsJv4L48cFt--YJ9bfpUJsnF02qB8wxwNU5Zc Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3498d28d03124b2285fe9801f1fde2c7 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1986976521 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,admin,member Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,admin,member Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3498d28d03124b2285fe9801f1fde2c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1986976521 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3498d28d03124b2285fe9801f1fde2c7 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1986976521 Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminNegativeTestJSON-1986976521-project-admin Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: e0cbc1619cdd47b688d58c13aaebc84f Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1986976521-project-admin Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: {"resize": {"flavorRef": "1183587897"}} Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '13d8f247-8b66-4275-bc7a-b4e7471e9bd5', 'body': {'resize': {'flavorRef': '1183587897'}}} Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:53:57.740734 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1d9997be-1e42-4833-89b0-c45d89a32cd4 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5/action" status: 403 len: 113 microversion: 2.1 time: 0.261093 Oct 26 05:53:57.745542 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3500/6987] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:53:57 2022] POST /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5/action => generated 113 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:53:57.757121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c8e171ad-73d1-430a-af6a-fe22daa09ca0 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.774057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c8e171ad-73d1-430a-af6a-fe22daa09ca0 tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1183587897" status: 202 len: 0 microversion: 2.1 time: 0.020652 Oct 26 05:53:57.774615 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3488/6988] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 26 05:53:57 2022] DELETE /compute/v2.1/flavors/1183587897 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:53:57.782804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-da780b3f-3e99-46ef-8bce-ab68aa27714f tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.805384 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-da780b3f-3e99-46ef-8bce-ab68aa27714f tempest-ServersAdminNegativeTestJSON-1986976521 tempest-ServersAdminNegativeTestJSON-1986976521-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026601 Oct 26 05:53:57.806065 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3501/6989] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 26 05:53:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:57.826746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.827245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:57.833328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.833891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.834637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.835329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.835786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.836216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.863276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:53:57.943117 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b20ddb64-28b6-4480-98ca-fbdab06f2ea3 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 204 len: 0 microversion: 2.1 time: 0.120175 Oct 26 05:53:57.944608 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3489/6990] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:53:57 2022] DELETE /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:53:57.953247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:57.953917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:57.961000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.961558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.962012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:57.962713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:57.963178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:57.963618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:58.094986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:58.103658 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73f3c426-5651-4964-8fac-c37db83f4d13 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1476 microversion: 2.1 time: 0.154556 Oct 26 05:53:58.104224 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3502/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:57 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1476 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:59.127713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:53:59.128431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:53:59.135970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:59.136468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:59.136914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:59.137646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:59.138112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:59.138553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:59.268888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:53:59.277270 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-02f22eb4-a873-49f4-9a27-d25cb212ee6f tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1476 microversion: 2.1 time: 0.153829 Oct 26 05:53:59.277874 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3490/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:53:59 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:53:59.817920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-499932af-2a9c-4429-b51a-7ecb1feb0127 req-37c6bcca-6fd6-4a61-9e5d-538b6e203f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d8f247-8b66-4275-bc7a-b4e7471e9bd5", "name": "network-vif-deleted", "tag": "5fd65f79-8d3e-401b-bbfe-360b8cd1c592"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:53:59.829577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-499932af-2a9c-4429-b51a-7ecb1feb0127 req-37c6bcca-6fd6-4a61-9e5d-538b6e203f97 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:53:59.830341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-499932af-2a9c-4429-b51a-7ecb1feb0127 req-37c6bcca-6fd6-4a61-9e5d-538b6e203f97 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:53:59.830788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-499932af-2a9c-4429-b51a-7ecb1feb0127 req-37c6bcca-6fd6-4a61-9e5d-538b6e203f97 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:53:59.843786 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-499932af-2a9c-4429-b51a-7ecb1feb0127 req-37c6bcca-6fd6-4a61-9e5d-538b6e203f97 service nova] Creating event network-vif-deleted:5fd65f79-8d3e-401b-bbfe-360b8cd1c592 for instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 on n-h1-862416-4 Oct 26 05:53:59.849346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-499932af-2a9c-4429-b51a-7ecb1feb0127 req-37c6bcca-6fd6-4a61-9e5d-538b6e203f97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034999 Oct 26 05:53:59.850767 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3503/6993] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:54:00.299350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:00.299973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:00.306971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:00.307453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:00.307904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:00.308612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:00.309078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:00.309543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:00.344013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:00.344503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:00.344956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:00.345436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lazy-loading 'fault' on Instance uuid 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:54:00.395572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cfdfa2ca00e4dde9eb5da9dc8b2a42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f48734c416b45b38665ee3d879bee53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:00.404033 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-31ee268b-7e86-448a-a4ef-aa4332c87637 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 200 len: 1311 microversion: 2.1 time: 0.108463 Oct 26 05:54:00.404927 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3491/6994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:00 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:01.430176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:01.430939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] [instance: 13d8f247-8b66-4275-bc7a-b4e7471e9bd5] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:01.437503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:01.438018 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:01.438470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:01.439188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:01.439660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:01.440259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:01.456883 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] HTTP exception thrown: Instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 could not be found. Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Request method failure captured: Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 HTTP/1.1 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMtmEnMIJMtnoQ4VrznLi7vmbvPyyHqhuPtNj1--Q-mB2kGHpJoq-Gi3yt6Gwt1BGIGicsqoIGgWL0uta0vRdkhPvBztVgYhOGKI1w9XIL-iPC08pbI33UDs_aoLyy8bBuDciE-V3uwqtF-2Q5IQg-J2OGV8MnGLrZeWG8PPl_Nu0D8 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 3f48734c416b45b38665ee3d879bee53 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1652341873 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f48734c416b45b38665ee3d879bee53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f48734c416b45b38665ee3d879bee53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f48734c416b45b38665ee3d879bee53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f48734c416b45b38665ee3d879bee53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1652341873 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 3f48734c416b45b38665ee3d879bee53 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1652341873 Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersAdminNegativeTestJSON-1652341873-project Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 8cfdfa2ca00e4dde9eb5da9dc8b2a42f Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1652341873-project Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 could not be found. Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '13d8f247-8b66-4275-bc7a-b4e7471e9bd5'} Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 could not be found. Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 could not be found. Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:01.458625 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 could not be found. Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] Returning 404 to user: Instance 13d8f247-8b66-4275-bc7a-b4e7471e9bd5 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72c0f064-0d10-4d1d-be22-3dec7ccce609 tempest-ServersAdminNegativeTestJSON-1652341873 tempest-ServersAdminNegativeTestJSON-1652341873-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5" status: 404 len: 111 microversion: 2.1 time: 0.035749 Oct 26 05:54:01.463560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3504/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:01 2022] GET /compute/v2.1/servers/13d8f247-8b66-4275-bc7a-b4e7471e9bd5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:54:07.440686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:07.441994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:07.578356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-941336114", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "6fd611cb-3647-49a5-bc76-3320ec5900d5"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:07.637718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] validate_networks() for [('6fd611cb-3647-49a5-bc76-3320ec5900d5', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:54:08.430727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:54:08.431227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:54:08.431862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:54:08.432374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:54:08.434261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:54:08.448087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:08.448712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:08.449000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:08.449886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:08.450592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:08.451025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:08.469092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Getting quotas for project adee706667a4442e8a3eaa9603f35998. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:54:08.475004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Getting quotas for user c34aebedbe0f491ea0b5f17910ecb3dd and project adee706667a4442e8a3eaa9603f35998. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:54:08.488492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:54:08.490847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:54:08.539003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4030027-6e2a-4d44-9dbd-9090a5281ad0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103973 Oct 26 05:54:08.539673 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3492/6996] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:54:08.551212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-debbee58-a0b2-44ee-8a77-7b3e7a2449d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:08.551846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-debbee58-a0b2-44ee-8a77-7b3e7a2449d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:08.555168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:08.556358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:08.615884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-debbee58-a0b2-44ee-8a77-7b3e7a2449d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:08.623177 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-debbee58-a0b2-44ee-8a77-7b3e7a2449d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1214 microversion: 2.1 time: 0.075932 Oct 26 05:54:08.623768 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3505/6997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:08 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:09.649052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:09.651405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:09.660188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:09.660821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:09.661434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:09.662201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:09.663829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:09.664499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:09.737858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:09.748541 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6fa6015-e6e4-447b-8fd3-3ffef7f8f4ba tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1274 microversion: 2.1 time: 0.105662 Oct 26 05:54:09.749517 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3493/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:09 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:10.773973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:10.774774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:10.784097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:10.784697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:10.785159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:10.785922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:10.786398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:10.786845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:10.939834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:10.954030 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-086691f4-ed09-4fca-9bd9-3e45bb4656ad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.184397 Oct 26 05:54:10.954633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3506/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:10 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:11.158101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-223fb4e0-6f0e-4329-a10c-2e17ac092af3 req-7556b29c-fd8b-42a0-90a9-ef6498acc7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8da995-e2c3-41cc-9ebe-dec626113d89", "tag": "ead907d7-922f-4de2-9b0b-3792400ad8de"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:11.170589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-223fb4e0-6f0e-4329-a10c-2e17ac092af3 req-7556b29c-fd8b-42a0-90a9-ef6498acc7a3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:11.171101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-223fb4e0-6f0e-4329-a10c-2e17ac092af3 req-7556b29c-fd8b-42a0-90a9-ef6498acc7a3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:11.171544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-223fb4e0-6f0e-4329-a10c-2e17ac092af3 req-7556b29c-fd8b-42a0-90a9-ef6498acc7a3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:11.192776 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-223fb4e0-6f0e-4329-a10c-2e17ac092af3 req-7556b29c-fd8b-42a0-90a9-ef6498acc7a3 service nova] Creating event network-changed:ead907d7-922f-4de2-9b0b-3792400ad8de for instance ee8da995-e2c3-41cc-9ebe-dec626113d89 on n-h1-862416-4 Oct 26 05:54:11.199352 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-223fb4e0-6f0e-4329-a10c-2e17ac092af3 req-7556b29c-fd8b-42a0-90a9-ef6498acc7a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045089 Oct 26 05:54:11.200944 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3494/7000] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:54:11.978562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:11.979096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:11.986071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:11.986564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:11.987013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:11.987708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:11.988197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:11.988614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:12.124424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:12.132238 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f643800b-d34e-410f-8c99-e0c3d6394ed7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.158299 Oct 26 05:54:12.139235 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3507/7001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:11 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:13.156249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:13.156953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:13.164564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:13.165044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:13.165517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:13.166207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:13.166661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:13.167087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:13.299549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:13.307552 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f33be63-549f-4e99-9f00-c2ebdd7842b6 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.155561 Oct 26 05:54:13.308139 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3495/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:13 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:14.331371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:14.332025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:14.334933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:14.341251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:14.341790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:14.342250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:14.342964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:14.343439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:14.343886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:14.347456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=66 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:14.476663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:14.484870 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8b370013-7978-4f3e-be81-7ec024cc45b7 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.157418 Oct 26 05:54:14.485483 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3508/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:14 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:15.508308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:15.509009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:15.511985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:15.517580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:15.518092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:15.518543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:15.519260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:15.519758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:15.520194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:15.526044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:15.670147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:15.680112 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb50299b-08ee-46f0-982b-6ac136190aad tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.174809 Oct 26 05:54:15.680713 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3496/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:15 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:16.704035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:16.704586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:16.713079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:16.713612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:16.714064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:16.714767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:16.715236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:16.715676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:16.845127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:16.852916 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37dd23c5-8f7a-4481-8daf-8d0318b55aec tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.153175 Oct 26 05:54:16.853512 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3509/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:16 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:17.669660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ec0413b4-86da-47c2-8c9d-e8b9d97fd79b req-07cfa767-6688-42b9-a90c-45d0a4d77a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8da995-e2c3-41cc-9ebe-dec626113d89", "name": "network-vif-plugged", "status": "completed", "tag": "ead907d7-922f-4de2-9b0b-3792400ad8de"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:17.681108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec0413b4-86da-47c2-8c9d-e8b9d97fd79b req-07cfa767-6688-42b9-a90c-45d0a4d77a4a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:17.681642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec0413b4-86da-47c2-8c9d-e8b9d97fd79b req-07cfa767-6688-42b9-a90c-45d0a4d77a4a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:17.682080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec0413b4-86da-47c2-8c9d-e8b9d97fd79b req-07cfa767-6688-42b9-a90c-45d0a4d77a4a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:17.693230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ec0413b4-86da-47c2-8c9d-e8b9d97fd79b req-07cfa767-6688-42b9-a90c-45d0a4d77a4a service nova] Creating event network-vif-plugged:ead907d7-922f-4de2-9b0b-3792400ad8de for instance ee8da995-e2c3-41cc-9ebe-dec626113d89 on n-h1-862416-4 Oct 26 05:54:17.698993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ec0413b4-86da-47c2-8c9d-e8b9d97fd79b req-07cfa767-6688-42b9-a90c-45d0a4d77a4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Oct 26 05:54:17.699587 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3497/7006] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:54:17.876158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:17.876788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:17.883663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:17.884167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:17.884623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:17.885351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:17.885858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:17.886333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:18.015269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:18.022934 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6b01ff5f-b3ea-4e53-a5ea-dbc3838f2290 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1314 microversion: 2.1 time: 0.150764 Oct 26 05:54:18.023816 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3510/7007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:17 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:19.043164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:19.043960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:19.048935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:19.049673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:19.056885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:19.057399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:19.057844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:19.058540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:19.058997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:19.059486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:19.197562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:19.205755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-715679f4-eb7e-44ac-ae07-3590d6fb8151 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1501 microversion: 2.1 time: 0.163461 Oct 26 05:54:19.206263 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3498/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:19 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:19.230884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:19.233226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:19.235229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:19.241204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:19.241742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:19.242192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:19.242902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:19.243372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:19.243820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:19.275102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:19.280471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Old instance type m1.heat2, new instance type m1.heat {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:54:19.286953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:54:19.287395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:54:19.287885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:54:19.288315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:54:19.289059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:54:19.353198 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-858f5404-2fda-42c5-9dc0-f05efa1928a2 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "POST /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89/action" status: 202 len: 0 microversion: 2.1 time: 0.126992 Oct 26 05:54:19.354077 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3511/7009] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:54:19 2022] POST /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:54:19.362173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:19.362850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:19.369153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:19.369675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:19.370111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:19.370832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:19.371286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:19.371709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:19.549608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:19.558008 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-abd8afdb-3bf7-4b28-a4d3-e5805672e882 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1510 microversion: 2.1 time: 0.199721 Oct 26 05:54:19.558608 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3499/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:19 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:54:20.582667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:20.583301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:20.590712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:20.591222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:20.591679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:20.592386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:20.592856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:20.593299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:20.723490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:20.731967 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-542c2fa1-a557-4e80-8697-35ee18e12489 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1510 microversion: 2.1 time: 0.154082 Oct 26 05:54:20.732544 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3512/7011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:20 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:21.755953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:21.756569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:21.763315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:21.763800 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:21.764256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:21.764921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:21.765406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:21.765828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:21.894810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:21.903044 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62e6164f-54bd-4a0b-ae82-33a94400af4c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.150912 Oct 26 05:54:21.903624 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3500/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:21 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:22.926870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:22.927493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:22.935360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:22.935856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:22.936307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:22.937006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:22.937504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:22.937947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:23.071013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:23.078993 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-96417471-30df-4f7a-adad-6f36f6e2e7c8 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.156029 Oct 26 05:54:23.079560 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3513/7013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:22 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:24.101756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:24.102516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:24.109469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:24.109960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:24.110403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:24.111096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:24.111560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:24.111991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:24.239608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:24.247973 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fcf77d8f-6406-46ac-8113-e94b3e64eab4 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.150111 Oct 26 05:54:24.248626 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3501/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:24 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:25.271866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:25.272503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:25.279477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:25.279980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:25.280440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:25.281153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:25.281665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:25.282120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:25.415589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:25.423367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58b52e8f-9fd2-4167-b2d1-43ae70cd6a09 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.155480 Oct 26 05:54:25.423940 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3514/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:25 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:26.448082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:26.448693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:26.455818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:26.456317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:26.456735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:26.457448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:26.457903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:26.458325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:26.590017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:26.597598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4eddb915-8f0c-41d9-ad82-fc829f4e0700 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.154043 Oct 26 05:54:26.598173 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3502/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:26 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:27.620975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:27.621682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:27.628307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:27.628802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:27.629262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:27.629999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:27.630470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:27.630916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:27.773078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:27.782133 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4d52e9f-50d4-4448-b2d0-a96ae322b768 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.164669 Oct 26 05:54:27.782810 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3515/7017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:27 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:28.807092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:28.807718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:28.814585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:28.815080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:28.815530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:28.816290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:28.816766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:28.817238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:28.948325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:28.956259 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5b2619ec-fead-4018-8c18-683163c1e73e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.153243 Oct 26 05:54:28.956829 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3503/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:28 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:29.981232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:29.981912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:29.988936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:29.989471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:29.989932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:29.990650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:29.991122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:29.991566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:30.120773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:30.128575 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8da68192-2496-4be5-b121-d9a2cbf66711 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.152062 Oct 26 05:54:30.129143 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3516/7019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:29 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:31.152703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:31.153370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:31.160279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:31.160747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:31.161180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:31.161896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:31.162352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:31.162776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:31.297850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:31.306251 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4e897f21-44b0-4e5d-b7a0-d9432ab26457 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.158126 Oct 26 05:54:31.306824 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3504/7020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:31 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:32.330033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:32.330660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:32.337487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:32.337988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:32.338437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:32.339133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:32.339597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:32.340033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:32.475708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:32.484189 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9a00038e-5c96-40e3-9cfa-596a48c7efcf tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.158440 Oct 26 05:54:32.484762 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3517/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:32 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:33.507678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:33.508962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:33.515729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:33.516223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:33.516660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:33.517372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:33.517831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:33.518256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:33.655975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:33.663953 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bbf2d530-51b2-46be-87b0-991745f773f3 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.160144 Oct 26 05:54:33.665034 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3505/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:33 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:34.688425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:34.689050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:34.696884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:34.697345 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:34.697810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:34.698537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:34.699032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:34.699473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:34.832009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:34.840601 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-07ddeb67-a8f5-46c3-a5b1-69aa4c525161 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.156117 Oct 26 05:54:34.841180 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3518/7023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:34 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:35.864315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:35.864930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:35.871978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:35.872462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:35.872895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:35.873632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:35.874089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:35.874514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:36.004983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:36.013653 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ed61b802-6600-4997-9f36-a6353c5c9a0a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.153126 Oct 26 05:54:36.014504 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3506/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:35 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:37.037914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:37.038598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:37.045528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:37.046032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:37.046489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:37.047198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:37.047668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:37.048115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:37.184087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:37.191879 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72b72542-632c-4002-b45e-5affda70a68e tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.157915 Oct 26 05:54:37.192449 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3519/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:37 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:38.215514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:38.216371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:38.222988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:38.223470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:38.223905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:38.224586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:38.225043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:38.225498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:38.355742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:38.363441 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e9413af-bd63-4246-9d5e-5e5622c50cfb tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.152074 Oct 26 05:54:38.364017 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3507/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:38 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:39.388143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:39.388840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:39.396151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:39.396860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:39.397533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:39.398512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:39.399100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:39.399607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:39.535189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:39.543694 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57dbf7b5-eb85-4fbb-81b2-78ac0ab12a5f tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.159739 Oct 26 05:54:39.544289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3520/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:39 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:40.569116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:40.569752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:40.577272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:40.577790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:40.578226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:40.578943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:40.579401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:40.579827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:40.709787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:40.717678 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ee5b763-adb4-4bd8-b486-e94fd23e9683 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.152439 Oct 26 05:54:40.718255 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3508/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:40 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:41.741804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:41.742352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:41.750397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:41.750914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:41.751376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:41.752108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:41.752582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:41.753031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:41.889117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:41.896999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3bf05060-419c-4e5f-b10e-caaa0ea3d5d0 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.159249 Oct 26 05:54:41.897609 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3521/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:41 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:42.921378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:42.921986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:42.928788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:42.929266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:42.929731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:42.930417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:42.931437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:42.931979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:43.060571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:43.068239 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a66e86c8-2671-4916-837f-268ae0f7562c tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.150796 Oct 26 05:54:43.068810 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3509/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:42 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:44.092210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:44.092852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:44.099783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:44.100284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:44.100739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:44.101474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:44.101951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:44.102401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:44.233982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:44.241627 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b01f0d7f-0cd3-4f28-9574-78f20616a538 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.153384 Oct 26 05:54:44.242210 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3522/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:44 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:54:45.266590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:45.267233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:45.274077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:45.274591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:45.275032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:45.275727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:45.276188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:45.276615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:45.409378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:45.417596 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a66ac50-9ee8-40ee-b973-e74d7f92b86a tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.155186 Oct 26 05:54:45.418175 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3510/7032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:45 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:46.441355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:46.441982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:46.444669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=34 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:46.450740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:46.451515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:46.451966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:46.452668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:46.453132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:46.453597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:46.456346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:46.587835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:46.595627 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6971cb48-cf0e-4dfa-a10a-6acfd9391620 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.158216 Oct 26 05:54:46.596203 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3523/7033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:46 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:47.620113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:47.620722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:47.623584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=30 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:47.628726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:47.629215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:47.629673 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:47.630356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:47.630809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:47.631232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:47.634430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=86 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:54:47.766375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:47.773966 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7688e433-f6d6-426b-9c32-ac0de6567333 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1515 microversion: 2.1 time: 0.158296 Oct 26 05:54:47.774553 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3511/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:47 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:48.797731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:48.798408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:48.805271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:48.805882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:48.806588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:48.807192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:48.807660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:48.808101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:48.941496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:48.950120 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-077823d1-0daa-4506-8480-d890d242d301 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1514 microversion: 2.1 time: 0.156418 Oct 26 05:54:48.950711 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3524/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:48 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:49.489235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8da995-e2c3-41cc-9ebe-dec626113d89", "name": "network-vif-unplugged", "status": "completed", "tag": "ead907d7-922f-4de2-9b0b-3792400ad8de"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:49.499298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:49.499751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:49.500185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:49.512388 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] Creating event network-vif-unplugged:ead907d7-922f-4de2-9b0b-3792400ad8de for instance ee8da995-e2c3-41cc-9ebe-dec626113d89 on n-h2-862416-4 Oct 26 05:54:49.518244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:54:49.530071 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f58e0b16-b4f3-4fb0-9019-3f8273e95cad req-06995652-2c05-42b1-8784-6295f18b0249 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121152 Oct 26 05:54:49.530781 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3512/7036] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:54:49.975180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:49.975654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:49.983119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:49.983620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:49.984071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:49.984779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:49.985245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:49.985722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:50.117576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:50.126431 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24a1868d-db4d-4666-abab-cb1bd841385b tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1514 microversion: 2.1 time: 0.155385 Oct 26 05:54:50.127007 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3525/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:49 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:51.152587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:51.153296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:51.159482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:51.159971 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:51.160419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:51.161117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:51.161656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:51.162091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:51.310921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:51.319404 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4c900e4b-c6e6-4f11-a82c-81279deb10be tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1512 microversion: 2.1 time: 0.172509 Oct 26 05:54:51.319998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3513/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:51 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:51.546719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8da995-e2c3-41cc-9ebe-dec626113d89", "tag": "ead907d7-922f-4de2-9b0b-3792400ad8de"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:51.558618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:51.559109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:51.559554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:51.580576 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] Creating event network-changed:ead907d7-922f-4de2-9b0b-3792400ad8de for instance ee8da995-e2c3-41cc-9ebe-dec626113d89 on n-h2-862416-4 Oct 26 05:54:51.586458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:54:51.599260 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-81c982ea-7a56-41db-a873-b456d97b9a81 req-89b7f63f-21d3-4787-a533-a6ba07efe79b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056323 Oct 26 05:54:51.599868 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3526/7039] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:54:52.344825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:52.345380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:52.352204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:52.353406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:52.353863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:52.354553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:52.355008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:52.355431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:52.487044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:52.495004 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0fa61036-017e-41ca-b837-cedd7a06cb78 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1512 microversion: 2.1 time: 0.154393 Oct 26 05:54:52.495579 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3514/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:52 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:53.515565 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:54:53.516133 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 (ip 10.222.0.16) !!! Oct 26 05:54:53.521646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:53.522360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:53.531764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:53.532263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:53.532710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:53.533449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:53.533919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:53.534362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:53.674172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:53.682356 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0493a26-443d-4847-803b-8b783d784363 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1509 microversion: 2.1 time: 0.168054 Oct 26 05:54:53.696055 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3527/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:53 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:53.706855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:53.707392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:53.714960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:53.715457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:53.715905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:53.716608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:53.717070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:53.717535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:53.744105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:54:53.795329 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Found an unconfirmed migration during delete, id: 16, status: finished Oct 26 05:54:55.255049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9c5c9b1a-b460-4a84-bb3b-8520968c5d8b req-44bb9ae6-2697-4bbb-9e53-5241c3bb0a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8da995-e2c3-41cc-9ebe-dec626113d89", "name": "network-vif-plugged", "status": "completed", "tag": "ead907d7-922f-4de2-9b0b-3792400ad8de"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:55.266414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9c5c9b1a-b460-4a84-bb3b-8520968c5d8b req-44bb9ae6-2697-4bbb-9e53-5241c3bb0a05 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:55.266936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9c5c9b1a-b460-4a84-bb3b-8520968c5d8b req-44bb9ae6-2697-4bbb-9e53-5241c3bb0a05 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:55.267388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9c5c9b1a-b460-4a84-bb3b-8520968c5d8b req-44bb9ae6-2697-4bbb-9e53-5241c3bb0a05 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:55.279409 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9c5c9b1a-b460-4a84-bb3b-8520968c5d8b req-44bb9ae6-2697-4bbb-9e53-5241c3bb0a05 service nova] Creating event network-vif-plugged:ead907d7-922f-4de2-9b0b-3792400ad8de for instance ee8da995-e2c3-41cc-9ebe-dec626113d89 on n-h2-862416-4 Oct 26 05:54:55.285036 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9c5c9b1a-b460-4a84-bb3b-8520968c5d8b req-44bb9ae6-2697-4bbb-9e53-5241c3bb0a05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117049 Oct 26 05:54:55.285690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3528/7042] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:54:55.331443 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7221b240-b314-4dca-aecd-b806e151d205 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 204 len: 0 microversion: 2.1 time: 1.628001 Oct 26 05:54:55.332187 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3515/7043] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:54:53 2022] DELETE /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 0 bytes in 1630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:54:55.341072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:55.341813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:55.347951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:55.348450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:55.348929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:55.349660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:55.350126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:55.350565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:55.481033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:55.488938 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fc3603e1-e1fa-44ad-aa6b-7d0ab4650382 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1501 microversion: 2.1 time: 0.152119 Oct 26 05:54:55.489549 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3529/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:55 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:56.514264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:56.515102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:56.521945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:56.522430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:56.522866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:56.523553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:56.524007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:56.524461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:56.658711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34aebedbe0f491ea0b5f17910ecb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adee706667a4442e8a3eaa9603f35998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:54:56.666930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e6a7c551-2a6b-486b-854f-6c6e8d2a4ada tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 200 len: 1501 microversion: 2.1 time: 0.157006 Oct 26 05:54:56.667517 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3516/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:56 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:54:57.143419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-56adb53f-ef55-4f16-87b4-46157b44b11a req-1d6b27e9-cb18-4042-839f-e3fd3a3ba43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8da995-e2c3-41cc-9ebe-dec626113d89", "name": "network-vif-deleted", "tag": "ead907d7-922f-4de2-9b0b-3792400ad8de"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:54:57.154964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-56adb53f-ef55-4f16-87b4-46157b44b11a req-1d6b27e9-cb18-4042-839f-e3fd3a3ba43f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.155537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-56adb53f-ef55-4f16-87b4-46157b44b11a req-1d6b27e9-cb18-4042-839f-e3fd3a3ba43f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.156019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-56adb53f-ef55-4f16-87b4-46157b44b11a req-1d6b27e9-cb18-4042-839f-e3fd3a3ba43f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.171759 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-56adb53f-ef55-4f16-87b4-46157b44b11a req-1d6b27e9-cb18-4042-839f-e3fd3a3ba43f service nova] Creating event network-vif-deleted:ead907d7-922f-4de2-9b0b-3792400ad8de for instance ee8da995-e2c3-41cc-9ebe-dec626113d89 on n-h2-862416-4 Oct 26 05:54:57.176779 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-56adb53f-ef55-4f16-87b4-46157b44b11a req-1d6b27e9-cb18-4042-839f-e3fd3a3ba43f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037060 Oct 26 05:54:57.177581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3530/7046] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:54:57.691303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:57.691921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:57.698925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.699351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.699795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.700488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.700954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.701699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.718820 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] HTTP exception thrown: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Request method failure captured: Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 HTTP/1.1 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMt_teMUjLF1lhBfRwRlbsSMQWU2jcgFUWeFbvYiYfoRnnB1U9BpF36SB9hj_YJKkAcypuXk8tbgliM0kDtdS5RaCsYtXiDfeMxahiC0F7ujeahgxE0dPQCvqlrWEM1ebGynwyR6BU-LvpNTgVXN9c1bMwpfjx5W5yhUwHkMQW4_zII Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: adee706667a4442e8a3eaa9603f35998 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adee706667a4442e8a3eaa9603f35998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: adee706667a4442e8a3eaa9603f35998 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-1375285233-project Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c34aebedbe0f491ea0b5f17910ecb3dd Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-1375285233-project Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'ee8da995-e2c3-41cc-9ebe-dec626113d89'} Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:57.720465 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Returning 404 to user: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9077cc76-20df-46e8-8b71-66dca24a494d tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 404 len: 111 microversion: 2.1 time: 0.034558 Oct 26 05:54:57.725343 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3517/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:57 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:54:57.735749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:57.736360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:57.742585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.743137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.743598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.744302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.744773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.745215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.758753 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] HTTP exception thrown: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Request method failure captured: Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 HTTP/1.1 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMt_teMUjLF1lhBfRwRlbsSMQWU2jcgFUWeFbvYiYfoRnnB1U9BpF36SB9hj_YJKkAcypuXk8tbgliM0kDtdS5RaCsYtXiDfeMxahiC0F7ujeahgxE0dPQCvqlrWEM1ebGynwyR6BU-LvpNTgVXN9c1bMwpfjx5W5yhUwHkMQW4_zII Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: adee706667a4442e8a3eaa9603f35998 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adee706667a4442e8a3eaa9603f35998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: adee706667a4442e8a3eaa9603f35998 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-DeleteServersTestJSON-1375285233-project Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: c34aebedbe0f491ea0b5f17910ecb3dd Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-DeleteServersTestJSON-1375285233-project Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'ee8da995-e2c3-41cc-9ebe-dec626113d89'} Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:54:57.760512 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Returning 404 to user: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73eca89f-223d-464e-8b36-86eea3a2b864 tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 404 len: 111 microversion: 2.1 time: 0.030457 Oct 26 05:54:57.764991 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3531/7048] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:54:57 2022] DELETE /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:54:57.770455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:54:57.771086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] [instance: ee8da995-e2c3-41cc-9ebe-dec626113d89] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:54:57.777954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.778454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.778954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.779680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:54:57.780148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:54:57.780581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:54:57.794696 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] HTTP exception thrown: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Request method failure captured: Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 HTTP/1.1 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMt_teMUjLF1lhBfRwRlbsSMQWU2jcgFUWeFbvYiYfoRnnB1U9BpF36SB9hj_YJKkAcypuXk8tbgliM0kDtdS5RaCsYtXiDfeMxahiC0F7ujeahgxE0dPQCvqlrWEM1ebGynwyR6BU-LvpNTgVXN9c1bMwpfjx5W5yhUwHkMQW4_zII Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: adee706667a4442e8a3eaa9603f35998 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adee706667a4442e8a3eaa9603f35998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adee706667a4442e8a3eaa9603f35998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: adee706667a4442e8a3eaa9603f35998 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-DeleteServersTestJSON-1375285233 Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-DeleteServersTestJSON-1375285233-project Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: c34aebedbe0f491ea0b5f17910ecb3dd Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-DeleteServersTestJSON-1375285233-project Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'ee8da995-e2c3-41cc-9ebe-dec626113d89'} Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:54:57.796226 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] Returning 404 to user: Instance ee8da995-e2c3-41cc-9ebe-dec626113d89 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c372b617-aa1d-455d-a48b-ec4070fb7cee tempest-DeleteServersTestJSON-1375285233 tempest-DeleteServersTestJSON-1375285233-project] 10.222.0.16 "GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89" status: 404 len: 111 microversion: 2.1 time: 0.031077 Oct 26 05:54:57.800150 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3518/7049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:54:57 2022] GET /compute/v2.1/servers/ee8da995-e2c3-41cc-9ebe-dec626113d89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:55:06.655903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1059697385", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "3a226202-4f80-4aea-95ea-cc2cbc1383b2"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:06.709249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] validate_networks() for [('3a226202-4f80-4aea-95ea-cc2cbc1383b2', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:55:07.086961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:55:07.087415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:55:07.087933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:55:07.088366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:55:07.088800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:55:07.098414 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:07.098993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:07.099452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:07.100196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:07.100665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:07.101112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:07.119616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Getting quotas for project 363cfc3d1e3f4ad9aea939f57a8117c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:55:07.124974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Getting quotas for user f06949959d4f4f51bbb3317ca1355d1d and project 363cfc3d1e3f4ad9aea939f57a8117c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:55:07.137958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:55:07.140299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:55:07.188331 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-043dbc9e-5804-4ffe-94a2-8b9e5bbeeaff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669921 Oct 26 05:55:07.188994 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3532/7050] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:55:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:55:07.201716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42d61fcb-8e4f-4c84-8a94-5ee28870b5de tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:07.202332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42d61fcb-8e4f-4c84-8a94-5ee28870b5de tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:07.260128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42d61fcb-8e4f-4c84-8a94-5ee28870b5de tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:07.267195 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42d61fcb-8e4f-4c84-8a94-5ee28870b5de tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1218 microversion: 2.1 time: 0.070599 Oct 26 05:55:07.267843 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3519/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:07 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:55:08.291995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:08.292633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:08.301842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:08.302571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:08.303214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:08.304156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:08.304816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:08.306281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:08.374669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:08.385234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf67b942-9af6-49db-b672-327c3e8d7e44 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1288 microversion: 2.1 time: 0.098105 Oct 26 05:55:08.385898 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3533/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:08 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:09.412197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:09.413814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:09.418502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:09.425836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:09.426658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:09.427289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:09.428434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:09.429084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:09.429734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:09.608244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:09.616942 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fae2afaa-f27e-4a65-b1a2-a5273f7f21c4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.210815 Oct 26 05:55:09.617664 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3520/7053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:09 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:09.673635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-1308115d-0ffc-4deb-83c1-4a6b3fa7d56f req-9e49521a-4da6-4043-ab0c-6dc8558d7c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e01bb1-2ac0-4379-93ab-e0f330d23b23", "tag": "16ff2537-9ea3-460c-9beb-6de0f199fc6b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:09.686988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1308115d-0ffc-4deb-83c1-4a6b3fa7d56f req-9e49521a-4da6-4043-ab0c-6dc8558d7c31 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:09.687591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1308115d-0ffc-4deb-83c1-4a6b3fa7d56f req-9e49521a-4da6-4043-ab0c-6dc8558d7c31 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:09.689897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-1308115d-0ffc-4deb-83c1-4a6b3fa7d56f req-9e49521a-4da6-4043-ab0c-6dc8558d7c31 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:09.706800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-1308115d-0ffc-4deb-83c1-4a6b3fa7d56f req-9e49521a-4da6-4043-ab0c-6dc8558d7c31 service nova] Creating event network-changed:16ff2537-9ea3-460c-9beb-6de0f199fc6b for instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 on n-h2-862416-4 Oct 26 05:55:09.712241 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-1308115d-0ffc-4deb-83c1-4a6b3fa7d56f req-9e49521a-4da6-4043-ab0c-6dc8558d7c31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042180 Oct 26 05:55:09.713147 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3534/7054] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:55:10.640753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:10.641401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:10.648399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:10.648894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:10.650032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:10.650752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:10.651217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:10.651669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:10.780126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:10.788270 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-442bf4eb-88db-4326-91ef-de831da27b96 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.151395 Oct 26 05:55:10.788837 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3521/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:10 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:11.811842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:11.812554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:11.819618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:11.820118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:11.820570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:11.821913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:11.822384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:11.822825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:11.957384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:11.965231 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d535fa26-d56b-4948-a08d-c453b176b4b3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.157701 Oct 26 05:55:11.965838 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3535/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:11 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:12.988073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:12.988628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:12.995577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:12.996074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:12.996517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:12.997221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:12.997726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:12.998160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:13.129417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:13.137949 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c085195c-28fc-487f-9acb-ccc058d0419a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.153765 Oct 26 05:55:13.138683 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3522/7057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:12 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:14.161397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:14.162023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:14.169561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:14.170040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:14.170497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:14.171198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:14.171675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:14.172103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:14.301975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:14.310359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3cac6220-0121-4b01-9332-3709ac0a09a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.152932 Oct 26 05:55:14.310932 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3536/7058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:14 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:15.260185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1952214a-8314-4024-bfe7-bb177577730b req-12099e92-c590-4de7-8b7b-80f0c6ad22f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e01bb1-2ac0-4379-93ab-e0f330d23b23", "name": "network-vif-plugged", "status": "completed", "tag": "16ff2537-9ea3-460c-9beb-6de0f199fc6b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:15.273452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1952214a-8314-4024-bfe7-bb177577730b req-12099e92-c590-4de7-8b7b-80f0c6ad22f9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:15.274542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1952214a-8314-4024-bfe7-bb177577730b req-12099e92-c590-4de7-8b7b-80f0c6ad22f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:15.275138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1952214a-8314-4024-bfe7-bb177577730b req-12099e92-c590-4de7-8b7b-80f0c6ad22f9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:15.286342 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1952214a-8314-4024-bfe7-bb177577730b req-12099e92-c590-4de7-8b7b-80f0c6ad22f9 service nova] Creating event network-vif-plugged:16ff2537-9ea3-460c-9beb-6de0f199fc6b for instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 on n-h2-862416-4 Oct 26 05:55:15.292088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1952214a-8314-4024-bfe7-bb177577730b req-12099e92-c590-4de7-8b7b-80f0c6ad22f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035985 Oct 26 05:55:15.292734 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3523/7059] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:55:15.334058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:15.334814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:15.342159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:15.342674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:15.343118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:15.343833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:15.344298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:15.344741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:15.482810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:15.490501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43758dbb-b125-4078-b62f-9b518f5ccfe3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.160564 Oct 26 05:55:15.491067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3537/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:15 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:16.516669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:16.517435 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:16.523640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:16.524131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:16.524576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:16.525372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:16.525863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:16.526292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:16.658289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:16.666400 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65d22c70-f1f8-4b13-87d1-a76c133ca1c6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1318 microversion: 2.1 time: 0.154382 Oct 26 05:55:16.666995 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3524/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:16 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:17.691341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:17.691970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:17.694912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:17.695712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:17.696490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:17.703816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:17.704319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:17.704775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:17.705519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:17.705993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:17.706437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:17.710070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=68 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:17.845391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:17.853111 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ab59c4f8-d6da-4dd6-aa9a-1bb0c5808403 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1507 microversion: 2.1 time: 0.165686 Oct 26 05:55:17.853912 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3538/7062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:17 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:17.875932 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:17.876545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:17.878648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:17.880227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:17.887156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:17.887616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:17.888116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:17.888812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:17.889294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:17.889716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.023104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:18.031728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a0d32a6a-11cf-412b-899d-939cc7283e32 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1507 microversion: 2.1 time: 0.159641 Oct 26 05:55:18.032655 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3525/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:17 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:18.054196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:18.057460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:18.063462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.063968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.064424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.065129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.065625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.066069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.128245 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0b5d091e-2592-4ccb-9566-a5c0ae0cffda tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "PUT /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1079 microversion: 2.1 time: 0.077823 Oct 26 05:55:18.128802 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3539/7064] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 26 05:55:18 2022] PUT /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1079 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:18.147348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:18.147989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:18.154321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.154806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.155242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.155962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.156415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.156838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.287697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:18.295962 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2142052a-445a-4a7d-b67b-35f7033a3faa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1505 microversion: 2.1 time: 0.152529 Oct 26 05:55:18.296539 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3526/7065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:18 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:18.318539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:18.319178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:18.325330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.325852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.326316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.327272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.327748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.328199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.464195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:18.472109 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28e5cd7b-adeb-4a13-aa16-b32582d67b6e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1505 microversion: 2.1 time: 0.157576 Oct 26 05:55:18.472832 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3540/7066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:18 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:18.495017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:18.497280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:18.503288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.503780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.504228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.504926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.505408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.505842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.535101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:18.540476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Old instance type m1.heat2, new instance type m1.heat {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:55:18.547337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:55:18.547765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:55:18.548247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:55:18.548661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:55:18.549077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:55:18.612224 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9776290c-9686-4d10-bac7-4ad0c1984595 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23/action" status: 202 len: 0 microversion: 2.1 time: 0.121215 Oct 26 05:55:18.612843 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3527/7067] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:55:18 2022] POST /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:55:18.621813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:18.622591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:18.628558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.629140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.629956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.630735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:18.631259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:18.631775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:18.797615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:18.806025 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b50a6daf-dd06-4508-9070-e0db7623fe43 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1516 microversion: 2.1 time: 0.188892 Oct 26 05:55:18.808368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3541/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:18 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:19.830756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:19.831287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:19.839214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:19.839702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:19.840139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:19.840827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:19.841281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:19.841729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:19.980741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:19.988558 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c2ed5344-721e-4a25-a4c7-777e490f493c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1516 microversion: 2.1 time: 0.162872 Oct 26 05:55:19.989147 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3528/7069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:19 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:21.013436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:21.014072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:21.020940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:21.021506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:21.021968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:21.022677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:21.023149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:21.023592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:21.154072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:21.161923 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ceac532d-dd19-4496-b43a-e0171b41287d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.153137 Oct 26 05:55:21.162502 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3542/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:21 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:22.186687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:22.187298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:22.194095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:22.194579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:22.195014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:22.195698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:22.196152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:22.196576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:22.331709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:22.340408 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-99f95dea-d1b3-4995-9de0-ee26c30fa8f2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.157717 Oct 26 05:55:22.341001 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3529/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:22 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:23.364032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:23.364663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:23.372207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:23.372704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:23.373155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:23.373884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:23.374355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:23.374800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:23.507449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:23.515630 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44873bf6-2b28-4bb0-bb32-b3a4061d3523 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.155521 Oct 26 05:55:23.516549 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3543/7072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:23 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:24.540194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:24.540817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:24.547914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:24.548404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:24.548846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:24.549579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:24.550042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:24.550468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:24.685486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:24.693543 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a0bc129-c3cf-4f6b-a72e-c4fe5edc18f7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.157218 Oct 26 05:55:24.694145 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3530/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:24 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:55:25.717826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:25.718372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:25.725251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:25.725787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:25.726250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:25.726991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:25.727470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:25.727922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:25.862409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:25.870166 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c13168ab-6266-4ac6-9753-c1827e3e2743 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.156356 Oct 26 05:55:25.870751 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3544/7074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:25 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:26.893986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:26.894640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:26.902116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:26.902605 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:26.903043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:26.903742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:26.904203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:26.904632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:27.040295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:27.048552 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82e24cd6-6a9e-484e-b960-8e3c5371a3a1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.158415 Oct 26 05:55:27.049138 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3531/7075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:26 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:28.072109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:28.073335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:28.080155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:28.080652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:28.081126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:28.081878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:28.082348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:28.082794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:28.213928 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:28.221774 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4baef149-a834-422a-9ead-07b1b0769e8c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.153757 Oct 26 05:55:28.222344 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3545/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:28 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:29.245987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:29.246779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:29.253730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:29.254218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:29.254691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:29.255381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:29.255839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:29.256270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:29.388082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:29.395733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-106b6586-7e36-4443-813d-6161c88a5569 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.153808 Oct 26 05:55:29.396309 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3532/7077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:29 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:30.419731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:30.420357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:30.427221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:30.427719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:30.428171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:30.428869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:30.429361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:30.429801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:30.564026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:30.571782 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2c6ae968-6715-42ce-9e9a-434ead286613 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.156331 Oct 26 05:55:30.572943 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3546/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:30 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:31.596656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:31.597272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:31.604134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:31.604621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:31.605064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:31.605793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:31.606251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:31.606678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:31.734382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:31.742060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a731a030-c20e-47a3-a1bc-c49fe28d115a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.149254 Oct 26 05:55:31.742647 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3533/7079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:31 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:32.765804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:32.766403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:32.773255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:32.773789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:32.774247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:32.774953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:32.775969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:32.776413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:32.908808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:32.917168 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f530214-080b-44ab-991c-86229f67db1f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.155392 Oct 26 05:55:32.917778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3547/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:32 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:33.940074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:33.940720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:33.947697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:33.948295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:33.948739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:33.949462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:33.949921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:33.950348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:34.078457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:34.086109 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9bc3d69e-c678-47aa-80ed-764055847c5d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.149979 Oct 26 05:55:34.086690 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3534/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:33 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:35.110467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:35.111017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:35.118009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:35.118513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:35.118975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:35.119694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:35.120264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:35.120713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:35.250682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:35.258462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46207b4d-3194-418f-8e62-63e1b87bf449 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.152009 Oct 26 05:55:35.259042 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3548/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:35 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:36.282468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:36.283076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:36.290093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:36.290523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:36.290968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:36.292206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:36.292667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:36.293135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:36.429093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:36.433128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:36.438575 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f9e9983-68a3-4473-bf1e-5e1fcd004f48 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.160140 Oct 26 05:55:36.439352 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3535/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:36 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:37.462033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:37.462662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:37.469378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:37.469874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:37.470324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:37.471025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:37.471490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:37.471929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:37.599433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:37.607878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9e110a3-6b9c-48ef-a6ab-a2229d730dae tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.149726 Oct 26 05:55:37.608450 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3549/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:37 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:38.631919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:38.632540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:38.640589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:38.641082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:38.641550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:38.642252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:38.642718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:38.643150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:38.780523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:38.788644 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da7c047f-28da-4c11-ac99-02e255a0babe tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.160550 Oct 26 05:55:38.789414 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3536/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:38 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:39.813162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:39.813862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:39.820754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:39.821245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:39.821722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:39.823055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:39.823628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:39.824077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:39.953130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:39.960854 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0f042658-2823-4f5e-b451-537d86620ec5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.151635 Oct 26 05:55:39.961450 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3550/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:39 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:40.983180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:40.983791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:40.990678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:40.991163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:40.991601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:40.992286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:40.992740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:40.993164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:41.131222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:41.139784 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d8a0fe28-deb2-4fbf-bb63-6687acb2c0c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.160536 Oct 26 05:55:41.144497 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3537/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:40 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:42.164203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:42.164903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:42.172517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:42.173025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:42.173525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:42.174241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:42.174718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:42.175168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:42.310418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:42.318280 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a467eeb7-8462-48b9-92e9-e28f24ede6d1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.158013 Oct 26 05:55:42.318878 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3551/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:42 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:43.343256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:43.343889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:43.350718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:43.351201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:43.351664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:43.352348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:43.352804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:43.353229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:43.487972 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:43.496269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c1438e8-279d-4b6f-85af-965fe79acd4b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.156964 Oct 26 05:55:43.496845 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3538/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:43 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:44.519636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:44.520257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:44.527402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:44.527899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:44.528357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:44.529056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:44.529558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:44.530000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:44.663165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:44.671508 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f53b62f9-d942-4fed-b9a0-df4e4bf8a249 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.155819 Oct 26 05:55:44.672076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3552/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:44 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:45.695011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:45.695576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:45.702787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:45.703277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:45.703720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:45.704428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:45.704896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:45.705348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:45.836268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:45.845009 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-67c2cca2-a09d-43be-8384-f390919ea29b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.153964 Oct 26 05:55:45.845620 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3539/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:45 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:46.868402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:46.869030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:46.876548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:46.877050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:46.877539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:46.878250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:46.878719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:46.879162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:47.011890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:47.019864 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7cf4455-c8bc-4d36-aa90-061587009ea0 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1521 microversion: 2.1 time: 0.155322 Oct 26 05:55:47.020441 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3553/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:46 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:47.745778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e01bb1-2ac0-4379-93ab-e0f330d23b23", "name": "network-vif-unplugged", "status": "completed", "tag": "16ff2537-9ea3-460c-9beb-6de0f199fc6b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:47.756422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:47.756945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:47.757514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:47.769687 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] Creating event network-vif-unplugged:16ff2537-9ea3-460c-9beb-6de0f199fc6b for instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 on n-h1-862416-4 Oct 26 05:55:47.774947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:55:47.785789 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-73ddeacf-f3dc-465e-b2f4-7b7b56bbedd1 req-ca9c0d00-10ab-498e-b997-538630770851 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043685 Oct 26 05:55:47.786402 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3540/7093] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:55:48.044579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:48.045214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:48.051442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=32 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:48.053940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:48.054451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:48.054923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:48.055764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:48.056245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:48.056692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:48.060133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:48.194319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:48.202992 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-48168954-d69b-466b-881b-9353837d8a07 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1520 microversion: 2.1 time: 0.162913 Oct 26 05:55:48.203558 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3554/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:48 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:49.228533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:49.229237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:49.231450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:55:49.237119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:49.237654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:49.238096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:49.238791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:49.239250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:49.239706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:49.375104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:49.382683 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d2c21216-ed34-4f6e-b859-b33b089769fa tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1518 microversion: 2.1 time: 0.159318 Oct 26 05:55:49.383255 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3541/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:49 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:49.806415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e01bb1-2ac0-4379-93ab-e0f330d23b23", "tag": "16ff2537-9ea3-460c-9beb-6de0f199fc6b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:49.817757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:49.818191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:49.818642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:49.830754 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] Creating event network-changed:16ff2537-9ea3-460c-9beb-6de0f199fc6b for instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 on n-h1-862416-4 Oct 26 05:55:49.836069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:55:49.846874 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f231f95d-b1bf-48c2-945d-35f05f5837c0 req-fa7282ba-200e-44e5-8893-ac6d82e41653 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044279 Oct 26 05:55:49.847532 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3555/7096] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:55:50.407883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:50.408585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:50.416300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:50.417236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:50.417953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:50.418825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:50.419445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:50.419887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:50.564243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:50.572933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49f96c59-aa43-4e9e-bb62-35152a0c2100 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1515 microversion: 2.1 time: 0.168874 Oct 26 05:55:50.573595 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3542/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:50 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:50.597438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:50.598085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:50.606404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:50.606936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:50.607381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:50.608107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:50.608586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:50.609035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:50.670092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb8351d9-db59-4ec3-b47a-cbd096033ef7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23/action" status: 204 len: 0 microversion: 2.1 time: 0.076864 Oct 26 05:55:50.671134 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3556/7098] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:55:50 2022] POST /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:55:50.679138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:50.689817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:50.697994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:50.698792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:50.699323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:50.700043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:50.700512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:50.700953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:50.954591 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:50.962562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7a2a32e-a633-4055-ba95-8e24474dc2b8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1515 microversion: 2.1 time: 0.287386 Oct 26 05:55:50.963477 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3543/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:50 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:51.989695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:51.990415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:51.997809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:51.998518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:51.998982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:51.999713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:52.000178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:52.000698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:52.170650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:52.178770 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e5a95733-d910-4e00-a9f4-6a64d76c9a2e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1507 microversion: 2.1 time: 0.194793 Oct 26 05:55:52.179357 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3557/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:51 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:55:52.202193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:52.203059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:52.209970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:52.210453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:52.210925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:52.211645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:52.212101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:52.212522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:52.348556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:52.357435 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-83099870-a81a-43c2-b25a-e7843b86f490 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1507 microversion: 2.1 time: 0.159092 Oct 26 05:55:52.358037 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3544/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:52 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:52.383907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b8f854c9-c4c0-4e86-9a4f-958cda1ece8a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'create', calling method: .version_select at 0x7f470a1ad310>, body: {"keypair": {"name": "tempest-keypair-1852727986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/PBECBGNpQoJ1U+w+PiTPuTFFHPFLPqieqQxUgrsP8V6tfjC39AFimCCNrTfGR1wnXXRpFr32vbFpUK5opPn1Q3wck/N/Xfc+4FeHrBOEED3VqrEecGtohTYlpXzGZLA=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:52.402033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b8f854c9-c4c0-4e86-9a4f-958cda1ece8a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Getting quotas for project 363cfc3d1e3f4ad9aea939f57a8117c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:55:52.407555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-b8f854c9-c4c0-4e86-9a4f-958cda1ece8a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Getting quotas for user f06949959d4f4f51bbb3317ca1355d1d and project 363cfc3d1e3f4ad9aea939f57a8117c2. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:55:52.437455 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b8f854c9-c4c0-4e86-9a4f-958cda1ece8a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057342 Oct 26 05:55:52.438076 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3558/7102] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:55:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:55:53.926485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:53.927097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:53.934914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:53.935401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:53.935838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:53.936529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:53.936985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:53.937433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:54.002753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-5550cba8-52bd-45ae-bd71-8c44a84d2d39 req-59f6b3fe-b9ce-4764-8715-97f742f74277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e01bb1-2ac0-4379-93ab-e0f330d23b23", "name": "network-vif-plugged", "status": "completed", "tag": "16ff2537-9ea3-460c-9beb-6de0f199fc6b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:54.014263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5550cba8-52bd-45ae-bd71-8c44a84d2d39 req-59f6b3fe-b9ce-4764-8715-97f742f74277 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:54.015103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5550cba8-52bd-45ae-bd71-8c44a84d2d39 req-59f6b3fe-b9ce-4764-8715-97f742f74277 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:54.015252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-5550cba8-52bd-45ae-bd71-8c44a84d2d39 req-59f6b3fe-b9ce-4764-8715-97f742f74277 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:54.026220 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-5550cba8-52bd-45ae-bd71-8c44a84d2d39 req-59f6b3fe-b9ce-4764-8715-97f742f74277 service nova] Creating event network-vif-plugged:16ff2537-9ea3-460c-9beb-6de0f199fc6b for instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 on n-h1-862416-4 Oct 26 05:55:54.031781 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-5550cba8-52bd-45ae-bd71-8c44a84d2d39 req-59f6b3fe-b9ce-4764-8715-97f742f74277 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033729 Oct 26 05:55:54.032727 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3559/7103] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:55:54.079411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:54.087219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75b2bd4e-8c76-4a59-a6d8-a21cdc414bec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 200 len: 1507 microversion: 2.1 time: 0.164690 Oct 26 05:55:54.087794 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3545/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:53 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:54.111197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:54.111824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:54.118084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:54.118562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:54.119011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:54.119716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:54.121267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:54.121743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:54.146466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:55:54.220991 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee153d50-db7d-42d9-a229-ab4d4fea3819 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 204 len: 0 microversion: 2.1 time: 0.113810 Oct 26 05:55:54.221613 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3560/7105] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:55:54 2022] DELETE /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:55:54.276892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1240982070", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "3a226202-4f80-4aea-95ea-cc2cbc1383b2"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:54.330324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] validate_networks() for [('3a226202-4f80-4aea-95ea-cc2cbc1383b2', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:55:54.704623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:55:54.705088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:55:54.705619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:55:54.706039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:55:54.706489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:55:54.715981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:54.716472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:54.716915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:54.717698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:54.718164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:54.718597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:54.735833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Getting quotas for project 363cfc3d1e3f4ad9aea939f57a8117c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:55:54.741342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Getting quotas for user f06949959d4f4f51bbb3317ca1355d1d and project 363cfc3d1e3f4ad9aea939f57a8117c2. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:55:54.753768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:55:54.756112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:55:54.802695 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c9d78559-da80-4060-b805-dcd5f652a288 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530031 Oct 26 05:55:54.803362 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3546/7106] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:55:54.815138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-16f2e697-1025-4209-8689-abb0d8216877 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:54.815870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-16f2e697-1025-4209-8689-abb0d8216877 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:54.873746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-16f2e697-1025-4209-8689-abb0d8216877 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:54.880972 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-16f2e697-1025-4209-8689-abb0d8216877 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1218 microversion: 2.1 time: 0.070046 Oct 26 05:55:54.881587 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3561/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:54 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:55.905161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:55.905973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:55.912714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:55.913201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:55.913664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:55.914362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:55.914826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:55.915256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:55.982528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:55.990793 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0a9a27ec-eb08-402a-b0a1-dffe37226c30 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1270 microversion: 2.1 time: 0.090592 Oct 26 05:55:55.991382 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3547/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:55 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:56.141113 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-e41f3344-5d7b-4d08-802e-47cb7f608f6d req-b14203fa-4f7f-4fb0-9c58-f9884cd6645e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e01bb1-2ac0-4379-93ab-e0f330d23b23", "name": "network-vif-deleted", "tag": "16ff2537-9ea3-460c-9beb-6de0f199fc6b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:56.157584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e41f3344-5d7b-4d08-802e-47cb7f608f6d req-b14203fa-4f7f-4fb0-9c58-f9884cd6645e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:56.158586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e41f3344-5d7b-4d08-802e-47cb7f608f6d req-b14203fa-4f7f-4fb0-9c58-f9884cd6645e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:56.159276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-e41f3344-5d7b-4d08-802e-47cb7f608f6d req-b14203fa-4f7f-4fb0-9c58-f9884cd6645e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:56.171238 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-e41f3344-5d7b-4d08-802e-47cb7f608f6d req-b14203fa-4f7f-4fb0-9c58-f9884cd6645e service nova] Creating event network-vif-deleted:16ff2537-9ea3-460c-9beb-6de0f199fc6b for instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 on n-h1-862416-4 Oct 26 05:55:56.176623 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-e41f3344-5d7b-4d08-802e-47cb7f608f6d req-b14203fa-4f7f-4fb0-9c58-f9884cd6645e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039616 Oct 26 05:55:56.177843 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3562/7109] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:55:57.020404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:57.022092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:57.029390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:57.029879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:57.030315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:57.031044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:57.031494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:57.032107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:57.169799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:57.177371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de37298f-6632-432e-8166-a671701b7de7 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.165240 Oct 26 05:55:57.177951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3548/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:57 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:58.202678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:58.203322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:58.209754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:58.210265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:58.210949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:58.211497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:58.212010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:58.212461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:58.221392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-660867b2-03aa-4afd-88ba-3412897db2e8 req-9c331846-60d3-46c3-a887-e3eda5788678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af280c03-922a-4f27-a2a3-b4db3dab6215", "tag": "a9435352-2ac2-47c4-800b-3c91fdcdf10f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:55:58.233219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-660867b2-03aa-4afd-88ba-3412897db2e8 req-9c331846-60d3-46c3-a887-e3eda5788678 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:58.233745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-660867b2-03aa-4afd-88ba-3412897db2e8 req-9c331846-60d3-46c3-a887-e3eda5788678 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:58.234178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-660867b2-03aa-4afd-88ba-3412897db2e8 req-9c331846-60d3-46c3-a887-e3eda5788678 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:58.245124 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-660867b2-03aa-4afd-88ba-3412897db2e8 req-9c331846-60d3-46c3-a887-e3eda5788678 service nova] Creating event network-changed:a9435352-2ac2-47c4-800b-3c91fdcdf10f for instance af280c03-922a-4f27-a2a3-b4db3dab6215 on n-h1-862416-4 Oct 26 05:55:58.250593 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-660867b2-03aa-4afd-88ba-3412897db2e8 req-9c331846-60d3-46c3-a887-e3eda5788678 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 Oct 26 05:55:58.251197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3549/7111] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:55:58.347427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:58.355282 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d1b1471a-fc63-4a45-8224-395f5ca44b31 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.158324 Oct 26 05:55:58.355860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3563/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:58 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:55:59.380668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:55:59.381389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:55:59.388302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:59.388799 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:59.389250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:59.389989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:55:59.390460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:55:59.390921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:55:59.521945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:55:59.530313 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-43dd3bdb-4642-43b2-86b7-bec48907b539 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.154745 Oct 26 05:55:59.530891 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3550/7113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:55:59 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:00.553744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:00.554374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:00.561460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:00.561965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:00.562422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:00.563136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:00.563612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:00.564055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:00.701679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:00.709721 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae68f6b7-12a7-489c-83b9-66ced4ed0abd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.160021 Oct 26 05:56:00.710297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3564/7114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:00 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:01.734060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:01.734635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:01.741523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:01.742019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:01.742464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:01.743163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:01.743630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:01.744064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:01.876792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:01.884641 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6109fa9b-a09a-4554-9660-dac531f586ab tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.155100 Oct 26 05:56:01.885227 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3551/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:01 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:02.908436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:02.909065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:02.915993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:02.916497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:02.917540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:02.918404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:02.918879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:02.919327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:03.052552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:03.062615 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fd5d653-2566-483c-a164-abbc5c59af2d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.158020 Oct 26 05:56:03.063200 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3565/7116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:02 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:04.071258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-17b75c00-f788-4092-b9e2-5cffc683ece5 req-4f7a4ea6-9552-4f70-8bd4-10a96c1d5f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af280c03-922a-4f27-a2a3-b4db3dab6215", "name": "network-vif-plugged", "status": "completed", "tag": "a9435352-2ac2-47c4-800b-3c91fdcdf10f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:04.083726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-17b75c00-f788-4092-b9e2-5cffc683ece5 req-4f7a4ea6-9552-4f70-8bd4-10a96c1d5f63 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:04.084391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-17b75c00-f788-4092-b9e2-5cffc683ece5 req-4f7a4ea6-9552-4f70-8bd4-10a96c1d5f63 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:04.084884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-17b75c00-f788-4092-b9e2-5cffc683ece5 req-4f7a4ea6-9552-4f70-8bd4-10a96c1d5f63 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:04.090008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:04.090008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:04.097230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-17b75c00-f788-4092-b9e2-5cffc683ece5 req-4f7a4ea6-9552-4f70-8bd4-10a96c1d5f63 service nova] Creating event network-vif-plugged:a9435352-2ac2-47c4-800b-3c91fdcdf10f for instance af280c03-922a-4f27-a2a3-b4db3dab6215 on n-h1-862416-4 Oct 26 05:56:04.097784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:04.098628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:04.099220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:04.100026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:04.100606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:04.101808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:04.102522 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-17b75c00-f788-4092-b9e2-5cffc683ece5 req-4f7a4ea6-9552-4f70-8bd4-10a96c1d5f63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Oct 26 05:56:04.103398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3552/7117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:56:04.243422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:04.252418 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1cce5f9f-8acd-4144-9933-4b81a46737f6 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.169726 Oct 26 05:56:04.253005 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3566/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:04 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:56:05.278420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:05.279150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:05.281321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:05.282107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:05.288682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:05.289185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:05.289664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:05.290376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:05.290839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:05.291327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:05.426165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:05.434598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c66cbc94-1776-4e37-b52c-4e72ca5f2684 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1318 microversion: 2.1 time: 0.162093 Oct 26 05:56:05.442414 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3553/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:05 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:06.459156 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:06.459789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:06.461824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:06.468000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.468504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.468958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.469695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.470168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.470611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.606998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:06.614790 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5a95fa54-df64-4c58-a201-6eeb47edc3cf tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1508 microversion: 2.1 time: 0.159515 Oct 26 05:56:06.615301 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3567/7120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:06 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:06.638098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:06.638764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:06.645557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.646043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.646488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.647217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.647683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.648113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.776632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:06.780085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=100 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:06.785281 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2d599f9c-a644-4955-b176-32b6c163346b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1508 microversion: 2.1 time: 0.151609 Oct 26 05:56:06.785889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3554/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:06 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:06.809516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:06.811860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:06.817807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.818303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.818768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.819448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.819918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.820354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.848435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:06.853772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Old instance type m1.heat2, new instance type m1.heat {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:56:06.860900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:56:06.861356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:56:06.861844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:56:06.862263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:56:06.862685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:56:06.925192 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69d58912-a080-4c95-a575-92d684fe0a1b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215/action" status: 202 len: 0 microversion: 2.1 time: 0.120331 Oct 26 05:56:06.925766 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3568/7122] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:56:06 2022] POST /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:56:06.934845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:06.935473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:06.941592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.942086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.942525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:06.943220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:06.943679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:06.944107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:07.106576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:07.114321 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eeef1f39-aec5-48a7-b9da-933188840696 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1515 microversion: 2.1 time: 0.184282 Oct 26 05:56:07.114953 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3555/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:06 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:08.139439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:08.140080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:08.147036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:08.147925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:08.148054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:08.148726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:08.149202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:08.149715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:08.283038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:08.291296 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db27cc27-0c7b-48e4-a1d3-c106e6bb01ec tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1515 microversion: 2.1 time: 0.156801 Oct 26 05:56:08.291951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3569/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:08 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:09.314368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:09.314987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:09.321656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:09.322131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:09.322575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:09.323760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:09.324218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:09.324642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:09.460256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:09.468071 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d1b24081-bbdc-4728-a09f-230bdde45c75 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.157629 Oct 26 05:56:09.468648 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3556/7125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:09 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:10.491904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:10.492538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:10.499963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:10.500466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:10.500922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:10.501663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:10.502137 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:10.502608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:10.506744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:10.639121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:10.647001 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6131efe5-cedf-4e23-9e57-cbd6af413678 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.159099 Oct 26 05:56:10.647581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3570/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:10 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:11.671877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:11.672487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:11.679533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:11.680009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:11.680444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:11.681127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:11.681614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:11.682037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:11.817068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:11.825582 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0460cd43-0372-4f74-885a-d529d8e7c130 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.157921 Oct 26 05:56:11.826160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3557/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:11 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:12.849410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:12.850033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:12.857685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:12.858180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:12.858632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:12.859334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:12.859799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:12.860237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:12.990023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:12.998309 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80352c6b-700e-45e0-a4d2-50a3d473ba25 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.152899 Oct 26 05:56:12.998884 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3571/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:12 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:14.021837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:14.022480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:14.029521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:14.030007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:14.030442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:14.031129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:14.031584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:14.032009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:14.163465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:14.171333 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2dcc8b7-765d-439b-a4cd-117617ab4866 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.153466 Oct 26 05:56:14.171907 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3558/7129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:14 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:15.194907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:15.195534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:15.203232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:15.203735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:15.204191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:15.204905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:15.205404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:15.205851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:15.342666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:15.350481 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-174110f3-c37d-4935-b47c-bc02b7694cc4 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.159558 Oct 26 05:56:15.351061 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3572/7130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:15 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:16.374693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:16.375348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:16.382315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:16.382809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:16.383251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:16.383949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:16.384412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:16.384874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:16.515191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:16.522895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ffe601e2-ced3-488c-a22b-00fcc296a5b1 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.152705 Oct 26 05:56:16.523467 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3559/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:16 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:17.545817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:17.546446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:17.554280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:17.554280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:17.554647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:17.555540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:17.556080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:17.556595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:17.690231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:17.698087 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cee574a3-c40d-47f8-858f-c214d41063db tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.156385 Oct 26 05:56:17.698661 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3573/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:17 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:18.722035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:18.722559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:18.729377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:18.729866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:18.730300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:18.731568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:18.732028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:18.732458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:18.863446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:18.871161 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b0ba45a2-d828-4a3c-8e69-a4fa63f368d3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.153058 Oct 26 05:56:18.872500 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3560/7133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:18 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:19.895139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:19.895766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:19.898642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:19.904214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:19.904755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:19.905210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:19.905940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:19.906409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:19.906844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:20.041069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:20.049522 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b1211e49-afd8-45e2-9867-a689060828b2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.158251 Oct 26 05:56:20.050095 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3574/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:19 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:21.072713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:21.073389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:21.076624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:21.082065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:21.082561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:21.083000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:21.083696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:21.084158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:21.084587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:21.215999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:21.223847 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-61d65e91-1686-4ad3-b76c-7f4d94790eb2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.155019 Oct 26 05:56:21.224427 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3561/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:21 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:22.247812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:22.248444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:22.255394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:22.255903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:22.256363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:22.257077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:22.257582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:22.258031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:22.386791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:22.394608 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-72715dd7-68e9-488e-9e69-baa36a17d2fd tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.150830 Oct 26 05:56:22.395194 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3575/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:22 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:23.417994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:23.419144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:23.426087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:23.426571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:23.427011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:23.427695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:23.428147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:23.428572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:23.565965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:23.573564 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-62d8ecf4-67ae-4fa9-b94b-7a6395b16c69 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.159392 Oct 26 05:56:23.574133 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3562/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:23 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:24.596564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:24.597197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:24.603811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:24.604317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:24.604805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:24.605548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:24.606653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:24.607101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:24.739047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:24.747543 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4073c440-a2b6-41e9-889d-ea9cd43eee8e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.154813 Oct 26 05:56:24.748127 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3576/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:24 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:56:25.770805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:25.771358 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:25.779291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:25.779777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:25.780213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:25.780903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:25.781376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:25.781804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:25.915744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:25.923499 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f6522db4-a5fc-4db1-b21b-a813d8c3f732 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.156626 Oct 26 05:56:25.924069 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3563/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:25 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:26.947393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:26.948015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:26.956300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:26.956799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:26.957253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:26.957982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:26.958450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:26.958893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:27.087840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:27.095720 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0831ce9a-2e31-4ce7-add8-1528d53cd44b tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.152404 Oct 26 05:56:27.096297 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3577/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:26 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:28.120057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:28.120671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:28.128077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:28.128559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:28.128997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:28.129703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:28.130165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:28.130587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:28.261637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:28.270219 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7d6d21cc-ab0b-41f4-a229-616193b2b5c2 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.154493 Oct 26 05:56:28.270805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3564/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:28 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:29.294591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:29.295219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:29.302305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:29.302806 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:29.303265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:29.303981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:29.304451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:29.304893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:29.441360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:29.449324 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a811d7aa-7baf-4a90-8a3e-1ec5d8505fa8 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.158941 Oct 26 05:56:29.449913 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3578/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:29 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:30.474220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:30.474833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:30.482223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:30.482852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:30.483326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:30.484016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:30.484531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:30.484955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:30.622696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:30.630742 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45ebfac5-aec4-4504-85e7-b9ff1c045844 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.160339 Oct 26 05:56:30.631320 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3565/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:30 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:31.655060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:31.655694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:31.662589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:31.663094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:31.663554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:31.664259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:31.664729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:31.665173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:31.799430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:31.807237 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d015095d-9f36-4044-8fe2-a775d3030457 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.156963 Oct 26 05:56:31.807809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3579/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:31 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:32.831594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:32.832249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:32.839100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:32.839592 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:32.840041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:32.840738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:32.841720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:32.842158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:32.970649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:32.978409 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6bd8a4a-0b85-4b99-9d11-60da31e8ea7e tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.151146 Oct 26 05:56:32.978989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3566/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:32 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:34.002330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:34.002965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:34.010557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:34.011060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:34.011532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:34.012232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:34.013188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:34.013676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:34.144904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:34.152709 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f9c3b77-e9ea-48a0-bfe4-db8319e9d406 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.154361 Oct 26 05:56:34.153834 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3580/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:33 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:35.177819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:35.178429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:35.185211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:35.185739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:35.186186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:35.186878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:35.187333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:35.187758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:35.318442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:35.326906 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30739440-8f02-4458-979c-002f4ab1ab04 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1520 microversion: 2.1 time: 0.153177 Oct 26 05:56:35.327486 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3567/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:35 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:36.351380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:36.352018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:36.358740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:36.359234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:36.359675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:36.360380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:36.360839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:36.361268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:36.390003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af280c03-922a-4f27-a2a3-b4db3dab6215", "name": "network-vif-unplugged", "status": "completed", "tag": "a9435352-2ac2-47c4-800b-3c91fdcdf10f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:36.400541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:36.401291 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:36.401961 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:36.414737 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] Creating event network-vif-unplugged:a9435352-2ac2-47c4-800b-3c91fdcdf10f for instance af280c03-922a-4f27-a2a3-b4db3dab6215 on n-h2-862416-4 Oct 26 05:56:36.420450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] Instance af280c03-922a-4f27-a2a3-b4db3dab6215 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:56:36.435328 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b497c45f-ca70-4c21-bf5c-c31844a29cb2 req-93d2f233-efbc-4e3e-a2e9-b6460330dfd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120454 Oct 26 05:56:36.436277 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3581/7148] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:56:36.595474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:36.603193 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6edf8f59-4d2e-4c82-89cd-c79ed613e2be tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1519 microversion: 2.1 time: 0.255689 Oct 26 05:56:36.603772 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3568/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:36 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:56:37.629723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:37.630372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:37.636524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:37.637022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:37.637531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:37.638567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:37.639042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:37.639487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:37.773385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:37.781142 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b6ff7a3-7975-485a-a434-393d2378df47 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1517 microversion: 2.1 time: 0.156736 Oct 26 05:56:37.781761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3582/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:37 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:38.461620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af280c03-922a-4f27-a2a3-b4db3dab6215", "tag": "a9435352-2ac2-47c4-800b-3c91fdcdf10f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:38.471586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:38.472072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:38.472514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:38.475028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=85 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:38.485716 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] Creating event network-changed:a9435352-2ac2-47c4-800b-3c91fdcdf10f for instance af280c03-922a-4f27-a2a3-b4db3dab6215 on n-h2-862416-4 Oct 26 05:56:38.490942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] Instance af280c03-922a-4f27-a2a3-b4db3dab6215 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:56:38.502060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-51067c53-3f49-4a78-a7c0-bab88587bc72 req-739e883e-9d6a-4a1a-826e-624b04271ba3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044342 Oct 26 05:56:38.502652 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3569/7151] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:56:38.805474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:38.806099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:38.814006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:38.814504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:38.814958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:38.815673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:38.816138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:38.816577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:38.950148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:38.958854 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb207493-c1fd-4f3f-bacc-d8fb85763927 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1517 microversion: 2.1 time: 0.157324 Oct 26 05:56:38.959432 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3583/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:38 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:39.984632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:39.985354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:39.991911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:39.992561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:39.992973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:39.993789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:39.994250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:39.994675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:40.161654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:40.169510 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75c99075-4f65-483a-8c18-827138eb4103 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1514 microversion: 2.1 time: 0.190704 Oct 26 05:56:40.170083 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3570/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:39 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:40.194399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:40.194965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:40.202549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:40.203309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:40.203761 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:40.204459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:40.204927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:40.205454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:40.266099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6f292ed0-eed6-4758-ab49-8ab4d7e92617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "POST /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215/action" status: 204 len: 0 microversion: 2.1 time: 0.075603 Oct 26 05:56:40.266688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3584/7154] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:56:40 2022] POST /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:56:40.274790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:40.275410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:40.281442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:40.281930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:40.282373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:40.283068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:40.283528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:40.283956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:40.417339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:40.425511 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bbe8f09a-47be-4762-943e-22a27d94c104 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1514 microversion: 2.1 time: 0.154496 Oct 26 05:56:40.426097 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3571/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:40 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:41.450759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:41.451498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:41.458541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:41.459271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:41.459727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:41.460625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:41.461101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:41.461573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:41.465963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:41.605939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:41.617701 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f48615b3-2124-4f3b-8ee9-df83ba6ed77c tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1514 microversion: 2.1 time: 0.172213 Oct 26 05:56:41.618908 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3585/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:41 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:42.644214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:42.644785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:42.651662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:42.652146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:42.652581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:42.653813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:42.654269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:42.654693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:42.785380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:42.793118 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d6693590-385c-4627-b3a4-44c9951fc8f5 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1506 microversion: 2.1 time: 0.152862 Oct 26 05:56:42.794043 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3572/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:42 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:42.815788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:42.816418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:42.823331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:42.823831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:42.824287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:42.824991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:42.826216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:42.826445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:42.955064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:42.962890 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59c78579-9d26-406b-a10f-eb0275aace0f tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1506 microversion: 2.1 time: 0.150995 Oct 26 05:56:42.963678 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3586/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:42 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:42.985562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:42.986183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:42.992177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:42.992667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:42.993114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:42.993841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:42.994302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:42.994735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.128119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:43.135740 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-246fd83b-e1b4-4c52-a2aa-d51d6efa982a tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1506 microversion: 2.1 time: 0.154042 Oct 26 05:56:43.136312 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3573/7159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:42 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:43.158654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:43.159108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:43.165108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.165651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.166110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.166816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.167289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.167736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.192895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:56:43.270999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f37ab492-995b-4546-8f5b-59b9545470ff tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 204 len: 0 microversion: 2.1 time: 0.113592 Oct 26 05:56:43.272140 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3587/7160] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:56:43 2022] DELETE /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:56:43.286231 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:43.286764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:43.292760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.293251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.293838 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.295101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.295563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.295992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.321260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:56:43.366061 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.compute.api [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Instance is already in deleting state, ignoring this request Oct 26 05:56:43.366888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80932a24-310f-4cc1-8bb7-79ca962f6854 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 204 len: 0 microversion: 2.1 time: 0.084548 Oct 26 05:56:43.367456 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3574/7161] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:56:43 2022] DELETE /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 05:56:43.376661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:43.377409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:43.383357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.383848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.384296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.384995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.385504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.385946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.520094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:43.527961 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-01918981-6af4-4d76-a6c4-8aaa30f87617 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1512 microversion: 2.1 time: 0.155805 Oct 26 05:56:43.529194 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3588/7162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:43 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:43.751926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-51488385-7b57-4fc2-965b-11b20ac7010e req-bd2a2b08-69a8-433c-80db-820987208b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af280c03-922a-4f27-a2a3-b4db3dab6215", "name": "network-vif-plugged", "status": "completed", "tag": "a9435352-2ac2-47c4-800b-3c91fdcdf10f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:43.762645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-51488385-7b57-4fc2-965b-11b20ac7010e req-bd2a2b08-69a8-433c-80db-820987208b1d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:43.763139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-51488385-7b57-4fc2-965b-11b20ac7010e req-bd2a2b08-69a8-433c-80db-820987208b1d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:43.763576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-51488385-7b57-4fc2-965b-11b20ac7010e req-bd2a2b08-69a8-433c-80db-820987208b1d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:43.774706 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-51488385-7b57-4fc2-965b-11b20ac7010e req-bd2a2b08-69a8-433c-80db-820987208b1d service nova] Creating event network-vif-plugged:a9435352-2ac2-47c4-800b-3c91fdcdf10f for instance af280c03-922a-4f27-a2a3-b4db3dab6215 on n-h2-862416-4 Oct 26 05:56:43.780067 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-51488385-7b57-4fc2-965b-11b20ac7010e req-bd2a2b08-69a8-433c-80db-820987208b1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032571 Oct 26 05:56:43.780668 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3575/7163] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:56:44.552680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:44.553302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:44.560700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:44.561194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:44.561677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:44.562381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:44.562848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:44.563286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:44.784021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06949959d4f4f51bbb3317ca1355d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363cfc3d1e3f4ad9aea939f57a8117c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:44.791892 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2590077-038a-4e24-aa9e-cb5999ae9ff3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 200 len: 1512 microversion: 2.1 time: 0.243054 Oct 26 05:56:44.792894 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3589/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:44 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:45.126896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1ed6cc09-0094-409d-b456-41760eeb8246 req-f9f8b695-1ca8-4430-b768-a247a86bef49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af280c03-922a-4f27-a2a3-b4db3dab6215", "name": "network-vif-deleted", "tag": "a9435352-2ac2-47c4-800b-3c91fdcdf10f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:45.137271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1ed6cc09-0094-409d-b456-41760eeb8246 req-f9f8b695-1ca8-4430-b768-a247a86bef49 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:45.138044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1ed6cc09-0094-409d-b456-41760eeb8246 req-f9f8b695-1ca8-4430-b768-a247a86bef49 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:45.138616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1ed6cc09-0094-409d-b456-41760eeb8246 req-f9f8b695-1ca8-4430-b768-a247a86bef49 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:45.150903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1ed6cc09-0094-409d-b456-41760eeb8246 req-f9f8b695-1ca8-4430-b768-a247a86bef49 service nova] Creating event network-vif-deleted:a9435352-2ac2-47c4-800b-3c91fdcdf10f for instance af280c03-922a-4f27-a2a3-b4db3dab6215 on n-h2-862416-4 Oct 26 05:56:45.156228 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1ed6cc09-0094-409d-b456-41760eeb8246 req-f9f8b695-1ca8-4430-b768-a247a86bef49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 Oct 26 05:56:45.156781 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3576/7165] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:56:45.816923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:45.817602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: af280c03-922a-4f27-a2a3-b4db3dab6215] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:45.824637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:45.825130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:45.825770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:45.826474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:45.826938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:45.827378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:45.841394 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] HTTP exception thrown: Instance af280c03-922a-4f27-a2a3-b4db3dab6215 could not be found. Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Request method failure captured: Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 HTTP/1.1 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMu6rWBA1dGZ_vWXMIGFCF-uIdO-v5U1ZbkTopuxSpZ-r0gkTufdyVhXpa1jGhUNJJsG8A_Fnn0kEMWwkdJhQSH6hw2WZUJOwkwbdAMwmxeeDuc7KJKq8217JkYLM_ka1p-oU7mXLdf68WlCnLorYVKTzfC3aCTGKv16l8CcIeaadZo Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 363cfc3d1e3f4ad9aea939f57a8117c2 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 363cfc3d1e3f4ad9aea939f57a8117c2 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-836988718-project Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f06949959d4f4f51bbb3317ca1355d1d Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-836988718-project Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance af280c03-922a-4f27-a2a3-b4db3dab6215 could not be found. Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'af280c03-922a-4f27-a2a3-b4db3dab6215'} Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af280c03-922a-4f27-a2a3-b4db3dab6215 could not be found. Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af280c03-922a-4f27-a2a3-b4db3dab6215 could not be found. Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:56:45.843085 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af280c03-922a-4f27-a2a3-b4db3dab6215 could not be found. Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Returning 404 to user: Instance af280c03-922a-4f27-a2a3-b4db3dab6215 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-28ed9392-77b1-45c4-88b2-e0ac7ac97fa3 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215" status: 404 len: 111 microversion: 2.1 time: 0.031481 Oct 26 05:56:45.848136 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3590/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:45 2022] GET /compute/v2.1/servers/af280c03-922a-4f27-a2a3-b4db3dab6215 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:56:45.854029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d07e5c6-4779-46f7-bcb3-1235fe91cf54 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '.version_select at 0x7f470adb7c10>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:45.859091 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d07e5c6-4779-46f7-bcb3-1235fe91cf54 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 05:56:46.866622 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d07e5c6-4779-46f7-bcb3-1235fe91cf54 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52276. Oct 26 05:56:46.886105 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d07e5c6-4779-46f7-bcb3-1235fe91cf54 tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852727986" status: 202 len: 0 microversion: 2.1 time: 1.036463 Oct 26 05:56:46.886700 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3577/7167] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 05:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852727986 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:56:47.777785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:47.778881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:47.785888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:47.786382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:47.786853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:47.787531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:47.787998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:47.788437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:47.806647 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] HTTP exception thrown: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Request method failure captured: Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 HTTP/1.1 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMu6rWBA1dGZ_vWXMIGFCF-uIdO-v5U1ZbkTopuxSpZ-r0gkTufdyVhXpa1jGhUNJJsG8A_Fnn0kEMWwkdJhQSH6hw2WZUJOwkwbdAMwmxeeDuc7KJKq8217JkYLM_ka1p-oU7mXLdf68WlCnLorYVKTzfC3aCTGKv16l8CcIeaadZo Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 363cfc3d1e3f4ad9aea939f57a8117c2 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 363cfc3d1e3f4ad9aea939f57a8117c2 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerDiskConfigTestJSON-836988718-project Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: f06949959d4f4f51bbb3317ca1355d1d Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerDiskConfigTestJSON-836988718-project Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e0e01bb1-2ac0-4379-93ab-e0f330d23b23'} Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:56:47.808213 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Returning 404 to user: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d84f6c6f-a8ca-463a-8d68-a53db9126d0d tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 404 len: 111 microversion: 2.1 time: 0.035794 Oct 26 05:56:47.813059 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3591/7168] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:56:47 2022] DELETE /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:56:47.818658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:47.819389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] [instance: e0e01bb1-2ac0-4379-93ab-e0f330d23b23] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:47.827384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:47.827868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:47.828557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:47.829243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:47.830086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:47.830524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:47.844378 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] HTTP exception thrown: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Request method failure captured: Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 HTTP/1.1 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMu6rWBA1dGZ_vWXMIGFCF-uIdO-v5U1ZbkTopuxSpZ-r0gkTufdyVhXpa1jGhUNJJsG8A_Fnn0kEMWwkdJhQSH6hw2WZUJOwkwbdAMwmxeeDuc7KJKq8217JkYLM_ka1p-oU7mXLdf68WlCnLorYVKTzfC3aCTGKv16l8CcIeaadZo Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 363cfc3d1e3f4ad9aea939f57a8117c2 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/363cfc3d1e3f4ad9aea939f57a8117c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 363cfc3d1e3f4ad9aea939f57a8117c2 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-836988718 Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerDiskConfigTestJSON-836988718-project Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: f06949959d4f4f51bbb3317ca1355d1d Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerDiskConfigTestJSON-836988718-project Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'e0e01bb1-2ac0-4379-93ab-e0f330d23b23'} Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:56:47.846034 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] Returning 404 to user: Instance e0e01bb1-2ac0-4379-93ab-e0f330d23b23 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce4a7968-7376-45ad-9811-c848df803fca tempest-ServerDiskConfigTestJSON-836988718 tempest-ServerDiskConfigTestJSON-836988718-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23" status: 404 len: 111 microversion: 2.1 time: 0.032640 Oct 26 05:56:47.850852 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3578/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:47 2022] GET /compute/v2.1/servers/e0e01bb1-2ac0-4379-93ab-e0f330d23b23 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 05:56:56.636147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79e44925-1903-4a6c-9193-a867aaf1e8a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'create', calling method: .version_select at 0x7f47092b79d0>, body: {"keypair": {"name": "tempest-keypair-1169985004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6col80q37B9wBYFgvWlNh/W2EghPxfDzg5uyLCG3rwW6t9tElxxHmqZvgTKbKSNn0q2nQrjDQ5scLSLiwHyAzJ6Rc3R/YfFY+ObnyG4904kqnQB84yMKTXm/E32BHdNQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:56.641923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:56.655586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-79e44925-1903-4a6c-9193-a867aaf1e8a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:56:56.661218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-79e44925-1903-4a6c-9193-a867aaf1e8a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:56:56.687481 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79e44925-1903-4a6c-9193-a867aaf1e8a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200975 Oct 26 05:56:56.688083 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3592/7170] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 05:56:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:56:58.043107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1450365492", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9e9be08-5efa-4913-8ca2-449133e5622b"}], "security_groups": [{"name": "tempest-securitygroup--84271778"}], "key_name": "tempest-keypair-1169985004", "user_data": "}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:56:58.053289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:58.053970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:58.170386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] validate_networks() for [('d9e9be08-5efa-4913-8ca2-449133e5622b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:56:58.586950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:56:58.587448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:56:58.587999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:56:58.588484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:56:58.588964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:56:58.598964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:58.599447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:58.599902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:58.600606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:58.601062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:58.601542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:58.620287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:56:58.626264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:56:58.639640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:56:58.641979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:56:58.697157 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9eb2dff-be7d-4ecd-9beb-b3bc96398bd9 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.658264 Oct 26 05:56:58.704819 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3579/7171] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:56:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:56:58.710778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cef6e10f-888e-4d88-b599-5fa58c4736c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:58.711838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cef6e10f-888e-4d88-b599-5fa58c4736c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:58.716618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:56:58.776846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cef6e10f-888e-4d88-b599-5fa58c4736c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:58.784494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cef6e10f-888e-4d88-b599-5fa58c4736c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1239 microversion: 2.1 time: 0.077975 Oct 26 05:56:58.785295 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3593/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:58 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:56:59.815247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:56:59.815970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:56:59.833074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:59.833613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:59.834178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:59.834980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:56:59.835448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:56:59.835935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:56:59.913049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:56:59.922008 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-062f61e4-e797-481b-910c-b13596de7f3b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1309 microversion: 2.1 time: 0.115898 Oct 26 05:56:59.939242 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3580/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:56:59 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:57:00.947004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:00.947633 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:00.955459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:00.955969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:00.956427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:00.957140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:00.957636 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:00.958082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:01.489664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:01.499023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb584782-9f28-455e-a717-dce462ca6dbb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.555928 Oct 26 05:57:01.499631 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3594/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:00 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:01.627378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-81da2a99-0d45-4670-b53a-25cc45af7115 req-ab2ebc8f-193c-4474-9246-9433a1a0f51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:57:01.638805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-81da2a99-0d45-4670-b53a-25cc45af7115 req-ab2ebc8f-193c-4474-9246-9433a1a0f51d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:01.639620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-81da2a99-0d45-4670-b53a-25cc45af7115 req-ab2ebc8f-193c-4474-9246-9433a1a0f51d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:01.640123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-81da2a99-0d45-4670-b53a-25cc45af7115 req-ab2ebc8f-193c-4474-9246-9433a1a0f51d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:01.652985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-81da2a99-0d45-4670-b53a-25cc45af7115 req-ab2ebc8f-193c-4474-9246-9433a1a0f51d service nova] Creating event network-changed:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h2-862416-4 Oct 26 05:57:01.658625 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-81da2a99-0d45-4670-b53a-25cc45af7115 req-ab2ebc8f-193c-4474-9246-9433a1a0f51d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034896 Oct 26 05:57:01.660002 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3581/7175] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:57:02.522721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:02.523351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:02.530411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:02.530910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:02.531369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:02.532075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:02.532547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:02.532989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:02.666763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:02.675470 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb6be855-fed4-46a3-aa40-19a985504c4d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.156731 Oct 26 05:57:02.676044 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3595/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:02 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:03.699460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:03.700576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:03.708880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:03.709408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:03.709854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:03.710553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:03.711016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:03.711456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:03.844306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:03.851913 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6438c60d-bb6f-438f-a1d5-123421587f68 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.157688 Oct 26 05:57:03.852479 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3582/7177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:03 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:04.875580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:04.876208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:04.883170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:04.883670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:04.884124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:04.884839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:04.885336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:04.885772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:05.021721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:05.029432 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5582e848-fe40-4846-ab6a-67f8267d3a6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.158646 Oct 26 05:57:05.030008 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3596/7178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:04 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:06.051973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:06.052582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:06.059218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:06.059699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:06.060137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:06.060826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:06.061281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:06.061735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:06.198139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:06.206932 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-74a6d787-9b96-45cd-a7c1-910a91bd8c88 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.158803 Oct 26 05:57:06.207640 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3583/7179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:06 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:07.230303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:07.230930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:07.238293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:07.238790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:07.239244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:07.239953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:07.240425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:07.240899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:07.369267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:07.377295 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24a8edc7-bf59-4c6b-aa53-82af75d022d3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.151089 Oct 26 05:57:07.377888 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3597/7180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:07 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:07.838783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c30e56fb-09e4-4f05-85e7-6523353d3171 req-55727046-1133-4acc-a865-4d66d7a0b4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "name": "network-vif-plugged", "status": "completed", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:57:07.849556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c30e56fb-09e4-4f05-85e7-6523353d3171 req-55727046-1133-4acc-a865-4d66d7a0b4d1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:07.850337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c30e56fb-09e4-4f05-85e7-6523353d3171 req-55727046-1133-4acc-a865-4d66d7a0b4d1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:07.850462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c30e56fb-09e4-4f05-85e7-6523353d3171 req-55727046-1133-4acc-a865-4d66d7a0b4d1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:07.862455 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c30e56fb-09e4-4f05-85e7-6523353d3171 req-55727046-1133-4acc-a865-4d66d7a0b4d1 service nova] Creating event network-vif-plugged:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h2-862416-4 Oct 26 05:57:07.867340 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c30e56fb-09e4-4f05-85e7-6523353d3171 req-55727046-1133-4acc-a865-4d66d7a0b4d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Oct 26 05:57:07.868111 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3584/7181] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:57:08.400146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:08.400817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:08.407705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:08.408212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:08.408675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:08.409440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:08.409920 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:08.410372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:08.543356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:08.551699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-702478b8-c29c-47bf-8e3f-e466904e2d57 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1363 microversion: 2.1 time: 0.155565 Oct 26 05:57:08.552275 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3598/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:08 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:09.572877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:57:09.573793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:57:09.579354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:09.580053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:09.587014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:09.587499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:09.587936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:09.588622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:09.589077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:09.589554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:09.725793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:57:09.734051 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2e238dc2-2a63-48f2-a8ce-d598de7d4b72 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1550 microversion: 2.1 time: 0.162119 Oct 26 05:57:09.734623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3585/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:57:09 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:57:09.756367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:57:09.756901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:57:09.758813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:57:09.766623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:09.767125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:09.767580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:09.768292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:09.769084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:09.769563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:09.850505 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-478bf3d5-888f-42fc-84a6-91c3135580bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098107 Oct 26 05:57:09.851134 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3599/7184] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:57:09 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:57:10.783935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-dd0dc2f2-4dc2-40af-a679-a8738dc48ad8 req-0eee6eaa-ff6d-46d4-afaf-0ab6d6ff2bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:57:10.795023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-dd0dc2f2-4dc2-40af-a679-a8738dc48ad8 req-0eee6eaa-ff6d-46d4-afaf-0ab6d6ff2bde service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:57:10.795515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-dd0dc2f2-4dc2-40af-a679-a8738dc48ad8 req-0eee6eaa-ff6d-46d4-afaf-0ab6d6ff2bde service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:57:10.795957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-dd0dc2f2-4dc2-40af-a679-a8738dc48ad8 req-0eee6eaa-ff6d-46d4-afaf-0ab6d6ff2bde service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:57:10.807361 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-dd0dc2f2-4dc2-40af-a679-a8738dc48ad8 req-0eee6eaa-ff6d-46d4-afaf-0ab6d6ff2bde service nova] Creating event network-changed:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h2-862416-4 Oct 26 05:57:10.812979 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-dd0dc2f2-4dc2-40af-a679-a8738dc48ad8 req-0eee6eaa-ff6d-46d4-afaf-0ab6d6ff2bde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032824 Oct 26 05:57:10.813807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3586/7185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:58:15.201153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:15.202174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=34 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:15.209171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:15.209844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:15.217862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.218374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.218833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.220051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.220541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.220970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.416639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:15.424521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eee43a3d-969d-4671-86b8-c27782e606bb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1669 microversion: 2.1 time: 0.226548 Oct 26 05:58:15.425100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3600/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:15 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1669 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:15.445813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:15.446561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=32 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:15.451423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:15.452081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:15.460811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.461304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.461771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.462472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.462939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.463374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.653658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:15.662833 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1576400-eefa-49dc-8f59-07730db40a30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1669 microversion: 2.1 time: 0.219735 Oct 26 05:58:15.663418 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3587/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:15 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:15.685465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:15.686094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:15.692738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.693240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.693730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.694439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.694912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.695359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.825471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:15.835369 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cf7a9127-35c2-4550-84bf-7e544e971550 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1669 microversion: 2.1 time: 0.153934 Oct 26 05:58:15.835951 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3601/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:15 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:15.857982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:15.860234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:15.866280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.866773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.867217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.867912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.868374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.868804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.897736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:15.903135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Old instance type m1.heat2, new instance type m1.heat {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 05:58:15.909825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:58:15.910260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:58:15.910744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:58:15.911163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:58:15.911584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:58:15.973815 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ad604180-8f97-4d55-adba-e3c8e1500607 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564/action" status: 202 len: 0 microversion: 2.1 time: 0.119655 Oct 26 05:58:15.974434 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3588/7189] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:58:15 2022] POST /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:58:15.982682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:15.983407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:15.990008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.990519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.990985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:15.991707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:15.992218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:15.992719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:16.158480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:16.166504 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc46ecce-e6f1-4f24-be83-fd1c1ebc990d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1678 microversion: 2.1 time: 0.187787 Oct 26 05:58:16.167056 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3602/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:15 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:17.192570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:17.193181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:17.200220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:17.200711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:17.201150 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:17.201874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:17.202331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:17.202757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:17.336691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:17.346094 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fa68f41e-8eda-41e8-9c8a-c2ea2b8f30a3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1678 microversion: 2.1 time: 0.159070 Oct 26 05:58:17.347008 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3589/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:17 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:18.372003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:18.372659 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:18.380196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:18.380625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:18.381076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:18.381815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:18.382283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:18.382723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:18.519914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:18.527838 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9dde742e-a9df-46aa-bc99-7fc9bb9d6f63 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.159723 Oct 26 05:58:18.528407 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3603/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:18 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:19.552302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:19.552913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:19.559960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:19.560442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:19.560875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:19.561577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:19.562029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:19.562448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:19.693652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:19.701377 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-70be0254-90ba-4525-957e-fb7b6f154306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.152885 Oct 26 05:58:19.701877 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3590/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:19 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:20.726760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:20.727353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:20.734548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:20.735545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:20.736006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:20.736716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:20.737194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:20.737673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:20.869802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:20.878697 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-426d4f28-a572-403d-9e32-13229ef8e9ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.156005 Oct 26 05:58:20.879278 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3604/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:20 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:21.902342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:21.902968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:21.909833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:21.910330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:21.910778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:21.911511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:21.911985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:21.912421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:22.040714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:22.049243 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f09bfa87-92f8-4395-866e-83aca9d4e599 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.150864 Oct 26 05:58:22.049851 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3591/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:21 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:23.073115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:23.073776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:23.081500 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:23.081996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:23.082445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:23.083142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:23.083607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:23.084044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:23.216433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:23.224614 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-df7fd341-f1ee-4146-ba45-f3bef83dfba4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.155436 Oct 26 05:58:23.225192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3605/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:23 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:24.247996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:24.248618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:24.255569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:24.256077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:24.256525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:24.257226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:24.257722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:24.258159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:24.387920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:24.396216 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-12870174-47cc-4c72-9f2a-b8b9e350cacc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.152137 Oct 26 05:58:24.396796 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3592/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:24 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:25.420252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:25.420866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:25.427952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:25.428447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:25.428899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:25.429631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:25.430097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:25.430538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:25.560629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:25.568995 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-373e005d-e1a6-4ab5-a633-fd84fc2b808c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.152953 Oct 26 05:58:25.569605 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3606/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:25 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:26.593022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:26.593821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:26.601680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:26.602253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:26.602940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:26.603697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:26.604111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:26.604558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:27.126431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:27.134032 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5c45b1b2-eac8-4403-8ce4-0d68da92d3c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.544857 Oct 26 05:58:27.134608 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3593/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:26 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:58:28.157700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:28.158318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:28.164934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:28.165455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:28.165905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:28.166606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:28.167077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:28.167514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:28.298700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:28.306483 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-90dfcf55-0792-411d-920e-a20acebe1b9d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.152787 Oct 26 05:58:28.307062 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3607/7200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:28 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:58:29.330674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:29.331262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:29.338958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:29.339444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:29.339881 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:29.340573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:29.341055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:29.341525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:29.477185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:29.484927 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77b6319a-f0ee-49d1-865f-9241610b8eb7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1683 microversion: 2.1 time: 0.158443 Oct 26 05:58:29.486276 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3594/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:29 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:58:30.338700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "name": "network-vif-unplugged", "status": "completed", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:30.350324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:30.350823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:30.351311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:30.365167 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] Creating event network-vif-unplugged:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h1-862416-4 Oct 26 05:58:30.370752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:58:30.383170 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-8b25a219-f58e-46f0-9e08-c9f6c2f17f22 req-3bdc9be3-767f-4521-8bd7-9fcb3a086865 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048215 Oct 26 05:58:30.383787 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3608/7202] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:58:30.509753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:30.510378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:30.517744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:30.518240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:30.518688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:30.519387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:30.519852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:30.520278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:30.658641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:30.666692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca7241ac-f940-4ff6-b0b8-b849f1dbf4a7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1682 microversion: 2.1 time: 0.161007 Oct 26 05:58:30.667276 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3595/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:30 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:31.692313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:31.693022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:31.702048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:31.702547 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:31.703000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:31.703800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:31.705072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:31.705549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:31.837070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:31.845464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5aa8f450-be3a-4ece-8775-0ba860e99468 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1680 microversion: 2.1 time: 0.158429 Oct 26 05:58:31.846038 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3609/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:31 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:32.419524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:32.430165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:32.430644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:32.431072 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:32.443702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] Creating event network-changed:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h1-862416-4 Oct 26 05:58:32.449281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 05:58:32.460927 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f5ffc1f3-2a11-4f05-b765-66964ea7e1cb req-3af467a8-4d36-44a1-a246-5d1101b6e2dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045048 Oct 26 05:58:32.461601 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3596/7205] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:58:32.869051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:32.869714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:32.877759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:32.878259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:32.878712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:32.879422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:32.879893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:32.880334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:33.091440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:33.101358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10d0a240-5db0-4a24-83e0-49498494a98a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1680 microversion: 2.1 time: 0.236214 Oct 26 05:58:33.102161 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3610/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:32 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:34.128158 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:34.128865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:34.134964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:34.135455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:34.136246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:34.136598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:34.137063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:34.137521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:34.268452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:34.276197 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0576bbb1-5f7c-4039-b5c2-7cd0a88a68d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1677 microversion: 2.1 time: 0.153713 Oct 26 05:58:34.276770 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3597/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:34 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:34.300206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:34.300771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:34.307620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:34.308119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:34.308571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:34.309278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:34.309773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:34.310213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:34.370631 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8942e67-c8bd-4cdb-82f9-a978f86c3818 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564/action" status: 204 len: 0 microversion: 2.1 time: 0.075096 Oct 26 05:58:34.371330 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3611/7208] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:58:34 2022] POST /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:58:34.380230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:34.380942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:34.387005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:34.387626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:34.388041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:34.388963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:34.389429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:34.389867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:34.606199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:34.614702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb62a7af-7617-43b2-bf1a-e7a5fc895842 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1677 microversion: 2.1 time: 0.239047 Oct 26 05:58:34.615294 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3598/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:34 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:35.639111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:35.639840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:35.647643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:35.648103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:35.648585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:35.649301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:35.649807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:35.650263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:35.854266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:35.862491 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f208013-6b5c-470f-b339-ee6bc7f8cb23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1669 microversion: 2.1 time: 0.227686 Oct 26 05:58:35.863056 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3612/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:35 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1669 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:35.885471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:35.886095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:35.893087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:35.893604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:35.894048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:35.894740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:35.895200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:35.895627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.069336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:36.077173 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c4a79f0-5f18-4708-8278-0ff47d8464a0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1669 microversion: 2.1 time: 0.195878 Oct 26 05:58:36.077779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3599/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:35 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:36.100301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:36.100971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:36.107212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.107667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.108203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.108917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.109452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.109926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.240179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:36.248020 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6303a0e2-5b4a-4ddc-aefc-a974ab8b7e59 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1669 microversion: 2.1 time: 0.151644 Oct 26 05:58:36.248803 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3613/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:36 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:36.271831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:36.272339 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:36.278473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.278966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.279408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.280103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.280563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.280993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.305786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 05:58:36.356761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:36.384330 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6737e178-1fe5-417a-bc72-df92f335ffa0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 204 len: 0 microversion: 2.1 time: 0.115878 Oct 26 05:58:36.384807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3600/7213] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 05:58:36 2022] DELETE /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 05:58:36.392842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:36.393501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:36.399393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.399903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.400358 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.401088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.401599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.402044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.535451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:36.543167 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c15e66e-24b6-410a-9c74-87dbf9894abc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1675 microversion: 2.1 time: 0.154119 Oct 26 05:58:36.543740 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3614/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:36 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:36.864784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c0c0d58e-f753-4c24-a87e-8b7864aff7eb req-290c2403-63c2-45ec-bfdb-76c7c99e4367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "name": "network-vif-plugged", "status": "completed", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:36.876698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0c0d58e-f753-4c24-a87e-8b7864aff7eb req-290c2403-63c2-45ec-bfdb-76c7c99e4367 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:36.877548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0c0d58e-f753-4c24-a87e-8b7864aff7eb req-290c2403-63c2-45ec-bfdb-76c7c99e4367 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:36.877985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c0c0d58e-f753-4c24-a87e-8b7864aff7eb req-290c2403-63c2-45ec-bfdb-76c7c99e4367 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:36.889596 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c0c0d58e-f753-4c24-a87e-8b7864aff7eb req-290c2403-63c2-45ec-bfdb-76c7c99e4367 service nova] Creating event network-vif-plugged:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h1-862416-4 Oct 26 05:58:36.895289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c0c0d58e-f753-4c24-a87e-8b7864aff7eb req-290c2403-63c2-45ec-bfdb-76c7c99e4367 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035713 Oct 26 05:58:36.895889 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3601/7215] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:58:37.567950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:37.568580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:37.575099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:37.575597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:37.576050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:37.576751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:37.577220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:37.577685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:37.710924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:37.713242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:37.721524 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-858f489d-d3cb-444d-aa0e-7dd12d56b67f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1675 microversion: 2.1 time: 0.158328 Oct 26 05:58:37.722104 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3615/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:37 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:38.644355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0caca9af-27ea-49a9-b604-438d529db2bd req-ea3a4191-bfaa-4d73-8331-703307b87a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5c04bc-d0b6-42f6-b198-eb3b6e00f564", "name": "network-vif-deleted", "tag": "73e50d32-8d6b-432f-a0a6-434adb8ee048"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:38.655225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0caca9af-27ea-49a9-b604-438d529db2bd req-ea3a4191-bfaa-4d73-8331-703307b87a5f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:38.655934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0caca9af-27ea-49a9-b604-438d529db2bd req-ea3a4191-bfaa-4d73-8331-703307b87a5f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:38.656532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0caca9af-27ea-49a9-b604-438d529db2bd req-ea3a4191-bfaa-4d73-8331-703307b87a5f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:38.669028 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0caca9af-27ea-49a9-b604-438d529db2bd req-ea3a4191-bfaa-4d73-8331-703307b87a5f service nova] Creating event network-vif-deleted:73e50d32-8d6b-432f-a0a6-434adb8ee048 for instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 on n-h1-862416-4 Oct 26 05:58:38.674349 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0caca9af-27ea-49a9-b604-438d529db2bd req-ea3a4191-bfaa-4d73-8331-703307b87a5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034709 Oct 26 05:58:38.674964 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3602/7217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:58:38.746033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:38.746727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:38.755781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:38.756055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:38.756732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:38.757623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:38.758095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:38.758533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:38.792548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:38.793057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:38.793544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:38.794021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lazy-loading 'fault' on Instance uuid fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 05:58:38.839750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:38.850070 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5852c7e0-78df-42b5-a90b-aa147b683465 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 200 len: 1329 microversion: 2.1 time: 0.108242 Oct 26 05:58:38.850838 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3616/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:38 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:39.877770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:39.878379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:39.884510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:39.884995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:39.885462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:39.886145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:39.886607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:39.887028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:39.901103 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 HTTP/1.1 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'fd5c04bc-d0b6-42f6-b198-eb3b6e00f564'} Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:58:39.902867 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e27ff256-dd05-4759-b356-1887c746b89d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 404 len: 111 microversion: 2.1 time: 0.032681 Oct 26 05:58:39.907988 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3603/7219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:39 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:58:39.915783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:39.916415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:39.923334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:39.923834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:39.924289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:39.925001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:39.925502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:39.925948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:39.939867 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 HTTP/1.1 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'fd5c04bc-d0b6-42f6-b198-eb3b6e00f564'} Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 05:58:39.941582 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-403c7165-29a1-4cd3-ac75-aadf10cda96a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 404 len: 111 microversion: 2.1 time: 0.031175 Oct 26 05:58:39.946271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3617/7220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:39 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 05:58:39.991178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-716504837", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d9e9be08-5efa-4913-8ca2-449133e5622b"}], "security_groups": [{"name": "tempest-securitygroup--84271778"}], "key_name": "tempest-keypair-1169985004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:40.232689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] validate_networks() for [('d9e9be08-5efa-4913-8ca2-449133e5622b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 05:58:40.613082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 05:58:40.613552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 05:58:40.614030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 05:58:40.614438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 05:58:40.614878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 05:58:40.624138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:40.624622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:40.625058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:40.626538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:40.627004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:40.627427 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:40.644443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 05:58:40.649734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 05:58:40.662031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 05:58:40.664240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 05:58:40.711469 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cf91850a-db37-4dd0-83ba-b6dc4f00b38d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.724055 Oct 26 05:58:40.712120 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3604/7221] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 05:58:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 05:58:40.725042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f3438e52-a2f3-4e9f-857f-e5e09c3e7845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:40.725914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f3438e52-a2f3-4e9f-857f-e5e09c3e7845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:40.869188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f3438e52-a2f3-4e9f-857f-e5e09c3e7845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:40.876765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f3438e52-a2f3-4e9f-857f-e5e09c3e7845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1238 microversion: 2.1 time: 0.156817 Oct 26 05:58:40.877369 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3618/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:40 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1238 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:41.901009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:41.901633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:41.909297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:41.909811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:41.910254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:41.910957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:41.911417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:41.911846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:41.994288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:42.003030 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0e0ff270-80b3-48cc-812f-deb6776dbcd3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1296 microversion: 2.1 time: 0.106706 Oct 26 05:58:42.003614 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3605/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:41 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:43.028405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:43.029040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:43.037811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:43.038477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:43.039064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:43.039692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:43.040270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:43.040638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:43.193539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4e61b0cc-fd36-4668-8e37-2afcacff54d2 req-b6110c19-63fb-4ee5-a2af-7cf7d4e33872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:43.206615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4e61b0cc-fd36-4668-8e37-2afcacff54d2 req-b6110c19-63fb-4ee5-a2af-7cf7d4e33872 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:43.207719 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4e61b0cc-fd36-4668-8e37-2afcacff54d2 req-b6110c19-63fb-4ee5-a2af-7cf7d4e33872 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:43.208170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4e61b0cc-fd36-4668-8e37-2afcacff54d2 req-b6110c19-63fb-4ee5-a2af-7cf7d4e33872 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:43.222733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4e61b0cc-fd36-4668-8e37-2afcacff54d2 req-b6110c19-63fb-4ee5-a2af-7cf7d4e33872 service nova] Creating event network-changed:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h2-862416-4 Oct 26 05:58:43.227782 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4e61b0cc-fd36-4668-8e37-2afcacff54d2 req-b6110c19-63fb-4ee5-a2af-7cf7d4e33872 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040199 Oct 26 05:58:43.228556 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3606/7224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:58:43.275838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:43.285068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db0f36b5-934f-418a-9ec1-807f396d2d27 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.261021 Oct 26 05:58:43.286036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3619/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:43 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:44.310378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:44.311082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:44.317940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:44.318431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:44.318876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:44.319568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:44.320064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:44.320492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:44.457136 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:44.464794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d998ffea-64f0-411f-8788-e17b77bdb2ed tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.159598 Oct 26 05:58:44.465391 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3607/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:44 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:45.489396 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:45.490031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:45.492816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=45 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:45.498227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:45.498733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:45.499196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:45.499910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:45.501019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:45.501518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:45.685033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:45.693686 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa3c1582-1203-456f-99e9-8502711d0297 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.208801 Oct 26 05:58:45.694279 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3620/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:45 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:46.718713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:46.719330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:46.722264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:46.727896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:46.728392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:46.728868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:46.729596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:46.730063 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:46.730496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:46.861359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:46.868943 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9321ce3f-cd31-4c18-961e-719575ff0097 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.154238 Oct 26 05:58:46.869543 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3608/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:46 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:47.893907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:47.894531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:47.901425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:47.901938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:47.902391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:47.903128 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:47.903602 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:47.904047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:48.035870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:48.043565 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f24c7fee-6cd7-469c-908a-3e9d2db7efba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.154208 Oct 26 05:58:48.044133 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3621/7229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:47 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:49.067300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:49.067928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:49.074769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:49.075262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:49.075707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:49.076405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:49.076868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:49.077299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:49.209047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:49.216742 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a933b200-ea14-42fb-9893-4f2e55874abb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.153484 Oct 26 05:58:49.217336 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3609/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:49 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:50.241482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:50.242110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:50.249933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:50.250489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:50.250945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:50.251663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:50.252130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:50.252567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:50.355689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d5ee22de-06a8-402e-b91a-e23939984868 req-c96b4f05-f47d-41e9-a23a-606c6608be7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "name": "network-vif-plugged", "status": "completed", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:50.367825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d5ee22de-06a8-402e-b91a-e23939984868 req-c96b4f05-f47d-41e9-a23a-606c6608be7d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:50.369238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d5ee22de-06a8-402e-b91a-e23939984868 req-c96b4f05-f47d-41e9-a23a-606c6608be7d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:50.369728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d5ee22de-06a8-402e-b91a-e23939984868 req-c96b4f05-f47d-41e9-a23a-606c6608be7d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:50.383363 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d5ee22de-06a8-402e-b91a-e23939984868 req-c96b4f05-f47d-41e9-a23a-606c6608be7d service nova] Creating event network-vif-plugged:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h2-862416-4 Oct 26 05:58:50.390799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:50.396623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d5ee22de-06a8-402e-b91a-e23939984868 req-c96b4f05-f47d-41e9-a23a-606c6608be7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045133 Oct 26 05:58:50.397620 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3610/7231] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 05:58:50.413625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c860484b-9a04-480d-8fa9-25d6fd540015 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.175748 Oct 26 05:58:50.414541 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3622/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:50 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:51.438871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:51.439892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:51.442261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:51.443068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:51.451332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:51.452004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:51.452613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:51.453484 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:51.454501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:51.455223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:51.584397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:51.592347 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cd67dbd8-5e29-4ed3-9874-bd107471a68a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1362 microversion: 2.1 time: 0.157656 Oct 26 05:58:51.592927 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3611/7233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:51 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 05:58:52.616587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:52.617215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:52.619099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:58:52.625496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:52.626181 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:52.626690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:52.627400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:52.627875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:52.628316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:52.764457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:58:52.772844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c09fb8d1-9aec-4adb-9dd9-d877f981c517 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1549 microversion: 2.1 time: 0.160157 Oct 26 05:58:52.773457 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3623/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:58:52 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:58:52.796531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:58:52.797036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:58:52.804045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:52.804535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:52.804978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:52.805713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:52.806202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:52.806642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:52.884762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3200abbc-96ab-4aa2-9de4-1e77f6dbc8f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092051 Oct 26 05:58:52.885395 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3612/7235] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 05:58:52 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:58:54.221060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-11865d75-7ea4-4227-9a4a-0cee850ff1c7 req-7a2186bf-481b-49c7-858a-23c909321524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:58:54.230862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-11865d75-7ea4-4227-9a4a-0cee850ff1c7 req-7a2186bf-481b-49c7-858a-23c909321524 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:58:54.231362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-11865d75-7ea4-4227-9a4a-0cee850ff1c7 req-7a2186bf-481b-49c7-858a-23c909321524 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:58:54.231815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-11865d75-7ea4-4227-9a4a-0cee850ff1c7 req-7a2186bf-481b-49c7-858a-23c909321524 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:58:54.243636 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-11865d75-7ea4-4227-9a4a-0cee850ff1c7 req-7a2186bf-481b-49c7-858a-23c909321524 service nova] Creating event network-changed:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h2-862416-4 Oct 26 05:58:54.249473 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-11865d75-7ea4-4227-9a4a-0cee850ff1c7 req-7a2186bf-481b-49c7-858a-23c909321524 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084198 Oct 26 05:58:54.250088 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3624/7236] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 05:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 05:59:57.908116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=9 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:59:57.909038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=46 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:59:57.914685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5619b6aa-3bba-44e4-947e-24d652ab9e79 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 05:59:57.921664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5619b6aa-3bba-44e4-947e-24d652ab9e79 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:59:57.922289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5619b6aa-3bba-44e4-947e-24d652ab9e79 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:59:57.922730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5619b6aa-3bba-44e4-947e-24d652ab9e79 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:59:57.952641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5619b6aa-3bba-44e4-947e-24d652ab9e79 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Going to try to stop instance {{(pid=120586) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 05:59:57.996285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5619b6aa-3bba-44e4-947e-24d652ab9e79 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action" status: 202 len: 0 microversion: 2.1 time: 0.090490 Oct 26 05:59:57.996958 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3613/7237] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 05:59:57 2022] POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 05:59:58.004465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=9 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:59:58.005224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=43 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 05:59:58.007134 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 05:59:58.007297 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 05:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 (ip 10.222.0.16) !!! Oct 26 05:59:58.014386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:59:58.015121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:59:58.029565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:59:58.030071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:59:58.030524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:59:58.031240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:59:58.031713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:59:58.032158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:59:58.177101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:59:58.185239 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db779315-905f-48a9-8e49-a888aef888c6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.182906 Oct 26 05:59:58.185847 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3625/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:59:58 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 05:59:59.211031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 05:59:59.211734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 05:59:59.220724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:59:59.221306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:59:59.221773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:59:59.222473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 05:59:59.222937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 05:59:59.223368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 05:59:59.353000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 05:59:59.361411 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d31032c3-ef2e-4da6-b330-82a9ea832565 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.155114 Oct 26 05:59:59.361993 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3614/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 05:59:59 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:00.387077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:00.387711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:00.395768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:00.396276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:00.396741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:00.397490 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:00.398283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:00.398402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:00.529205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:00.537878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a37f4dec-b9c9-40a4-97e4-88cae10682c2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.154832 Oct 26 06:00:00.538451 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3626/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:00 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:01.561233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:01.561887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:01.568927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:01.569453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:01.569899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:01.570597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:01.571141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:01.571572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:01.703848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:01.712227 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8a9c9f1d-39bd-4321-ac9b-85212555fec3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.154920 Oct 26 06:00:01.712805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3615/7241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:01 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:02.736585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:02.737246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:02.744170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:02.744673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:02.745127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:02.745862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:02.746340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:02.746784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:02.876190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:02.884596 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c33e507-d99a-4836-9f4d-8ad06bd6a715 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.152617 Oct 26 06:00:02.885169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3627/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:02 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:03.908569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:03.909217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:03.916017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:03.916519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:03.916970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:03.917698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:03.918161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:03.918599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:04.055167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:04.063054 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-45ceb596-d379-44e2-9bf3-220397f1d0f6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.159015 Oct 26 06:00:04.063648 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3616/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:03 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:05.087068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:05.087700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:05.094537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:05.095126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:05.096208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:05.096963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:05.097481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:05.097937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:05.227296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:05.234992 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4c32816b-d7ee-405d-b1f5-6b49c3bcc3e4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.151927 Oct 26 06:00:05.235562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3628/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:05 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:06.259499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:06.260109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:06.266658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:06.268095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:06.268545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:06.269240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:06.269793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:06.270229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:06.401668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:06.410245 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-71574dec-7e82-4c90-b7fd-fadef560d843 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.154716 Oct 26 06:00:06.410832 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3617/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:06 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:07.434454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:07.435081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:07.441831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:07.442342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:07.442796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:07.443511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:07.443985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:07.444670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:07.575383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:07.583320 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e80fd244-e1c0-4d82-9692-f670709f5c6e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.152957 Oct 26 06:00:07.583898 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3629/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:07 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:08.607385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:08.607996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:08.615270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:08.615756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:08.616198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:08.616892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:08.617373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:08.617806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:08.746841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:08.755580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2ef24fda-1981-42fd-bb5b-d5e5e4649c76 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1655 microversion: 2.1 time: 0.152103 Oct 26 06:00:08.756164 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3618/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:08 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:08.780690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:08.783083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:08.790142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:08.790652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:08.791130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:08.791875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:08.792346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:08.792798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:08.823357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:08.828820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Old instance type m1.heat2, new instance type m1.heat {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 06:00:08.836129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:00:08.836566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:00:08.837053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:00:08.837501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:00:08.837927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:00:08.901266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd362900-35ce-40d8-87e6-709100d159b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action" status: 202 len: 0 microversion: 2.1 time: 0.125394 Oct 26 06:00:08.901909 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3630/7248] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:00:08 2022] POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:00:08.911048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:08.911757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:08.917797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:08.918311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:08.918733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:08.919424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:08.919879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:08.920305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:09.092600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:09.101191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa9f7a34-c704-48e8-9467-0ae90ccaa9d0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.194906 Oct 26 06:00:09.101955 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3619/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:08 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:10.128064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:10.128689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:10.135558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:10.136058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:10.136505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:10.137203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:10.137696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:10.138140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:10.271646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:10.279412 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-70db1cab-b180-4997-904e-fa37faa168c5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1678 microversion: 2.1 time: 0.156959 Oct 26 06:00:10.279987 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3631/7250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:10 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:11.303110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:11.303770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:11.311242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:11.311732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:11.312182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:11.312882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:11.313379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:11.314460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:11.444886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:11.452674 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39f44a0c-59f0-44fb-b6cd-fb28d4685845 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1683 microversion: 2.1 time: 0.153545 Oct 26 06:00:11.453240 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3620/7251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:11 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:12.477285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:12.477996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:12.484704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:12.485200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:12.486732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:12.487442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:12.487914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:12.488359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:12.616938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:12.624701 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-156f610c-d9bf-4627-bfaa-8a53ed2fba35 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1683 microversion: 2.1 time: 0.151322 Oct 26 06:00:12.625271 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3632/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:12 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:00:13.649038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:13.649701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:13.657209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:13.657964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:13.658520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:13.659433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:13.659907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:13.660381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:13.695680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "name": "network-vif-unplugged", "status": "completed", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:13.707228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:13.707813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:13.708885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:13.721907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] Creating event network-vif-unplugged:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h1-862416-4 Oct 26 06:00:13.728176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] Instance dde18585-7114-473e-ae5d-218cc6ca1e97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:00:13.742275 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-943a803b-7cbc-4576-8bcf-fb015880fd3a req-4e831884-2bec-4104-8e60-09eddbcccc3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126468 Oct 26 06:00:13.743031 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3621/7253] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:00:13.804088 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:13.811819 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a823cd13-d52a-4ea0-b77a-0492b34d7fe6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1682 microversion: 2.1 time: 0.166644 Oct 26 06:00:13.812559 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3633/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:13 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:14.838744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:14.839445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:14.846633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:14.847159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:14.847599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:14.848320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:14.848779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:14.849202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:14.990757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:14.998612 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f870d2ed-92f2-4dcb-96f8-91f0e9e804bd tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1682 microversion: 2.1 time: 0.164946 Oct 26 06:00:14.999609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3622/7255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:14 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:15.843365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:15.853660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:15.854161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:15.854617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:15.866771 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] Creating event network-changed:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h1-862416-4 Oct 26 06:00:15.872302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] Instance dde18585-7114-473e-ae5d-218cc6ca1e97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:00:15.883581 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-19c23a5c-90da-464f-b0b3-92a261ceef77 req-655b9e93-cdce-4bdb-81fc-4607c51d74ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093417 Oct 26 06:00:15.884199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3634/7256] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:00:16.022649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:16.023222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:16.029928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:16.030418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:16.030862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:16.031556 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:16.032017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:16.033071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:16.281538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:16.293353 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-11830d46-ff90-45f9-8d80-40e54476f2c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1680 microversion: 2.1 time: 0.274310 Oct 26 06:00:16.293951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3623/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:16 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:17.320413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:17.321304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:17.328126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:17.328637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:17.329089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:17.330191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:17.330807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:17.331628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:17.484459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:17.492383 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ad6e0de9-7a7f-46c6-805b-1e59eb4d640d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1676 microversion: 2.1 time: 0.177791 Oct 26 06:00:17.492978 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3635/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:17 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:17.517318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:17.518135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:17.525273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:17.525802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:17.526276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:17.526986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:17.527450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:17.527886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:17.587434 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-16eec9e1-49df-491f-b229-36e885819310 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action" status: 204 len: 0 microversion: 2.1 time: 0.074458 Oct 26 06:00:17.588076 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3624/7259] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:00:17 2022] POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:00:17.596454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:17.597399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:17.603619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:17.604121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:17.604612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:17.605530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:17.606044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:17.606639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:17.819661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:17.828907 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee10b40c-85b1-4c48-9583-6d6f57a88171 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1676 microversion: 2.1 time: 0.236376 Oct 26 06:00:17.837803 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3636/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:17 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:18.856390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:18.857109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:18.866004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:18.866503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:18.867142 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:18.867849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:18.868318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:18.868754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.003244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:19.011081 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bd1e5df0-453a-4fdb-8651-ab8a6e8ee324 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1655 microversion: 2.1 time: 0.160929 Oct 26 06:00:19.011648 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3625/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:18 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:19.034734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:19.035312 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:19.042363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:19.042871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:19.043334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.044051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:19.044531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:19.044983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.176828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:19.184830 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a96e0905-282b-48ec-bba1-af0d0fd2af2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1655 microversion: 2.1 time: 0.154597 Oct 26 06:00:19.185464 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3637/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:19 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:19.208425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-21d3a777-2c21-4dd8-8b5d-128574d6fa90 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:19.214492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21d3a777-2c21-4dd8-8b5d-128574d6fa90 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:19.214991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21d3a777-2c21-4dd8-8b5d-128574d6fa90 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:19.215431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21d3a777-2c21-4dd8-8b5d-128574d6fa90 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.239355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-21d3a777-2c21-4dd8-8b5d-128574d6fa90 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Going to try to start instance {{(pid=120586) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 06:00:19.273973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:19.284845 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-21d3a777-2c21-4dd8-8b5d-128574d6fa90 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action" status: 202 len: 0 microversion: 2.1 time: 0.081074 Oct 26 06:00:19.288382 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3626/7263] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:00:19 2022] POST /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:00:19.294830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:19.295483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:19.301796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:19.302304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:19.303060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.304246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:19.304983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:19.305557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.504394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-faf6d6a0-7db9-4f8b-86fc-b40fc57cdf65 req-b3026c7f-befe-4545-a7f0-0c57055c37f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "name": "network-vif-plugged", "status": "completed", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:19.514973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-faf6d6a0-7db9-4f8b-86fc-b40fc57cdf65 req-b3026c7f-befe-4545-a7f0-0c57055c37f1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:19.515585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-faf6d6a0-7db9-4f8b-86fc-b40fc57cdf65 req-b3026c7f-befe-4545-a7f0-0c57055c37f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:19.516792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-faf6d6a0-7db9-4f8b-86fc-b40fc57cdf65 req-b3026c7f-befe-4545-a7f0-0c57055c37f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:19.530879 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-faf6d6a0-7db9-4f8b-86fc-b40fc57cdf65 req-b3026c7f-befe-4545-a7f0-0c57055c37f1 service nova] Creating event network-vif-plugged:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h1-862416-4 Oct 26 06:00:19.537090 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-faf6d6a0-7db9-4f8b-86fc-b40fc57cdf65 req-b3026c7f-befe-4545-a7f0-0c57055c37f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107835 Oct 26 06:00:19.537764 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3627/7264] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:00:19.787157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:19.794908 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5cc66da2-a48c-42a8-87cc-c18dba1f3acc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1664 microversion: 2.1 time: 0.505219 Oct 26 06:00:19.795726 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3638/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:19 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1664 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:20.820289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:20.820992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:20.828289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:20.829125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:20.829594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:20.830340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:20.830736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:20.831401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:20.960654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:20.968442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8623bef9-367e-45fc-9a80-3d191bf02864 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1668 microversion: 2.1 time: 0.152802 Oct 26 06:00:20.969019 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3628/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:20 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:20.991660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:20.992224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:20.999196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:20.999698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:21.000157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:21.000869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:21.001368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:21.001817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:21.028337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:00:21.054170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:21.104800 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58c7ce19-185b-4d6a-b390-0a4cf051f8a1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 204 len: 0 microversion: 2.1 time: 0.116363 Oct 26 06:00:21.105681 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3639/7267] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:00:20 2022] DELETE /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:00:21.116044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:21.116651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:21.122541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:21.123022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:21.123457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:21.124141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:21.124598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:21.125022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:21.262117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:21.269791 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-64ca65f8-7d6f-47fc-9c04-71411ac2a8da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1674 microversion: 2.1 time: 0.159039 Oct 26 06:00:21.270356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3629/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:21 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:22.293681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:22.294471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:22.301891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:22.302392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:22.302846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:22.303550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:22.304020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:22.304466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:22.435441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:22.444187 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92af42a1-f293-495e-8b14-2e48ebb1aa5d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1674 microversion: 2.1 time: 0.154749 Oct 26 06:00:22.445054 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3640/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:22 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:23.380538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4dcc6a6c-c762-4572-845e-31ba7d53acff req-da286296-2581-47bb-916f-93364b81acfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde18585-7114-473e-ae5d-218cc6ca1e97", "name": "network-vif-deleted", "tag": "1083a4e0-dd7e-403c-b463-fed57a87e586"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:23.392383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4dcc6a6c-c762-4572-845e-31ba7d53acff req-da286296-2581-47bb-916f-93364b81acfb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:23.393715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4dcc6a6c-c762-4572-845e-31ba7d53acff req-da286296-2581-47bb-916f-93364b81acfb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:23.394378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4dcc6a6c-c762-4572-845e-31ba7d53acff req-da286296-2581-47bb-916f-93364b81acfb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:23.406307 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4dcc6a6c-c762-4572-845e-31ba7d53acff req-da286296-2581-47bb-916f-93364b81acfb service nova] Creating event network-vif-deleted:1083a4e0-dd7e-403c-b463-fed57a87e586 for instance dde18585-7114-473e-ae5d-218cc6ca1e97 on n-h1-862416-4 Oct 26 06:00:23.411886 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4dcc6a6c-c762-4572-845e-31ba7d53acff req-da286296-2581-47bb-916f-93364b81acfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035649 Oct 26 06:00:23.413377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3630/7270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:00:23.469571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:23.470336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:23.479036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:23.479555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:23.480760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:23.481526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:23.482800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:23.483580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:23.517233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:23.519314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:23.519882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:23.520429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lazy-loading 'fault' on Instance uuid dde18585-7114-473e-ae5d-218cc6ca1e97 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:00:23.574006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:23.585103 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c22b4721-e265-4fc3-8465-3dc7fbc31b94 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 200 len: 1328 microversion: 2.1 time: 0.120293 Oct 26 06:00:23.585725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3641/7271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:23 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:24.610346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:24.611052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:24.617806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:24.618345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:24.618732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:24.619421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:24.619877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:24.620305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:24.634324 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 HTTP/1.1 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'dde18585-7114-473e-ae5d-218cc6ca1e97'} Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:00:24.635928 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2dfbafa5-fb4a-4ec0-8f64-966a89d7c6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 404 len: 111 microversion: 2.1 time: 0.032114 Oct 26 06:00:24.640624 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3631/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:24 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:00:24.653802 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:24.654459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:24.661723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:24.662229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:24.662681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:24.663408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:24.663872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:24.664311 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:24.680577 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 HTTP/1.1 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'dde18585-7114-473e-ae5d-218cc6ca1e97'} Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:00:24.682263 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f7ff311c-4f1b-4510-949b-8a23c7d822b7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 404 len: 111 microversion: 2.1 time: 0.033830 Oct 26 06:00:24.686590 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3642/7273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:24 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:00:24.732376 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-177567431", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d9e9be08-5efa-4913-8ca2-449133e5622b"}], "security_groups": [{"name": "tempest-securitygroup--84271778"}], "key_name": "tempest-keypair-1169985004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:24.841442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] validate_networks() for [('d9e9be08-5efa-4913-8ca2-449133e5622b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:00:25.289436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:00:25.289864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:00:25.290362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:00:25.290770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:00:25.291182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:00:25.302690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:25.303162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:25.303602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:25.304328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:25.304787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:25.305212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:25.325171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:00:25.331327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:00:25.343741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:00:25.346955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:00:25.394089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-97387afd-f814-43b6-8a67-0b9537330e25 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.665550 Oct 26 06:00:25.394762 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3632/7274] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:00:24 2022] POST /compute/v2.1/servers => generated 404 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:00:25.406250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-41f46f14-65d1-4b38-af8c-b2ef8c48b55a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:25.406890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-41f46f14-65d1-4b38-af8c-b2ef8c48b55a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:25.462869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-41f46f14-65d1-4b38-af8c-b2ef8c48b55a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:25.472107 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-41f46f14-65d1-4b38-af8c-b2ef8c48b55a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1238 microversion: 2.1 time: 0.069715 Oct 26 06:00:25.473344 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3643/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:25 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:26.496904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:26.497538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:26.504830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:26.505350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:26.505796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:26.506503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:26.506976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:26.507410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:26.569944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:26.577871 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93b99f44-3082-42ae-b16c-42ab832604e5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1290 microversion: 2.1 time: 0.085904 Oct 26 06:00:26.578450 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3633/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:26 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:27.603050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:27.603686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:27.613355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:27.613969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:27.614701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:27.615825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:27.616306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:27.617031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:27.837568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:27.845533 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-133984b9-94e0-4c9d-9cc5-7a6a8268e14b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.246392 Oct 26 06:00:27.856798 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3644/7277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:27 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:00:28.384406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-79f6768e-51ba-4bca-a855-53ed165c43c6 req-18d59da0-aeb7-43d6-bcc2-318179bed9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:28.393111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:28.401486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-79f6768e-51ba-4bca-a855-53ed165c43c6 req-18d59da0-aeb7-43d6-bcc2-318179bed9b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:28.401987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-79f6768e-51ba-4bca-a855-53ed165c43c6 req-18d59da0-aeb7-43d6-bcc2-318179bed9b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:28.402430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-79f6768e-51ba-4bca-a855-53ed165c43c6 req-18d59da0-aeb7-43d6-bcc2-318179bed9b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:28.416280 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-79f6768e-51ba-4bca-a855-53ed165c43c6 req-18d59da0-aeb7-43d6-bcc2-318179bed9b6 service nova] Creating event network-changed:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h2-862416-4 Oct 26 06:00:28.421819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-79f6768e-51ba-4bca-a855-53ed165c43c6 req-18d59da0-aeb7-43d6-bcc2-318179bed9b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040990 Oct 26 06:00:28.422446 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3634/7278] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:00:28.871820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:28.872376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:28.875209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:28.881788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:28.882293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:28.882784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:28.883505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:28.883975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:28.884419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:29.018075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:29.025777 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4ab6123e-059f-48ef-9721-8a340094aeab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.158304 Oct 26 06:00:29.026350 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3645/7279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:28 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:30.050340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:30.051053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:30.058230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:30.058723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:30.059168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:30.059865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:30.060530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:30.060966 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:30.202085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:30.213371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80dc01d4-a79b-4f6e-b779-cc95ae6adc4a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.167475 Oct 26 06:00:30.213965 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3635/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:30 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:31.238148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:31.238770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:31.246710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:31.247968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:31.248538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:31.249481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:31.249965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:31.250438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:31.383015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:31.390706 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94279f97-46d1-471b-9c36-03f17918397c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.157210 Oct 26 06:00:31.391273 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3646/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:31 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:32.415268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:32.415902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:32.423096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:32.423580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:32.424887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:32.425527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:32.425991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:32.426416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:32.563505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:32.572385 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b135f463-ed3a-454f-a625-bc41f37031ee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.161035 Oct 26 06:00:32.572991 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3636/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:32 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:33.596989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:33.597637 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:33.604405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:33.604900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:33.605383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:33.606090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:33.606558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:33.607002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:33.737949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:33.745698 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8ff68879-6a19-4fba-a67c-f624a755c25b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.153602 Oct 26 06:00:33.746270 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3647/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:33 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:00:34.705948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-210bd0b1-83eb-4c2c-b680-0da9a707c756 req-337b0bb6-7c32-487c-a658-284aa486f819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "name": "network-vif-plugged", "status": "completed", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:34.717306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-210bd0b1-83eb-4c2c-b680-0da9a707c756 req-337b0bb6-7c32-487c-a658-284aa486f819 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:34.718792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-210bd0b1-83eb-4c2c-b680-0da9a707c756 req-337b0bb6-7c32-487c-a658-284aa486f819 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:34.719245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-210bd0b1-83eb-4c2c-b680-0da9a707c756 req-337b0bb6-7c32-487c-a658-284aa486f819 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:34.731633 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-210bd0b1-83eb-4c2c-b680-0da9a707c756 req-337b0bb6-7c32-487c-a658-284aa486f819 service nova] Creating event network-vif-plugged:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h2-862416-4 Oct 26 06:00:34.737610 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-210bd0b1-83eb-4c2c-b680-0da9a707c756 req-337b0bb6-7c32-487c-a658-284aa486f819 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034680 Oct 26 06:00:34.738857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3637/7284] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:00:34.770841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:34.771953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:34.779304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:34.779868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:34.780653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:34.781423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:34.781902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:34.782524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:34.964848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:34.973200 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92b0349c-9f90-4395-8d78-646076c647ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.208718 Oct 26 06:00:34.973820 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3648/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:34 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:35.997788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:35.999062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:36.001243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:36.002083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:36.010073 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:36.010573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:36.011018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:36.011763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:36.012238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:36.012680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:36.153977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:36.164930 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80149470-70c9-477e-9186-1e95235c9baf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1362 microversion: 2.1 time: 0.170933 Oct 26 06:00:36.166317 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3638/7286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:35 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:37.191380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:37.192007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:37.194087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:00:37.199738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:37.200243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:37.200702 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:37.201446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:37.201924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:37.202372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:37.337988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:00:37.346272 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4e9379a-bd3a-4ef1-9ef6-9836b946d7ab tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1549 microversion: 2.1 time: 0.158910 Oct 26 06:00:37.346876 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3649/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:00:37 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:00:37.369806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:00:37.370323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:00:37.378983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:37.379476 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:37.379923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:37.380619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:37.381082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:37.381542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:37.459690 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5be05151-49d5-423f-875d-711022da0930 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093704 Oct 26 06:00:37.460305 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3639/7288] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 06:00:37 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:00:38.386154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b87d9d3a-fef2-49d9-8e99-7ceb07f81397 req-e124daa3-8ba0-49bf-a5fe-dd2804ad4397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:00:38.397305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b87d9d3a-fef2-49d9-8e99-7ceb07f81397 req-e124daa3-8ba0-49bf-a5fe-dd2804ad4397 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:00:38.397830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b87d9d3a-fef2-49d9-8e99-7ceb07f81397 req-e124daa3-8ba0-49bf-a5fe-dd2804ad4397 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:00:38.398281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b87d9d3a-fef2-49d9-8e99-7ceb07f81397 req-e124daa3-8ba0-49bf-a5fe-dd2804ad4397 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:00:38.409299 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b87d9d3a-fef2-49d9-8e99-7ceb07f81397 req-e124daa3-8ba0-49bf-a5fe-dd2804ad4397 service nova] Creating event network-changed:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h2-862416-4 Oct 26 06:00:38.414441 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b87d9d3a-fef2-49d9-8e99-7ceb07f81397 req-e124daa3-8ba0-49bf-a5fe-dd2804ad4397 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031970 Oct 26 06:00:38.415011 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3650/7289] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:01:50.396751 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=11 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:01:50.397535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=52 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:01:50.402395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:01:50.405713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:50.416692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:50.417187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:50.417666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:50.418388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:50.418850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:50.419284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:50.448947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:50.454530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Old instance type m1.heat2, new instance type m1.heat {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 06:01:50.461291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:01:50.461748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:01:50.462228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:01:50.462645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:01:50.463065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:01:50.525061 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-561f78dc-d93f-4752-83a7-cec7a990927f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888/action" status: 202 len: 0 microversion: 2.1 time: 0.131243 Oct 26 06:01:50.525733 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3640/7290] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:01:50 2022] POST /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:01:50.533047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=11 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:01:50.533913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:01:50.540036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:50.540857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:50.552769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:50.553454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:50.554052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:50.555005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:50.555474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:50.555921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:50.731225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:50.739945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a193cae0-2b34-4c67-a017-44a1579d0a84 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1677 microversion: 2.1 time: 0.209652 Oct 26 06:01:50.740585 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3651/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:50 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:51.761179 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:01:51.761739 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:01:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 (ip 10.222.0.16) !!! Oct 26 06:01:51.766233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:51.766858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:51.775550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:51.776048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:51.776497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:51.777203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:51.777696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:51.778143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:51.950856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:51.959038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-832208e6-94cb-49ac-99b6-d7ad60b43838 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1677 microversion: 2.1 time: 0.199198 Oct 26 06:01:51.959619 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3641/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:51 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:52.983942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:52.984569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:52.994416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:52.994919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:52.995374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:52.996082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:52.996552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:52.996997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:53.126337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:53.134346 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49456cbd-f091-4f3d-b54c-15e068b3ec97 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.154322 Oct 26 06:01:53.134928 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3652/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:52 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:54.158318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:54.159451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:54.166222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:54.166715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:54.167163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:54.167860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:54.168319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:54.168748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:54.302674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:54.310391 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8f2daf1f-c6e4-49a5-8199-7e9678d7d31e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.156112 Oct 26 06:01:54.310965 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3642/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:54 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:55.397903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:55.398623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:55.407025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:55.407541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:55.407988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:55.408698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:55.409628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:55.410077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:55.546143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:55.554389 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-14c516fa-a13d-4ab7-aec4-d52e8bd96a07 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.224009 Oct 26 06:01:55.554969 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3653/7295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:55 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:56.578870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:56.579521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:56.586545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:56.587036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:56.587480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:56.588179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:56.588640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:56.589098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:56.723692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:56.731337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-304c439e-8d9d-4776-bd75-86c5604ba46f tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.156336 Oct 26 06:01:56.731917 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3643/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:56 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:57.756078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:57.756954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:57.763354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:57.763849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:57.764298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:57.765404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:57.765877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:57.766316 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:57.900846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:57.908752 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b98287d-3f9b-47fc-b694-7fc857831c9b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.157773 Oct 26 06:01:57.909354 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3654/7297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:57 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:01:58.934098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:01:58.934713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:01:58.941727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:58.942218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:58.942659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:58.943350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:01:58.943811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:01:58.944246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:01:59.076859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:01:59.086537 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-296019c0-1ba9-4afc-91b9-0aedff86e844 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.156196 Oct 26 06:01:59.087259 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3644/7298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:01:58 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:00.111429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:00.112109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:00.121116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:00.121673 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:00.122376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:00.123142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:00.123629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:00.124083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:00.259504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:00.267228 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e07a45ec-451b-47ae-817f-bb39a220032e tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.159781 Oct 26 06:02:00.267818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3655/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:00 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:01.290570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:01.291190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:01.298058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:01.298546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:01.298988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:01.300257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:01.300801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:01.301235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:01.433277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:01.441505 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-07080d9c-fe64-4a16-a8ae-c1042f547d52 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.154798 Oct 26 06:02:01.442094 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3645/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:01 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:02.465693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:02.466327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:02.474193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:02.474691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:02.475146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:02.475850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:02.476321 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:02.476764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:02.611818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:02.620177 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2fcfb7c4-d0de-40c2-9d3a-f0f29d35d442 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.158507 Oct 26 06:02:02.620768 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3656/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:02 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:03.644186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:03.644769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:03.651440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:03.651925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:03.652367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:03.653056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:03.653546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:03.653974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:03.783687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:03.792099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-60a511d3-173d-4405-bc10-95debb5b04b2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.152024 Oct 26 06:02:03.792679 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3646/7302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:03 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:04.816632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:04.817259 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:04.824481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:04.824988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:04.825487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:04.826209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:04.826689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:04.827139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:04.955363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:04.963620 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-11e31067-2399-4661-8c3c-8db28fcbd37c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.151520 Oct 26 06:02:04.964197 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3657/7303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:04 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:05.987047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:05.988321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:05.994914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:05.995407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:05.995860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:05.996559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:05.997021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:05.997487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:06.130731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:06.138444 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b55ffcd-e80a-4522-beb9-29d28a17bbad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.155363 Oct 26 06:02:06.139027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3647/7304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:05 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:02:07.163076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:07.163703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:07.170196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:07.170696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:07.171150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:07.171856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:07.172328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:07.172772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:07.305854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:07.313976 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4af04444-c245-4995-b4a8-1afbf6e2b2a8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.155203 Oct 26 06:02:07.314594 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3658/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:07 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:08.338731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:08.339334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:08.345892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:08.346378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:08.347268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:08.347976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:08.348438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:08.348867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:08.486451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:08.494837 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8912a837-a8c9-4b86-813a-46ab4f342d16 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1682 microversion: 2.1 time: 0.160136 Oct 26 06:02:08.495424 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3648/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:08 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:09.520992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:09.522023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:09.528808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:09.529342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:09.530481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:09.531267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:09.531766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:09.532226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:09.668119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:09.676367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d35b867f-6d9c-4a87-bd11-d0c71c9ed359 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1681 microversion: 2.1 time: 0.160490 Oct 26 06:02:09.677162 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3659/7307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:09 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:09.975855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "name": "network-vif-unplugged", "status": "completed", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:09.985973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:09.986492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:09.987058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:10.000509 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] Creating event network-vif-unplugged:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h1-862416-4 Oct 26 06:02:10.007541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:02:10.018746 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8945d883-9064-4752-b2e2-a7c867e5dd16 req-2482c493-36e9-43c3-8f23-078beb19e024 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046982 Oct 26 06:02:10.019357 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3649/7308] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:02:10.700398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:10.701047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:10.709367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:10.709869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:10.710476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:10.711026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:10.711493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:10.711932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:10.849384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:10.857154 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-41f6f0b3-47d9-4cc0-bad2-fc3d6e646067 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1681 microversion: 2.1 time: 0.160640 Oct 26 06:02:10.857848 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3660/7309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:10 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:11.883595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:11.884305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:11.890511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:11.891004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:11.891449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:11.892145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:11.892610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:11.893051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:12.027858 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:12.035651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:12.036756 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a2b1e9f-5f4a-48c0-974a-ad78c8581a75 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1679 microversion: 2.1 time: 0.158626 Oct 26 06:02:12.049333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3650/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:11 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:12.049520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:12.049520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:12.049520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:12.059365 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] Creating event network-changed:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h1-862416-4 Oct 26 06:02:12.064644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:02:12.075753 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2986784a-34a3-44a0-b0b6-ad09183ee6b4 req-a43f6859-33bb-4724-81c3-adfc0c7ffd88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044880 Oct 26 06:02:12.076329 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3661/7311] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:02:13.062014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:13.062755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:13.069669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.070170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.070618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.071337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.071819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.072246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.207648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:13.215872 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0a6c64a-fccf-4e76-b515-028a18768281 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1676 microversion: 2.1 time: 0.157791 Oct 26 06:02:13.216470 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3651/7312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:13 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:13.241347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:13.241991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:13.248138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.248641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.249102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.249839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.250319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.250791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.291406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.291829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.292284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.293030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.293534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.293978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.317117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:02:13.322360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:02:13.420986 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1de667ce-83c7-46bb-88ea-5fe0f0f4bcd7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888/action" status: 202 len: 0 microversion: 2.1 time: 0.184807 Oct 26 06:02:13.421654 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3662/7313] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:02:13 2022] POST /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:02:13.430438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:13.431056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:13.445927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.447299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.447747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.448633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:13.449099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:13.449581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:13.584240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:13.594246 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cedea3c7-48a7-4123-8af0-e8dbff86e915 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1675 microversion: 2.1 time: 0.167584 Oct 26 06:02:13.594982 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3652/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:13 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:02:14.620752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:14.621580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:14.627906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:14.628924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:14.629484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:14.630203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:14.630682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:14.631132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:14.763535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:14.772083 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a1df9c79-e157-4e41-88f0-d5ce93f359b3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1675 microversion: 2.1 time: 0.156601 Oct 26 06:02:14.772661 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3663/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:14 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:15.796456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:15.797079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:15.804043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:15.804540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:15.804988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:15.805726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:15.806192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:15.806625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:15.947208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:15.955331 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5a66589a-67ea-40a0-ac67-4d7abfa31417 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1675 microversion: 2.1 time: 0.162813 Oct 26 06:02:15.956026 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3653/7316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:15 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:16.979632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:16.980255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:16.987992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:16.988590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:16.989054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:16.989808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:16.990286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:16.990739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:17.160212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:17.170659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:17.171152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:17.171598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:17.184165 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] Creating event network-changed:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h2-862416-4 Oct 26 06:02:17.189589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:02:17.201100 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8f9532ec-8ec3-4148-8908-dca0150bdf4f req-a51ffe42-f262-49a2-9577-7387dc9b8dee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044901 Oct 26 06:02:17.201940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3654/7317] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:02:17.246497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:17.250188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:02:17.257234 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-edf79df9-71d4-4179-aae8-75498f6f1df6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1675 microversion: 2.1 time: 0.281799 Oct 26 06:02:17.257860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3664/7318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:16 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1675 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:18.283127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:18.283752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:18.290768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:18.291262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:18.291704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:18.292398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:18.292861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:18.293292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:18.427475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:18.431080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:02:18.436544 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-80e99825-4fdd-47fc-b5c3-f9a9b36f7279 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1675 microversion: 2.1 time: 0.158582 Oct 26 06:02:18.437139 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3655/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:18 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:19.465945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:19.466626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:19.475286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:19.475781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:19.476233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:19.476932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:19.477420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:19.477860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:19.608150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:19.617474 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6fcb94d8-5cfb-4818-bddf-7d72cb2f4b6b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1675 microversion: 2.1 time: 0.155748 Oct 26 06:02:19.618052 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3665/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:19 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:20.642848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:20.644687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:20.647449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=37 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:02:20.653548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:20.653989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:20.654414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:20.655114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:20.655580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:20.656005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:20.863981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:20.871614 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9c004525-69fb-42c1-a960-e54ac54c90fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1668 microversion: 2.1 time: 0.233321 Oct 26 06:02:20.872209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3656/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:20 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:20.895483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:20.896154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:20.899372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:02:20.905450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:20.905914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:20.906363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:20.907201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:20.907680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:20.908135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.038472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:21.046235 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93f9e66e-fee3-45b2-8e59-0619dae91c2d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1668 microversion: 2.1 time: 0.154921 Oct 26 06:02:21.046809 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3666/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:20 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:21.069647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:21.070272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:21.076133 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:21.076624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:21.077064 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.077786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:21.078258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:21.078690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.217495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:21.225842 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a8eb6300-1bfc-4d98-b13c-f59a26342766 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1668 microversion: 2.1 time: 0.160605 Oct 26 06:02:21.226427 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3657/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:21 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:21.251726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:21.252256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:21.258491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:21.259081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:21.259539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.260252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:21.260903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:21.261336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.288473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:02:21.368539 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7b26c8c8-f536-4c73-9363-8f54f7d831ba tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 204 len: 0 microversion: 2.1 time: 0.122950 Oct 26 06:02:21.369450 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3667/7324] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:02:21 2022] DELETE /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:02:21.379738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:21.380353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:21.386334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:21.386818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:21.387266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.387944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:21.388395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:21.388819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:21.525470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:21.533151 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9662da9d-56d1-49f3-9618-bb47caf9fb7d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1674 microversion: 2.1 time: 0.159453 Oct 26 06:02:21.533758 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3658/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:21 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:02:22.558032 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:22.558764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:22.566105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:22.566604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:22.567087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:22.567784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:22.568253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:22.568690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:22.700001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:22.708649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b07aa2a6-a288-47b1-b970-4235643343c4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1674 microversion: 2.1 time: 0.154924 Oct 26 06:02:22.709217 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3668/7326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:22 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:23.228186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b1265959-4ccd-46f4-bc70-f1dc08195d20 req-2f89b152-be03-41c8-ac66-05ca8381b9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "name": "network-vif-plugged", "status": "completed", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:23.239080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b1265959-4ccd-46f4-bc70-f1dc08195d20 req-2f89b152-be03-41c8-ac66-05ca8381b9fc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:23.239562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b1265959-4ccd-46f4-bc70-f1dc08195d20 req-2f89b152-be03-41c8-ac66-05ca8381b9fc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:23.240006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b1265959-4ccd-46f4-bc70-f1dc08195d20 req-2f89b152-be03-41c8-ac66-05ca8381b9fc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:23.251992 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b1265959-4ccd-46f4-bc70-f1dc08195d20 req-2f89b152-be03-41c8-ac66-05ca8381b9fc service nova] Creating event network-vif-plugged:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h2-862416-4 Oct 26 06:02:23.257567 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b1265959-4ccd-46f4-bc70-f1dc08195d20 req-2f89b152-be03-41c8-ac66-05ca8381b9fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034132 Oct 26 06:02:23.258231 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3659/7327] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:02:23.732730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:23.733549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:23.735796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:02:23.743955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c14c69d1-9a02-4e8a-bdd2-698fc9e92601 req-046eccc3-fc18-473c-93b9-55da492c8a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f3ad7-6b91-4f41-be01-3c4b3928a888", "name": "network-vif-deleted", "tag": "1fee758d-02bc-4b47-98a9-01a755e577b0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:23.744245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:23.744964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:23.745460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:23.746200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:23.746692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:23.747302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:23.758734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c14c69d1-9a02-4e8a-bdd2-698fc9e92601 req-046eccc3-fc18-473c-93b9-55da492c8a46 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:23.759495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c14c69d1-9a02-4e8a-bdd2-698fc9e92601 req-046eccc3-fc18-473c-93b9-55da492c8a46 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:23.759936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c14c69d1-9a02-4e8a-bdd2-698fc9e92601 req-046eccc3-fc18-473c-93b9-55da492c8a46 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:23.772241 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c14c69d1-9a02-4e8a-bdd2-698fc9e92601 req-046eccc3-fc18-473c-93b9-55da492c8a46 service nova] Creating event network-vif-deleted:1fee758d-02bc-4b47-98a9-01a755e577b0 for instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 on n-h2-862416-4 Oct 26 06:02:23.778168 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c14c69d1-9a02-4e8a-bdd2-698fc9e92601 req-046eccc3-fc18-473c-93b9-55da492c8a46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039634 Oct 26 06:02:23.779116 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3660/7328] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:02:23.815722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:23.825918 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-35f0bff8-fc66-4699-9167-b2e7e93141da tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 200 len: 1608 microversion: 2.1 time: 0.097194 Oct 26 06:02:23.826812 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3669/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:23 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 1608 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:02:24.853687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:24.854313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:24.860405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:24.860896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:24.861366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:24.862641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:24.863178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:24.863615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:24.876936 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 HTTP/1.1 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '377f3ad7-6b91-4f41-be01-3c4b3928a888'} Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:02:24.878639 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-390dc38f-6a45-4635-894c-ba32268619ec tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 404 len: 111 microversion: 2.1 time: 0.031638 Oct 26 06:02:24.883221 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3661/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:24 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:02:24.899560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:24.900191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:24.907264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:24.907765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:24.908388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:24.909432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:24.909914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:24.910359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:24.928095 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 HTTP/1.1 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '377f3ad7-6b91-4f41-be01-3c4b3928a888'} Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:02:24.929857 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19ae62d1-f235-4100-86f0-55ee6250e237 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 404 len: 111 microversion: 2.1 time: 0.035671 Oct 26 06:02:24.934067 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3670/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:24 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:02:24.980702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-37739033", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "d9e9be08-5efa-4913-8ca2-449133e5622b"}], "security_groups": [{"name": "tempest-securitygroup--84271778"}], "key_name": "tempest-keypair-1169985004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:25.085937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] validate_networks() for [('d9e9be08-5efa-4913-8ca2-449133e5622b', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:02:25.455463 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:02:25.455970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:02:25.456449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:02:25.456865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:02:25.457324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:02:25.466217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:25.466702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:25.467143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:25.467870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:25.468330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:25.468759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:25.486312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:02:25.492451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:02:25.504614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:02:25.506954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:02:25.554302 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7251eecb-2424-423b-b376-7b65150ebbf1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.577469 Oct 26 06:02:25.554956 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3662/7332] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:02:24 2022] POST /compute/v2.1/servers => generated 404 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:02:25.566665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-52f5d630-4bf9-433c-9df8-271bb0744a8b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:25.567397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-52f5d630-4bf9-433c-9df8-271bb0744a8b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:25.625934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-52f5d630-4bf9-433c-9df8-271bb0744a8b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:25.633022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-52f5d630-4bf9-433c-9df8-271bb0744a8b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1237 microversion: 2.1 time: 0.070570 Oct 26 06:02:25.633627 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3671/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:25 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:26.657954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:26.658530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:26.666318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:26.666818 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:26.667268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:26.667977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:26.668446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:26.668882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:26.734078 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:26.743481 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b52174ba-ee55-49cd-afaa-646362e7ac6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1297 microversion: 2.1 time: 0.090615 Oct 26 06:02:26.744088 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3663/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:26 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:27.768529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:27.769325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:27.776819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:27.777274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:27.777762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:27.778481 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:27.779229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:27.779688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:27.918488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:27.927253 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d79a00a1-98a6-443a-8871-03d6230d8977 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1361 microversion: 2.1 time: 0.162712 Oct 26 06:02:27.927954 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3672/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:27 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:28.108878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9bbccd9a-f6b8-4003-ab42-2a08fa7e1455 req-721eff51-0d02-48e7-9bd5-1a8ed3e81a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:28.120849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9bbccd9a-f6b8-4003-ab42-2a08fa7e1455 req-721eff51-0d02-48e7-9bd5-1a8ed3e81a3c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:28.121648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9bbccd9a-f6b8-4003-ab42-2a08fa7e1455 req-721eff51-0d02-48e7-9bd5-1a8ed3e81a3c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:28.122080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9bbccd9a-f6b8-4003-ab42-2a08fa7e1455 req-721eff51-0d02-48e7-9bd5-1a8ed3e81a3c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:28.134796 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9bbccd9a-f6b8-4003-ab42-2a08fa7e1455 req-721eff51-0d02-48e7-9bd5-1a8ed3e81a3c service nova] Creating event network-changed:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h1-862416-4 Oct 26 06:02:28.139992 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9bbccd9a-f6b8-4003-ab42-2a08fa7e1455 req-721eff51-0d02-48e7-9bd5-1a8ed3e81a3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034889 Oct 26 06:02:28.140677 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3664/7336] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:02:28.953582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:28.954139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:28.961405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:28.961909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:28.962367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:28.963077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:28.963557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:28.963995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:29.096219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:29.104596 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-035aa20a-38d4-4a13-8ebe-2cb63d1c70fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1361 microversion: 2.1 time: 0.155070 Oct 26 06:02:29.105172 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3673/7337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:28 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:30.129453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:30.130885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:30.138304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:30.139126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:30.139649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:30.140479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:30.141170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:30.141797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:30.274967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:30.282618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2a9205fb-603c-4126-b094-6c70a8f07d60 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1361 microversion: 2.1 time: 0.157901 Oct 26 06:02:30.283197 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3665/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:30 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:31.306556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:31.307183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:31.314085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:31.314581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:31.315034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:31.315733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:31.316226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:31.316666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:31.448479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:31.456180 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39bae8ce-962f-40f3-8bd2-f49ed33c1780 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1361 microversion: 2.1 time: 0.153632 Oct 26 06:02:31.456752 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3674/7339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:31 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:32.066218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b5695f04-3abd-4bf4-9671-133b49e9fd21 req-f15a492a-44e4-40f5-af40-b5bf32f7ae19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "name": "network-vif-plugged", "status": "completed", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:32.076713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b5695f04-3abd-4bf4-9671-133b49e9fd21 req-f15a492a-44e4-40f5-af40-b5bf32f7ae19 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:32.077195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b5695f04-3abd-4bf4-9671-133b49e9fd21 req-f15a492a-44e4-40f5-af40-b5bf32f7ae19 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:32.077661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b5695f04-3abd-4bf4-9671-133b49e9fd21 req-f15a492a-44e4-40f5-af40-b5bf32f7ae19 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:32.089659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b5695f04-3abd-4bf4-9671-133b49e9fd21 req-f15a492a-44e4-40f5-af40-b5bf32f7ae19 service nova] Creating event network-vif-plugged:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h1-862416-4 Oct 26 06:02:32.094401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b5695f04-3abd-4bf4-9671-133b49e9fd21 req-f15a492a-44e4-40f5-af40-b5bf32f7ae19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Oct 26 06:02:32.094999 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3666/7340] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:02:32.480554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:32.481104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:32.487858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:32.488349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:32.488797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:32.489522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:32.491078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:32.491525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:32.627925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:32.636355 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5b01a1a2-258c-48bd-91bb-5b6304c4dfb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1361 microversion: 2.1 time: 0.159832 Oct 26 06:02:32.636940 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3675/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:32 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:33.661112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:33.661928 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:33.668051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:33.668547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:33.668994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:33.669728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:33.670184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:33.670617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:33.802041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:02:33.809711 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd49598b-4e6f-4747-84cf-33b198b2236d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1548 microversion: 2.1 time: 0.153786 Oct 26 06:02:33.810307 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3667/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:02:33 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:02:33.835405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:02:33.835972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:02:33.842754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:33.843254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:33.843708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:33.844408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:33.844875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:33.845333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:33.925185 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0bbb04d5-2c45-4402-be96-f402d7214074 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095001 Oct 26 06:02:33.925824 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3676/7343] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 06:02:33 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:02:34.858652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1d030540-be2e-4f7a-80b3-5ce3f2d9bdc0 req-6552f98c-6065-46a4-b901-4b635fc1a5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:02:34.869511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1d030540-be2e-4f7a-80b3-5ce3f2d9bdc0 req-6552f98c-6065-46a4-b901-4b635fc1a5f0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:02:34.870093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1d030540-be2e-4f7a-80b3-5ce3f2d9bdc0 req-6552f98c-6065-46a4-b901-4b635fc1a5f0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:02:34.870531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1d030540-be2e-4f7a-80b3-5ce3f2d9bdc0 req-6552f98c-6065-46a4-b901-4b635fc1a5f0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:02:35.150902 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1d030540-be2e-4f7a-80b3-5ce3f2d9bdc0 req-6552f98c-6065-46a4-b901-4b635fc1a5f0 service nova] Creating event network-changed:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h1-862416-4 Oct 26 06:02:35.155747 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1d030540-be2e-4f7a-80b3-5ce3f2d9bdc0 req-6552f98c-6065-46a4-b901-4b635fc1a5f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301055 Oct 26 06:02:35.156602 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3668/7344] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:03:09.257021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.258029 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.258991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.263758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:09.264337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:09.272263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:09.272770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:09.273229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:09.273964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:09.274440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:09.274892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:09.408222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:09.416682 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69232e40-53e4-43e0-ad79-8329ca87f909 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1667 microversion: 2.1 time: 0.162182 Oct 26 06:03:09.417253 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3677/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:09 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:09.436544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.437338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.440075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.440731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=50 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:09.446309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7027544-7ebd-4d32-a74d-b3dc21012b2d"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:03:09.448597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:09.457517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:09.458262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:09.458704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:09.459391 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:09.460386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:09.460809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:09.701384 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a48e5a72-deb7-4525-bd50-8d06af193f93 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265424 Oct 26 06:03:09.701998 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3669/7346] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 06:03:09 2022] POST /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:03:21.489838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:03:21.492172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:21.494999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:21.495662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:21.501069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:21.501591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:21.502052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:21.502750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:21.503215 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:21.503657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:21.531809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:21.537161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Old instance type m1.heat2, new instance type m1.heat {{(pid=120585) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 06:03:21.544801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:03:21.545237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:03:21.545746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:03:21.546166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:03:21.546587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:03:21.607980 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [6ee93c99-bf6c-410e-baa2-793550982598] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:03:22.615076 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [6ee93c99-bf6c-410e-baa2-793550982598] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53140. Oct 26 06:03:22.619671 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ef438fea-c9d2-492d-a4fe-8b184dd4ffa4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/action" status: 202 len: 0 microversion: 2.1 time: 1.133808 Oct 26 06:03:22.620302 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3678/7347] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:03:21 2022] POST /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/action => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:03:22.630871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:22.632178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:22.637000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:22.637770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:22.645416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:22.645984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:22.646604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:22.647748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:22.648425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:22.648861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:22.805440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:22.815100 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-055c37cb-8df1-422b-bf94-348312bbb810 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1722 microversion: 2.1 time: 0.186140 Oct 26 06:03:22.815675 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3670/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:22 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:23.842145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:23.843835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:23.850583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:23.851096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:23.851571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:23.852323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:23.852946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:23.853440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:24.312444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:24.321178 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5d654b0c-ab11-4b23-bbef-9b5688073172 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1722 microversion: 2.1 time: 0.484623 Oct 26 06:03:24.321840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3679/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:23 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:25.345842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:25.346436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:25.353915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:25.354399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:25.354835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:25.355524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:25.355981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:25.356405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:25.485112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:25.494209 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca0c0b6d-58d3-41c1-a30e-9eaf3d2a0c89 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.152451 Oct 26 06:03:25.494780 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3671/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:25 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:26.518183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:26.518812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:26.525439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:26.525941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:26.526398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:26.527101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:26.527574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:26.528015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:26.660491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:26.668967 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-00f5f21f-d1c8-4cc4-a266-6a213297cc9c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.154744 Oct 26 06:03:26.669565 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3680/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:26 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:27.692005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:27.692649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:27.700438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:27.700870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:27.701325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:27.702026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:27.702485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:27.702915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:27.832782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:27.842274 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-66b930b1-a495-4b33-a638-56afb3be54f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.154164 Oct 26 06:03:27.842857 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3672/7352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:27 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:28.865428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:28.866149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:28.872784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:28.873285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:28.873767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:28.874474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:28.874946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:28.875391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:29.008851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:29.017059 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9b827c7d-21d9-4d74-aef8-6ab77b1f50f5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.155595 Oct 26 06:03:29.017664 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3681/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:28 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:30.041555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:30.042102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:30.048891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:30.049423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:30.049876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:30.050586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:30.051057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:30.051494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:30.180346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:30.188889 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-05b2c5f9-50d4-43ed-a2fc-193f4badc9a2 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.151822 Oct 26 06:03:30.189516 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3673/7354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:30 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:31.212553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:31.213237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:31.216460 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:03:31.216605 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 (ip 10.222.0.16) !!! Oct 26 06:03:31.222331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:31.222832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:31.223286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:31.224004 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:31.224469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:31.225534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:31.363934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:31.372835 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c1e2d119-dad9-40e2-8191-9a75f34c48ca tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.164481 Oct 26 06:03:31.373426 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3682/7355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:31 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:32.397145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:32.397890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:32.405191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:32.405706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:32.406146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:32.406840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:32.407295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:32.407717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:32.540120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:32.548471 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d697e35a-fd71-465d-959b-36336cc13959 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.155920 Oct 26 06:03:32.549065 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3674/7356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:32 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:33.572138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:33.572762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:33.579661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:33.580161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:33.580616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:33.581340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:33.581807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:33.582247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:33.715125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:33.723533 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a75ac85-cd87-45eb-99c4-a5ea0bb27e95 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.155397 Oct 26 06:03:33.724121 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3683/7357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:33 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:34.747666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:34.748258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:34.755205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:34.755635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:34.756081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:34.757420 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:34.757891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:34.758327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:34.890070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:34.898895 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86513af4-ef53-43ab-af04-6bf7433106a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.155231 Oct 26 06:03:34.899495 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3675/7358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:34 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:35.922765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:35.923390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:35.930299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:35.930804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:35.931263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:35.931966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:35.932445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:35.932884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:36.062570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:36.071789 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-35d8a3fd-9225-4d8e-8c02-6977d4cffe69 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.152935 Oct 26 06:03:36.072370 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3684/7359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:35 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:37.096106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:37.096733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:37.104087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:37.104585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:37.105032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:37.105780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:37.106247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:37.106683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:37.241266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:37.249531 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ead775d7-51ce-4a73-8781-8a0d35b5137d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.157371 Oct 26 06:03:37.250105 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3676/7360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:37 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:38.274576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:38.275205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:38.281687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:38.282191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:38.282648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:38.283355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:38.283827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:38.284276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:38.415034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:38.423247 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dfe88bce-94f5-41ed-94f3-d3b9677a7ced tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.152994 Oct 26 06:03:38.423818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3685/7361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:38 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:39.446992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:39.447650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:39.454573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:39.455075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:39.455518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:39.456215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:39.456675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:39.457108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:39.586657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:39.595142 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36346d08-94c7-4e39-8ca9-4a4bb0d4233b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.152253 Oct 26 06:03:39.595722 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3677/7362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:39 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:40.619520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:40.620146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:40.627003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:40.627505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:40.627964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:40.628670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:40.629145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:40.629634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:40.815533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:40.824092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-efdae773-47da-444d-88e5-d05ec568a299 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.209296 Oct 26 06:03:40.824675 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3686/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:40 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:41.847911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:41.848547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:41.856346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:41.857094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:41.857581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:41.858299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:41.858770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:41.859208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:42.050980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:42.059819 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-caaa1561-b0b0-4335-87ff-82903c497ea5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.215721 Oct 26 06:03:42.060394 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3678/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:41 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:43.084303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:43.084959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:43.092410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:43.092908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:43.093381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:43.094094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:43.094564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:43.095007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:43.233840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:43.242493 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-be4b6c23-0af9-4c6d-84f4-c2ab9972cf55 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1727 microversion: 2.1 time: 0.162295 Oct 26 06:03:43.243263 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3687/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:43 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:44.267429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:44.268318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:44.276443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:44.277047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:44.277615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:44.278561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:44.279219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:44.279663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:44.279886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "name": "network-vif-unplugged", "status": "completed", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:03:44.293849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:44.294346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:44.294859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:44.308177 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] Creating event network-vif-unplugged:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h2-862416-4 Oct 26 06:03:44.313751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:03:44.326016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-948e5c93-35d4-447e-8b85-fc9a814ac278 req-88abd48c-4c4f-4b82-b0da-ac13bf0c107e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050329 Oct 26 06:03:44.326651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3688/7366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:03:44.557085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:44.565371 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a24ae52b-a5c6-4a9a-95f0-c084d46c1b5a tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1726 microversion: 2.1 time: 0.302068 Oct 26 06:03:44.565942 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3679/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:44 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1726 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:45.592152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:45.592908 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:45.599247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:45.599749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:45.600207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:45.601455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:45.601973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:45.602608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:45.736476 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:45.745657 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94eb424e-7488-4537-a159-c5c5939de39d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.158626 Oct 26 06:03:45.746237 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3689/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:45 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:46.362980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:03:46.374883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:46.375369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:46.375811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:46.390835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] Creating event network-changed:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h2-862416-4 Oct 26 06:03:46.396518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:03:46.407425 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f9a91a83-62a0-4921-8e87-712762ce9480 req-02572b90-2589-45a6-b046-2137a1eeac24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048161 Oct 26 06:03:46.408037 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3680/7369] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:03:46.769807 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:46.770438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:46.778546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:46.779052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:46.779503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:46.780227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:46.780697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:46.781136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:47.008480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:47.018853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-15a8ddef-6f5d-4752-a01b-2ea762d6cc23 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.252818 Oct 26 06:03:47.019829 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3690/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:46 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:48.047061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:48.047941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:48.055266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:48.055761 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:48.056204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:48.056923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:48.057394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:48.057833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:48.201773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:48.211202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0d66ae36-29fc-4159-bf71-d470c6e191af tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.169213 Oct 26 06:03:48.221577 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3681/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:48 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:49.235891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:49.236523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:49.244360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:49.244867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:49.245336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:49.246153 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:49.246629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:49.247103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:49.382379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:49.391077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8eec40ea-e9d2-4f97-bb05-eb4797b1b306 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.159177 Oct 26 06:03:49.391668 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3691/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:49 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:50.414769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:50.415533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:50.422904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:50.423467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:50.423860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:50.424580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:50.425107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:50.425633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:50.559601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:50.568127 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ba9ef8a0-e643-4d88-9df2-03313033324c tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.157333 Oct 26 06:03:50.568707 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3682/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:50 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:03:51.592506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:51.593134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:51.596017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=33 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:51.601567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:51.602069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:51.602526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:51.603237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:51.603707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:51.604152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:51.606932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:51.735440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:51.743728 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37b3933b-2bf5-422c-9e1f-f413eeb40aaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.155171 Oct 26 06:03:51.744332 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3692/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:51 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:52.767565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:52.768140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:52.770885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=27 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:52.776462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:52.776953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:52.777424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:52.778116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:52.778575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:52.779003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:52.781684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=77 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:03:52.908486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:52.917689 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b28b0fe-28cf-479f-a1ed-846bd003ce3d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.154099 Oct 26 06:03:52.918301 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3683/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:52 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:53.942323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:53.942947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:53.950424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:53.950918 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:53.951370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:53.952077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:53.952536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:53.952976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:54.083992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:54.092858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dc45f3d5-552d-4570-b3c4-56c2315a2fe7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.154461 Oct 26 06:03:54.093460 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3693/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:53 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:55.117040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:55.117688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:55.124650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:55.125146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:55.125628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:55.126331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:55.126798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:55.127236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:55.256501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:55.265328 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93bc8ae6-c088-4997-9e53-c33e8dece0bc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.152417 Oct 26 06:03:55.265916 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3684/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:55 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:56.289879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:56.290456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:56.296974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:56.297514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:56.297984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:56.298696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:56.299171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:56.299621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:56.434590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:56.443080 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fb599ed6-426c-4d38-a51b-407cd31fd821 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.158160 Oct 26 06:03:56.443672 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3694/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:56 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:57.467120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:57.467750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:57.474746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:57.475243 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:57.476270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:57.476977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:57.477486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:57.477933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:57.607212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:57.615382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-725249d0-3af9-4b26-ab61-ced30d6f1cd1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.152210 Oct 26 06:03:57.615961 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3685/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:57 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:58.638591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:58.639859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:58.646600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:58.647098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:58.648267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:58.649005 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:58.649484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:58.654035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:58.803147 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:58.812031 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d4201185-1acf-4c65-8841-c650849a9596 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1724 microversion: 2.1 time: 0.177242 Oct 26 06:03:58.813027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3695/7380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:58 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:03:59.836774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:03:59.837516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:03:59.844272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:59.844767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:59.845214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:59.845967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:03:59.846430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:03:59.846899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:03:59.980551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:03:59.988904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3786afef-529d-4324-8921-688758b398f1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1721 microversion: 2.1 time: 0.156651 Oct 26 06:03:59.989513 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3686/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:03:59 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:00.012703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:00.013257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:00.020110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:00.020614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:00.021080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:00.021847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:00.022343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:00.022825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:00.060076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:00.060570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:00.061024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:00.061792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:00.062265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:00.062708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:00.082767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for project f14656c9f81340c0b29625afa8967c52. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:04:00.088429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Getting quotas for user df1bf247850a4124bec3ec088f61f09f and project f14656c9f81340c0b29625afa8967c52. Resources: {'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:04:00.199266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4643b6bd-b0c0-490b-8132-1cffc5b869d8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "POST /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/action" status: 202 len: 0 microversion: 2.1 time: 0.190299 Oct 26 06:04:00.199885 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3696/7382] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:04:00 2022] POST /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:04:00.208713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:00.209640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:00.217219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:00.217758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:00.218561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:00.219297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:00.220531 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:00.220985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:00.472451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:00.482267 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0676b23f-ccf4-43ad-8e0e-df556ef7138b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.278012 Oct 26 06:04:00.482853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3687/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:00 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:01.508117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:01.508842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:01.516196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:01.516701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:01.517157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:01.517893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:01.518364 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:01.518808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:01.648357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:01.656718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5bdcf080-d69d-493e-92a1-5398bdcc95fe tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.154021 Oct 26 06:04:01.657524 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3697/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:01 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:01.784885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "name": "network-vif-plugged", "status": "completed", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:01.796228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:01.796722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:01.797166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:01.809552 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] Creating event network-vif-plugged:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h2-862416-4 Oct 26 06:04:01.815139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:04:01.826365 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b879ca93-ebfd-48d6-9a66-417a772246be req-fc49df1f-3ac3-4094-9c00-38c797386ea7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045163 Oct 26 06:04:01.826977 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3688/7385] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:04:02.682753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:02.683305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:02.690086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:02.690577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:02.691023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:02.691716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:02.692184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:02.692619 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:02.834590 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:02.843583 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7df7610d-d1b7-427f-ab6a-0fb2b273efaf tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.164984 Oct 26 06:04:02.844499 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3698/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:02 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:03.869915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:03.870753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:03.877087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:03.877574 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:03.878029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:03.878770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:03.879238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:03.879677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:04.011479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:04.019792 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bfcace6-c949-4bee-b49a-45728016fcee tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.155732 Oct 26 06:04:04.020368 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3689/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:03 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:05.043795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:05.044435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:05.051202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:05.051710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:05.052167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:05.052888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:05.053392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:05.053885 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:05.190992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:05.199917 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57413e83-79d2-465f-9f8e-6c247cbc5b6d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.159928 Oct 26 06:04:05.200515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3699/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:05 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:05.575410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "name": "network-vif-unplugged", "status": "completed", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:05.586554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:05.586964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:05.587448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:05.600079 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] Creating event network-vif-unplugged:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h1-862416-4 Oct 26 06:04:05.605571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:04:05.616835 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6f45f0da-80e6-4af5-972f-5cbd1ebd3969 req-60b14b3c-0a62-4aa3-afcd-62d238e10d11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044549 Oct 26 06:04:05.617484 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3690/7389] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:04:06.224093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:06.224745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:06.233100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:06.233649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:06.234097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:06.234820 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:06.235297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:06.235747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:06.372773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:06.381169 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02080f45-fb3e-48af-99fa-b47e746025d1 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.160994 Oct 26 06:04:06.381801 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3700/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:06 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:07.406405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:07.407301 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:07.413772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:07.414271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:07.414722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:07.415433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:07.415899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:07.416336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:07.551739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:07.560703 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2061f0c8-f93f-425c-a8cf-369d3af82e28 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.159558 Oct 26 06:04:07.561286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3691/7391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:07 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:07.655982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:07.667080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:07.667573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:07.668019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:07.680494 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] Creating event network-changed:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h1-862416-4 Oct 26 06:04:07.685804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:04:07.697743 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-dd15f46c-2e0b-498d-94ea-b621971a2a05 req-55ab7372-a06f-44a6-9c7a-78f14aeac7d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045501 Oct 26 06:04:07.698349 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3701/7392] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:04:08.584250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:08.586029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:08.592981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:08.593522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:08.593973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:08.594676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:08.595134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:08.595565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:08.734649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:08.744249 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4760a1cf-5383-4a18-8bfc-ee9a2814d0e0 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.164110 Oct 26 06:04:08.744831 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3692/7393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:08 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:09.770712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:09.771429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:09.780118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:09.780625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:09.781079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:09.781819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:09.782295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:09.782740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:09.915695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:09.924367 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-30eae909-b10e-4292-9e1d-e637c740e3d7 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.157913 Oct 26 06:04:09.924948 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3702/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:09 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:10.949336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:10.949968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:10.956891 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:10.957408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:10.957854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:10.958806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:10.959266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:10.959696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:11.095837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:11.104733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9e325c69-c4d7-4712-81f9-6eb7de341682 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.160501 Oct 26 06:04:11.105301 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3693/7395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:10 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:12.185999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:12.186657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:12.188665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:12.194923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:12.195427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:12.195891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:12.196605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:12.197080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:12.197562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:12.326057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:12.335156 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-79ace177-69f7-420f-b293-8a5fd7583014 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.152604 Oct 26 06:04:12.335730 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3703/7396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:12 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:13.360021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:13.360639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:13.367930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:13.368419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:13.368860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:13.369582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:13.370044 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:13.370474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:13.508357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:13.516724 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a6a2a6c8-5b99-4472-91f3-102c5e02062b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.160618 Oct 26 06:04:13.517335 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3694/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:13 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:14.541428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:14.542052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:14.548784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:14.549278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:14.549759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:14.550469 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:14.550930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:14.551372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:14.680774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:14.689003 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ebafe434-3d85-4b71-883b-a7c3bc917c81 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.152331 Oct 26 06:04:14.689603 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3704/7398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:14 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:15.712894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:15.713554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:15.720456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:15.720951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:15.721425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:15.722141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:15.722596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:15.723038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:15.853430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:15.861655 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5baa4486-3e27-4cd8-afcb-c4291239f76d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.153514 Oct 26 06:04:15.862232 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3695/7399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:15 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:16.886110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:16.886765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:16.893573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:16.894071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:16.894523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:16.895254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:16.895720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:16.896158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:17.028812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:17.036976 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9e3c1a6-7000-4590-86bc-2741150531be tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.154854 Oct 26 06:04:17.037595 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3705/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:16 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:18.061068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:18.061705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:18.068505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:18.069272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:18.070070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:18.070763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:18.071224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:18.071656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:18.202245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:18.211385 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd3609b2-47d8-470c-be54-6f2f22a0bbfb tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1720 microversion: 2.1 time: 0.154252 Oct 26 06:04:18.211972 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3696/7401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:18 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:19.235953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:19.236563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:19.243947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.244450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.244910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.245653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.246126 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.246569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.249151 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:19.382556 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:19.390860 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d620613b-11de-4756-9e29-b595c9e612a6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1713 microversion: 2.1 time: 0.158857 Oct 26 06:04:19.391459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3706/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:19 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:19.414393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:19.415014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:19.421698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.422191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.422632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.423324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.423786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.424217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.552081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:19.560836 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-77294690-b33f-44f5-a719-396b10640e65 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1713 microversion: 2.1 time: 0.151157 Oct 26 06:04:19.561423 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3697/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:19 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:19.583293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:19.584205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:19.590419 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.590926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.591388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.592098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.592575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.593049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.725736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:19.733990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-626f716e-26bc-4580-b9a3-f74ba89e7316 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1713 microversion: 2.1 time: 0.154655 Oct 26 06:04:19.734571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3707/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:19 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:19.758437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:19.758863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:19.764941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.765498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.765944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.766632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.767096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.767526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.792672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:04:19.844901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:19.874761 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0c56fd17-a14a-473d-9df3-e0541cb9b13d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 204 len: 0 microversion: 2.1 time: 0.120978 Oct 26 06:04:19.875376 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3698/7405] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:04:19 2022] DELETE /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:04:19.884734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:19.885394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:19.891277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.891772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.892229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:19.892938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:19.893439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:19.893883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:20.022851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:20.031359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f63fb64c-4f16-427a-b626-6ba4a4fc5f30 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1719 microversion: 2.1 time: 0.151315 Oct 26 06:04:20.031930 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3708/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:19 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:04:21.057914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:21.058639 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:21.065451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:21.065952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:21.066402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:21.067140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:21.067607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:21.068046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:21.197688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:21.205969 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-32074c2f-ab98-4afe-a960-4d4c2b063e5b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1719 microversion: 2.1 time: 0.153650 Oct 26 06:04:21.206549 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3699/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:21 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:22.232186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:22.232846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:22.237420 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:22.247040 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:22.248172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:22.248172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:22.248718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:22.249185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:22.249660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:22.321052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:22.331917 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba8fa685-f006-41ba-a02c-98dee123300b tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1653 microversion: 2.1 time: 0.104202 Oct 26 06:04:22.345386 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3709/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:22 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1653 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:22.385736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-f75fa817-c4d5-4094-8a28-7e658e0a6099 req-fc2121a3-dbf1-4b53-877a-21d42fcb6f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b5080-8eb2-4353-a450-bb03324a3627", "name": "network-vif-deleted", "tag": "92d7bb13-cf78-463b-a29b-7ce3cd8aea73"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:22.406307 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f75fa817-c4d5-4094-8a28-7e658e0a6099 req-fc2121a3-dbf1-4b53-877a-21d42fcb6f08 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:22.406848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f75fa817-c4d5-4094-8a28-7e658e0a6099 req-fc2121a3-dbf1-4b53-877a-21d42fcb6f08 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:22.407308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-f75fa817-c4d5-4094-8a28-7e658e0a6099 req-fc2121a3-dbf1-4b53-877a-21d42fcb6f08 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:22.423154 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-f75fa817-c4d5-4094-8a28-7e658e0a6099 req-fc2121a3-dbf1-4b53-877a-21d42fcb6f08 service nova] Creating event network-vif-deleted:92d7bb13-cf78-463b-a29b-7ce3cd8aea73 for instance 1d1b5080-8eb2-4353-a450-bb03324a3627 on n-h1-862416-4 Oct 26 06:04:22.428344 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-f75fa817-c4d5-4094-8a28-7e658e0a6099 req-fc2121a3-dbf1-4b53-877a-21d42fcb6f08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047379 Oct 26 06:04:22.429077 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3700/7409] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:04:23.360288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:23.360890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:23.369136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:23.369788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:23.370189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:23.370923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:23.371424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:23.371870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:23.447941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:23.457153 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e24fc24c-823c-4ce7-abf6-082074fe51ad tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1368 microversion: 2.1 time: 0.100806 Oct 26 06:04:23.457789 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3710/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:23 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:24.483188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:24.483926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:24.485920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:24.491815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:24.492309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:24.492755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:24.493497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:24.493964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:24.494399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:24.565786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:24.574669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aaa91250-2941-4cf3-912b-60c64aa789d5 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1368 microversion: 2.1 time: 0.096714 Oct 26 06:04:24.575282 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3701/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:24 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:25.598922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:25.599573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:25.607098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:25.607604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:25.608071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:25.608805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:25.609289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:25.609771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:25.674575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:25.683633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2819fa07-f41f-40c8-af7e-6460cb5cfa67 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1368 microversion: 2.1 time: 0.088830 Oct 26 06:04:25.684220 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3711/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:25 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:26.707055 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:26.707575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:26.715415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:26.715907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:26.716350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:26.717045 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:26.717536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:26.717968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:26.750384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:26.750860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:26.751296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:26.751745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lazy-loading 'fault' on Instance uuid 1d1b5080-8eb2-4353-a450-bb03324a3627 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:04:26.793028 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1bf247850a4124bec3ec088f61f09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14656c9f81340c0b29625afa8967c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:26.801404 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4d2b1ba9-2b96-4290-b283-f8b1f545e41d tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 200 len: 1373 microversion: 2.1 time: 0.098345 Oct 26 06:04:26.801971 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3702/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:26 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 1373 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:27.825892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:27.826523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:27.833195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:27.833960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:27.835263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:27.836031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:27.836507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:27.836955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:27.850637 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 HTTP/1.1 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1d1b5080-8eb2-4353-a450-bb03324a3627'} Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:27.852314 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a7e84742-3638-4b6a-b5bb-479c2c00c147 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 404 len: 111 microversion: 2.1 time: 0.032064 Oct 26 06:04:27.856948 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3712/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:27 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:27.914865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:27.917086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:27.923775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:27.924273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:27.924718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:27.925448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:27.925929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:27.926359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:27.940405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-volume_attachments HTTP/1.1 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '1d1b5080-8eb2-4353-a450-bb03324a3627'} Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:27.942164 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7bfa5194-950d-469a-bb4a-2597f3195fd8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032711 Oct 26 06:04:27.947012 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3703/7415] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:04:27 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.267452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.267957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.275002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.275509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.275973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.276685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.277164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.277756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.296858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 HTTP/1.1 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1d1b5080-8eb2-4353-a450-bb03324a3627'} Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.298736 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-64fd6703-6746-428f-9cc0-f00b62d19547 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 404 len: 111 microversion: 2.1 time: 0.036649 Oct 26 06:04:31.303853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3713/7416] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:04:31 2022] DELETE /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.309337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.309957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 1d1b5080-8eb2-4353-a450-bb03324a3627] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.316851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.317384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.317837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.318557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.319023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.319534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.332940 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 HTTP/1.1 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '1d1b5080-8eb2-4353-a450-bb03324a3627'} Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.334937 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 1d1b5080-8eb2-4353-a450-bb03324a3627 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9ff3f9bc-2ab3-4d88-8065-8b2c1fd4d6b4 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627" status: 404 len: 111 microversion: 2.1 time: 0.030900 Oct 26 06:04:31.339647 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3704/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:31 2022] GET /compute/v2.1/servers/1d1b5080-8eb2-4353-a450-bb03324a3627 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.345932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.346460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.353518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.354039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.354502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.355245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.355726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.356207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.371104 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 HTTP/1.1 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '377f3ad7-6b91-4f41-be01-3c4b3928a888'} Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.372722 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3ec60532-064f-4836-8d71-510272e653c3 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 404 len: 111 microversion: 2.1 time: 0.032378 Oct 26 06:04:31.377464 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3714/7418] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:04:31 2022] DELETE /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.384618 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.385362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: 377f3ad7-6b91-4f41-be01-3c4b3928a888] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.391825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.392566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.393057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.393806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.394275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.394710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.409337 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 HTTP/1.1 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '377f3ad7-6b91-4f41-be01-3c4b3928a888'} Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.410942 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance 377f3ad7-6b91-4f41-be01-3c4b3928a888 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b440a62-cac3-4c78-bf47-c597113c5baa tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888" status: 404 len: 111 microversion: 2.1 time: 0.032834 Oct 26 06:04:31.419326 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3705/7419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:31 2022] GET /compute/v2.1/servers/377f3ad7-6b91-4f41-be01-3c4b3928a888 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.422306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.423386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.429696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.430209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.430837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.431754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.432399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.432849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.459840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 HTTP/1.1 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'dde18585-7114-473e-ae5d-218cc6ca1e97'} Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.461452 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af495b30-d5cb-491b-9a9c-ee421c5eabb6 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 404 len: 111 microversion: 2.1 time: 0.044536 Oct 26 06:04:31.468066 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3715/7420] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:04:31 2022] DELETE /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 06:04:31.471620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.472240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: dde18585-7114-473e-ae5d-218cc6ca1e97] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.479648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.480135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.480580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.481274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.481759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.482189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.495791 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 HTTP/1.1 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'dde18585-7114-473e-ae5d-218cc6ca1e97'} Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.497264 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance dde18585-7114-473e-ae5d-218cc6ca1e97 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.502214 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b1495a66-67ea-4843-afed-53603d875898 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97" status: 404 len: 111 microversion: 2.1 time: 0.030906 Oct 26 06:04:31.502922 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3706/7421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:31 2022] GET /compute/v2.1/servers/dde18585-7114-473e-ae5d-218cc6ca1e97 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.508915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.509532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.515561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.516065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.516516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.517214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.517706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.518148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.532824 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 HTTP/1.1 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'fd5c04bc-d0b6-42f6-b198-eb3b6e00f564'} Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.534444 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e392989-f5fc-4634-b96a-43d9851b74dc tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 404 len: 111 microversion: 2.1 time: 0.032023 Oct 26 06:04:31.538718 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3716/7422] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:04:31 2022] DELETE /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.545117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.545781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] [instance: fd5c04bc-d0b6-42f6-b198-eb3b6e00f564] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:31.551853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.552374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.552817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.553943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:31.554111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:31.554552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:31.568494 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] HTTP exception thrown: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Request method failure captured: Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 HTTP/1.1 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWMwoSzjP1ZklzNmfe-AJgsZUjT-wxqnEOoA17RDB9ARVkyV0JJQEUcFriV_J9dn5-aEkz6OyrLYEMJtMxUP_lHtqTEiGMyzpScpveUfrgxPxVYhqp9l3xV-OcxxvhxaYgdUYRmbJoes39RYyb8X1tDk2QG998vHyRN_JuEhRyHNZfU4 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14656c9f81340c0b29625afa8967c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14656c9f81340c0b29625afa8967c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f14656c9f81340c0b29625afa8967c52 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServerActionsTestJSON-432491408 Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: df1bf247850a4124bec3ec088f61f09f Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServerActionsTestJSON-432491408-project Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'fd5c04bc-d0b6-42f6-b198-eb3b6e00f564'} Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:04:31.570816 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Returning 404 to user: Instance fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a219e0ee-cdb7-4afc-a625-4ac0835ac106 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564" status: 404 len: 111 microversion: 2.1 time: 0.031121 Oct 26 06:04:31.575663 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3707/7423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:31 2022] GET /compute/v2.1/servers/fd5c04bc-d0b6-42f6-b198-eb3b6e00f564 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:04:31.581305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19c46d64-d651-4409-bb9e-c79f0c1046e8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] Calling method '.version_select at 0x7f470eba80d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:31.606639 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19c46d64-d651-4409-bb9e-c79f0c1046e8 tempest-ServerActionsTestJSON-432491408 tempest-ServerActionsTestJSON-432491408-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169985004" status: 202 len: 0 microversion: 2.1 time: 0.029251 Oct 26 06:04:31.607233 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3717/7424] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 26 06:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169985004 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:04:41.132447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1491500685", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "9e849825-05e8-4ef2-bfc0-a6dc15c7fb64"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:41.194363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] validate_networks() for [('9e849825-05e8-4ef2-bfc0-a6dc15c7fb64', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:04:41.559493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=32 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:41.601669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:04:41.602143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:04:41.602633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:04:41.603057 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:04:41.603624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:04:41.612629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:41.613121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:41.613622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:41.614370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:41.614835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:41.615828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:41.634322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Getting quotas for project b181fdba7cbb46558480dc277ffb9452. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:04:41.639816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Getting quotas for user 28bac6a20c084723a006bb989ac9f79f and project b181fdba7cbb46558480dc277ffb9452. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:04:41.651978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:04:41.654334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:04:41.700274 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8d9b7d2a-9c27-4d8e-9679-4e6f66b5fcc8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704453 Oct 26 06:04:41.700924 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3708/7425] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:04:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:04:41.710515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=45 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:41.711288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:41.715225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0065967e-1447-470b-b672-b19e795f7ece tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:41.715850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0065967e-1447-470b-b672-b19e795f7ece tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:41.774228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0065967e-1447-470b-b672-b19e795f7ece tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:41.782016 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0065967e-1447-470b-b672-b19e795f7ece tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1217 microversion: 2.1 time: 0.073565 Oct 26 06:04:41.782618 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3718/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:41 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:42.807402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4ddcce4-3e5f-4899-bccd-a078dd27d57f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:42.808621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4ddcce4-3e5f-4899-bccd-a078dd27d57f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:42.883870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4ddcce4-3e5f-4899-bccd-a078dd27d57f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:42.891853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4ddcce4-3e5f-4899-bccd-a078dd27d57f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1217 microversion: 2.1 time: 0.089615 Oct 26 06:04:42.892510 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3709/7427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:42 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:43.915853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:43.916489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:43.923618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:43.924127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:43.924585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:43.925330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:43.925805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:43.926255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:43.994049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:44.002440 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb824c4e-8b52-46c9-ab5c-a59d61810066 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1221 microversion: 2.1 time: 0.091087 Oct 26 06:04:44.003131 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3719/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:43 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:45.026545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:45.027175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:45.033994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:45.034493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:45.034952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:45.035671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:45.036141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:45.036581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:45.104366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:45.112446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-81268bf2-732e-48eb-a5b9-aca01580f774 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1275 microversion: 2.1 time: 0.090573 Oct 26 06:04:45.113044 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3710/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:45 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:46.138132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:46.139246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:46.145987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:46.147027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:46.147560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:46.148295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:46.148762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:46.149205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:46.282282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-638e3b66-811c-4394-bd72-b25021369d68 req-121a0d0e-b391-4875-b206-108ee12ed3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef4891d-884c-489a-b062-f2b766f7c974", "tag": "9afd93fb-b048-4079-8450-9654b269fba0"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:46.296886 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-638e3b66-811c-4394-bd72-b25021369d68 req-121a0d0e-b391-4875-b206-108ee12ed3c6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:46.297713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-638e3b66-811c-4394-bd72-b25021369d68 req-121a0d0e-b391-4875-b206-108ee12ed3c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:46.298485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-638e3b66-811c-4394-bd72-b25021369d68 req-121a0d0e-b391-4875-b206-108ee12ed3c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:46.316269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:46.316887 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-638e3b66-811c-4394-bd72-b25021369d68 req-121a0d0e-b391-4875-b206-108ee12ed3c6 service nova] Creating event network-changed:9afd93fb-b048-4079-8450-9654b269fba0 for instance 1ef4891d-884c-489a-b062-f2b766f7c974 on n-h1-862416-4 Oct 26 06:04:46.323000 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-638e3b66-811c-4394-bd72-b25021369d68 req-121a0d0e-b391-4875-b206-108ee12ed3c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046883 Oct 26 06:04:46.324152 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3711/7430] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:04:46.329103 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3e584bdc-88db-4bae-a6e7-994c1d14142d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.195083 Oct 26 06:04:46.330569 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3720/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:46 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:47.355757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:47.356499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:47.362695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:47.363184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:47.363626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:47.364323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:47.364787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:47.365822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:47.500544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:47.508850 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d85a0bdb-2311-47fb-90e2-f704c9492a37 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.158214 Oct 26 06:04:47.509450 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3712/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:47 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:48.532497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:48.533117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:48.540119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:48.540613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:48.541065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:48.541824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:48.542297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:48.542734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:48.674122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:48.682681 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f00dd63-3334-4948-a853-9f669fa246c6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.154447 Oct 26 06:04:48.683252 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3721/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:48 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:49.706333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:49.706955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:49.714008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:49.714504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:49.714953 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:49.715650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:49.716112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:49.716544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:49.850508 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:49.858163 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-73ed795f-d56d-4c25-8fb0-0a9f4de0effd tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.155798 Oct 26 06:04:49.858736 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3713/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:49 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:50.881774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:50.882379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:50.889248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:50.889790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:50.890251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:50.890967 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:50.891449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:50.891897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:51.027238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:51.034999 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dde956fe-ea02-4415-8be4-f4cd86567791 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.157807 Oct 26 06:04:51.035571 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3722/7435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:50 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:52.058895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:52.059518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:52.062304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:52.067741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:52.068353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:52.068985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:52.069726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:52.070192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:52.070626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:52.201097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:52.209317 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0d7e1dd-9901-4a71-9cc1-d07354cb056e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.153867 Oct 26 06:04:52.210078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3714/7436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:52 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:52.796503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-63afa0d7-b95c-46e5-b323-01ebbbf57716 req-6520f96a-5a6d-483c-afa4-ac2da6322762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef4891d-884c-489a-b062-f2b766f7c974", "name": "network-vif-plugged", "status": "completed", "tag": "9afd93fb-b048-4079-8450-9654b269fba0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:52.804858 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:52.810693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-63afa0d7-b95c-46e5-b323-01ebbbf57716 req-6520f96a-5a6d-483c-afa4-ac2da6322762 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:52.811184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-63afa0d7-b95c-46e5-b323-01ebbbf57716 req-6520f96a-5a6d-483c-afa4-ac2da6322762 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:52.811710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-63afa0d7-b95c-46e5-b323-01ebbbf57716 req-6520f96a-5a6d-483c-afa4-ac2da6322762 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:52.824579 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-63afa0d7-b95c-46e5-b323-01ebbbf57716 req-6520f96a-5a6d-483c-afa4-ac2da6322762 service nova] Creating event network-vif-plugged:9afd93fb-b048-4079-8450-9654b269fba0 for instance 1ef4891d-884c-489a-b062-f2b766f7c974 on n-h1-862416-4 Oct 26 06:04:52.829575 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-63afa0d7-b95c-46e5-b323-01ebbbf57716 req-6520f96a-5a6d-483c-afa4-ac2da6322762 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Oct 26 06:04:52.830176 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3723/7437] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:04:53.233369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:53.234033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:53.235840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:53.241977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:53.242474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:53.242922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:53.243624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:53.244089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:53.244523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:53.374317 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:53.382710 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-54edf8c8-335f-4aeb-aff9-58890100222e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1317 microversion: 2.1 time: 0.153328 Oct 26 06:04:53.383286 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3715/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:53 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:54.406674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:54.407398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:54.414775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:54.415277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:54.415738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:54.416447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:54.416923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:54.417392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:54.552681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:54.560724 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5dc27092-53c1-4b4f-b86a-57e701923547 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.159220 Oct 26 06:04:54.561337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3724/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:54 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:54.623095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1949567897", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "9e849825-05e8-4ef2-bfc0-a6dc15c7fb64"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:54.632880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:04:54.678739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] validate_networks() for [('9e849825-05e8-4ef2-bfc0-a6dc15c7fb64', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:04:55.055993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:04:55.056432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:04:55.056924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:04:55.057379 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:04:55.057809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:04:55.066583 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:55.067079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:55.067529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:55.068934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:55.069464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:55.069902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:55.086708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Getting quotas for project b181fdba7cbb46558480dc277ffb9452. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:04:55.091919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Getting quotas for user 28bac6a20c084723a006bb989ac9f79f and project b181fdba7cbb46558480dc277ffb9452. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:04:55.104256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:04:55.106577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:04:55.152728 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-21ed66d0-9c41-470f-aeaf-335a01a67b3d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533586 Oct 26 06:04:55.153415 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3716/7440] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:04:55.164520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c6cbcef-51c4-4004-9f60-57e9a01efdba tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:55.165158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1c6cbcef-51c4-4004-9f60-57e9a01efdba tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:55.219830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c6cbcef-51c4-4004-9f60-57e9a01efdba tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:55.227023 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c6cbcef-51c4-4004-9f60-57e9a01efdba tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1217 microversion: 2.1 time: 0.066456 Oct 26 06:04:55.227601 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3725/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:55 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:56.262586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:56.263218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:56.274534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:56.275029 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:56.275470 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:56.276190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:56.276651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:56.277093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:56.349046 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:56.357257 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-aa82b20a-718b-4b8c-8db0-bb74de0d85ec tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1275 microversion: 2.1 time: 0.110315 Oct 26 06:04:56.357874 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3717/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:56 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:57.382353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:57.382978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:57.389468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:57.389968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:57.390426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:57.391133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:57.391601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:57.392039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:57.590347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:57.598362 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c9a3393-f67c-4e46-b550-1ac80f9bb32d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.220339 Oct 26 06:04:57.598957 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3726/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:57 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:57.992233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-82b769c9-d63a-4d60-9ba9-f4cdcd0a9723 req-8cbc6b9b-6d6c-4111-9cde-505a030152bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a348958-ea39-41cc-abac-7a3e43fa94e2", "tag": "43e623c1-cf4e-4e8d-a109-6d5152fef398"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:04:58.005002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-82b769c9-d63a-4d60-9ba9-f4cdcd0a9723 req-8cbc6b9b-6d6c-4111-9cde-505a030152bb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:58.005576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-82b769c9-d63a-4d60-9ba9-f4cdcd0a9723 req-8cbc6b9b-6d6c-4111-9cde-505a030152bb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:58.006230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-82b769c9-d63a-4d60-9ba9-f4cdcd0a9723 req-8cbc6b9b-6d6c-4111-9cde-505a030152bb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:58.017615 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-82b769c9-d63a-4d60-9ba9-f4cdcd0a9723 req-8cbc6b9b-6d6c-4111-9cde-505a030152bb service nova] Creating event network-changed:43e623c1-cf4e-4e8d-a109-6d5152fef398 for instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 on n-h2-862416-4 Oct 26 06:04:58.023629 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-82b769c9-d63a-4d60-9ba9-f4cdcd0a9723 req-8cbc6b9b-6d6c-4111-9cde-505a030152bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114490 Oct 26 06:04:58.024241 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3718/7444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:04:58.622223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:58.622857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:58.629782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:58.630336 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:58.630943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:58.631657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:58.632131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:58.632578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:58.763023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:58.770637 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8e1aac8-1795-4853-bfbf-3c3359039777 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.152369 Oct 26 06:04:58.771708 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3727/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:58 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:04:59.795407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:04:59.796135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:04:59.804533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:59.805040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:59.805546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:59.806264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:04:59.806735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:04:59.807207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:04:59.940577 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:04:59.948935 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-205f9d28-88d6-451d-9dc9-c0b587302d60 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.158265 Oct 26 06:04:59.949537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3719/7446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:04:59 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:00.972234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:00.972794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:00.980179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:00.984187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:00.984187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:00.984187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:00.984187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:00.984187 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:01.111824 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:01.119708 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f03612a6-aa5b-4c80-81ac-99b6b401c227 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.151571 Oct 26 06:05:01.120289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3728/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:00 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:02.143082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:02.143712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:02.151156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:02.151650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:02.152096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:02.152793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:02.153259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:02.153720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:02.284663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:02.292356 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-55d61bbc-9cc6-47a3-96f5-823830c147ee tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.153385 Oct 26 06:05:02.292924 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3720/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:02 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:03.315399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:03.316035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:03.323862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:03.324368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:03.324845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:03.325579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:03.326055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:03.326503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:03.463348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:03.471492 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02b9fe9b-cb69-4207-b99e-ccf1361298a0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.160015 Oct 26 06:05:03.472071 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3729/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:03 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:04.018464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-c222ec98-5d37-4ab9-87cc-32ece37432a8 req-7c7ff28d-1deb-4724-bc37-37b8594fcc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a348958-ea39-41cc-abac-7a3e43fa94e2", "name": "network-vif-plugged", "status": "completed", "tag": "43e623c1-cf4e-4e8d-a109-6d5152fef398"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:04.029718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c222ec98-5d37-4ab9-87cc-32ece37432a8 req-7c7ff28d-1deb-4724-bc37-37b8594fcc8a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:04.030482 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c222ec98-5d37-4ab9-87cc-32ece37432a8 req-7c7ff28d-1deb-4724-bc37-37b8594fcc8a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:04.030923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-c222ec98-5d37-4ab9-87cc-32ece37432a8 req-7c7ff28d-1deb-4724-bc37-37b8594fcc8a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:04.042810 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-c222ec98-5d37-4ab9-87cc-32ece37432a8 req-7c7ff28d-1deb-4724-bc37-37b8594fcc8a service nova] Creating event network-vif-plugged:43e623c1-cf4e-4e8d-a109-6d5152fef398 for instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 on n-h2-862416-4 Oct 26 06:05:04.048003 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-c222ec98-5d37-4ab9-87cc-32ece37432a8 req-7c7ff28d-1deb-4724-bc37-37b8594fcc8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Oct 26 06:05:04.048657 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3721/7450] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:05:04.495111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:04.495750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:04.503003 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:04.503522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:04.503976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:04.504692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:04.505281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:04.505962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:04.644541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:04.652880 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bee234ac-7178-4c4d-beb7-8663ea15a65f tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1317 microversion: 2.1 time: 0.161835 Oct 26 06:05:04.653487 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3730/7451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:04 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:05.675299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:05.676053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:05.681020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:05.681759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:05.688678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:05.689161 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:05.689636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:05.690331 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:05.690790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:05.691220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:05.823353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:05.831629 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7a6aa16d-c675-4c7e-a4c9-4a2536f045f3 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1506 microversion: 2.1 time: 0.158157 Oct 26 06:05:05.832205 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3722/7452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:05 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:05.856657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:05.857180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:05.859198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:05.865393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:05.865902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:05.866369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:05.867082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:05.867561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:05.868011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:05.896906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:05:05.970698 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bd1dc72c-1c6e-420e-825f-ffdf960352e8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 204 len: 0 microversion: 2.1 time: 0.117681 Oct 26 06:05:05.971515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3731/7453] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:05:05 2022] DELETE /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:05:05.980138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:05.980765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:05.987036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:05.987523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:05.987967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:05.988667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:05.989137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:05.989609 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:06.118684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:06.126446 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-01f8df2c-f757-4a46-be9b-1bd0c21b8bfb tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1512 microversion: 2.1 time: 0.150613 Oct 26 06:05:06.127027 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3723/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:05 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:07.150884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:07.151605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:07.158190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:07.158695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:07.159148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:07.159852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:07.160330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:07.160773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:07.295501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:07.303315 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce306523-25b5-437c-b974-fa7939fdbcd0 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1512 microversion: 2.1 time: 0.157328 Oct 26 06:05:07.303892 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3732/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:07 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:07.834674 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d741db46-a97b-45cb-ba35-76635d1126cf req-9fe0f69a-c228-4e17-85ec-0bbef7559ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a348958-ea39-41cc-abac-7a3e43fa94e2", "name": "network-vif-deleted", "tag": "43e623c1-cf4e-4e8d-a109-6d5152fef398"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:07.845845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d741db46-a97b-45cb-ba35-76635d1126cf req-9fe0f69a-c228-4e17-85ec-0bbef7559ec2 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:07.846690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d741db46-a97b-45cb-ba35-76635d1126cf req-9fe0f69a-c228-4e17-85ec-0bbef7559ec2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:07.847341 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d741db46-a97b-45cb-ba35-76635d1126cf req-9fe0f69a-c228-4e17-85ec-0bbef7559ec2 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:07.861148 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d741db46-a97b-45cb-ba35-76635d1126cf req-9fe0f69a-c228-4e17-85ec-0bbef7559ec2 service nova] Creating event network-vif-deleted:43e623c1-cf4e-4e8d-a109-6d5152fef398 for instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 on n-h2-862416-4 Oct 26 06:05:07.871175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d741db46-a97b-45cb-ba35-76635d1126cf req-9fe0f69a-c228-4e17-85ec-0bbef7559ec2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040219 Oct 26 06:05:07.872035 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3724/7456] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:05:08.326932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:08.327571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:08.336009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:08.336511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:08.336968 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:08.337718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:08.338189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:08.338632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:08.371579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:08.372417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:08.372906 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:08.373417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lazy-loading 'fault' on Instance uuid 3a348958-ea39-41cc-abac-7a3e43fa94e2 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:05:08.414632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:08.421832 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-51f81f51-fae3-41cc-9281-8af2db7ca7a2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 200 len: 1307 microversion: 2.1 time: 0.099019 Oct 26 06:05:08.422415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3733/7457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:08 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:05:09.448012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:09.448717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:09.454842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.455328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.455769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.456456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.456915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.457378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.475843 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] HTTP exception thrown: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 HTTP/1.1 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3a348958-ea39-41cc-abac-7a3e43fa94e2'} Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:09.477522 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 404 to user: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-49ddad8d-b89e-41de-8590-cc1e915d5f71 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 404 len: 111 microversion: 2.1 time: 0.036725 Oct 26 06:05:09.482536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3725/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:09 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:05:09.488125 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:09.488752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:09.495758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.496257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.496713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.497451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.497953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.498400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.625684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:09.633971 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3040c069-6dc3-487a-8223-c35c4d178a14 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.149778 Oct 26 06:05:09.634550 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3734/7459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:09 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:09.658014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3435839e-2265-4660-acec-92acc7009384 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:09.660266 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3435839e-2265-4660-acec-92acc7009384 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: b504267f-1fd1-4349-869a-c027c33056c2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:09.666139 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3435839e-2265-4660-acec-92acc7009384 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] HTTP exception thrown: Instance b504267f-1fd1-4349-869a-c027c33056c2 could not be found. Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3435839e-2265-4660-acec-92acc7009384 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/b504267f-1fd1-4349-869a-c027c33056c2/action HTTP/1.1 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 32 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: {"resize": {"flavorRef": "452"}} Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance b504267f-1fd1-4349-869a-c027c33056c2 could not be found. Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'b504267f-1fd1-4349-869a-c027c33056c2', 'body': {'resize': {'flavorRef': '452'}}} Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b504267f-1fd1-4349-869a-c027c33056c2 could not be found. Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:05:09.667727 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b504267f-1fd1-4349-869a-c027c33056c2 could not be found. Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b504267f-1fd1-4349-869a-c027c33056c2 could not be found. Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3435839e-2265-4660-acec-92acc7009384 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 404 to user: Instance b504267f-1fd1-4349-869a-c027c33056c2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3435839e-2265-4660-acec-92acc7009384 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "POST /compute/v2.1/servers/b504267f-1fd1-4349-869a-c027c33056c2/action" status: 404 len: 111 microversion: 2.1 time: 0.015081 Oct 26 06:05:09.672936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3726/7460] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:05:09 2022] POST /compute/v2.1/servers/b504267f-1fd1-4349-869a-c027c33056c2/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:05:09.678211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:09.678859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:09.684725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.685227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.685718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.686424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.686893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.687335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.691472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:09.822840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:09.830572 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9945df40-ae65-4d7e-94c3-f7a178104cbc tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.156484 Oct 26 06:05:09.831146 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3735/7461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:09 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:09.855672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:09.856290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:09.863202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.863686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.864125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:09.865920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:09.866394 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:09.866832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.000726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:10.008488 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-de4c582b-2afa-4023-9b21-72eae6e8c135 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.156734 Oct 26 06:05:10.009065 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3727/7462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:09 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:10.031230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d8458d49-c7ee-4a34-b781-2b10175a5523"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:10.033448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.040161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.040663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.041129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.041868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.042342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.042787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.160154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:10.165968 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] HTTP exception thrown: Flavor d8458d49-c7ee-4a34-b781-2b10175a5523 could not be found. Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: request: POST /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974/action HTTP/1.1 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 65 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: {"resize": {"flavorRef": "d8458d49-c7ee-4a34-b781-2b10175a5523"}} Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: exception: Flavor d8458d49-c7ee-4a34-b781-2b10175a5523 could not be found. Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1ef4891d-884c-489a-b062-f2b766f7c974', 'body': {'resize': {'flavorRef': 'd8458d49-c7ee-4a34-b781-2b10175a5523'}}} Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:10.172740 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d8458d49-c7ee-4a34-b781-2b10175a5523 could not be found. Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d8458d49-c7ee-4a34-b781-2b10175a5523 could not be found. Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d8458d49-c7ee-4a34-b781-2b10175a5523 could not be found. Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 400 to user: Flavor d8458d49-c7ee-4a34-b781-2b10175a5523 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-82e01113-d377-430c-aef6-1e1e3ba712d2 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "POST /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974/action" status: 400 len: 107 microversion: 2.1 time: 0.147183 Oct 26 06:05:10.178403 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3736/7463] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:05:10 2022] POST /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974/action => generated 107 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 06:05:10.183706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.184338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.190384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.190882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.191337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.192071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.192541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.193636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.323869 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:10.331616 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b595194a-5cab-4695-8533-f6efd2502be6 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.151884 Oct 26 06:05:10.332196 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3728/7464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:10 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:10.356754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.357408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.363288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.363784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.364235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.366065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.366536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.366977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.503975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:10.512049 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47656ec7-4d7d-4ff0-844e-d59e1232657d tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.159073 Oct 26 06:05:10.512622 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3737/7465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:10 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:10.534236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2673c15d-7738-449d-b0ef-0addc249517e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2673c15d-7738-449d-b0ef-0addc249517e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: request: POST /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974/action HTTP/1.1 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 29 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: {"resize": {"flavorRef": ""}} Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '1ef4891d-884c-489a-b062-f2b766f7c974', 'body': {'resize': {'flavorRef': ''}}} Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise error Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi '' Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.538885 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2673c15d-7738-449d-b0ef-0addc249517e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2673c15d-7738-449d-b0ef-0addc249517e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "POST /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974/action" status: 400 len: 113 microversion: 2.1 time: 0.010009 Oct 26 06:05:10.543564 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3729/7466] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:05:10 2022] POST /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 06:05:10.548506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.549143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.555681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.556183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.556644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.557399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.557877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.558326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.686653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:10.694743 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6be12ee0-c5a4-4bf5-9a53-809919682265 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1506 microversion: 2.1 time: 0.149946 Oct 26 06:05:10.695327 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3738/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:10 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:10.722092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.722596 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.730526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.731030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.731473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.732182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.732650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.733090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.746088 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] HTTP exception thrown: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 HTTP/1.1 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3a348958-ea39-41cc-abac-7a3e43fa94e2'} Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:05:10.747655 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 404 to user: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-018fe867-799b-4829-8da0-c7d7097f0440 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 404 len: 111 microversion: 2.1 time: 0.031694 Oct 26 06:05:10.752451 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3730/7468] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:05:10 2022] DELETE /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:05:10.757617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.758281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 3a348958-ea39-41cc-abac-7a3e43fa94e2] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.764183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.764683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.765139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.765872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.766984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.767438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.781529 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] HTTP exception thrown: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 HTTP/1.1 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '3a348958-ea39-41cc-abac-7a3e43fa94e2'} Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:10.783070 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 404 to user: Instance 3a348958-ea39-41cc-abac-7a3e43fa94e2 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5c152216-c306-4ed3-8525-1f849c39cab8 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2" status: 404 len: 111 microversion: 2.1 time: 0.030833 Oct 26 06:05:10.788586 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3739/7469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:10 2022] GET /compute/v2.1/servers/3a348958-ea39-41cc-abac-7a3e43fa94e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:05:10.793413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.793930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.799810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.800306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.800754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.801497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.801962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.802542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.827597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:05:10.863021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:10.906456 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dfaa8c93-df61-4f35-aedd-21b9d0649c45 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 204 len: 0 microversion: 2.1 time: 0.116538 Oct 26 06:05:10.907039 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3731/7470] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:05:10 2022] DELETE /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 06:05:10.915591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:10.916234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:10.922363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.922891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.923373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:10.924075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:10.924545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:10.924986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:11.060742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:11.069069 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-795e9ebd-a329-42d2-8645-416798b30c84 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1512 microversion: 2.1 time: 0.157798 Oct 26 06:05:11.069743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3740/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:10 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:12.093228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:12.093968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:12.101754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:12.102248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:12.102690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:12.103385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:12.103845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:12.104275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:12.236144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:12.244549 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1acf2e98-2c87-4331-98f8-a84fe137ae9e tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1512 microversion: 2.1 time: 0.155586 Oct 26 06:05:12.245128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3732/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:12 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:12.811051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0cb68455-fcdc-4175-ba06-5b080e37abb3 req-717cf9a8-84f2-428e-aea9-12fe854d11d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef4891d-884c-489a-b062-f2b766f7c974", "name": "network-vif-deleted", "tag": "9afd93fb-b048-4079-8450-9654b269fba0"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:12.825290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:12.834435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0cb68455-fcdc-4175-ba06-5b080e37abb3 req-717cf9a8-84f2-428e-aea9-12fe854d11d9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:12.835443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0cb68455-fcdc-4175-ba06-5b080e37abb3 req-717cf9a8-84f2-428e-aea9-12fe854d11d9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:12.836106 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0cb68455-fcdc-4175-ba06-5b080e37abb3 req-717cf9a8-84f2-428e-aea9-12fe854d11d9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:12.851196 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0cb68455-fcdc-4175-ba06-5b080e37abb3 req-717cf9a8-84f2-428e-aea9-12fe854d11d9 service nova] Creating event network-vif-deleted:9afd93fb-b048-4079-8450-9654b269fba0 for instance 1ef4891d-884c-489a-b062-f2b766f7c974 on n-h1-862416-4 Oct 26 06:05:12.856816 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0cb68455-fcdc-4175-ba06-5b080e37abb3 req-717cf9a8-84f2-428e-aea9-12fe854d11d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049474 Oct 26 06:05:12.857686 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3741/7473] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:05:13.268084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:13.268624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:13.271051 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:05:13.271213 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 (ip 10.222.0.16) !!! Oct 26 06:05:13.278434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:13.278925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:13.279366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:13.280065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:13.280523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:13.280949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:13.321857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:13.322351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:13.322795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:13.323251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lazy-loading 'fault' on Instance uuid 1ef4891d-884c-489a-b062-f2b766f7c974 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:05:13.365173 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bac6a20c084723a006bb989ac9f79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181fdba7cbb46558480dc277ffb9452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:13.374618 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-190d38b1-c3d5-4dc7-8279-63ee80160501 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 200 len: 1307 microversion: 2.1 time: 0.110420 Oct 26 06:05:13.375623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3733/7474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:13 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:14.400449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:14.401158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] [instance: 1ef4891d-884c-489a-b062-f2b766f7c974] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:14.407351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:14.407846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:14.408294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:14.408989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:14.409493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:14.409931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:14.423299 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] HTTP exception thrown: Instance 1ef4891d-884c-489a-b062-f2b766f7c974 could not be found. Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Request method failure captured: Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 HTTP/1.1 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM34d3OTrLjn5nB3th7inPSJ7IeS4XTh3tHfzJiu18lVNpgkYazFrQjvA2-MVz8RAGy2zIevGBsXxAJHYA1qd06c4QOSfoO-EqLoBDFXCDjyhB7KdRfx7-PwaEK8GD3W31w_WQFevvLlZsUtMrJRkxq7FLJtve_mpJcIZdpUoda9ZNk Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b181fdba7cbb46558480dc277ffb9452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: b181fdba7cbb46558480dc277ffb9452 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1908511798 Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 28bac6a20c084723a006bb989ac9f79f Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-ServersNegativeTestJSON-1908511798-project Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 1ef4891d-884c-489a-b062-f2b766f7c974 could not be found. Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '1ef4891d-884c-489a-b062-f2b766f7c974'} Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef4891d-884c-489a-b062-f2b766f7c974 could not be found. Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef4891d-884c-489a-b062-f2b766f7c974 could not be found. Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:05:14.424917 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef4891d-884c-489a-b062-f2b766f7c974 could not be found. Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] Returning 404 to user: Instance 1ef4891d-884c-489a-b062-f2b766f7c974 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4d226f9-4e68-40af-9514-4ef4e56fb852 tempest-ServersNegativeTestJSON-1908511798 tempest-ServersNegativeTestJSON-1908511798-project] 10.222.0.16 "GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974" status: 404 len: 111 microversion: 2.1 time: 0.031185 Oct 26 06:05:14.430875 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3742/7475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:14 2022] GET /compute/v2.1/servers/1ef4891d-884c-489a-b062-f2b766f7c974 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:05:45.582887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:45.583641 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:45.756672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5de1aac0-d2d6-46dd-b999-9532798b0d2f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: .version_select at 0x7f47098ab280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-532662349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/zmoC+Q7q+MGMglddkYMY1d5TM9L4Cu076oEQAwcmCVjuqJ5IXXSwK2Vly+/U41BG8aHHg8w2jhfC7hiq7xIW+LYV1ES6A9rcghLwBFQ1nPQUCbodzIBhtKugAdCRx2A=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:45.774436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5de1aac0-d2d6-46dd-b999-9532798b0d2f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for project 6ab836d6beb5471495f26f0810429a8f. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:05:45.783483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-5de1aac0-d2d6-46dd-b999-9532798b0d2f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for user 567d5a976bd44ca18d91d54f353af31b and project 6ab836d6beb5471495f26f0810429a8f. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:05:45.811532 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5de1aac0-d2d6-46dd-b999-9532798b0d2f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.233818 Oct 26 06:05:45.813592 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3734/7476] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:05:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:05:45.870374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1593061128", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-532662349", "networks": [{"uuid": "0d7aaefc-d48c-472f-9502-0f6c05ae86c5"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:45.879530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:45.880367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=32 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:45.935016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] validate_networks() for [('0d7aaefc-d48c-472f-9502-0f6c05ae86c5', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:05:46.368701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:05:46.369143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:05:46.369662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:05:46.370089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:05:46.370517 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:05:46.379698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:46.380196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:46.380655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:46.381971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:46.382479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:46.382924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:46.401447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for project 6ab836d6beb5471495f26f0810429a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:05:46.406785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for user 567d5a976bd44ca18d91d54f353af31b and project 6ab836d6beb5471495f26f0810429a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:05:46.419061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:05:46.421474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:05:46.468952 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-23991075-3703-481a-b0da-f3dd1b6a9978 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603899 Oct 26 06:05:46.469646 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3743/7477] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:05:46.481560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-47fb6df9-ee53-4548-b0e3-6eb8b5efde0c tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:46.482116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-47fb6df9-ee53-4548-b0e3-6eb8b5efde0c tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:46.539141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-47fb6df9-ee53-4548-b0e3-6eb8b5efde0c tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:46.546200 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-47fb6df9-ee53-4548-b0e3-6eb8b5efde0c tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1262 microversion: 2.1 time: 0.068715 Oct 26 06:05:46.546775 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3735/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:46 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:05:47.571789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:47.572584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:47.579775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:47.580421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:47.580890 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:47.583786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:47.585262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:47.585412 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:47.665237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:47.675162 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c811adb4-4cf4-4cfb-9a8d-20fb26332af8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1322 microversion: 2.1 time: 0.109148 Oct 26 06:05:47.675772 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3744/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:47 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:48.707185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:48.711729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:48.723228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:48.724014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:48.725348 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:48.726276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:48.726746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:48.727188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:48.882961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:48.891569 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e94df42c-bca8-4da4-a4eb-f80b8f2bda7f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.192923 Oct 26 06:05:48.892469 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3736/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:48 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:49.501747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cba84885-41ce-44f7-b145-bd2eb95370e8 req-eec30034-3df3-4e43-8349-1c3b3af4c918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f", "tag": "883ebcde-aff3-4335-94d7-fb7e3f156765"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:49.523478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cba84885-41ce-44f7-b145-bd2eb95370e8 req-eec30034-3df3-4e43-8349-1c3b3af4c918 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:49.524308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cba84885-41ce-44f7-b145-bd2eb95370e8 req-eec30034-3df3-4e43-8349-1c3b3af4c918 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:49.524941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cba84885-41ce-44f7-b145-bd2eb95370e8 req-eec30034-3df3-4e43-8349-1c3b3af4c918 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:49.538332 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cba84885-41ce-44f7-b145-bd2eb95370e8 req-eec30034-3df3-4e43-8349-1c3b3af4c918 service nova] Creating event network-changed:883ebcde-aff3-4335-94d7-fb7e3f156765 for instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f on n-h1-862416-4 Oct 26 06:05:49.543480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cba84885-41ce-44f7-b145-bd2eb95370e8 req-eec30034-3df3-4e43-8349-1c3b3af4c918 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138563 Oct 26 06:05:49.544429 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3745/7481] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:05:49.917116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:49.918027 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:49.924861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:49.925386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:49.925834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:49.926539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:49.927010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:49.927440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:50.061298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:50.069991 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f7a59af-dc59-4ae9-88d0-94389607a9ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.156906 Oct 26 06:05:50.070586 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3737/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:49 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:51.093722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:51.094462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:51.102828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:51.103327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:51.103781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:51.104496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:51.104959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:51.105429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:51.244320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:51.253098 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-defd938b-ba49-41ef-8d04-b293bba23895 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.163370 Oct 26 06:05:51.261654 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3746/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:51 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:52.277350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:52.277750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:52.284251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:52.284745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:52.285193 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:52.285921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:52.286388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:52.286824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:52.415640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:52.423383 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-39131c96-3696-4a8c-b733-ad50c437e83a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.150579 Oct 26 06:05:52.423957 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3738/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:52 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:05:53.446320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:53.446984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:53.453819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:53.454318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:53.455067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:53.455778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:53.456249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:53.456696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:53.588620 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:53.596288 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c23fbea5-8a1c-4a40-8493-57213aebd4d1 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.153937 Oct 26 06:05:53.596876 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3747/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:53 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:54.620110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:54.620668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:54.627504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:54.627999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:54.628447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:54.629159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:54.629657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:54.630097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:54.770106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:54.777944 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a97d3ee3-af9f-4e26-b1c3-66c297b3d23e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.161943 Oct 26 06:05:54.778523 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3739/7486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:54 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:55.083395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-cc36233a-84c5-4512-beba-bb4e34d53b93 req-a7ac1657-604a-4055-92dc-d9fc07de37fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f", "name": "network-vif-plugged", "status": "completed", "tag": "883ebcde-aff3-4335-94d7-fb7e3f156765"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:55.093988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cc36233a-84c5-4512-beba-bb4e34d53b93 req-a7ac1657-604a-4055-92dc-d9fc07de37fb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:55.094482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cc36233a-84c5-4512-beba-bb4e34d53b93 req-a7ac1657-604a-4055-92dc-d9fc07de37fb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:55.094924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-cc36233a-84c5-4512-beba-bb4e34d53b93 req-a7ac1657-604a-4055-92dc-d9fc07de37fb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:55.106350 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-cc36233a-84c5-4512-beba-bb4e34d53b93 req-a7ac1657-604a-4055-92dc-d9fc07de37fb service nova] Creating event network-vif-plugged:883ebcde-aff3-4335-94d7-fb7e3f156765 for instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f on n-h1-862416-4 Oct 26 06:05:55.111329 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-cc36233a-84c5-4512-beba-bb4e34d53b93 req-a7ac1657-604a-4055-92dc-d9fc07de37fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090572 Oct 26 06:05:55.111909 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3748/7487] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:05:55.801053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:55.801704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:55.808666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:55.809174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:55.809645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:55.810346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:55.810810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:55.811245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:55.941200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:55.948925 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30464ed5-aa2e-4bd5-9325-1f2b25024758 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1362 microversion: 2.1 time: 0.151770 Oct 26 06:05:55.949528 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3740/7488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:55 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:56.971286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:56.972175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:56.977598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:56.978310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:56.985194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:56.985712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:56.986164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:56.986864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:56.987329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:56.987768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:57.121714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:57.129699 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-69614f29-9a4a-450f-99a0-2ca1c3b36e06 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1555 microversion: 2.1 time: 0.160246 Oct 26 06:05:57.130359 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3749/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:56 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:57.152796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:05:57.153460 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:57.155356 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:05:57.161537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:57.162670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:57.163121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:57.163826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:57.164296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:57.164734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:57.298936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:05:57.307039 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f2173e8b-630d-4c97-8ff8-9bcee561c3e3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1555 microversion: 2.1 time: 0.158207 Oct 26 06:05:57.307630 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3741/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:05:57 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:05:58.982946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b019f0ac-69a4-47a2-85be-c164ed9158b0"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:05:58.985423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:05:58.993050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:58.993587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:58.994036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:58.994734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:05:58.995201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:05:58.995639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:05:59.239058 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b56ba490-2ad8-479f-b775-c88541733ff7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259801 Oct 26 06:05:59.239669 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3750/7491] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 06:05:58 2022] POST /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:09.981417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:09.981919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:09.984034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:09.984842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:09.991957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:09.992446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:09.992888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:09.993616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:09.994074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:09.994506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:10.075367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lazy-loading 'services' on Instance uuid 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:06:10.149978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1aab5f8b-e68a-4077-8cf3-a5eaf2ef1ce7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments/b019f0ac-69a4-47a2-85be-c164ed9158b0" status: 202 len: 0 microversion: 2.1 time: 0.172597 Oct 26 06:06:10.150613 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3742/7492] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:06:09 2022] DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments/b019f0ac-69a4-47a2-85be-c164ed9158b0 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:06:10.157654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:10.158475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:10.163797 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:10.166271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:10.174351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:10.174859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:10.175322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:10.176077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:10.176555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:10.177006 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:10.214033 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-546620c6-0944-439d-bd3c-18b4b2ee1e43 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058353 Oct 26 06:06:10.214620 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3751/7493] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:10 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:11.228717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:11.231153 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:11.237446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:11.237943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:11.238393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:11.239091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:11.239551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:11.239983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:11.271614 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-458cfc24-85e9-4074-a901-72c8343821b0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 Oct 26 06:06:11.272191 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3743/7494] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:11 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:12.284207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:12.286495 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:12.293946 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:12.294447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:12.294931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:12.295641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:12.296111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:12.296549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:12.326334 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee90c66b-3624-4e87-97be-da70f8af42c0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Oct 26 06:06:12.326887 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3752/7495] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:12 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:13.339219 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:13.341722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:13.348561 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:13.349054 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:13.349529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:13.350239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:13.351205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:13.351631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:13.381994 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68350ac6-ee33-4126-81ec-83ef725a2d12 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Oct 26 06:06:13.386680 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3744/7496] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:13 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:14.394645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:14.396872 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:14.404468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:14.404962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:14.405442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:14.406149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:14.406614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:14.407056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:14.438012 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-aa018844-9597-4115-a91d-183a128e43e6 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Oct 26 06:06:14.439204 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3753/7497] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:14 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:15.451587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:15.453825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:15.461743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:15.462241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:15.462713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:15.463413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:15.463880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:15.464313 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:15.493015 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-90274025-50e7-4ec5-9a07-37ed46656528 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045446 Oct 26 06:06:15.493616 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3745/7498] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:15 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 06:06:15.504676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:15.505177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:15.512559 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:15.513139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:15.513677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:15.514437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:15.514956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:15.515443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:15.593745 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] HTTP exception thrown: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f is not attached to volume b019f0ac-69a4-47a2-85be-c164ed9158b0 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Request method failure captured: Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments/b019f0ac-69a4-47a2-85be-c164ed9158b0 HTTP/1.1 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM40WbeqPlkOZmNJC6-9-6UfOCs5bast2xJYxkh6lEaVUDro5w_owBC23K1MvXa9pfTJCduiJMPcBkSQaHikc6KtXgFWzht0kiPQPVvc8JxvuY8xTVupPCPUPc712B0TVPzAu7Ll1ybL5l6k7Vq537gj8eMjPByhxbjBuUAMO7Un5b0 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 567d5a976bd44ca18d91d54f353af31b Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f is not attached to volume b019f0ac-69a4-47a2-85be-c164ed9158b0 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': '5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f', 'id': 'b019f0ac-69a4-47a2-85be-c164ed9158b0'} Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b019f0ac-69a4-47a2-85be-c164ed9158b0. Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f is not attached to volume b019f0ac-69a4-47a2-85be-c164ed9158b0 Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:15.602020 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f is not attached to volume b019f0ac-69a4-47a2-85be-c164ed9158b0 Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Returning 404 to user: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f is not attached to volume b019f0ac-69a4-47a2-85be-c164ed9158b0 {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88a154e8-89d6-4861-9695-08c8af4acd47 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments/b019f0ac-69a4-47a2-85be-c164ed9158b0" status: 404 len: 154 microversion: 2.1 time: 0.102896 Oct 26 06:06:15.606854 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3754/7499] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:06:15 2022] DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f/os-volume_attachments/b019f0ac-69a4-47a2-85be-c164ed9158b0 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:06:18.950461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:18.951091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:18.958276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:18.958777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:18.959220 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:18.961238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:18.961767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:18.962207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:18.992360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:06:19.072396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6f203a48-2b31-438d-bf7e-ab4f779f8c19 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 204 len: 0 microversion: 2.1 time: 0.125669 Oct 26 06:06:19.073147 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3746/7500] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:06:18 2022] DELETE /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:06:19.083144 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:19.083744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:19.092375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:19.092873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:19.093349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:19.094075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:19.094546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:19.094986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:19.227926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:19.235978 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24ca20ab-55a3-47c3-826f-f623c0d8bc27 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1561 microversion: 2.1 time: 0.158206 Oct 26 06:06:19.236555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3755/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:19 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:20.260894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:20.261634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:20.268595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:20.269095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:20.269565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:20.270262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:20.270726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:20.271156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:20.410300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:20.418190 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d7ac6135-f5e9-48f2-be5c-62ecdce973ca tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1561 microversion: 2.1 time: 0.161972 Oct 26 06:06:20.418773 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3747/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:20 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:21.150565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-9574e522-de38-47da-acda-0b2ca01974e9 req-7fb63871-cdd5-4436-86ad-8a109bb4fb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f", "name": "network-vif-deleted", "tag": "883ebcde-aff3-4335-94d7-fb7e3f156765"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:21.161290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9574e522-de38-47da-acda-0b2ca01974e9 req-7fb63871-cdd5-4436-86ad-8a109bb4fb07 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:21.161815 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9574e522-de38-47da-acda-0b2ca01974e9 req-7fb63871-cdd5-4436-86ad-8a109bb4fb07 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:21.162276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-9574e522-de38-47da-acda-0b2ca01974e9 req-7fb63871-cdd5-4436-86ad-8a109bb4fb07 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:21.174670 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-9574e522-de38-47da-acda-0b2ca01974e9 req-7fb63871-cdd5-4436-86ad-8a109bb4fb07 service nova] Creating event network-vif-deleted:883ebcde-aff3-4335-94d7-fb7e3f156765 for instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f on n-h1-862416-4 Oct 26 06:06:21.180609 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-9574e522-de38-47da-acda-0b2ca01974e9 req-7fb63871-cdd5-4436-86ad-8a109bb4fb07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034261 Oct 26 06:06:21.181195 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3756/7503] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:21.442016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:21.442636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:21.450197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:21.450689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:21.451131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:21.451826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:21.452285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:21.452711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:21.484988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:21.485515 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:21.485956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:21.486407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lazy-loading 'fault' on Instance uuid 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:06:21.527640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:21.535323 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e659cebd-d266-4825-9932-c95239a8f0f8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 200 len: 1352 microversion: 2.1 time: 0.097251 Oct 26 06:06:21.535895 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3748/7504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:21 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:22.560960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:22.561711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:22.567936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:22.568464 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:22.568925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:22.570252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:22.570771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:22.571211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:22.584365 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] HTTP exception thrown: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f could not be found. Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Request method failure captured: Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f HTTP/1.1 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM40WbeqPlkOZmNJC6-9-6UfOCs5bast2xJYxkh6lEaVUDro5w_owBC23K1MvXa9pfTJCduiJMPcBkSQaHikc6KtXgFWzht0kiPQPVvc8JxvuY8xTVupPCPUPc712B0TVPzAu7Ll1ybL5l6k7Vq537gj8eMjPByhxbjBuUAMO7Un5b0 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 567d5a976bd44ca18d91d54f353af31b Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f could not be found. Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f'} Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f could not be found. Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f could not be found. Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:22.586283 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f could not be found. Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Returning 404 to user: Instance 5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f4525ad-07ad-47b2-8f81-a61d2933b51a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f" status: 404 len: 111 microversion: 2.1 time: 0.031947 Oct 26 06:06:22.591104 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3757/7505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:22 2022] GET /compute/v2.1/servers/5e29ad7c-57e2-4d4d-b2e9-b1277c88c55f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:06:22.596489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7c7d0a5c-105e-4110-88f3-1f111e5d670e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '.version_select at 0x7f47093071f0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:22.617692 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7c7d0a5c-105e-4110-88f3-1f111e5d670e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-532662349" status: 202 len: 0 microversion: 2.1 time: 0.024914 Oct 26 06:06:22.618475 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3749/7506] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 06:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-532662349 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:06:22.637280 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10bd26b9-85c3-496e-b018-a85fb8a01713 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: .version_select at 0x7f4709a56d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1948557187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWuH3UXFl5y8wMy3d63D8StSTPGBEeGcNS3SiB+itScZqB85D5dIAchNQb5kSYpzvgKWTtBk1x7nfzL9Ij4GKr7SViQ1Uh6RvoPGV8SBTtymH7icVtf+YpGpUn1Rr1eZQ=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:22.653452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-10bd26b9-85c3-496e-b018-a85fb8a01713 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for project 6ab836d6beb5471495f26f0810429a8f. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:06:22.659406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-10bd26b9-85c3-496e-b018-a85fb8a01713 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for user 567d5a976bd44ca18d91d54f353af31b and project 6ab836d6beb5471495f26f0810429a8f. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:06:22.682359 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10bd26b9-85c3-496e-b018-a85fb8a01713 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049593 Oct 26 06:06:22.682948 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3758/7507] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:06:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:22.734194 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1935203724", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1948557187", "networks": [{"uuid": "0d7aaefc-d48c-472f-9502-0f6c05ae86c5"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:22.787419 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] validate_networks() for [('0d7aaefc-d48c-472f-9502-0f6c05ae86c5', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:06:23.204816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:06:23.205254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:06:23.205768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:06:23.206188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:06:23.206612 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:06:23.217270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:23.217813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:23.218256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:23.218995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:23.219456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:23.219887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:23.236980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for project 6ab836d6beb5471495f26f0810429a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:06:23.242250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for user 567d5a976bd44ca18d91d54f353af31b and project 6ab836d6beb5471495f26f0810429a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:06:23.254375 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:06:23.256672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:06:23.306191 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ce551fbc-49d1-420a-8fdb-47f59994350a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575928 Oct 26 06:06:23.306948 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3750/7508] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:06:23.318090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a38479e-7448-4bcb-b43f-afe67edcfe94 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:23.318713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a38479e-7448-4bcb-b43f-afe67edcfe94 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:23.373011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3a38479e-7448-4bcb-b43f-afe67edcfe94 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:23.379804 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a38479e-7448-4bcb-b43f-afe67edcfe94 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1263 microversion: 2.1 time: 0.065612 Oct 26 06:06:23.380373 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3759/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:23 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:24.405795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:24.407211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:24.415402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:24.416198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:24.416837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:24.417796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:24.418452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:24.419084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:24.490613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:24.499360 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ca9433b1-58b0-4e77-84fa-27a552b2b3db tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1323 microversion: 2.1 time: 0.098184 Oct 26 06:06:24.501755 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3751/7510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:24 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:25.524348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:25.525654 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:25.532529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:25.533021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:25.533503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:25.534214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:25.534674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:25.535317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:25.671273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:25.680481 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b6eb20e9-213d-4ff6-99d4-f0b5a6430c82 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1363 microversion: 2.1 time: 0.161361 Oct 26 06:06:25.681073 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3760/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:25 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:25.731043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-25d1f033-c793-437b-8ee4-5374be10501d req-08bdb60e-a43e-4250-820e-e9d69e9df741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4f161d-2ea7-469b-ae3a-feb79393ccde", "tag": "d5b8d218-f57a-47d1-adfe-dfa463b8f5f1"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:25.743013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-25d1f033-c793-437b-8ee4-5374be10501d req-08bdb60e-a43e-4250-820e-e9d69e9df741 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:25.743630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-25d1f033-c793-437b-8ee4-5374be10501d req-08bdb60e-a43e-4250-820e-e9d69e9df741 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:25.744168 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-25d1f033-c793-437b-8ee4-5374be10501d req-08bdb60e-a43e-4250-820e-e9d69e9df741 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:25.755729 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-25d1f033-c793-437b-8ee4-5374be10501d req-08bdb60e-a43e-4250-820e-e9d69e9df741 service nova] Creating event network-changed:d5b8d218-f57a-47d1-adfe-dfa463b8f5f1 for instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde on n-h1-862416-4 Oct 26 06:06:25.760814 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-25d1f033-c793-437b-8ee4-5374be10501d req-08bdb60e-a43e-4250-820e-e9d69e9df741 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033623 Oct 26 06:06:25.761785 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3752/7512] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:26.704769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:26.705328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:26.713643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:26.714142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:26.714592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:26.715293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:26.715763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:26.716203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:26.843162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:26.851201 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4f2e8deb-a0dd-46c7-bb62-f7aebd77763a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1363 microversion: 2.1 time: 0.150383 Oct 26 06:06:26.851784 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3761/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:26 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:27.875614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:27.876321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:27.882562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:27.883144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:27.883606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:27.884305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:27.884770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:27.885204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:28.021820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:28.030298 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c5a2fd7-f002-464e-b58b-0455c3b24494 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1363 microversion: 2.1 time: 0.159745 Oct 26 06:06:28.030859 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3753/7514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:27 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:29.054139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:29.054765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:29.061641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:29.062143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:29.062596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:29.063300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:29.063770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:29.064211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:29.194852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:29.203174 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ce00290f-0c30-4450-ada2-8eff05a6a6ba tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1363 microversion: 2.1 time: 0.153020 Oct 26 06:06:29.203754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3762/7515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:29 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:30.227752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:30.228360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:30.235430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:30.235933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:30.236380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:30.237095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:30.237601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:30.238042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:30.378864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:30.387448 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e7c61cfe-66c7-4955-b6cb-0da5884808ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1363 microversion: 2.1 time: 0.164324 Oct 26 06:06:30.388052 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3754/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:30 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:31.216851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-dd73e1b2-bcf2-4316-9170-f131ae0a8350 req-da7eb321-bbef-4191-adc0-bd8943bfd9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4f161d-2ea7-469b-ae3a-feb79393ccde", "name": "network-vif-plugged", "status": "completed", "tag": "d5b8d218-f57a-47d1-adfe-dfa463b8f5f1"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:31.228072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd73e1b2-bcf2-4316-9170-f131ae0a8350 req-da7eb321-bbef-4191-adc0-bd8943bfd9c6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:31.229390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd73e1b2-bcf2-4316-9170-f131ae0a8350 req-da7eb321-bbef-4191-adc0-bd8943bfd9c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:31.229878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd73e1b2-bcf2-4316-9170-f131ae0a8350 req-da7eb321-bbef-4191-adc0-bd8943bfd9c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:31.241489 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-dd73e1b2-bcf2-4316-9170-f131ae0a8350 req-da7eb321-bbef-4191-adc0-bd8943bfd9c6 service nova] Creating event network-vif-plugged:d5b8d218-f57a-47d1-adfe-dfa463b8f5f1 for instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde on n-h1-862416-4 Oct 26 06:06:31.246516 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-dd73e1b2-bcf2-4316-9170-f131ae0a8350 req-da7eb321-bbef-4191-adc0-bd8943bfd9c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Oct 26 06:06:31.247113 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3763/7517] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:31.411120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:31.411656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:31.418624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:31.419123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:31.419572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:31.420283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:31.420752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:31.421192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:31.552957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:31.561702 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-545d4d85-251a-46ce-a209-114e1072aec5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1363 microversion: 2.1 time: 0.154526 Oct 26 06:06:31.562223 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3755/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:31 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:32.587355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:32.588163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:32.595641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:32.596258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:32.596765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:32.597721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:32.599294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:32.599715 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:32.738553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:32.746462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d544eb28-9fcd-4587-a5dc-2f70b829a88a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1556 microversion: 2.1 time: 0.165075 Oct 26 06:06:32.747159 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3764/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:32 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:32.770086 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:32.770843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:32.778474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:32.778973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:32.779451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:32.780159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:32.780625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:32.781062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:32.916280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:32.924086 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3aad5bdf-2fee-4980-92ce-636c0251071a tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1556 microversion: 2.1 time: 0.158146 Oct 26 06:06:32.924668 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3756/7520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:32 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:34.432707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1cec52a-833f-4c9c-b319-79ef29f4f81e"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:34.435246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:34.437344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:34.443739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:34.444238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:34.444684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:34.447338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:34.447817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:34.448262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:34.688930 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5be6916-57d7-4c2f-a11d-d24fb9f8c4f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260524 Oct 26 06:06:34.689592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3765/7521] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 06:06:34 2022] POST /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:45.411999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:45.412607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:45.415385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:45.416068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:45.416829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:45.417537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:45.424294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:45.424801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:45.425254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:45.425991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:45.426462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:45.426906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:45.512631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lazy-loading 'services' on Instance uuid 5e4f161d-2ea7-469b-ae3a-feb79393ccde {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:06:45.583904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b067cbec-e08e-4e9e-b0b5-16d874358614 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments/e1cec52a-833f-4c9c-b319-79ef29f4f81e" status: 202 len: 0 microversion: 2.1 time: 0.175869 Oct 26 06:06:45.584490 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3757/7522] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:06:45 2022] DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments/e1cec52a-833f-4c9c-b319-79ef29f4f81e => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:06:45.594880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:45.597509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:45.600526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:45.601561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:06:45.608694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:45.609199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:45.609679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:45.610397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:45.610869 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:45.611317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:45.649476 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44f67946-b8db-449e-be26-103926e77488 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059867 Oct 26 06:06:45.650086 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3766/7523] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:45 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:46.663105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:46.665657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:46.672784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:46.673378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:46.673835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:46.674549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:46.675017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:46.675459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:46.707212 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-28638058-92c8-4ec6-b499-459eb4781da9 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048474 Oct 26 06:06:46.707683 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3758/7524] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:46 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:47.720073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:47.722324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:47.729368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:47.729878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:47.730337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:47.731055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:47.731533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:47.731982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:47.762681 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-24c298c9-acb9-48e7-bfb8-855392ae6464 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046587 Oct 26 06:06:47.763255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3767/7525] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:47 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:48.775514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:48.777747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:48.784517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:48.784991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:48.785459 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:48.786154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:48.786825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:48.787269 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:48.817723 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7daae94a-d948-4f2e-92ec-70da9068e129 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 Oct 26 06:06:48.818293 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3759/7526] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:48 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:49.831152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:49.833554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:49.841397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:49.841971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:49.842496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:49.843307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:49.843817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:49.844468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:49.875660 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88ff04d6-faf9-432f-805a-0205f789b4e2 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048574 Oct 26 06:06:49.876233 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3768/7527] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:49 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:50.889236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:50.891449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:50.898479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:50.898965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:50.899405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:50.901259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:50.901747 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:50.902179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:50.934223 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-75921190-e4b2-4adc-927c-cc007826d36f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049929 Oct 26 06:06:50.934853 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3760/7528] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:06:50 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 26 06:06:50.945587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:50.946136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:50.953413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:50.953930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:50.954374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:50.955074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:50.955548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:50.955992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:51.031088 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] HTTP exception thrown: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde is not attached to volume e1cec52a-833f-4c9c-b319-79ef29f4f81e Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Request method failure captured: Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: request: DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments/e1cec52a-833f-4c9c-b319-79ef29f4f81e HTTP/1.1 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM40WbeqPlkOZmNJC6-9-6UfOCs5bast2xJYxkh6lEaVUDro5w_owBC23K1MvXa9pfTJCduiJMPcBkSQaHikc6KtXgFWzht0kiPQPVvc8JxvuY8xTVupPCPUPc712B0TVPzAu7Ll1ybL5l6k7Vq537gj8eMjPByhxbjBuUAMO7Un5b0 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 567d5a976bd44ca18d91d54f353af31b Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde is not attached to volume e1cec52a-833f-4c9c-b319-79ef29f4f81e Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'server_id': '5e4f161d-2ea7-469b-ae3a-feb79393ccde', 'id': 'e1cec52a-833f-4c9c-b319-79ef29f4f81e'} Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e1cec52a-833f-4c9c-b319-79ef29f4f81e. Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde is not attached to volume e1cec52a-833f-4c9c-b319-79ef29f4f81e Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:51.032752 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde is not attached to volume e1cec52a-833f-4c9c-b319-79ef29f4f81e Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Returning 404 to user: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde is not attached to volume e1cec52a-833f-4c9c-b319-79ef29f4f81e {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4b08a87a-fb6b-4665-9a28-485a596d1983 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments/e1cec52a-833f-4c9c-b319-79ef29f4f81e" status: 404 len: 154 microversion: 2.1 time: 0.092798 Oct 26 06:06:51.038024 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3769/7529] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:06:50 2022] DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde/os-volume_attachments/e1cec52a-833f-4c9c-b319-79ef29f4f81e => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:06:54.382483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:54.383141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:54.391918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:54.392415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:54.392861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:54.393607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:54.394069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:54.394496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:54.423648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:06:54.506175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2429f4f5-cde3-4e5b-a404-840e8742ce5b tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 204 len: 0 microversion: 2.1 time: 0.127321 Oct 26 06:06:54.506936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3761/7530] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:06:54 2022] DELETE /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:06:54.515740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:54.516322 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:54.526266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:54.526759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:54.527223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:54.527945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:54.528418 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:54.528863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:54.663154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:54.671120 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-248eba98-f57d-4a22-96b2-c1371ef022ce tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1562 microversion: 2.1 time: 0.159296 Oct 26 06:06:54.671633 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3770/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:54 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:55.695924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:55.696703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:55.703559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:55.704306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:55.704768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:55.705498 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:55.705985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:55.706415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:55.839277 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:55.847905 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bebb817e-b279-4c86-9099-382eeb38fbc4 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1562 microversion: 2.1 time: 0.156842 Oct 26 06:06:55.848484 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3762/7532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:55 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:56.595443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4c67647f-127d-4294-b054-afb5a47859de req-0b98b396-6c3d-411b-a48b-29cdec2802ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4f161d-2ea7-469b-ae3a-feb79393ccde", "name": "network-vif-deleted", "tag": "d5b8d218-f57a-47d1-adfe-dfa463b8f5f1"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:56.607050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4c67647f-127d-4294-b054-afb5a47859de req-0b98b396-6c3d-411b-a48b-29cdec2802ea service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:56.607557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4c67647f-127d-4294-b054-afb5a47859de req-0b98b396-6c3d-411b-a48b-29cdec2802ea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:56.608009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4c67647f-127d-4294-b054-afb5a47859de req-0b98b396-6c3d-411b-a48b-29cdec2802ea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:56.623160 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4c67647f-127d-4294-b054-afb5a47859de req-0b98b396-6c3d-411b-a48b-29cdec2802ea service nova] Creating event network-vif-deleted:d5b8d218-f57a-47d1-adfe-dfa463b8f5f1 for instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde on n-h1-862416-4 Oct 26 06:06:56.628175 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4c67647f-127d-4294-b054-afb5a47859de req-0b98b396-6c3d-411b-a48b-29cdec2802ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036823 Oct 26 06:06:56.628784 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3771/7533] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:06:56.872204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:56.872763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:56.879570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:56.880056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:56.880501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:56.881199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:56.881691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:56.882114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:56.914456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:56.914937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:56.915825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:56.916280 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lazy-loading 'fault' on Instance uuid 5e4f161d-2ea7-469b-ae3a-feb79393ccde {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:06:56.956256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:56.965131 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9324db7b-7453-48df-a773-249925505fa5 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 200 len: 1353 microversion: 2.1 time: 0.097357 Oct 26 06:06:56.965692 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3763/7534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:56 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 1353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:06:57.989728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:57.990443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: 5e4f161d-2ea7-469b-ae3a-feb79393ccde] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:57.997220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:57.997748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:57.998201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:57.998899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:57.999368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:57.999808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:58.013521 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] HTTP exception thrown: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde could not be found. Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Request method failure captured: Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde HTTP/1.1 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWM40WbeqPlkOZmNJC6-9-6UfOCs5bast2xJYxkh6lEaVUDro5w_owBC23K1MvXa9pfTJCduiJMPcBkSQaHikc6KtXgFWzht0kiPQPVvc8JxvuY8xTVupPCPUPc712B0TVPzAu7Ll1ybL5l6k7Vq537gj8eMjPByhxbjBuUAMO7Un5b0 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 567d5a976bd44ca18d91d54f353af31b Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde could not be found. Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '5e4f161d-2ea7-469b-ae3a-feb79393ccde'} Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde could not be found. Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde could not be found. Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:58.015171 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde could not be found. Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Returning 404 to user: Instance 5e4f161d-2ea7-469b-ae3a-feb79393ccde could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-484a0dc7-bfa3-4d07-99ac-c867b9cf1f00 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde" status: 404 len: 111 microversion: 2.1 time: 0.032002 Oct 26 06:06:58.020585 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3772/7535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:57 2022] GET /compute/v2.1/servers/5e4f161d-2ea7-469b-ae3a-feb79393ccde => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:06:58.026128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e37ae7a6-c886-4eda-bfe9-409c0b05f3d7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '.version_select at 0x7f4709b7c4c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:58.046028 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e37ae7a6-c886-4eda-bfe9-409c0b05f3d7 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1948557187" status: 202 len: 0 microversion: 2.1 time: 0.024288 Oct 26 06:06:58.046607 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3764/7536] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 26 06:06:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1948557187 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:06:58.064308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-39e36979-3609-4a30-b278-0345269e8cec tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: .version_select at 0x7f470eb63040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-692749703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/q1Gw68McBoSna0HK7d1ZYTfEPCpj6C8tBaGQGm5gbAvTHrGtim/y/FL65GtLtbk8N7lSjK8R3pXv+5Of3SWuq1XYvb3FuLRqkvpP+KDXMEsAn7LNWjPGqfGatsu1cXw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:58.080398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-39e36979-3609-4a30-b278-0345269e8cec tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for project 6ab836d6beb5471495f26f0810429a8f. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:06:58.086509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-39e36979-3609-4a30-b278-0345269e8cec tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for user 567d5a976bd44ca18d91d54f353af31b and project 6ab836d6beb5471495f26f0810429a8f. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:06:58.109889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-39e36979-3609-4a30-b278-0345269e8cec tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049550 Oct 26 06:06:58.110489 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3773/7537] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:06:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:06:58.160227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-844957434", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-692749703", "networks": [{"uuid": "0d7aaefc-d48c-472f-9502-0f6c05ae86c5"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:06:58.213738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] validate_networks() for [('0d7aaefc-d48c-472f-9502-0f6c05ae86c5', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:06:58.904267 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:06:58.904698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:06:58.905196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:06:58.905662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:06:58.906084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:06:58.915417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:58.916480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:58.916925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:58.917694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:06:58.918155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:06:58.918584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:06:58.936449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for project 6ab836d6beb5471495f26f0810429a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:06:58.941716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Getting quotas for user 567d5a976bd44ca18d91d54f353af31b and project 6ab836d6beb5471495f26f0810429a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:06:58.954374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:06:58.956648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:06:59.004762 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3dfab4af-dd77-44b3-bf56-66a6ece4c2b8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848454 Oct 26 06:06:59.005627 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3765/7538] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:06:59.018576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d57fba28-8787-4d5b-a19c-3aa004c614ed tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:06:59.019308 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d57fba28-8787-4d5b-a19c-3aa004c614ed tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:06:59.075279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d57fba28-8787-4d5b-a19c-3aa004c614ed tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:06:59.082462 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d57fba28-8787-4d5b-a19c-3aa004c614ed tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1261 microversion: 2.1 time: 0.068861 Oct 26 06:06:59.083223 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3774/7539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:06:59 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:00.107843 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:00.108715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:00.116835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:00.117354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:00.117893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:00.118912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:00.119388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:00.119824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:00.187921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:00.196169 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c82d05d7-a40f-410e-8c22-14694495677f tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1321 microversion: 2.1 time: 0.093879 Oct 26 06:07:00.196856 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3766/7540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:00 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1321 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:01.220989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:01.221652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:01.232197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:01.232995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:01.233665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:01.234401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:01.234877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:01.235323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:01.369878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:01.378145 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c79f7d75-c5d6-49c7-9b89-5bd9b8ca24fc tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.161774 Oct 26 06:07:01.378754 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3775/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:01 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:01.484876 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-d53c7fc6-0469-4a85-9e98-398f6ae3bd9f req-38d22d0d-b816-47e5-9ea3-dcc7deed339a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d096ad87-1e7f-419f-af7a-f623bf5eaf30", "tag": "7d67261c-8629-4538-85d7-044839edc87a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:07:01.496637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d53c7fc6-0469-4a85-9e98-398f6ae3bd9f req-38d22d0d-b816-47e5-9ea3-dcc7deed339a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:01.497116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d53c7fc6-0469-4a85-9e98-398f6ae3bd9f req-38d22d0d-b816-47e5-9ea3-dcc7deed339a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:01.497589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-d53c7fc6-0469-4a85-9e98-398f6ae3bd9f req-38d22d0d-b816-47e5-9ea3-dcc7deed339a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:01.512714 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-d53c7fc6-0469-4a85-9e98-398f6ae3bd9f req-38d22d0d-b816-47e5-9ea3-dcc7deed339a service nova] Creating event network-changed:7d67261c-8629-4538-85d7-044839edc87a for instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 on n-h1-862416-4 Oct 26 06:07:01.518054 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-d53c7fc6-0469-4a85-9e98-398f6ae3bd9f req-38d22d0d-b816-47e5-9ea3-dcc7deed339a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036876 Oct 26 06:07:01.518682 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3767/7542] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:02.402775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:02.403309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:02.410211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:02.410713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:02.411198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:02.411879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:02.412359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:02.412812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:02.547292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:02.555311 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6018dff8-cd80-435e-8752-fc19d11aedfe tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.157186 Oct 26 06:07:02.556484 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3776/7543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:02 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:03.581295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:03.582492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:03.591537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:03.592034 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:03.592478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:03.593188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:03.593675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:03.594126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:03.755294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:03.764263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b8fc80df-ffd3-4715-985b-ba8a9291ae75 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.188658 Oct 26 06:07:03.764866 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3768/7544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:03 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:04.789573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:04.790284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:04.797597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:04.798102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:04.798562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:04.799271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:04.799743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:04.800191 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:04.929666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:04.938165 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27831a41-7524-404f-b691-8b688f3fd891 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.152508 Oct 26 06:07:04.938744 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3777/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:04 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:05.962008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:05.962811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:05.969622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:05.970116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:05.970563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:05.971263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:05.971733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:05.972167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:06.106183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:06.113866 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c805c364-afd2-486a-9739-38accd477d72 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.156212 Oct 26 06:07:06.114441 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3769/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:05 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:07.136792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:07.137445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:07.144451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:07.144954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:07.145442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:07.146155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:07.146628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:07.147074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:07.279264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:07.287128 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eeb41f94-d22e-420c-9095-42793d10c832 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.154835 Oct 26 06:07:07.287709 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3778/7547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:07 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:07.364264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-cacf019a-243f-4437-9f59-ff84446d676c req-4a084d80-7c0e-4f53-bb89-ce1afb0a16b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d096ad87-1e7f-419f-af7a-f623bf5eaf30", "name": "network-vif-plugged", "status": "completed", "tag": "7d67261c-8629-4538-85d7-044839edc87a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:07:07.375031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cacf019a-243f-4437-9f59-ff84446d676c req-4a084d80-7c0e-4f53-bb89-ce1afb0a16b4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:07.375517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cacf019a-243f-4437-9f59-ff84446d676c req-4a084d80-7c0e-4f53-bb89-ce1afb0a16b4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:07.375955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-cacf019a-243f-4437-9f59-ff84446d676c req-4a084d80-7c0e-4f53-bb89-ce1afb0a16b4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:07.388465 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-cacf019a-243f-4437-9f59-ff84446d676c req-4a084d80-7c0e-4f53-bb89-ce1afb0a16b4 service nova] Creating event network-vif-plugged:7d67261c-8629-4538-85d7-044839edc87a for instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 on n-h1-862416-4 Oct 26 06:07:07.393286 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-cacf019a-243f-4437-9f59-ff84446d676c req-4a084d80-7c0e-4f53-bb89-ce1afb0a16b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033048 Oct 26 06:07:07.393907 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3770/7548] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:08.310965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:08.311589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:08.318455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:08.318951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:08.319404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:08.320100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:08.320567 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:08.321015 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:08.454150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:08.462773 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ae4c9345-a769-426e-9c99-f6d8a83e6e0e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1361 microversion: 2.1 time: 0.155658 Oct 26 06:07:08.463237 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3779/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:08 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:07:09.485465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:09.486237 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:09.490889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:09.491608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:09.498686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:09.499180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:09.499630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:09.500332 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:09.500804 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:09.501240 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:09.630441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:09.639143 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f7c9708-9d73-42c1-897d-323138af4546 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1554 microversion: 2.1 time: 0.155529 Oct 26 06:07:09.639722 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3771/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:09 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:09.662626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:09.663192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:09.665669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:09.671575 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:09.672067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:09.672515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:09.673219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:09.673719 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:09.674157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:09.808995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:09.817368 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9938415-5d00-49b4-9eff-1ea5a33d49b3 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1554 microversion: 2.1 time: 0.158705 Oct 26 06:07:09.818033 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3780/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:09 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:11.309987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79c36d88-aca5-482c-87f4-bf3c27fed824"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:07:11.313216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:11.320558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:11.321195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:11.321703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:11.322363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:11.322830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:11.323263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:11.549923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:11.570060 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2c3f554e-9853-4e40-be83-00fd4e47dcdb tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "POST /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264105 Oct 26 06:07:11.570681 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3772/7552] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 06:07:11 2022] POST /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:22.286119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:22.286665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:22.289568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:22.290344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=70 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:22.296615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:22.297114 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:22.297623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:22.298330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:22.298800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:22.299248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:22.382932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lazy-loading 'services' on Instance uuid d096ad87-1e7f-419f-af7a-f623bf5eaf30 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:07:22.457096 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-05cd0fa7-2e81-4379-b0a7-c35693d41038 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments/79c36d88-aca5-482c-87f4-bf3c27fed824" status: 202 len: 0 microversion: 2.1 time: 0.174787 Oct 26 06:07:22.457725 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3781/7553] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:07:22 2022] DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments/79c36d88-aca5-482c-87f4-bf3c27fed824 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:07:22.465629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:22.466408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:07:22.470760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:22.473143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:22.481302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:22.482043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:22.482372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:22.483116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:22.483541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:22.484006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:22.519230 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-84a19c65-adf1-477e-824e-30ebb26886f0 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055439 Oct 26 06:07:22.519805 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3773/7554] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:07:22 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:23.533122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:23.535587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:23.542782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:23.543289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:23.543981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:23.544724 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:23.545200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:23.545675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:23.576458 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-74e62d19-9532-4fa9-bd10-2953e20f0e40 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 Oct 26 06:07:23.577028 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3782/7555] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:07:23 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:24.589206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:24.591506 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:24.598727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:24.599224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:24.599666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:24.600374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:24.600832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:24.601262 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:24.637972 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f10a4cd7-2c66-4bd9-bc94-0b8efbeee0c8 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053090 Oct 26 06:07:24.638573 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3774/7556] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:07:24 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:25.651562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:25.653878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:25.660427 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:25.660932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:25.661408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:25.662132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:25.662597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:25.663035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:25.694950 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-438374b8-d85f-4813-801b-36936c4bb624 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047985 Oct 26 06:07:25.695742 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3783/7557] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:07:25 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:26.707696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:26.709889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:26.717183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:26.717718 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:26.718167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:26.718861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:26.719322 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:26.719753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:26.751047 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82cc13d9-4eaa-47ff-9d7d-aa6667990773 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047402 Oct 26 06:07:26.751629 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3775/7558] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:07:26 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:27.763747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:27.765860 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:27.772511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:27.773019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:27.773577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:27.774831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:27.775338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:27.775791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:27.805068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-981305ac-03a6-4a69-9f8b-b6e7a9005e1d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045364 Oct 26 06:07:27.805533 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3784/7559] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:07:27 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 06:07:27.816232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:27.816724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:27.823851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:27.824336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:27.824775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:27.825505 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:27.825969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:27.826398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:27.904382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] HTTP exception thrown: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 is not attached to volume 79c36d88-aca5-482c-87f4-bf3c27fed824 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Request method failure captured: Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments/79c36d88-aca5-482c-87f4-bf3c27fed824 HTTP/1.1 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM40WbeqPlkOZmNJC6-9-6UfOCs5bast2xJYxkh6lEaVUDro5w_owBC23K1MvXa9pfTJCduiJMPcBkSQaHikc6KtXgFWzht0kiPQPVvc8JxvuY8xTVupPCPUPc712B0TVPzAu7Ll1ybL5l6k7Vq537gj8eMjPByhxbjBuUAMO7Un5b0 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 567d5a976bd44ca18d91d54f353af31b Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 is not attached to volume 79c36d88-aca5-482c-87f4-bf3c27fed824 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': 'd096ad87-1e7f-419f-af7a-f623bf5eaf30', 'id': '79c36d88-aca5-482c-87f4-bf3c27fed824'} Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 79c36d88-aca5-482c-87f4-bf3c27fed824. Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 is not attached to volume 79c36d88-aca5-482c-87f4-bf3c27fed824 Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:07:27.906374 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 is not attached to volume 79c36d88-aca5-482c-87f4-bf3c27fed824 Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Returning 404 to user: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 is not attached to volume 79c36d88-aca5-482c-87f4-bf3c27fed824 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23d1d02d-fdd8-4538-ab9c-48ca62b78f9d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments/79c36d88-aca5-482c-87f4-bf3c27fed824" status: 404 len: 154 microversion: 2.1 time: 0.095657 Oct 26 06:07:27.911349 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3776/7560] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:07:27 2022] DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30/os-volume_attachments/79c36d88-aca5-482c-87f4-bf3c27fed824 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:07:31.260123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:31.260695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:31.267786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:31.268297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:31.268754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:31.269509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:31.269985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:31.270432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:31.297606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:07:31.377748 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d2ff9317-bd70-48a2-90a7-a9abf2f15587 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 204 len: 0 microversion: 2.1 time: 0.121260 Oct 26 06:07:31.378488 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3785/7561] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:07:31 2022] DELETE /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 06:07:31.387164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:31.387743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:31.394586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:31.395090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:31.395731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:31.396638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:31.397112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:31.397578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:31.535993 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:31.545343 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-40c7b98f-356c-44bd-8225-c1eadcc2832d tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1560 microversion: 2.1 time: 0.162289 Oct 26 06:07:31.545921 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3777/7562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:31 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:32.569122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:32.569864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:32.577341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:32.577842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:32.578293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:32.578996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:32.579466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:32.579907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:32.708668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:32.717114 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-43c9ff4c-bedf-4474-bc55-071c87e7dfff tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1560 microversion: 2.1 time: 0.152353 Oct 26 06:07:32.717727 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3786/7563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:32 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:33.506560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ab1212bc-14d1-425e-83e2-065c1d2035e8 req-b39ea286-e7bb-4aa9-990c-7b59c26f5fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d096ad87-1e7f-419f-af7a-f623bf5eaf30", "name": "network-vif-deleted", "tag": "7d67261c-8629-4538-85d7-044839edc87a"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:07:33.520995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ab1212bc-14d1-425e-83e2-065c1d2035e8 req-b39ea286-e7bb-4aa9-990c-7b59c26f5fb7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:33.521631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ab1212bc-14d1-425e-83e2-065c1d2035e8 req-b39ea286-e7bb-4aa9-990c-7b59c26f5fb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:33.522679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ab1212bc-14d1-425e-83e2-065c1d2035e8 req-b39ea286-e7bb-4aa9-990c-7b59c26f5fb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:33.537405 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ab1212bc-14d1-425e-83e2-065c1d2035e8 req-b39ea286-e7bb-4aa9-990c-7b59c26f5fb7 service nova] Creating event network-vif-deleted:7d67261c-8629-4538-85d7-044839edc87a for instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 on n-h1-862416-4 Oct 26 06:07:33.544058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ab1212bc-14d1-425e-83e2-065c1d2035e8 req-b39ea286-e7bb-4aa9-990c-7b59c26f5fb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041115 Oct 26 06:07:33.545056 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3778/7564] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:07:33.740355 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:33.740989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:33.748134 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:33.748661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:33.749117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:33.749878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:33.750333 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:33.750782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:33.784999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:33.785519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:33.785972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:33.786434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lazy-loading 'fault' on Instance uuid d096ad87-1e7f-419f-af7a-f623bf5eaf30 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:07:33.830639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567d5a976bd44ca18d91d54f353af31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab836d6beb5471495f26f0810429a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:07:33.839276 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-489eb915-0fcc-4408-9ea5-af9f22843b95 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 200 len: 1351 microversion: 2.1 time: 0.103150 Oct 26 06:07:33.839857 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3787/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:33 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:07:34.863864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:34.864579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] [instance: d096ad87-1e7f-419f-af7a-f623bf5eaf30] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:07:34.871659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:34.872146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:34.872588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:34.873285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:07:34.873775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:07:34.874207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:07:34.888046 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] HTTP exception thrown: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 could not be found. Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Request method failure captured: Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 HTTP/1.1 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM40WbeqPlkOZmNJC6-9-6UfOCs5bast2xJYxkh6lEaVUDro5w_owBC23K1MvXa9pfTJCduiJMPcBkSQaHikc6KtXgFWzht0kiPQPVvc8JxvuY8xTVupPCPUPc712B0TVPzAu7Ll1ybL5l6k7Vq537gj8eMjPByhxbjBuUAMO7Un5b0 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ab836d6beb5471495f26f0810429a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6ab836d6beb5471495f26f0810429a8f Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244654577 Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 567d5a976bd44ca18d91d54f353af31b Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244654577-project Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 could not be found. Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd096ad87-1e7f-419f-af7a-f623bf5eaf30'} Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 could not be found. Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 could not be found. Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:34.889734 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 could not be found. Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Returning 404 to user: Instance d096ad87-1e7f-419f-af7a-f623bf5eaf30 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9d9d9c2-3154-41e5-9eea-2aa402e3af3e tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30" status: 404 len: 111 microversion: 2.1 time: 0.031553 Oct 26 06:07:34.894958 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3779/7566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:07:34 2022] GET /compute/v2.1/servers/d096ad87-1e7f-419f-af7a-f623bf5eaf30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:07:34.900324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0afbcd8e-899c-4538-9dfd-21a17ce7fa87 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] Calling method '.version_select at 0x7f470e9621f0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:07:34.919831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0afbcd8e-899c-4538-9dfd-21a17ce7fa87 tempest-TestEncryptedCinderVolumes-1244654577 tempest-TestEncryptedCinderVolumes-1244654577-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-692749703" status: 202 len: 0 microversion: 2.1 time: 0.023858 Oct 26 06:07:34.920397 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3788/7567] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 26 06:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-692749703 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:08:01.876164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8421b9fe-60f0-4389-b06d-7f7012632be0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'create', calling method: .version_select at 0x7f4709e475e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-232267345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjGuXwL2sxayYTkvGOLIDiGeqAs4QTZ+7i/ZoO35vvSAA0XL4GPQg884MJ42i6n9XNJCbK0iR8UMeINnUgolVUmBimN6Q8eNyZnfBj/w0NAmAtTflBBWnuIQyvihtROtw=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:01.882757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=14 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:01.883914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=34 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:01.895390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8421b9fe-60f0-4389-b06d-7f7012632be0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for project c689dcf0ae06427999dfafaf04dead99. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:08:01.901703 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-8421b9fe-60f0-4389-b06d-7f7012632be0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for user 830ec1ede9ef4e869c01a89f49adec26 and project c689dcf0ae06427999dfafaf04dead99. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:08:01.924382 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8421b9fe-60f0-4389-b06d-7f7012632be0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052287 Oct 26 06:08:01.924977 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3780/7568] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:08:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:08:01.974391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:01.975178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:01.979601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-772330010", "imageRef": "5a34831c-4d3e-4fd7-aa03-4461e2199d53", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-232267345", "networks": [{"uuid": "f0f5c2a9-0d48-408c-8969-26218af1010a"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:02.034467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] validate_networks() for [('f0f5c2a9-0d48-408c-8969-26218af1010a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:08:02.409075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:08:02.409568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:08:02.410066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:08:02.410527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:08:02.410962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:08:02.420572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:02.421074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:02.421596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:02.422329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:02.422795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:02.423237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:02.442499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for project c689dcf0ae06427999dfafaf04dead99. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:08:02.449230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for user 830ec1ede9ef4e869c01a89f49adec26 and project c689dcf0ae06427999dfafaf04dead99. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:08:02.462956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:08:02.465218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a34831c-4d3e-4fd7-aa03-4461e2199d53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:08:02.512646 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ffbaa0dc-8219-44ee-9d14-8f2edf9d9315 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540254 Oct 26 06:08:02.513327 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3789/7569] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:08:02.524962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0dd1a00a-139b-41f1-a398-55ec1f03dfc8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:02.525914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0dd1a00a-139b-41f1-a398-55ec1f03dfc8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:02.582624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0dd1a00a-139b-41f1-a398-55ec1f03dfc8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:02.592099 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0dd1a00a-139b-41f1-a398-55ec1f03dfc8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1257 microversion: 2.1 time: 0.071770 Oct 26 06:08:02.592693 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3781/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:02 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:03.614690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:03.615324 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:03.624240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:03.625069 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:03.625851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:03.627043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:03.627845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:03.628592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:03.719841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:03.732663 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e26c7712-ed29-4c11-9f42-a8474f4272f1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1317 microversion: 2.1 time: 0.122017 Oct 26 06:08:03.733335 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3790/7571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:03 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1317 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:04.756783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:04.758071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:04.768226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:04.769353 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:04.770359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:04.771239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:04.772020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:04.772602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:04.928889 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:04.937598 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-35e4ce5c-fa14-4740-8ddd-34322d46f067 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.185254 Oct 26 06:08:04.954322 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3782/7572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:04 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:05.964132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:05.964776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:05.971726 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:05.972237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:05.972696 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:05.973444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:05.973921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:05.974363 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:06.123171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:06.131956 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d9ce80c3-0550-46e1-b276-6db246811547 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.172313 Oct 26 06:08:06.132785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3791/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:05 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:07.156584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:07.157564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:07.163842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:07.164372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:07.165788 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:07.166499 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:07.167289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:07.168017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:07.316627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:07.325211 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f8c3194d-51d9-482f-afa3-9303b0914c50 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.172806 Oct 26 06:08:07.325865 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3783/7574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:07 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:08.350305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:08.351083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:08.361288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:08.361895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:08.362440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:08.363238 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:08.363779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:08.364550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:08.513080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:08.522112 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3f2b952-9148-4a36-95f9-3e1f345f5c8c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.176052 Oct 26 06:08:08.522713 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3792/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:08 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:09.545554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:09.546479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:09.553645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:09.554125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:09.554568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:09.555996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:09.556468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:09.556899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:09.717104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:09.727262 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d13d173-bc77-4355-a47b-407bbda476b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.185476 Oct 26 06:08:09.744205 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3784/7576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:09 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:10.751046 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:10.751638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:10.759001 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:10.759529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:10.759985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:10.760704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:10.761174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:10.761644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:10.903767 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:10.911880 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eb382a26-2b3d-4e38-bb68-c52c9f28d8a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.164777 Oct 26 06:08:10.912465 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3793/7577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:10 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:11.935370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:11.935976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:11.943061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:11.943566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:11.944013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:11.944720 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:11.945182 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:11.945685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:12.080228 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:12.088501 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-945dc829-81b4-4207-8483-d37df77fb059 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.157035 Oct 26 06:08:12.089086 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3785/7578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:11 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:12.259997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-db11fcaf-83d3-480d-b7ca-d32145966a13 req-c488ed47-0244-4507-b849-3e9303600b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:12.272229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-db11fcaf-83d3-480d-b7ca-d32145966a13 req-c488ed47-0244-4507-b849-3e9303600b77 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:12.273008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-db11fcaf-83d3-480d-b7ca-d32145966a13 req-c488ed47-0244-4507-b849-3e9303600b77 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:12.273489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-db11fcaf-83d3-480d-b7ca-d32145966a13 req-c488ed47-0244-4507-b849-3e9303600b77 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:12.285936 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-db11fcaf-83d3-480d-b7ca-d32145966a13 req-c488ed47-0244-4507-b849-3e9303600b77 service nova] Creating event network-changed:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:08:12.290887 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-db11fcaf-83d3-480d-b7ca-d32145966a13 req-c488ed47-0244-4507-b849-3e9303600b77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035269 Oct 26 06:08:12.291532 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3794/7579] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:08:13.112092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:13.112766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:13.114594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:13.121381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:13.121879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:13.122318 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:13.123013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:13.123471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:13.123900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:13.255965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:13.264473 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a8382a98-8502-434d-8728-918e0f7d88c4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.156302 Oct 26 06:08:13.265054 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3786/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:13 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:14.284825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:14.285603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:14.292367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:14.293081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:14.299810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:14.300298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:14.300756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:14.301467 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:14.301937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:14.302373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:14.433772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:14.441691 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bb041b9-c735-45d3-b71b-ba2e5669d849 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.157838 Oct 26 06:08:14.442291 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3795/7581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:14 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:15.467040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:15.467667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:15.475188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:15.475688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:15.475688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:15.476888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:15.478091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:15.478091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:15.622377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:15.630263 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-14fa1eaa-bca3-4ae9-9076-65bb82dd2b90 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.167341 Oct 26 06:08:15.630922 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3787/7582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:15 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:08:16.654176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:16.654811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:16.661647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:16.662155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:16.662613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:16.663326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:16.663816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:16.664252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:16.790864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:16.798641 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93a0ca5a-f62c-49b2-bdc5-2de5c7189344 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.149024 Oct 26 06:08:16.799221 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3796/7583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:16 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:17.746257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6dbf7de0-e4c0-4560-9763-7425972e0f6b req-a703c298-b571-46d9-bd70-d2296d4b84d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "name": "network-vif-plugged", "status": "completed", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:17.756991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6dbf7de0-e4c0-4560-9763-7425972e0f6b req-a703c298-b571-46d9-bd70-d2296d4b84d0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:17.757526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6dbf7de0-e4c0-4560-9763-7425972e0f6b req-a703c298-b571-46d9-bd70-d2296d4b84d0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:17.757977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6dbf7de0-e4c0-4560-9763-7425972e0f6b req-a703c298-b571-46d9-bd70-d2296d4b84d0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:17.769603 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6dbf7de0-e4c0-4560-9763-7425972e0f6b req-a703c298-b571-46d9-bd70-d2296d4b84d0 service nova] Creating event network-vif-plugged:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:08:17.774605 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6dbf7de0-e4c0-4560-9763-7425972e0f6b req-a703c298-b571-46d9-bd70-d2296d4b84d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Oct 26 06:08:17.775212 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3788/7584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:08:17.821213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:17.821899 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:17.828895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:17.829443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:17.829907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:17.830629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:17.831104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:17.831550 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:17.965897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:17.973760 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-169c1400-129d-4e78-a8e0-feda3c8d3865 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1357 microversion: 2.1 time: 0.156420 Oct 26 06:08:17.974331 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3797/7585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:17 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:18.999644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:19.000403 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:19.007141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.007672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.008109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.008815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.009278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.009738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.141634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:19.149442 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1399672f-8c12-4de8-9a38-3614758b1f5e tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1547 microversion: 2.1 time: 0.155699 Oct 26 06:08:19.150030 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3789/7586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:18 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:19.172786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:19.173447 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:19.180254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.180762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.181221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.182105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.182597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.183047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.310703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:19.318487 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-577bf45b-970e-440d-a2ed-dd7f95302caa tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1547 microversion: 2.1 time: 0.149564 Oct 26 06:08:19.319062 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3798/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:19 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:19.341047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:19.345822 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:19.346601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Searching by: {'deleted': False, 'project_id': 'c689dcf0ae06427999dfafaf04dead99'} {{(pid=120586) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 06:08:19.351898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.352389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.352833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.354275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.354744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.355178 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.378658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.multi_cell_list [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 06:08:19.408491 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f523550e-f65c-45cb-bb1f-39996126109a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071891 Oct 26 06:08:19.409072 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3790/7588] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 06:08:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:08:19.421389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:19.422027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:19.427998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.428504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.428962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.429703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:19.430178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:19.430627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:19.561760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:19.569524 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8e18f072-8d4b-44ed-b3f7-8b9874f687a5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1547 microversion: 2.1 time: 0.152046 Oct 26 06:08:19.570101 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3799/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:19 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:21.116210 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ffd8809-9bef-4635-a53c-7c7b6bfc8229"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:21.118611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:21.126171 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:21.126663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:21.127105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:21.127805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:21.128265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:21.128691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:21.378192 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-517c5e6a-e5ac-4a00-9e7b-31be124fca31 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265797 Oct 26 06:08:21.378840 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3791/7590] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 06:08:21 2022] POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:08:34.440400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:34.441030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:34.443734 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:34.444410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=58 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:34.450367 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:34.450866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:34.451314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:34.452021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:34.452486 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:34.452923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:34.582926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:34.592052 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-931d7905-3d30-4f2c-85ce-ac08d5b189a2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1593 microversion: 2.1 time: 0.155687 Oct 26 06:08:34.592624 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3800/7591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:34 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:36.280488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:36.281716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:36.282756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:08:36.289135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-9fef34b0-4d08-494f-b2d9-47a670ce7587 req-28c4b826-d0b7-44dc-92de-2e46d2dd7264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:36.305533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9fef34b0-4d08-494f-b2d9-47a670ce7587 req-28c4b826-d0b7-44dc-92de-2e46d2dd7264 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:36.306717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9fef34b0-4d08-494f-b2d9-47a670ce7587 req-28c4b826-d0b7-44dc-92de-2e46d2dd7264 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:36.307510 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-9fef34b0-4d08-494f-b2d9-47a670ce7587 req-28c4b826-d0b7-44dc-92de-2e46d2dd7264 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:36.322956 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-9fef34b0-4d08-494f-b2d9-47a670ce7587 req-28c4b826-d0b7-44dc-92de-2e46d2dd7264 service nova] Creating event network-changed:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:08:36.331443 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-9fef34b0-4d08-494f-b2d9-47a670ce7587 req-28c4b826-d0b7-44dc-92de-2e46d2dd7264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052647 Oct 26 06:08:36.332544 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3792/7592] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:08:37.406026 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1165768095"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:37.406707 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:37.413728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:37.414231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:37.414685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:37.415400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:37.416002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:37.416301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:37.547077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Adding security group d6a00c3c-2dbc-417b-b471-621199e75e03 to port 71349e29-ea17-494c-9dbb-11210cd1d918 Oct 26 06:08:37.858573 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-621b5d73-f471-49f3-836a-ce144f0caf44 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action" status: 202 len: 0 microversion: 2.1 time: 0.457151 Oct 26 06:08:37.859199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3801/7593] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:08:37 2022] POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:08:37.870366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:08:37.873005 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:08:37.883202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:37.883816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:37.884558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:37.885359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:37.886581 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:37.887033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:38.046649 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:08:38.055035 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f6ea2c2a-2083-4c26-a615-75f77e89a5b8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1759 microversion: 2.1 time: 0.190952 Oct 26 06:08:38.055631 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3793/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:08:37 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:08:38.347082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b999caee-6c30-4abe-953d-2e26ead84063 req-81e0731a-75e5-4d0c-927e-b42109d05502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:08:38.356774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b999caee-6c30-4abe-953d-2e26ead84063 req-81e0731a-75e5-4d0c-927e-b42109d05502 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:08:38.357265 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b999caee-6c30-4abe-953d-2e26ead84063 req-81e0731a-75e5-4d0c-927e-b42109d05502 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:08:38.357735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b999caee-6c30-4abe-953d-2e26ead84063 req-81e0731a-75e5-4d0c-927e-b42109d05502 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:08:38.368782 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b999caee-6c30-4abe-953d-2e26ead84063 req-81e0731a-75e5-4d0c-927e-b42109d05502 service nova] Creating event network-changed:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:08:38.374060 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b999caee-6c30-4abe-953d-2e26ead84063 req-81e0731a-75e5-4d0c-927e-b42109d05502 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Oct 26 06:08:38.374656 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3802/7595] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:10:17.708864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:10:17.709745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:10:17.710736 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:10:17.710875 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:10:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action (ip 10.222.0.16) !!! Oct 26 06:10:17.712911 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:10:17.713101 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:10:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action (ip 10.222.0.16) !!! Oct 26 06:10:17.719186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:10:17.721471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:10:17.737693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:10:17.738176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:10:17.738633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:10:17.739344 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:10:17.739817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:10:17.740256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:10:17.812788 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-348e0f5c-1ea7-462b-ac61-34092f1d3d96 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action" status: 202 len: 0 microversion: 2.1 time: 0.105688 Oct 26 06:10:17.813463 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3794/7596] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:10:17 2022] POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:10:17.819912 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7813b65-3d9c-45f7-af47-65a9f25bbe02] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:10:17.821221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:10:17.822002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:10:17.828304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:10:17.829033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:10:17.837553 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:10:17.838063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:10:17.838523 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:10:17.839244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:10:17.839718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:10:17.840166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:10:18.157264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:10:18.165625 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cc494e69-2c26-48d3-8631-c269e0510482 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1761 microversion: 2.1 time: 0.347536 Oct 26 06:10:18.166207 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3803/7597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:10:17 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1761 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:10:19.190456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:10:19.191166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:10:19.197300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:10:19.197813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:10:19.198256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:10:19.198947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:10:19.199410 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:10:19.199841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:10:19.406271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:10:19.414631 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-439a802a-3da4-4b3b-85ef-6c338928ac87 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1759 microversion: 2.1 time: 0.230051 Oct 26 06:10:19.415211 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3795/7598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:10:19 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1759 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:11:32.942916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:11:32.943705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:11:32.948718 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1165768095"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:11:32.949212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:32.957981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:32.958484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:32.958939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:32.959649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:32.960121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:32.960558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:32.981970 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7813b65-3d9c-45f7-af47-65a9f25bbe02] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54658. Oct 26 06:11:33.095945 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Removing security group d6a00c3c-2dbc-417b-b471-621199e75e03 from port 71349e29-ea17-494c-9dbb-11210cd1d918 Oct 26 06:11:33.406799 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-25e4c91b-00b1-47b6-9d9b-67bf4f934275 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action" status: 202 len: 0 microversion: 2.1 time: 0.466368 Oct 26 06:11:33.411313 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3804/7599] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:11:32 2022] POST /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:11:33.420138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:11:33.422812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:11:33.511765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-224bb127-479c-4768-a8d7-e1056efb896f req-645a2b88-3338-4419-bead-a589a5e75c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:11:33.522372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-224bb127-479c-4768-a8d7-e1056efb896f req-645a2b88-3338-4419-bead-a589a5e75c63 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:33.522897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-224bb127-479c-4768-a8d7-e1056efb896f req-645a2b88-3338-4419-bead-a589a5e75c63 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:33.523342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-224bb127-479c-4768-a8d7-e1056efb896f req-645a2b88-3338-4419-bead-a589a5e75c63 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:33.535590 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-224bb127-479c-4768-a8d7-e1056efb896f req-645a2b88-3338-4419-bead-a589a5e75c63 service nova] Creating event network-changed:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:11:33.541285 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-224bb127-479c-4768-a8d7-e1056efb896f req-645a2b88-3338-4419-bead-a589a5e75c63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128232 Oct 26 06:11:33.542243 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3796/7600] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:34.931157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:34.931697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:34.937599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:34.938093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:34.938546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:34.939349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:34.939829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:34.941369 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:35.024641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lazy-loading 'services' on Instance uuid 7b5f1c03-cf96-4306-8c06-9a852e9f0105 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:11:35.099317 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [43542d26-ba5e-4fb3-89ed-b4375171ca63] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:11:35.557991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-6699b93f-31ea-48ed-85c3-b9621a93cdec req-d0eb35ea-100e-4376-b8d2-9e60909f495b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:11:35.569106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6699b93f-31ea-48ed-85c3-b9621a93cdec req-d0eb35ea-100e-4376-b8d2-9e60909f495b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:35.569627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6699b93f-31ea-48ed-85c3-b9621a93cdec req-d0eb35ea-100e-4376-b8d2-9e60909f495b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:35.570068 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-6699b93f-31ea-48ed-85c3-b9621a93cdec req-d0eb35ea-100e-4376-b8d2-9e60909f495b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:35.585096 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-6699b93f-31ea-48ed-85c3-b9621a93cdec req-d0eb35ea-100e-4376-b8d2-9e60909f495b service nova] Creating event network-changed:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:11:35.590659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-6699b93f-31ea-48ed-85c3-b9621a93cdec req-d0eb35ea-100e-4376-b8d2-9e60909f495b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037302 Oct 26 06:11:35.591273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3797/7601] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:36.106146 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [43542d26-ba5e-4fb3-89ed-b4375171ca63] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54688. Oct 26 06:11:36.109423 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7ef54052-ca84-476e-b260-924cff78887f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments/7ffd8809-9bef-4635-a53c-7c7b6bfc8229" status: 202 len: 0 microversion: 2.1 time: 1.183260 Oct 26 06:11:36.110042 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3805/7602] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:11:34 2022] DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments/7ffd8809-9bef-4635-a53c-7c7b6bfc8229 => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:11:36.119682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:36.122333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:36.128653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:36.129156 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:36.129632 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:36.130349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:36.130813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:36.131247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:36.165959 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c5cb1192-5bb7-4f1a-887f-d42524abd717 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050582 Oct 26 06:11:36.166536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3798/7603] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:11:36 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:37.179839 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:37.182234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:37.189446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:37.190582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:37.191250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:37.191835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:37.192309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:37.192756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:37.222514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0e4c6b3e-1c0f-4796-bc62-8f9c0a8113b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047848 Oct 26 06:11:37.223118 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3806/7604] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:11:37 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:38.235311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:38.237665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:38.244725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:38.245221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:38.245690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:38.246408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:38.246905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:38.247335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:38.279720 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-749c5577-d31d-4ec7-98c3-b523dcc53d79 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048389 Oct 26 06:11:38.280318 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3799/7605] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:11:38 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:39.292283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:39.295179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:39.302755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:39.303251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:39.303699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:39.304410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:39.304875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:39.305335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:39.334163 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5edeb4b8-90b1-47f2-9cbd-0add19fb0daf tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Oct 26 06:11:39.334865 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3807/7606] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:11:39 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:40.347664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:40.350010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:40.356935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:40.357611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:40.358060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:40.358762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:40.359224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:40.359974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:40.389129 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-81f9bf52-bc54-4f56-b7aa-ff4f2a613bec tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046285 Oct 26 06:11:40.389763 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3800/7607] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:11:40 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:41.402339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:41.404593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:41.412035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:41.412546 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:41.413007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:41.413746 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:41.414225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:41.414674 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:41.444935 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83072be4-604a-4c68-93b4-36694e1f07ad tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046239 Oct 26 06:11:41.445117 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3808/7608] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:11:41 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 06:11:41.455819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:41.456440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:41.463610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:41.464106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:41.464555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:41.465261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:41.465866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:41.466309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:41.544410 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] HTTP exception thrown: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 is not attached to volume 7ffd8809-9bef-4635-a53c-7c7b6bfc8229 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Request method failure captured: Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments/7ffd8809-9bef-4635-a53c-7c7b6bfc8229 HTTP/1.1 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM6zoajjr_oCeskNblr2hu797eKRduMQd0GC9pvBDLLl6uWOQhivQzwiNxNWeV2CT-duL5twCqKTx-d49Q2LcWR5CxCdUeDjjemwXFSZa6OpH5_vHFulae2L_PFb8REa2oy6jhvR8sFEE6jeDpmFG5Sfez-BtYBNqOnj4sAVixdF5L8 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 830ec1ede9ef4e869c01a89f49adec26 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 is not attached to volume 7ffd8809-9bef-4635-a53c-7c7b6bfc8229 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '7b5f1c03-cf96-4306-8c06-9a852e9f0105', 'id': '7ffd8809-9bef-4635-a53c-7c7b6bfc8229'} Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7ffd8809-9bef-4635-a53c-7c7b6bfc8229. Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 is not attached to volume 7ffd8809-9bef-4635-a53c-7c7b6bfc8229 Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:11:41.546090 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 is not attached to volume 7ffd8809-9bef-4635-a53c-7c7b6bfc8229 Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Returning 404 to user: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 is not attached to volume 7ffd8809-9bef-4635-a53c-7c7b6bfc8229 {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1366c257-fe26-4edc-b673-29cf579c53a9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments/7ffd8809-9bef-4635-a53c-7c7b6bfc8229" status: 404 len: 154 microversion: 2.1 time: 0.096014 Oct 26 06:11:41.551978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3801/7609] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:11:41 2022] DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105/os-volume_attachments/7ffd8809-9bef-4635-a53c-7c7b6bfc8229 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:11:44.806569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:44.807097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:44.814108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:44.814618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:44.815080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:44.815790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:44.816338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:44.816795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:44.842753 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:11:44.929649 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88bf9e77-dae1-4afc-9cfb-62b53602d372 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 204 len: 0 microversion: 2.1 time: 0.126608 Oct 26 06:11:44.933289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3809/7610] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:11:44 2022] DELETE /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:11:44.939642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:44.940288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:44.947587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:44.948149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:44.948528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:44.949233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:44.949726 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:44.950157 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:45.088776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:11:45.096993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e56d6191-225f-4d1c-acc4-738d4c2baf53 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1553 microversion: 2.1 time: 0.161707 Oct 26 06:11:45.097607 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3802/7611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:11:44 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:11:46.120592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:46.121306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:46.129406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:46.130072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:46.130535 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:46.131257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:46.131728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:46.132173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:46.263892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:11:46.271940 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91cc2efa-a2b1-4faf-8cf2-ef4f41805a4c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1553 microversion: 2.1 time: 0.156173 Oct 26 06:11:46.272521 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3810/7612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:11:46 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:11:47.193992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ec50dba1-acfb-4280-806a-527b71ee7216 req-72a16c7f-e01b-4fce-8048-6818649d3fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5f1c03-cf96-4306-8c06-9a852e9f0105", "name": "network-vif-deleted", "tag": "71349e29-ea17-494c-9dbb-11210cd1d918"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:11:47.203763 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec50dba1-acfb-4280-806a-527b71ee7216 req-72a16c7f-e01b-4fce-8048-6818649d3fe3 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:47.204254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec50dba1-acfb-4280-806a-527b71ee7216 req-72a16c7f-e01b-4fce-8048-6818649d3fe3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:47.204690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ec50dba1-acfb-4280-806a-527b71ee7216 req-72a16c7f-e01b-4fce-8048-6818649d3fe3 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:47.217231 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ec50dba1-acfb-4280-806a-527b71ee7216 req-72a16c7f-e01b-4fce-8048-6818649d3fe3 service nova] Creating event network-vif-deleted:71349e29-ea17-494c-9dbb-11210cd1d918 for instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 on n-h1-862416-4 Oct 26 06:11:47.222181 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ec50dba1-acfb-4280-806a-527b71ee7216 req-72a16c7f-e01b-4fce-8048-6818649d3fe3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092375 Oct 26 06:11:47.222823 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3803/7613] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:11:47.296671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:47.297302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:47.305101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:47.305638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:47.306136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:47.306851 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:47.307335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:47.307769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:47.339223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:47.339723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:47.340179 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:47.340651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lazy-loading 'fault' on Instance uuid 7b5f1c03-cf96-4306-8c06-9a852e9f0105 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:11:47.381760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:11:47.389633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-89e5c42b-25dd-4a2c-afd1-24568ed1ca0d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 200 len: 1347 microversion: 2.1 time: 0.096854 Oct 26 06:11:47.390199 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3811/7614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:11:47 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:11:48.415365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:48.416083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 7b5f1c03-cf96-4306-8c06-9a852e9f0105] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:48.422383 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:48.422880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:48.423328 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:48.424035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:48.424503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:48.424939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:48.439136 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] HTTP exception thrown: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 could not be found. Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Request method failure captured: Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 HTTP/1.1 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM6zoajjr_oCeskNblr2hu797eKRduMQd0GC9pvBDLLl6uWOQhivQzwiNxNWeV2CT-duL5twCqKTx-d49Q2LcWR5CxCdUeDjjemwXFSZa6OpH5_vHFulae2L_PFb8REa2oy6jhvR8sFEE6jeDpmFG5Sfez-BtYBNqOnj4sAVixdF5L8 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 830ec1ede9ef4e869c01a89f49adec26 Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 could not be found. Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '7b5f1c03-cf96-4306-8c06-9a852e9f0105'} Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 could not be found. Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 could not be found. Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:11:48.440842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 could not be found. Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Returning 404 to user: Instance 7b5f1c03-cf96-4306-8c06-9a852e9f0105 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8adb86a3-7865-478a-8666-7849ff9a58b0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105" status: 404 len: 111 microversion: 2.1 time: 0.032885 Oct 26 06:11:48.446611 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3804/7615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:11:48 2022] GET /compute/v2.1/servers/7b5f1c03-cf96-4306-8c06-9a852e9f0105 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:11:48.451770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3836db94-b1c5-458c-9379-b3210e0a4196 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '.version_select at 0x7f470c03e5e0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:48.472319 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3836db94-b1c5-458c-9379-b3210e0a4196 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-232267345" status: 202 len: 0 microversion: 2.1 time: 0.024311 Oct 26 06:11:48.472953 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3812/7616] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 26 06:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-232267345 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:11:57.650386 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ee9dfe17-9c3f-4f6b-ade3-9946ca3a3b2b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'create', calling method: .version_select at 0x7f470a79b4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1028455211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg2Jx3Rb4VMrN1jQmky7++yTgtOAI0tdiQL+Rqsc2o86wszVrIn5/oZ7PlHMkFJClhsdwDHGOLSj1GG4LWpg8/amaRh7bYFcXXz/xwrxV56PJAtxt9WiPnC4EqZAqjSyQ=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:11:57.668739 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ee9dfe17-9c3f-4f6b-ade3-9946ca3a3b2b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for project c689dcf0ae06427999dfafaf04dead99. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:11:57.674032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-ee9dfe17-9c3f-4f6b-ade3-9946ca3a3b2b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for user 830ec1ede9ef4e869c01a89f49adec26 and project c689dcf0ae06427999dfafaf04dead99. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:11:57.703082 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ee9dfe17-9c3f-4f6b-ade3-9946ca3a3b2b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056594 Oct 26 06:11:57.703692 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3805/7617] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:11:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:11:57.752949 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:11:57.757984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1186132355", "imageRef": "3eb72b24-5865-45b0-a0bc-25adf94660f6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1028455211", "networks": [{"uuid": "f0f5c2a9-0d48-408c-8969-26218af1010a"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:11:57.810103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] validate_networks() for [('f0f5c2a9-0d48-408c-8969-26218af1010a', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:11:58.244964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:11:58.245440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:11:58.245934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:11:58.246370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:11:58.246800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:11:58.256426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:58.256929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:58.257417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:58.258163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:58.258631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:58.259097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:58.276783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for project c689dcf0ae06427999dfafaf04dead99. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:11:58.282007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Getting quotas for user 830ec1ede9ef4e869c01a89f49adec26 and project c689dcf0ae06427999dfafaf04dead99. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:11:58.294614 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:11:58.296841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3eb72b24-5865-45b0-a0bc-25adf94660f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:11:58.341506 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e383284b-cd0e-4780-b274-aee05a8cf6ff tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590350 Oct 26 06:11:58.342164 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3813/7618] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:11:58.353516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3da1bcff-df8c-4083-b1f5-828bc9f5a658 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:58.354174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3da1bcff-df8c-4083-b1f5-828bc9f5a658 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:58.409735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3da1bcff-df8c-4083-b1f5-828bc9f5a658 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:11:58.416837 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3da1bcff-df8c-4083-b1f5-828bc9f5a658 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1259 microversion: 2.1 time: 0.067333 Oct 26 06:11:58.417443 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3806/7619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:11:58 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:11:59.441648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:11:59.443024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:11:59.451143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:59.451728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:59.452339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:59.453042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:11:59.453609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:11:59.454118 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:11:59.566075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:11:59.575493 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fabd8890-cb10-4a9e-b2aa-6d93fae35799 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1329 microversion: 2.1 time: 0.138376 Oct 26 06:11:59.576706 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3814/7620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:11:59 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1329 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:00.601242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:00.602841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:00.609863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=38 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:00.613080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:00.614020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:00.614946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:00.616857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:00.617743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:00.618705 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:00.781813 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:00.790675 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8139c25d-0b8c-433a-8dc1-76c9de81564a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.194150 Oct 26 06:12:00.791274 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3807/7621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:00 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:01.815562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:01.816976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:01.824913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:01.825441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:01.826090 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:01.826989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:01.827465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:01.827905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:01.975615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:01.983975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-37278084-b2fa-4a9b-8afd-120e182abfe1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.172183 Oct 26 06:12:01.984566 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3815/7622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:01 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:03.009276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:03.010677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:03.018245 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:03.019368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:03.020038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:03.020973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:03.022019 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:03.022686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:03.165776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:03.179537 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-82289d8e-c210-4408-8df6-2c783d3feac2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.171285 Oct 26 06:12:03.180520 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3808/7623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:03 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:04.204255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:04.204907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:04.207612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:04.213110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:04.213660 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:04.214127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:04.214866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:04.215344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:04.215801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:04.368930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:04.376931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6085ad3-62c2-4251-aaf0-d4a7c5754c51 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.176986 Oct 26 06:12:04.377565 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3816/7624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:04 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:05.401043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:05.402398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:05.408760 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:05.411312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:05.412355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:05.412873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:05.413654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:05.414104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:05.414540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:05.555660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:05.563369 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c20547cb-8c22-48c4-9cd3-65eeb6a3210b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.167135 Oct 26 06:12:05.563951 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3809/7625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:05 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:06.592736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:06.593388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:06.600589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:06.601089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:06.601562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:06.602283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:06.602747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:06.603183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:06.745050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:06.753305 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31987715-2f56-4392-bac4-1db78cf8cb69 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.164362 Oct 26 06:12:06.754010 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3817/7626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:06 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:07.779129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:07.779710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:07.788533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:07.789473 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:07.790124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:07.790859 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:07.791325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:07.791755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:07.945990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:07.955428 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a9c6e2ca-d3bb-422a-a137-04d5bca081a8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.180369 Oct 26 06:12:07.956015 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3810/7627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:07 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:08.979710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:08.980281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:08.982989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:08.983671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:08.989625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:08.990157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:08.990615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:08.991323 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:08.991795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:08.992241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:09.124078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:09.132301 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1bbee51f-a0f5-40a7-bcd8-e4e69d9c0aa1 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.156593 Oct 26 06:12:09.132881 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3818/7628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:08 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:09.867939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-49cb9209-7da0-4c8f-8b1a-e46b520d8fca req-ab9f5f46-d7f6-4aec-b066-5d3fb7ef5991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:12:09.874830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:09.880246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-49cb9209-7da0-4c8f-8b1a-e46b520d8fca req-ab9f5f46-d7f6-4aec-b066-5d3fb7ef5991 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:09.881455 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-49cb9209-7da0-4c8f-8b1a-e46b520d8fca req-ab9f5f46-d7f6-4aec-b066-5d3fb7ef5991 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:09.881930 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-49cb9209-7da0-4c8f-8b1a-e46b520d8fca req-ab9f5f46-d7f6-4aec-b066-5d3fb7ef5991 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:09.894443 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-49cb9209-7da0-4c8f-8b1a-e46b520d8fca req-ab9f5f46-d7f6-4aec-b066-5d3fb7ef5991 service nova] Creating event network-changed:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:12:09.900011 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-49cb9209-7da0-4c8f-8b1a-e46b520d8fca req-ab9f5f46-d7f6-4aec-b066-5d3fb7ef5991 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Oct 26 06:12:09.900622 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3811/7629] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:12:10.155978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:10.156685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:10.164235 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:10.164835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:10.165288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:10.166021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:10.166487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:10.166926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:10.375213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:10.383965 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5dcb9308-5114-4805-af92-c9ccc1f231b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.231828 Oct 26 06:12:10.384548 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3819/7630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:10 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:11.411511 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:11.412258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:11.419015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:11.419579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:11.420017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:11.420710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:11.421167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:11.421626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:11.551961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:11.561064 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a56b42bb-330c-41af-a208-3b8f12baf42c tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.154773 Oct 26 06:12:11.561674 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3812/7631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:11 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:12.583882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:12.584594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:12.591617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:12.592127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:12.592584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:12.593337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:12.593793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:12.594242 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:12.830932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:12.839035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f6ae8f18-975e-4c3f-990f-411ed6ec6fc4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.259091 Oct 26 06:12:12.839615 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3820/7632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:12 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:13.862456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:13.863074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:13.870996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:13.871485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:13.871954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:13.872653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:13.873111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:13.873570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:14.005143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:14.013089 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cdf874ef-b050-4f78-b528-5bfeaddd2b18 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.154508 Oct 26 06:12:14.013775 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3813/7633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:13 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:15.036915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:15.037615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:15.044374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:15.044871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:15.045338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:15.046055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:15.046522 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:15.046966 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:15.173344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:15.181081 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-127700e6-1618-4acf-a8ee-97c8a29da7ee tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.148267 Oct 26 06:12:15.181688 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3821/7634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:15 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:12:16.204544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a56cbef0-4f30-4f67-a5cf-190d1a924d7c req-78d8e280-e2ba-4c38-ac53-b4a4b7578ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "name": "network-vif-plugged", "status": "completed", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:12:16.204981 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:16.205430 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:16.214353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:16.214936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:16.215067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a56cbef0-4f30-4f67-a5cf-190d1a924d7c req-78d8e280-e2ba-4c38-ac53-b4a4b7578ecd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:16.215424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a56cbef0-4f30-4f67-a5cf-190d1a924d7c req-78d8e280-e2ba-4c38-ac53-b4a4b7578ecd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:16.215580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:16.215864 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a56cbef0-4f30-4f67-a5cf-190d1a924d7c req-78d8e280-e2ba-4c38-ac53-b4a4b7578ecd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:16.216306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:16.216781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:16.217228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:16.227881 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a56cbef0-4f30-4f67-a5cf-190d1a924d7c req-78d8e280-e2ba-4c38-ac53-b4a4b7578ecd service nova] Creating event network-vif-plugged:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:12:16.233344 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a56cbef0-4f30-4f67-a5cf-190d1a924d7c req-78d8e280-e2ba-4c38-ac53-b4a4b7578ecd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105059 Oct 26 06:12:16.233901 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3814/7635] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:12:16.403395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:16.411118 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9ebd21e0-9702-4ac0-b96e-82f742cee2c7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.210689 Oct 26 06:12:16.412310 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3822/7636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:16 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:17.437039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:17.437769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:17.444758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:17.445254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:17.445744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:17.446446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:17.446908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:17.447333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:17.591172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:17.594402 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b78a5f92-a180-4fbe-8c2f-1042b4c7fea7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1359 microversion: 2.1 time: 0.162600 Oct 26 06:12:17.594985 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3815/7637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:17 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:18.619033 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:18.619666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:18.626492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:18.626995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:18.627455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:18.628186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:18.628645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:18.629096 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:18.757825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:18.765686 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fcdf3b6-9780-4258-8d5f-c23a377f4669 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1548 microversion: 2.1 time: 0.151274 Oct 26 06:12:18.766261 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3823/7638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:18 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:18.789089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:18.789746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:18.796687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:18.797180 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:18.797663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:18.798370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:18.798839 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:18.799275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:18.930224 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:18.938000 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d2fc625-ea44-466f-bbb2-86d832185f76 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1548 microversion: 2.1 time: 0.153350 Oct 26 06:12:18.938584 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3816/7639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:18 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:18.960884 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:18.965977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:18.966762 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Searching by: {'deleted': False, 'project_id': 'c689dcf0ae06427999dfafaf04dead99'} {{(pid=120585) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 06:12:18.971942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:18.972445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:18.972901 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:18.973670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:18.974227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:18.974677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:18.997838 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.multi_cell_list [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 06:12:19.025579 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-61d24609-a42d-4788-99ae-3363cf64863d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069224 Oct 26 06:12:19.026153 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3824/7640] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 26 06:12:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:12:19.037847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:19.039545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:19.045740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:19.046241 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:19.046686 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:19.047389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:19.047856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:19.048286 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:19.177846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:19.185616 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e09a102a-c323-4a80-a9f1-4cb087910bcc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1548 microversion: 2.1 time: 0.151613 Oct 26 06:12:19.186199 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3817/7641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:19 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:12:20.697792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f156826-e5e6-4e63-8185-31668c39982e"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:12:20.700228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:20.707149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:20.707644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:20.708095 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:20.709700 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:20.710183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:20.710629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:20.947759 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-40a3da33-2420-4910-9658-73c585e92574 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253417 Oct 26 06:12:20.948379 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3825/7642] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 26 06:12:20 2022] POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:12:31.720845 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:31.721500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:31.724468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=17 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:31.725253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=58 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:31.731091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:31.731593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:31.732039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:31.732738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:31.733202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:31.733659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:31.861496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:31.870523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cb2a1aad-28b1-4e6c-a020-5f9f87035690 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1594 microversion: 2.1 time: 0.153555 Oct 26 06:12:31.871263 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3818/7643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:31 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:33.780882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0bd6b8b2-b73f-4f79-9c8d-e0a098206d76 req-a631d250-8c88-43a9-8717-2016bbc17920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:12:33.793456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:33.794260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=19 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:33.794925 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:12:33.798351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0bd6b8b2-b73f-4f79-9c8d-e0a098206d76 req-a631d250-8c88-43a9-8717-2016bbc17920 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:33.798351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0bd6b8b2-b73f-4f79-9c8d-e0a098206d76 req-a631d250-8c88-43a9-8717-2016bbc17920 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:33.798812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0bd6b8b2-b73f-4f79-9c8d-e0a098206d76 req-a631d250-8c88-43a9-8717-2016bbc17920 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:33.813137 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0bd6b8b2-b73f-4f79-9c8d-e0a098206d76 req-a631d250-8c88-43a9-8717-2016bbc17920 service nova] Creating event network-changed:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:12:33.818763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0bd6b8b2-b73f-4f79-9c8d-e0a098206d76 req-a631d250-8c88-43a9-8717-2016bbc17920 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043607 Oct 26 06:12:33.819603 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3826/7644] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:12:34.952702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-75684872"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:12:34.953594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:34.955759 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:12:34.961251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:34.961774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:34.962217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:34.963197 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:34.963654 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:34.964084 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:35.093989 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.network.security_group_api [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Adding security group cc8b6001-c6e5-4ff0-ad06-295e847ff6c0 to port 6289da7c-4d21-4ed1-a552-a62e8f3271d9 Oct 26 06:12:35.402906 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe075d37-7867-4a9c-8dd7-9eb8dc725eb5 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action" status: 202 len: 0 microversion: 2.1 time: 0.454507 Oct 26 06:12:35.403931 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3819/7645] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:12:34 2022] POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:12:35.413752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:12:35.415087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:12:35.421853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:35.422145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:35.422604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:35.423952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:35.424416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:35.424861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:35.581373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:12:35.590762 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-516903b0-cf21-499d-8baa-ddcdcb2deff7 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1758 microversion: 2.1 time: 0.182522 Oct 26 06:12:35.591361 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3827/7646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:12:35 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:12:35.833678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-0dae0545-5965-44f7-ade6-f08107d2296c req-2edf1062-a85e-4ec7-a4ba-ac92ca2a96ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:12:35.844002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dae0545-5965-44f7-ade6-f08107d2296c req-2edf1062-a85e-4ec7-a4ba-ac92ca2a96ce service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:12:35.844494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dae0545-5965-44f7-ade6-f08107d2296c req-2edf1062-a85e-4ec7-a4ba-ac92ca2a96ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:12:35.844934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-0dae0545-5965-44f7-ade6-f08107d2296c req-2edf1062-a85e-4ec7-a4ba-ac92ca2a96ce service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:12:35.857068 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-0dae0545-5965-44f7-ade6-f08107d2296c req-2edf1062-a85e-4ec7-a4ba-ac92ca2a96ce service nova] Creating event network-changed:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:12:35.862235 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-0dae0545-5965-44f7-ade6-f08107d2296c req-2edf1062-a85e-4ec7-a4ba-ac92ca2a96ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032317 Oct 26 06:12:35.863078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3820/7647] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:13:23.724528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:13:23.725222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:13:23.775691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:13:23.778065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:23.784247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:23.784720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:23.785170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:23.785891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:23.786356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:23.786796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:23.862831 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94903b73-a664-4f6e-a5b2-82f7e3fcc10d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action" status: 202 len: 0 microversion: 2.1 time: 0.143209 Oct 26 06:13:23.863442 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3828/7648] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:13:23 2022] POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:13:23.870353 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:13:23.871119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:13:23.872035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:13:23.876943 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:23.877807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:23.887793 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:23.888285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:23.888731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:23.889540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:23.889998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:23.890423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:23.894017 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55016. Oct 26 06:13:24.128364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:24.136779 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b8dfa7f-7052-4888-9ad0-bb71a3b4bae9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1750 microversion: 2.1 time: 0.268781 Oct 26 06:13:24.149239 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3821/7649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:23 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1750 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:25.161509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:25.162264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:25.169262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:25.169801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:25.170247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:25.170950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:25.171416 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:25.171856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:25.319255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:25.327600 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b4ed8a0c-6e18-49bb-bb04-c40abfe5110b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.171297 Oct 26 06:13:25.328170 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3829/7650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:25 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:26.351537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:26.352877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:26.363670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:26.364160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:26.364600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:26.365297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:26.365841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:26.366272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:26.373012 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55022. Oct 26 06:13:26.511141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:26.519480 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-68da058d-7c3f-4d65-ac72-ae5fa8e56e29 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.171859 Oct 26 06:13:26.520055 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3822/7651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:26 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:27.544272 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:27.545017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:27.551697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:27.552190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:27.552646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:27.553374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:27.553896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:27.554410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:27.700856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:27.709082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f4b9ca98-18e9-4fa3-acc5-ce103881aca9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.169552 Oct 26 06:13:27.709682 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3830/7652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:27 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:28.734127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:28.734670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:28.741522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:28.742016 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:28.743351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:28.743795 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:28.744256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:28.744689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:28.890987 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:28.900122 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ded8721-77bc-414a-9671-99b3d7ab113a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.170029 Oct 26 06:13:28.900694 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3823/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:28 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:29.924623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:29.925253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:29.932632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:29.933135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:29.933625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:29.934334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:29.934805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:29.935249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:30.077163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:30.085459 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f2b95e43-c94c-4ca3-8ea4-1969a445a0fb tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.164760 Oct 26 06:13:30.086029 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3831/7654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:29 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:31.111009 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:31.111644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:31.119011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:31.119497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:31.119938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:31.120634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:31.121095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:31.121557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:31.267145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:31.275573 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09262e9d-b2f5-4538-ab90-e36eb9838442 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.168796 Oct 26 06:13:31.276157 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3824/7655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:31 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:32.299048 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:32.299670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:32.307748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:32.308246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:32.308695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:32.309421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:32.309889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:32.310326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:32.452444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:32.460726 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29dc3378-4bf1-42b1-8c08-5fefed069582 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.165579 Oct 26 06:13:32.461436 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3832/7656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:32 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:33.485222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:33.485878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:33.492722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:33.493216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:33.493775 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:33.494437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:33.494907 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:33.495442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:33.645564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:33.654422 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8acdaa4e-253f-4d50-87d2-46eb03bba338 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.173150 Oct 26 06:13:33.654994 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3825/7657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:33 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:34.678100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:34.678730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:34.685944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:34.686444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:34.686936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:34.687656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:34.688129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:34.688573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:34.829882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:34.839420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fd935d99-0b3d-42f3-95db-f30447bbee55 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1755 microversion: 2.1 time: 0.165397 Oct 26 06:13:34.839989 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3833/7658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:34 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:13:35.863587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:13:35.864208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:13:35.872092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:35.872573 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:35.873012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:35.873731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:13:35.874189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:13:35.874617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:13:36.019894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:13:36.028772 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a4f38a83-7b96-4f61-8c0a-65b4bc0e470f tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1758 microversion: 2.1 time: 0.169164 Oct 26 06:13:36.029361 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3826/7659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:13:35 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:14:31.214857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-75684872"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:14:31.215604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:31.218389 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:14:31.218542 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action (ip 10.222.0.16) !!! Oct 26 06:14:31.219801 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 26 06:14:31.220616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:14:31.221337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:14:31.229478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:31.229984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:31.230441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:31.231161 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:31.231631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:31.232073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:31.362092 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.network.security_group_api [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Removing security group cc8b6001-c6e5-4ff0-ad06-295e847ff6c0 from port 6289da7c-4d21-4ed1-a552-a62e8f3271d9 Oct 26 06:14:31.667863 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3c29a504-aff8-48f4-b25b-0beeda8e03c0 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action" status: 202 len: 0 microversion: 2.1 time: 0.457323 Oct 26 06:14:31.668591 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3834/7660] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:14:31 2022] POST /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:14:31.677090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-8df25086-b88d-407d-9870-22414045f860 req-c7922492-1eb7-4ee1-84ce-1ba4c6ef5a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:14:31.689668 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:14:31.690272 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 26 06:14:31.693204 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:14:31.693641 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 26 06:14:31.695297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:14:31.697519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:14:31.699758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8df25086-b88d-407d-9870-22414045f860 req-c7922492-1eb7-4ee1-84ce-1ba4c6ef5a27 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:31.700716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8df25086-b88d-407d-9870-22414045f860 req-c7922492-1eb7-4ee1-84ce-1ba4c6ef5a27 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:31.701585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-8df25086-b88d-407d-9870-22414045f860 req-c7922492-1eb7-4ee1-84ce-1ba4c6ef5a27 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:31.732340 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-8df25086-b88d-407d-9870-22414045f860 req-c7922492-1eb7-4ee1-84ce-1ba4c6ef5a27 service nova] Creating event network-changed:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:14:31.738174 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-8df25086-b88d-407d-9870-22414045f860 req-c7922492-1eb7-4ee1-84ce-1ba4c6ef5a27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065838 Oct 26 06:14:31.738732 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3827/7661] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:14:32.751180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:32.751842 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:32.754004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-85909a19-8a48-47b1-85cd-532d67771d52 req-62fd44b9-5775-40f4-b72a-ffc616e924b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:14:32.760227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:32.760732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:32.761417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:32.762331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:32.762809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:32.763258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:32.766325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85909a19-8a48-47b1-85cd-532d67771d52 req-62fd44b9-5775-40f4-b72a-ffc616e924b6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:32.766880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85909a19-8a48-47b1-85cd-532d67771d52 req-62fd44b9-5775-40f4-b72a-ffc616e924b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:32.767395 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-85909a19-8a48-47b1-85cd-532d67771d52 req-62fd44b9-5775-40f4-b72a-ffc616e924b6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:32.779486 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-85909a19-8a48-47b1-85cd-532d67771d52 req-62fd44b9-5775-40f4-b72a-ffc616e924b6 service nova] Creating event network-changed:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:14:32.784700 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-85909a19-8a48-47b1-85cd-532d67771d52 req-62fd44b9-5775-40f4-b72a-ffc616e924b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036195 Oct 26 06:14:32.785913 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3828/7662] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:14:32.858201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lazy-loading 'services' on Instance uuid 962789ad-df56-4562-8a15-bd0bd01afc10 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:14:32.937343 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d03e935d-2107-444f-b269-32b857a3e1ae tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments/7f156826-e5e6-4e63-8185-31668c39982e" status: 202 len: 0 microversion: 2.1 time: 0.190439 Oct 26 06:14:32.938607 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3835/7663] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:14:32 2022] DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments/7f156826-e5e6-4e63-8185-31668c39982e => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:14:32.952737 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:32.957011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:32.967105 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:32.967735 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:32.968282 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:32.969112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:32.973892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:32.974412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:33.017175 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-72bb13c2-1af2-4a25-994f-1f5d9df9b7fc tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073650 Oct 26 06:14:33.018060 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3829/7664] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:14:32 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:14:34.031606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:34.033930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:34.041254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:34.041781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:34.042240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:34.042953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:34.043424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:34.043867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:34.073782 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7909a983-6f43-4b6d-b4d6-960acbe9aaba tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046748 Oct 26 06:14:34.074364 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3836/7665] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:14:34 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:14:35.087854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:35.090346 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:35.097643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:35.097955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:35.098393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:35.099095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:35.099552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:35.099980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:35.131484 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-86e45105-e9e6-469f-88fd-f745d4d0859a tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Oct 26 06:14:35.132048 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3830/7666] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:14:35 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:14:36.144814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:36.147044 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:36.154635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:36.155135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:36.155599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:36.156293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:36.156756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:36.157193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:36.186420 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4055dada-3c71-4d7b-b600-b1e0c3e0c27b tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Oct 26 06:14:36.186990 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3837/7667] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:14:36 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:14:37.199794 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:37.202013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:37.208935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:37.209461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:37.209904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:37.210610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:37.211074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:37.211526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:37.244778 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-cda951ad-b20c-4682-869c-1a90946613d2 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049709 Oct 26 06:14:37.245382 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3831/7668] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:14:37 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:14:38.258224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:38.260532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:38.267615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:38.268116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:38.268574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:38.269279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:38.269779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:38.270222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:38.299128 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1c48ef3f-3aa0-4935-a37a-bca84ddcfb10 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045776 Oct 26 06:14:38.299691 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3838/7669] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 26 06:14:38 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 06:14:38.310533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:38.311038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:38.317855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:38.318350 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:38.318798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:38.319497 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:38.319962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:38.320926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:38.395917 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] HTTP exception thrown: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 is not attached to volume 7f156826-e5e6-4e63-8185-31668c39982e Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Request method failure captured: Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: request: DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments/7f156826-e5e6-4e63-8185-31668c39982e HTTP/1.1 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM6zoajjr_oCeskNblr2hu797eKRduMQd0GC9pvBDLLl6uWOQhivQzwiNxNWeV2CT-duL5twCqKTx-d49Q2LcWR5CxCdUeDjjemwXFSZa6OpH5_vHFulae2L_PFb8REa2oy6jhvR8sFEE6jeDpmFG5Sfez-BtYBNqOnj4sAVixdF5L8 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 830ec1ede9ef4e869c01a89f49adec26 Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 is not attached to volume 7f156826-e5e6-4e63-8185-31668c39982e Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'server_id': '962789ad-df56-4562-8a15-bd0bd01afc10', 'id': '7f156826-e5e6-4e63-8185-31668c39982e'} Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f156826-e5e6-4e63-8185-31668c39982e. Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 is not attached to volume 7f156826-e5e6-4e63-8185-31668c39982e Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:14:38.397578 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 is not attached to volume 7f156826-e5e6-4e63-8185-31668c39982e Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Returning 404 to user: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 is not attached to volume 7f156826-e5e6-4e63-8185-31668c39982e {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-52803757-b3a2-4bff-b212-5f6a655b08b9 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments/7f156826-e5e6-4e63-8185-31668c39982e" status: 404 len: 154 microversion: 2.1 time: 0.093380 Oct 26 06:14:38.403355 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3832/7670] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 26 06:14:38 2022] DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10/os-volume_attachments/7f156826-e5e6-4e63-8185-31668c39982e => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:14:41.661488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:41.662178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:41.670024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:41.670532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:41.670996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:41.671711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:41.672217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:41.672670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:41.697768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:14:41.787853 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-54c632c1-abf4-46aa-95a4-0907d10107e4 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 204 len: 0 microversion: 2.1 time: 0.129897 Oct 26 06:14:41.792407 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3839/7671] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:14:41 2022] DELETE /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:14:41.798102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:41.798828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:41.807819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:41.808312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:41.808752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:41.809488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:41.809948 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:41.810370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:41.953865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:14:41.963715 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e11249d2-27ba-4f10-8561-1f7b01ca2812 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1554 microversion: 2.1 time: 0.169315 Oct 26 06:14:41.964398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3833/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:14:41 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:14:42.987604 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:42.988275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:42.995840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:42.996380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:42.996846 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:42.997595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:42.998075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:42.998530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:43.135845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:14:43.143640 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c309aafa-bc7a-41dc-b1a4-7353f9cfb283 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1554 microversion: 2.1 time: 0.160456 Oct 26 06:14:43.144210 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3840/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:14:42 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:14:44.067030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ae63fd12-e8cd-4c2d-b2f2-75eaf6781230 req-ed02de43-38e7-468c-8e9e-02bd18bd13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962789ad-df56-4562-8a15-bd0bd01afc10", "name": "network-vif-deleted", "tag": "6289da7c-4d21-4ed1-a552-a62e8f3271d9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:14:44.079369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ae63fd12-e8cd-4c2d-b2f2-75eaf6781230 req-ed02de43-38e7-468c-8e9e-02bd18bd13a8 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:44.079960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ae63fd12-e8cd-4c2d-b2f2-75eaf6781230 req-ed02de43-38e7-468c-8e9e-02bd18bd13a8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:44.080401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ae63fd12-e8cd-4c2d-b2f2-75eaf6781230 req-ed02de43-38e7-468c-8e9e-02bd18bd13a8 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:44.093578 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ae63fd12-e8cd-4c2d-b2f2-75eaf6781230 req-ed02de43-38e7-468c-8e9e-02bd18bd13a8 service nova] Creating event network-vif-deleted:6289da7c-4d21-4ed1-a552-a62e8f3271d9 for instance 962789ad-df56-4562-8a15-bd0bd01afc10 on n-h2-862416-4 Oct 26 06:14:44.098659 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ae63fd12-e8cd-4c2d-b2f2-75eaf6781230 req-ed02de43-38e7-468c-8e9e-02bd18bd13a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035312 Oct 26 06:14:44.099281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3834/7674] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:14:44.169185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:44.170380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:44.177400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:44.177897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:44.178348 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:44.179057 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:44.179979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:44.180167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:44.215947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:44.216444 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:44.216902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:44.217390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lazy-loading 'fault' on Instance uuid 962789ad-df56-4562-8a15-bd0bd01afc10 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:14:44.262606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830ec1ede9ef4e869c01a89f49adec26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689dcf0ae06427999dfafaf04dead99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:14:44.270361 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-19415117-ef76-4be4-a934-d1303c3542b3 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 200 len: 1349 microversion: 2.1 time: 0.106925 Oct 26 06:14:44.270921 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3841/7675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:14:44 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:14:45.296412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:45.297125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] [instance: 962789ad-df56-4562-8a15-bd0bd01afc10] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:14:45.303283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:45.303769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:45.304213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:45.305731 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:14:45.306129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:14:45.306562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:14:45.319899 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] HTTP exception thrown: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 could not be found. Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Request method failure captured: Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 HTTP/1.1 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWM6zoajjr_oCeskNblr2hu797eKRduMQd0GC9pvBDLLl6uWOQhivQzwiNxNWeV2CT-duL5twCqKTx-d49Q2LcWR5CxCdUeDjjemwXFSZa6OpH5_vHFulae2L_PFb8REa2oy6jhvR8sFEE6jeDpmFG5Sfez-BtYBNqOnj4sAVixdF5L8 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c689dcf0ae06427999dfafaf04dead99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: c689dcf0ae06427999dfafaf04dead99 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestMinimumBasicScenario-866204112 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 830ec1ede9ef4e869c01a89f49adec26 Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestMinimumBasicScenario-866204112-project Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 could not be found. Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '962789ad-df56-4562-8a15-bd0bd01afc10'} Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 could not be found. Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 could not be found. Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:14:45.322337 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 could not be found. Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Returning 404 to user: Instance 962789ad-df56-4562-8a15-bd0bd01afc10 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3ce492cc-a162-4d1d-a61f-2780821c108d tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10" status: 404 len: 111 microversion: 2.1 time: 0.032431 Oct 26 06:14:45.327936 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3835/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:14:45 2022] GET /compute/v2.1/servers/962789ad-df56-4562-8a15-bd0bd01afc10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:14:45.332339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-04333eb7-bf4f-4207-a071-572eb46218e8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] Calling method '.version_select at 0x7f4709bd69d0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:14:45.356127 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-04333eb7-bf4f-4207-a071-572eb46218e8 tempest-TestMinimumBasicScenario-866204112 tempest-TestMinimumBasicScenario-866204112-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1028455211" status: 202 len: 0 microversion: 2.1 time: 0.027521 Oct 26 06:14:45.356704 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3842/7677] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 26 06:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1028455211 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:14:54.662106 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-09372a39-0b72-4c50-8b07-aa6f2e8f264c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: .version_select at 0x7f470b4d9d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-933071014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgWrlEvm7DNR5nVRQ/XZqde942g73sPRE/wvbuxTHrbPFR1yEtcvTLc+qV4pzoZIDuXsaBJr/Bu6PATBuysMUB/CKYJYW3O9pQKZPYqS01MTiHa4Bmngs6yUMuQW9e4YA=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:14:54.678062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-09372a39-0b72-4c50-8b07-aa6f2e8f264c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:14:54.685129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-09372a39-0b72-4c50-8b07-aa6f2e8f264c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:14:54.713675 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-09372a39-0b72-4c50-8b07-aa6f2e8f264c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.228207 Oct 26 06:14:54.714277 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3836/7678] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:14:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:15:00.860300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:00.861598 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:00.871202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1857911411", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "fd40bc6f-cc8b-481d-9760-b8a968ed6e60"}], "key_name": "tempest-TestNetworkAdvancedServerOps-933071014", "security_groups": [{"name": "tempest-secgroup-smoke-1539141482"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:01.042385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] validate_networks() for [('fd40bc6f-cc8b-481d-9760-b8a968ed6e60', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:15:01.542569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:15:01.543287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:15:01.544121 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:15:01.544695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:15:01.545472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:15:01.556446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:01.556948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:01.557630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:01.558634 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:01.559349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:01.560002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:01.586431 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:15:01.595196 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:15:01.610712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:15:01.613591 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:15:01.667848 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1117658a-abad-4469-8d24-f122139af0c9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810828 Oct 26 06:15:01.674746 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3843/7679] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:15:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:15:01.677940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=38 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:01.686214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5c4adaa-421d-42da-9c2d-5860405a4b89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:01.687520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5c4adaa-421d-42da-9c2d-5860405a4b89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:01.751303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5c4adaa-421d-42da-9c2d-5860405a4b89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:01.758621 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5c4adaa-421d-42da-9c2d-5860405a4b89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1266 microversion: 2.1 time: 0.081662 Oct 26 06:15:01.759226 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3837/7680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:01 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:02.785102 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:02.785796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:02.792120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:02.792623 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:02.793089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:02.793859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:02.794334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:02.794780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:02.871388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:02.879633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-001d2bb1-3b17-43a7-aba8-e4a6e71b4246 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1318 microversion: 2.1 time: 0.099342 Oct 26 06:15:02.880245 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3844/7681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:02 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:03.904485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:03.905695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:03.909607 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:03.915783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:03.916283 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:03.916730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:03.917494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:03.918128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:03.918567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:04.063268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:04.072401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3d094570-6982-40c7-9e1f-4a227b68cdc9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1392 microversion: 2.1 time: 0.172071 Oct 26 06:15:04.073054 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3838/7682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:03 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:04.574158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-139989ec-af8e-47b8-93cc-a0d610d71100 req-49be65ca-4091-4d40-b69e-9c33b07e33f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34e4bf3-5a5a-4170-85a6-6e7d12b769b9", "tag": "c09cc372-ef6e-4a8c-b231-f7221ddcaa9b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:04.586651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-139989ec-af8e-47b8-93cc-a0d610d71100 req-49be65ca-4091-4d40-b69e-9c33b07e33f5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:04.587167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-139989ec-af8e-47b8-93cc-a0d610d71100 req-49be65ca-4091-4d40-b69e-9c33b07e33f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:04.587625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-139989ec-af8e-47b8-93cc-a0d610d71100 req-49be65ca-4091-4d40-b69e-9c33b07e33f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:04.599795 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-139989ec-af8e-47b8-93cc-a0d610d71100 req-49be65ca-4091-4d40-b69e-9c33b07e33f5 service nova] Creating event network-changed:c09cc372-ef6e-4a8c-b231-f7221ddcaa9b for instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 on n-h1-862416-4 Oct 26 06:15:04.606210 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-139989ec-af8e-47b8-93cc-a0d610d71100 req-49be65ca-4091-4d40-b69e-9c33b07e33f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036564 Oct 26 06:15:04.606818 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3845/7683] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:15:05.096327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:05.097251 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:05.105065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:05.105597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:05.106039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:05.106736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:05.107406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:05.108223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:05.243218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:05.250897 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c20aa08-b90d-47c9-bb01-51b5ab081ad0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1392 microversion: 2.1 time: 0.158582 Oct 26 06:15:05.251474 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3839/7684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:05 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:06.277472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:06.278185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:06.284360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:06.284850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:06.285697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:06.286019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:06.286483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:06.286921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:06.428200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:06.437186 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f717f63a-fe9c-4b11-a1f6-42b2e8e45db0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1392 microversion: 2.1 time: 0.165725 Oct 26 06:15:06.438021 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3846/7685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:06 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:07.463222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:07.464087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:07.471052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:07.471542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:07.471983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:07.472688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:07.473147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:07.473598 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:07.608293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:07.616058 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5d124a88-7543-4a7a-8487-1dcca43a61ad tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1392 microversion: 2.1 time: 0.157992 Oct 26 06:15:07.616661 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3840/7686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:07 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:08.639907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:08.640532 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:08.647305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:08.647994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:08.648453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:08.649150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:08.649662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:08.650099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:08.787344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:08.795465 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f5bffb9c-e682-4aef-89fd-0d3fbab924bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1392 microversion: 2.1 time: 0.159839 Oct 26 06:15:08.796047 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3847/7687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:08 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:09.422744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-a350906f-b315-4c3d-b00e-e02aeecbe451 req-1e47cc61-b1dc-4352-8263-24aef9a27551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34e4bf3-5a5a-4170-85a6-6e7d12b769b9", "name": "network-vif-plugged", "status": "completed", "tag": "c09cc372-ef6e-4a8c-b231-f7221ddcaa9b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:09.438042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a350906f-b315-4c3d-b00e-e02aeecbe451 req-1e47cc61-b1dc-4352-8263-24aef9a27551 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:09.438042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a350906f-b315-4c3d-b00e-e02aeecbe451 req-1e47cc61-b1dc-4352-8263-24aef9a27551 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:09.438042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-a350906f-b315-4c3d-b00e-e02aeecbe451 req-1e47cc61-b1dc-4352-8263-24aef9a27551 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:09.448137 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-a350906f-b315-4c3d-b00e-e02aeecbe451 req-1e47cc61-b1dc-4352-8263-24aef9a27551 service nova] Creating event network-vif-plugged:c09cc372-ef6e-4a8c-b231-f7221ddcaa9b for instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 on n-h1-862416-4 Oct 26 06:15:09.453396 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-a350906f-b315-4c3d-b00e-e02aeecbe451 req-1e47cc61-b1dc-4352-8263-24aef9a27551 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034412 Oct 26 06:15:09.454033 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3841/7688] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:15:09.819596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:09.821197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:09.827812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:09.828314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:09.828772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:09.829516 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:09.829987 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:09.830429 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:09.963293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:09.971339 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dfaf6fd4-a263-4e32-8c77-527babdc132a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1392 microversion: 2.1 time: 0.155698 Oct 26 06:15:09.971921 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3848/7689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:09 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:10.996862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:10.997638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:11.003857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:11.004347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:11.004792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:11.005526 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:11.005991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:11.006424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:11.137806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:11.149185 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d812c188-bc6e-4fb7-b0d2-c5940f55ac05 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1565 microversion: 2.1 time: 0.157933 Oct 26 06:15:11.149815 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3842/7690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:10 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:11.172980 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:11.173628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:11.180436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:11.180927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:11.181395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:11.182175 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:11.183353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:11.183831 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:11.325912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:11.337772 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a6c28701-3a6a-4a10-bb99-9d95504c39fd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1565 microversion: 2.1 time: 0.168500 Oct 26 06:15:11.338292 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3849/7691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:11 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:13.312053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:13.313026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:13.314531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-dd809e75-1859-4833-a341-1989b1adac62 req-50c7c983-757d-4d55-aaca-f5ffa1778b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34e4bf3-5a5a-4170-85a6-6e7d12b769b9", "tag": "c09cc372-ef6e-4a8c-b231-f7221ddcaa9b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:13.318070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:13.321462 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:13.321870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:13.323067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:13.323274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:13.323554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:13.324768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:13.325273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:13.325949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:13.331229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd809e75-1859-4833-a341-1989b1adac62 req-50c7c983-757d-4d55-aaca-f5ffa1778b9c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:13.331727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd809e75-1859-4833-a341-1989b1adac62 req-50c7c983-757d-4d55-aaca-f5ffa1778b9c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:13.332405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-dd809e75-1859-4833-a341-1989b1adac62 req-50c7c983-757d-4d55-aaca-f5ffa1778b9c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:13.345326 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-dd809e75-1859-4833-a341-1989b1adac62 req-50c7c983-757d-4d55-aaca-f5ffa1778b9c service nova] Creating event network-changed:c09cc372-ef6e-4a8c-b231-f7221ddcaa9b for instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 on n-h1-862416-4 Oct 26 06:15:13.350778 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-dd809e75-1859-4833-a341-1989b1adac62 req-50c7c983-757d-4d55-aaca-f5ffa1778b9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040314 Oct 26 06:15:13.351384 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3850/7692] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:15:13.480668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:13.489119 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d115d0d2-e883-429d-a489-320eb6426cf7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1565 microversion: 2.1 time: 0.181757 Oct 26 06:15:13.490461 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3843/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:13 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:36.745679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:36.746562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=36 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:36.751123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:36.753423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:36.761366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:36.762299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:36.762763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:36.763477 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:36.763950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:36.764394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:36.814554 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dea19691-db4d-4d3a-83c1-339a9d0d4c5d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action" status: 200 len: 24576 microversion: 2.1 time: 0.071318 Oct 26 06:15:36.815183 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3851/7694] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:15:36 2022] POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action => generated 24576 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:15:47.757167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:47.757806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:47.759809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=11 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:47.761056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=32 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:47.767487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:47.767986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:47.768433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:47.769167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:47.769690 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:47.770124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:47.837394 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d46f5245-374f-4e3c-8dc8-f276486d10d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action" status: 202 len: 0 microversion: 2.1 time: 0.084319 Oct 26 06:15:47.840050 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3844/7695] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:15:47 2022] POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:15:47.847581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:47.848307 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:47.852338 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:47.853260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:15:47.859163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:47.859551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:47.860012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:47.860739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:47.861214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:47.861694 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:48.055749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:48.064463 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e24a54f9-2d53-4ea6-964b-54c6ff60afa5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1689 microversion: 2.1 time: 0.221189 Oct 26 06:15:48.065035 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3852/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:47 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:49.090594 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:49.091906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:49.099254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:49.099748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:49.100202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:49.100898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:49.101392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:49.101849 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:49.288834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:49.297458 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3c1ff748-60c9-4d6f-a82b-3ff1c305419b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1669 microversion: 2.1 time: 0.211413 Oct 26 06:15:49.298034 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3845/7697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:49 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:50.391641 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:50.393850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:50.403268 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:50.403783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:50.404244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:50.404958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:50.405463 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:50.405912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:50.457786 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-688a3f3d-1942-42af-bc26-82806ee8d81b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action" status: 200 len: 32646 microversion: 2.1 time: 0.069874 Oct 26 06:15:50.458755 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3853/7698] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:15:50 2022] POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:15:50.470991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:50.471558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:50.478456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:50.478946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:50.479521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:50.480221 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:50.480688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:50.481121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:50.553429 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac6a23f7-f847-42d4-809b-aa77a041b7f4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action" status: 202 len: 0 microversion: 2.1 time: 0.086152 Oct 26 06:15:50.554115 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3846/7699] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:15:50 2022] POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:15:50.563213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:50.563960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:50.571451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:50.571690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:50.572150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:50.573722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:50.574241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:50.574695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:50.713246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:50.723181 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5edd8740-f6b2-46bc-aacc-df2fd2bc56d8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1676 microversion: 2.1 time: 0.164339 Oct 26 06:15:50.723788 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3854/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:50 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:51.749588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:51.750242 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:51.756400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:51.756884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:51.757336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:51.758082 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:51.758542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:51.758962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:51.894406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:51.902259 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-00826fa0-168c-491c-9b7b-30ad8257a057 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1684 microversion: 2.1 time: 0.158912 Oct 26 06:15:51.903233 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3847/7701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:51 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:52.001748 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:52.003882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:52.011400 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:52.011902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:52.013194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:52.013929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:52.014406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:52.014852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:52.065885 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e588f424-72a5-431d-91e7-0857ce125505 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action" status: 200 len: 38362 microversion: 2.1 time: 0.068010 Oct 26 06:15:52.066519 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3855/7702] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:15:51 2022] POST /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9/action => generated 38362 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 06:15:53.057435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-600aebc8-a487-454e-b60a-766aa30aee5b req-1589286a-2cdb-47a3-b152-c1de658eb7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34e4bf3-5a5a-4170-85a6-6e7d12b769b9", "tag": "c09cc372-ef6e-4a8c-b231-f7221ddcaa9b"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:53.063121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:53.063631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:53.071207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:53.071990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:53.072544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:53.073405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:53.073969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:53.074679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:53.075584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-600aebc8-a487-454e-b60a-766aa30aee5b req-1589286a-2cdb-47a3-b152-c1de658eb7fd service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:53.076080 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-600aebc8-a487-454e-b60a-766aa30aee5b req-1589286a-2cdb-47a3-b152-c1de658eb7fd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:53.076526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-600aebc8-a487-454e-b60a-766aa30aee5b req-1589286a-2cdb-47a3-b152-c1de658eb7fd service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:53.089421 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-600aebc8-a487-454e-b60a-766aa30aee5b req-1589286a-2cdb-47a3-b152-c1de658eb7fd service nova] Creating event network-changed:c09cc372-ef6e-4a8c-b231-f7221ddcaa9b for instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 on n-h1-862416-4 Oct 26 06:15:53.095803 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-600aebc8-a487-454e-b60a-766aa30aee5b req-1589286a-2cdb-47a3-b152-c1de658eb7fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042374 Oct 26 06:15:53.096406 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3856/7703] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:15:53.102667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:15:53.187035 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4b53d6e6-af5a-4e9f-858e-72cd9c00a865 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 204 len: 0 microversion: 2.1 time: 0.137128 Oct 26 06:15:53.187643 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3848/7704] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:15:53 2022] DELETE /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:15:53.198234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:53.198959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:53.206741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:53.207250 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:53.207688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:53.208401 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:53.208868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:53.209337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:53.351843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:53.360588 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-46264476-1e8f-464d-8084-3386ba630f29 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1690 microversion: 2.1 time: 0.168042 Oct 26 06:15:53.361160 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3857/7705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:53 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:54.384909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:54.385648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:54.392844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:54.393370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:54.393827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:54.394535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:54.395006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:54.395445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:54.533525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:54.541268 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7f94e721-d6c3-4f9d-a077-0d5d2849d4ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1690 microversion: 2.1 time: 0.160781 Oct 26 06:15:54.541876 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3849/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:54 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:55.566545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:55.567310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:55.574330 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:55.575491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:55.575960 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:55.576686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:55.577164 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:55.577639 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:55.618894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b11289ed-edae-4730-8976-e3549f7c5e2b req-6770b0b8-b7c7-4e6b-81ee-265fa0fcef55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34e4bf3-5a5a-4170-85a6-6e7d12b769b9", "name": "network-vif-deleted", "tag": "c09cc372-ef6e-4a8c-b231-f7221ddcaa9b"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:15:55.630087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b11289ed-edae-4730-8976-e3549f7c5e2b req-6770b0b8-b7c7-4e6b-81ee-265fa0fcef55 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:55.630576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b11289ed-edae-4730-8976-e3549f7c5e2b req-6770b0b8-b7c7-4e6b-81ee-265fa0fcef55 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:55.633367 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b11289ed-edae-4730-8976-e3549f7c5e2b req-6770b0b8-b7c7-4e6b-81ee-265fa0fcef55 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:55.646135 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b11289ed-edae-4730-8976-e3549f7c5e2b req-6770b0b8-b7c7-4e6b-81ee-265fa0fcef55 service nova] Creating event network-vif-deleted:c09cc372-ef6e-4a8c-b231-f7221ddcaa9b for instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 on n-h1-862416-4 Oct 26 06:15:55.653826 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:15:55.654772 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b11289ed-edae-4730-8976-e3549f7c5e2b req-6770b0b8-b7c7-4e6b-81ee-265fa0fcef55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039458 Oct 26 06:15:55.655401 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3850/7707] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:15:55.662042 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d68c505e-c40c-4441-b864-a482d518ef34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 200 len: 1503 microversion: 2.1 time: 0.099786 Oct 26 06:15:55.662761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3858/7708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:55 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 1503 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:15:56.689294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:15:56.690032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: a34e4bf3-5a5a-4170-85a6-6e7d12b769b9] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:15:56.696248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:56.696685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:56.697132 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:56.697855 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:15:56.698321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:15:56.698753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:15:56.712000 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] HTTP exception thrown: Instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 could not be found. Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Request method failure captured: Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 HTTP/1.1 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWNBdaubfcGN37kV_fD-1dsTbVC6x7wuiXFeunBQvJWFh1oBys0stBGAtD0b3RfVKTL6BeM_L19hGap6dsz3oLe2u7gJDD4WBbqspVYv5SGI0mPvijI9_tC554BxXFcrRCpAMijqqt7_RliTJfLg-U7OgHaxv673xiCfcAWQavUgHrWg Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4d9b8fa88864052831d44570a94327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 9644d94c283d4cc6ae4396b85ca1d620 Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 could not be found. Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'a34e4bf3-5a5a-4170-85a6-6e7d12b769b9'} Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 could not be found. Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 could not be found. Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:15:56.713650 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 could not be found. Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Returning 404 to user: Instance a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b215a392-bd35-4600-8b91-08951e895e50 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9" status: 404 len: 111 microversion: 2.1 time: 0.031860 Oct 26 06:15:56.719316 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3851/7709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:15:56 2022] GET /compute/v2.1/servers/a34e4bf3-5a5a-4170-85a6-6e7d12b769b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:16:00.072972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-099f18ce-67f3-4726-b47b-3a6f3c29f3c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '.version_select at 0x7f470931ba60>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:00.096228 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-099f18ce-67f3-4726-b47b-3a6f3c29f3c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-933071014" status: 202 len: 0 microversion: 2.1 time: 0.027042 Oct 26 06:16:00.100100 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3859/7710] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 06:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-933071014 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:16:00.135814 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dd30606d-8506-40ef-9106-69728fad22ff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: .version_select at 0x7f470a7ff280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1591223363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCn1DyOSdj9qCeOqqVsInmbqcxD1aU+WQB1kz3RH0wst+k+QQdsFg4ieUdJsdi8r/lTGDvwYAUj2CErH97fXWaEqPUwucWeq533dXM7/o2HGRsyri5XBh8ANxx9DR/zK2g=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:16:00.154418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-dd30606d-8506-40ef-9106-69728fad22ff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:16:00.159901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-dd30606d-8506-40ef-9106-69728fad22ff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:16:00.185128 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dd30606d-8506-40ef-9106-69728fad22ff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054106 Oct 26 06:16:00.185846 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3852/7711] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:16:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:16:05.727459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=34 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:05.732814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-577816563", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "0a8ed63b-a902-4180-82fc-3734242b08a2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1591223363", "security_groups": [{"name": "tempest-secgroup-smoke-1226361035"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:16:05.861264 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] validate_networks() for [('0a8ed63b-a902-4180-82fc-3734242b08a2', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:16:06.287587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:16:06.288116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:16:06.288703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:16:06.289206 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:16:06.290062 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:16:06.299902 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:06.300510 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:06.301035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:06.301888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:06.302428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:06.303020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:06.321756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:16:06.328083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:16:06.342435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:16:06.344804 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:16:06.395142 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-014180f5-b2dd-442d-a7a3-3575288672ca tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669085 Oct 26 06:16:06.395741 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3860/7712] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:16:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:16:06.408941 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b3cf10ef-2d6d-45a4-9060-d58b5b3b8bcb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:06.410284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b3cf10ef-2d6d-45a4-9060-d58b5b3b8bcb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:06.481004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b3cf10ef-2d6d-45a4-9060-d58b5b3b8bcb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:06.488814 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b3cf10ef-2d6d-45a4-9060-d58b5b3b8bcb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1266 microversion: 2.1 time: 0.084874 Oct 26 06:16:06.489427 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3853/7713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:06 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:07.514625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:07.515392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:07.530042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:07.530042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:07.530406 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:07.531117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:07.537188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:07.539286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:07.634248 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:07.642921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2961a382-a558-4e17-bb3e-e829bd7bbb4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1336 microversion: 2.1 time: 0.134100 Oct 26 06:16:07.643562 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3861/7714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:07 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:08.666606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:08.667361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:08.669585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:08.680447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:08.681069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:08.681611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:08.682414 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:08.682952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:08.683471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:08.932246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:08.941074 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b45dd37a-d9ef-4673-8a94-ffac961441fc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1392 microversion: 2.1 time: 0.278376 Oct 26 06:16:08.942708 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3854/7715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:08 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:09.111931 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-212b147b-93fe-47e5-968a-abdb6509f59e req-3b4891a7-638e-45f0-9e41-d9075b6569f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cdeaea-9588-4124-807d-7bdf608a38b1", "tag": "f48abbb7-b695-48ff-bedf-9ebe5fb9385c"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:16:09.125428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-212b147b-93fe-47e5-968a-abdb6509f59e req-3b4891a7-638e-45f0-9e41-d9075b6569f5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:09.126384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-212b147b-93fe-47e5-968a-abdb6509f59e req-3b4891a7-638e-45f0-9e41-d9075b6569f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:09.127184 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-212b147b-93fe-47e5-968a-abdb6509f59e req-3b4891a7-638e-45f0-9e41-d9075b6569f5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:09.141764 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-212b147b-93fe-47e5-968a-abdb6509f59e req-3b4891a7-638e-45f0-9e41-d9075b6569f5 service nova] Creating event network-changed:f48abbb7-b695-48ff-bedf-9ebe5fb9385c for instance c1cdeaea-9588-4124-807d-7bdf608a38b1 on n-h2-862416-4 Oct 26 06:16:09.148364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-212b147b-93fe-47e5-968a-abdb6509f59e req-3b4891a7-638e-45f0-9e41-d9075b6569f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040928 Oct 26 06:16:09.149761 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3862/7716] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:16:09.966729 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:09.967351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:09.974321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:09.974816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:09.975261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:09.975967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:09.976432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:09.976871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:10.112387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:10.120084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d69edb1b-335f-4e7e-9226-ad1b169afea7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1392 microversion: 2.1 time: 0.157957 Oct 26 06:16:10.120670 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3855/7717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:09 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:11.144910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:11.145588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:11.151751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:11.152805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:11.153411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:11.154115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:11.154581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:11.155021 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:11.289149 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:11.297791 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2bf27f93-913b-4cb6-9b2f-f1a1f7487dc6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1392 microversion: 2.1 time: 0.157874 Oct 26 06:16:11.298593 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3863/7718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:11 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:12.321359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:12.322030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:12.330428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:12.330927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:12.331377 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:12.332472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:12.333290 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:12.333773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:12.482840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:12.491536 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-dbd55bd5-0f53-4935-a7ef-42511573a4ea tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1392 microversion: 2.1 time: 0.174099 Oct 26 06:16:12.492127 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3856/7719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:12 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:13.349201 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d4177124-9add-4933-8812-23eee7250029 req-b8847aa7-1144-43ea-aa30-73260887b797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdeaea-9588-4124-807d-7bdf608a38b1", "name": "network-vif-plugged", "status": "completed", "tag": "f48abbb7-b695-48ff-bedf-9ebe5fb9385c"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:16:13.360438 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d4177124-9add-4933-8812-23eee7250029 req-b8847aa7-1144-43ea-aa30-73260887b797 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:13.361056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d4177124-9add-4933-8812-23eee7250029 req-b8847aa7-1144-43ea-aa30-73260887b797 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:13.361709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d4177124-9add-4933-8812-23eee7250029 req-b8847aa7-1144-43ea-aa30-73260887b797 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:13.378399 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d4177124-9add-4933-8812-23eee7250029 req-b8847aa7-1144-43ea-aa30-73260887b797 service nova] Creating event network-vif-plugged:f48abbb7-b695-48ff-bedf-9ebe5fb9385c for instance c1cdeaea-9588-4124-807d-7bdf608a38b1 on n-h2-862416-4 Oct 26 06:16:13.383427 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d4177124-9add-4933-8812-23eee7250029 req-b8847aa7-1144-43ea-aa30-73260887b797 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038308 Oct 26 06:16:13.384039 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3864/7720] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:16:13.517552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:13.518174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:13.524922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:13.525443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:13.525920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:13.526616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:13.527582 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:13.528287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:13.660037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:13.667933 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c87d40a2-4d2d-4bf8-b7eb-6bd4b8710aff tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1392 microversion: 2.1 time: 0.154412 Oct 26 06:16:13.668657 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3857/7721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:13 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:14.692811 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:14.693552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:14.700450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:14.700886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:14.701359 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:14.702061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:14.702526 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:14.702963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:14.853456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:14.862397 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-caaf3454-653f-47eb-a995-7e03f1e077c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1392 microversion: 2.1 time: 0.174607 Oct 26 06:16:14.862991 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3865/7722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:14 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:15.885532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:15.886149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:15.894179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:15.894666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:15.895109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:15.895802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:15.896261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:15.896689 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:16.028223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:16.035892 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d4a9e913-1732-4014-95ce-82e8d8402788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1563 microversion: 2.1 time: 0.154389 Oct 26 06:16:16.036474 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3858/7723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:15 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:16.134883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:16.135511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:16.142368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:16.142867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:16.143320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:16.144034 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:16.144504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:16.144944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:16.280649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:16.288714 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-dd8eb48f-beff-4082-aca6-26f23342d929 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1563 microversion: 2.1 time: 0.157696 Oct 26 06:16:16.289334 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3866/7724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:16 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:18.013802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:16:18.014369 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:18.016514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:18.018074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:18.021423 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-016aa0f2-86a4-4e46-b591-497cf0ecdc95 req-09e70350-b251-4ce9-b482-c176f905b67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cdeaea-9588-4124-807d-7bdf608a38b1", "tag": "f48abbb7-b695-48ff-bedf-9ebe5fb9385c"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:16:18.023509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:18.024004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:18.024446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:18.025146 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:18.025894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:18.026408 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:18.027837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:18.028809 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:18.030460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:18.040737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-016aa0f2-86a4-4e46-b591-497cf0ecdc95 req-09e70350-b251-4ce9-b482-c176f905b67f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:18.041403 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-016aa0f2-86a4-4e46-b591-497cf0ecdc95 req-09e70350-b251-4ce9-b482-c176f905b67f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:18.042101 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-016aa0f2-86a4-4e46-b591-497cf0ecdc95 req-09e70350-b251-4ce9-b482-c176f905b67f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:18.056364 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-016aa0f2-86a4-4e46-b591-497cf0ecdc95 req-09e70350-b251-4ce9-b482-c176f905b67f service nova] Creating event network-changed:f48abbb7-b695-48ff-bedf-9ebe5fb9385c for instance c1cdeaea-9588-4124-807d-7bdf608a38b1 on n-h2-862416-4 Oct 26 06:16:18.062204 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-016aa0f2-86a4-4e46-b591-497cf0ecdc95 req-09e70350-b251-4ce9-b482-c176f905b67f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045052 Oct 26 06:16:18.063374 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3867/7725] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:16:18.260784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:16:18.268907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b2e6ccb8-f57d-442c-89d4-692e75e1b8f3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1563 microversion: 2.1 time: 0.259689 Oct 26 06:16:18.269541 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3859/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:16:18 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1563 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:16:49.599958 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=32 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:49.600725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:16:49.606097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:16:49.608347 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:16:49.615163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:49.615662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:49.616146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:49.616843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:16:49.617331 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:16:49.617772 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:16:49.668342 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5668f65-6245-4298-9010-8baaf55f8208 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action" status: 200 len: 24570 microversion: 2.1 time: 0.070313 Oct 26 06:16:49.669202 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3868/7727] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:16:49 2022] POST /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:17:20.047743 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:17:20.048488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:17:20.052812 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:17:20.055111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:20.062354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:20.062847 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:20.063302 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:20.064004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:20.064472 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:20.064909 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:20.141688 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f28bae75-85bf-411d-bf47-47249a0c94c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action" status: 202 len: 0 microversion: 2.1 time: 0.095636 Oct 26 06:17:20.142355 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3860/7728] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:17:20 2022] POST /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:17:20.152729 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:20.153306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:20.155868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:17:20.156630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:17:20.164990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:20.165534 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:20.165992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:20.166704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:20.167172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:20.167661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:20.415502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:20.424043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a9ad7bf2-ffa6-4e2d-8cc3-a4269f501ff5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1674 microversion: 2.1 time: 0.276480 Oct 26 06:17:20.424630 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3869/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:20 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:21.453076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:21.453806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:21.460026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:21.460516 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:21.460952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:21.461666 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:21.462126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:21.462554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:21.597773 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:21.606965 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-85fad277-68ee-42d6-9b08-958580ec5aa1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.159954 Oct 26 06:17:21.607552 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3861/7730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:21 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:22.631278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:22.631912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:22.639565 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:22.640073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:22.640537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:22.641254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:22.641756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:22.642207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:22.776982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:22.784985 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1298fa01-684b-4e13-b9bd-e89d1d40ba86 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.157604 Oct 26 06:17:22.785846 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3870/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:22 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:23.811610 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:23.812233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:23.819093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:23.819587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:23.820036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:23.820741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:23.821204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:23.821662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:23.953893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:23.961903 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e075af30-3dba-49b7-a45a-30a6110af43e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.156139 Oct 26 06:17:23.962485 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3862/7732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:23 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:24.985752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:24.986378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:24.993228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:24.993752 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:24.994209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:24.994914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:24.995385 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:24.996051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:25.125480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:25.133195 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e7ed0d80-ed9c-401c-8971-5349f596e5c4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.151543 Oct 26 06:17:25.133810 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3871/7733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:24 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:26.157977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:26.158588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:26.165456 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:26.165942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:26.166385 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:26.167076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:26.167707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:26.168159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:26.304563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:26.313114 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-89d3c723-2a48-4d79-9def-7c46498fa19a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.159067 Oct 26 06:17:26.313743 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3863/7734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:26 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:27.338417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:27.339037 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:27.346460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:27.346954 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:27.347405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:27.348104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:27.348570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:27.349008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:27.484104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:27.492889 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8f5d4e2f-f2ad-41b0-958e-4d699a1f999f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.158546 Oct 26 06:17:27.493490 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3872/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:27 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:28.517973 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:28.518597 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:28.525010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:28.525538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:28.525981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:28.526675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:28.528265 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:28.528695 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:28.664135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:28.672043 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-787c34a5-3032-446d-96bc-033be682892b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.158120 Oct 26 06:17:28.672628 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3864/7736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:28 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:29.696070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:29.696624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:29.703514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:29.704016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:29.704457 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:29.705155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:29.705650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:29.706091 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:29.836879 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:29.845256 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a5e4b772-2c9c-4f08-ba86-38889f7fcba6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.153149 Oct 26 06:17:29.845862 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3873/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:29 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:30.868077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:30.868733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:30.875887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:30.876380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:30.876828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:30.877559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:30.878022 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:30.878454 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:31.014967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:31.022737 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d9b5f332-cb1f-4674-b8c4-88e5a9fabd9d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1679 microversion: 2.1 time: 0.158576 Oct 26 06:17:31.023314 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3865/7738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:30 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:17:32.047950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:17:32.048574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:17:32.055589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:32.056089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:32.056539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:32.057241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:17:32.057732 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:17:32.058244 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:17:32.188531 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:17:32.196213 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5e121baa-da70-4c0d-9982-74dfc5a721bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1682 microversion: 2.1 time: 0.152211 Oct 26 06:17:32.196785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3874/7739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:17:32 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:04.416234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:04.419099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:04.421575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=12 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:04.422416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:04.423553 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:18:04.423683 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action (ip 10.222.0.16) !!! Oct 26 06:18:04.431716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:04.432212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:04.432663 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:04.433792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:04.433940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:04.434329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:04.493737 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fd165b54-6a71-4b9e-afc5-8a4ba7a4fc62 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action" status: 200 len: 69125 microversion: 2.1 time: 0.081336 Oct 26 06:18:04.494419 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3866/7740] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:18:04 2022] POST /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1/action => generated 69125 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:18:21.748618 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:21.749188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:21.751551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=12 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:21.752253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:21.752778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=36 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:21.753885 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 26 06:18:21.754976 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 26 06:18:21.757101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:21.763497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:21.764051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:21.764731 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:21.765504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:21.765985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:21.766433 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:21.793112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:18:21.820169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-ba6ed02c-dd67-4241-9885-48af4c39e0c0 req-00609f19-9919-4f8a-8834-54aaeff4bad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cdeaea-9588-4124-807d-7bdf608a38b1", "tag": "f48abbb7-b695-48ff-bedf-9ebe5fb9385c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:21.833246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ba6ed02c-dd67-4241-9885-48af4c39e0c0 req-00609f19-9919-4f8a-8834-54aaeff4bad9 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:21.833968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ba6ed02c-dd67-4241-9885-48af4c39e0c0 req-00609f19-9919-4f8a-8834-54aaeff4bad9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:21.836336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-ba6ed02c-dd67-4241-9885-48af4c39e0c0 req-00609f19-9919-4f8a-8834-54aaeff4bad9 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:21.849300 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-ba6ed02c-dd67-4241-9885-48af4c39e0c0 req-00609f19-9919-4f8a-8834-54aaeff4bad9 service nova] Creating event network-changed:f48abbb7-b695-48ff-bedf-9ebe5fb9385c for instance c1cdeaea-9588-4124-807d-7bdf608a38b1 on n-h2-862416-4 Oct 26 06:18:21.855591 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-ba6ed02c-dd67-4241-9885-48af4c39e0c0 req-00609f19-9919-4f8a-8834-54aaeff4bad9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108839 Oct 26 06:18:21.856273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3867/7741] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:18:21.882035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-91499359-bc71-40b4-b33d-51352ee00d54 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 204 len: 0 microversion: 2.1 time: 0.137458 Oct 26 06:18:21.882794 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3875/7742] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:18:21 2022] DELETE /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:18:21.896272 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:21.896995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:21.905678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:21.906174 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:21.906628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:21.907342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:21.907837 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:21.908273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:22.051061 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:22.058884 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f0ad9c8a-a0c3-4be5-b501-0e66701acdf6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1688 microversion: 2.1 time: 0.169940 Oct 26 06:18:22.059590 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3868/7743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:21 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:23.085408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:23.086131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:23.093566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:23.094072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:23.094530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:23.095237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:23.095709 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:23.096157 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:23.576677 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:23.585987 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85c2c485-312e-49f2-bdec-b9ffc7241c45 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 200 len: 1688 microversion: 2.1 time: 0.504735 Oct 26 06:18:23.594352 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3876/7744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:23 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 1688 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:24.095238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-bfb73a10-514e-4df9-9601-5edd3f1b5043 req-8e7d9f1c-7bd2-4355-825f-c70320623b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdeaea-9588-4124-807d-7bdf608a38b1", "name": "network-vif-deleted", "tag": "f48abbb7-b695-48ff-bedf-9ebe5fb9385c"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:24.105625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bfb73a10-514e-4df9-9601-5edd3f1b5043 req-8e7d9f1c-7bd2-4355-825f-c70320623b3b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:24.106163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bfb73a10-514e-4df9-9601-5edd3f1b5043 req-8e7d9f1c-7bd2-4355-825f-c70320623b3b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:24.106723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-bfb73a10-514e-4df9-9601-5edd3f1b5043 req-8e7d9f1c-7bd2-4355-825f-c70320623b3b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:24.120861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-bfb73a10-514e-4df9-9601-5edd3f1b5043 req-8e7d9f1c-7bd2-4355-825f-c70320623b3b service nova] Creating event network-vif-deleted:f48abbb7-b695-48ff-bedf-9ebe5fb9385c for instance c1cdeaea-9588-4124-807d-7bdf608a38b1 on n-h2-862416-4 Oct 26 06:18:24.126411 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-bfb73a10-514e-4df9-9601-5edd3f1b5043 req-8e7d9f1c-7bd2-4355-825f-c70320623b3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094069 Oct 26 06:18:24.127610 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3869/7745] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:18:24.610867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:24.611453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: c1cdeaea-9588-4124-807d-7bdf608a38b1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:24.618296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:24.618801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:24.619267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:24.619974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:24.620445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:24.620893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:24.635633 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] HTTP exception thrown: Instance c1cdeaea-9588-4124-807d-7bdf608a38b1 could not be found. Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Request method failure captured: Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 HTTP/1.1 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWNBdaubfcGN37kV_fD-1dsTbVC6x7wuiXFeunBQvJWFh1oBys0stBGAtD0b3RfVKTL6BeM_L19hGap6dsz3oLe2u7gJDD4WBbqspVYv5SGI0mPvijI9_tC554BxXFcrRCpAMijqqt7_RliTJfLg-U7OgHaxv673xiCfcAWQavUgHrWg Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4d9b8fa88864052831d44570a94327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9644d94c283d4cc6ae4396b85ca1d620 Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance c1cdeaea-9588-4124-807d-7bdf608a38b1 could not be found. Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'c1cdeaea-9588-4124-807d-7bdf608a38b1'} Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cdeaea-9588-4124-807d-7bdf608a38b1 could not be found. Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cdeaea-9588-4124-807d-7bdf608a38b1 could not be found. Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:18:24.638053 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cdeaea-9588-4124-807d-7bdf608a38b1 could not be found. Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Returning 404 to user: Instance c1cdeaea-9588-4124-807d-7bdf608a38b1 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-709e6fa0-3595-4bb0-a879-57078c440c49 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1" status: 404 len: 111 microversion: 2.1 time: 0.033153 Oct 26 06:18:24.644077 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3877/7746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:24 2022] GET /compute/v2.1/servers/c1cdeaea-9588-4124-807d-7bdf608a38b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:18:28.037076 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5db06ae5-6c4f-44a7-b26c-58a9abddb20d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '.version_select at 0x7f4709eea4c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:28.060195 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5db06ae5-6c4f-44a7-b26c-58a9abddb20d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1591223363" status: 202 len: 0 microversion: 2.1 time: 0.027484 Oct 26 06:18:28.060858 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3870/7747] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 26 06:18:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1591223363 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:18:28.089887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9d542fd7-befa-4d08-af4e-ec191188ee79 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: .version_select at 0x7f470913d1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1852065165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq2YxrN7l7qVBSa3O7dPZV1opISndG29HC+7GP7+EBWBnO8XlByOMmrkJOf1CcTy2H5YlHGHwWC5fDnpNTyB7bbamO5w4yL61GBCOBOr+stUs7dOvgSjcvvAP1fZvZ1DA=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:28.108393 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9d542fd7-befa-4d08-af4e-ec191188ee79 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:18:28.114863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-9d542fd7-befa-4d08-af4e-ec191188ee79 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:18:28.143457 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9d542fd7-befa-4d08-af4e-ec191188ee79 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057470 Oct 26 06:18:28.144070 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3878/7748] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:18:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:18:33.697929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1997558302", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "8e18df4b-12b2-480b-8ad9-314028f1107f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1852065165", "security_groups": [{"name": "tempest-secgroup-smoke-1043336725"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:33.810981 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] validate_networks() for [('8e18df4b-12b2-480b-8ad9-314028f1107f', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:18:34.111957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:34.326093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:18:34.326774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:18:34.327447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:18:34.327865 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:18:34.328468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:18:34.337947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:34.338711 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:34.339159 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:34.339917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:34.341167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:34.341631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:34.361854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:18:34.368355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:18:34.382334 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:18:34.385071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:18:34.466524 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-229fc969-6568-48c8-943c-ec4e37f71ec8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772109 Oct 26 06:18:34.473887 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3871/7749] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:18:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:18:34.480313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8586fced-92f8-4340-9f84-15c6c9c67571 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:34.482208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8586fced-92f8-4340-9f84-15c6c9c67571 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:34.549289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8586fced-92f8-4340-9f84-15c6c9c67571 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:34.556680 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8586fced-92f8-4340-9f84-15c6c9c67571 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1267 microversion: 2.1 time: 0.081762 Oct 26 06:18:34.557690 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3879/7750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:34 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:35.584160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:35.584790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:35.592683 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:35.593343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:35.593656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:35.594364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:35.594831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:35.595263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:35.665382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:35.708948 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1c5dad01-4e6c-4820-8f9b-7641149eb4ec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1319 microversion: 2.1 time: 0.129605 Oct 26 06:18:35.709733 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3872/7751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:35 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1319 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:36.733657 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:36.734299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:36.737145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:36.748261 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:36.748927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:36.749425 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:36.750163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:36.750644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:36.751093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:36.961204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:36.973620 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-94e02f09-8d84-4316-bfac-7abdb2c71d36 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.244029 Oct 26 06:18:36.974228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3880/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:36 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:37.316796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-09f02f9d-201d-412b-926b-07fa6551c822 req-e20b977a-1814-4d3a-80c3-c5d8cc76687a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:37.328708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-09f02f9d-201d-412b-926b-07fa6551c822 req-e20b977a-1814-4d3a-80c3-c5d8cc76687a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:37.329547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-09f02f9d-201d-412b-926b-07fa6551c822 req-e20b977a-1814-4d3a-80c3-c5d8cc76687a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:37.330094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-09f02f9d-201d-412b-926b-07fa6551c822 req-e20b977a-1814-4d3a-80c3-c5d8cc76687a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:37.344301 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-09f02f9d-201d-412b-926b-07fa6551c822 req-e20b977a-1814-4d3a-80c3-c5d8cc76687a service nova] Creating event network-changed:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h1-862416-4 Oct 26 06:18:37.349941 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-09f02f9d-201d-412b-926b-07fa6551c822 req-e20b977a-1814-4d3a-80c3-c5d8cc76687a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037071 Oct 26 06:18:37.350650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3873/7753] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:18:37.999010 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:37.999560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:38.006383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:38.006887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:38.007343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:38.008051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:38.008524 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:38.008970 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:38.146454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:38.154663 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b7e80ae9-c52b-4db4-b851-0f23d05399bf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.160175 Oct 26 06:18:38.155240 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3881/7754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:37 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:39.179382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:39.180092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:39.187701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:39.188195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:39.188636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:39.189360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:39.189824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:39.190257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:39.604640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:39.612970 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0b0e379-34b9-4b01-91c4-50685979925d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.438752 Oct 26 06:18:39.613648 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3874/7755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:39 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:40.636070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:40.636701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:40.644422 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:40.644922 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:40.645402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:40.646120 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:40.646589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:40.647043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:40.780214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:40.787946 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a29e77bd-356e-4b17-8352-c6f070f6961e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.155803 Oct 26 06:18:40.788521 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3882/7756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:40 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:41.811950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:41.812570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:41.819524 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:41.820014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:41.820451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:41.821160 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:41.821678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:41.822109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:41.961736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:41.969876 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-36adf62b-32ae-4b10-a286-193e4f8f4cdc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.162418 Oct 26 06:18:41.970480 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3875/7757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:41 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:42.659236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-23afeb74-b09f-46cc-9d89-86633de1c116 req-4fd18767-9868-4e38-ad72-cd4e48b770af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "name": "network-vif-plugged", "status": "completed", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:42.669904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-23afeb74-b09f-46cc-9d89-86633de1c116 req-4fd18767-9868-4e38-ad72-cd4e48b770af service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:42.670335 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-23afeb74-b09f-46cc-9d89-86633de1c116 req-4fd18767-9868-4e38-ad72-cd4e48b770af service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:42.670785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-23afeb74-b09f-46cc-9d89-86633de1c116 req-4fd18767-9868-4e38-ad72-cd4e48b770af service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:42.681994 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-23afeb74-b09f-46cc-9d89-86633de1c116 req-4fd18767-9868-4e38-ad72-cd4e48b770af service nova] Creating event network-vif-plugged:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h1-862416-4 Oct 26 06:18:42.687139 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-23afeb74-b09f-46cc-9d89-86633de1c116 req-4fd18767-9868-4e38-ad72-cd4e48b770af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099612 Oct 26 06:18:42.687723 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3883/7758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:18:42.993109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:42.993759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:43.000670 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:43.001189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:43.002551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:43.003252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:43.003715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:43.004143 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:43.136502 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:43.145275 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-83d499ca-6dbc-4472-8fba-1029594b5178 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.156052 Oct 26 06:18:43.145867 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3876/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:42 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:44.171445 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:44.172315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:44.178843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:44.179442 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:44.179971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:44.180769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:44.181340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:44.181854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:44.321952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:44.330547 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b712cf67-621c-4f95-9520-abe05770104e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1393 microversion: 2.1 time: 0.165331 Oct 26 06:18:44.331089 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3884/7760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:44 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:18:45.354297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:45.354884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:45.358218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:45.358888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:45.364661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:45.365152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:45.365620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:45.366315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:45.366772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:45.367199 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:45.503707 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:45.511483 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7bea27ee-31e1-4dbd-a6ca-1fef74dc42ac tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1566 microversion: 2.1 time: 0.161234 Oct 26 06:18:45.512058 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3877/7761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:45 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:45.534983 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:45.535538 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:45.537566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:18:45.543529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:45.545183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:45.545669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:45.546375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:45.546845 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:45.547285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:45.679898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:45.687878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d3ba4962-3713-49d0-82c5-7433d1a96f89 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1566 microversion: 2.1 time: 0.156802 Oct 26 06:18:45.688461 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3885/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:45 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:18:47.276291 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:18:47.277232 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:18:47.278053 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ebdf4f47-f0d3-4782-89f8-b02fba892d40 req-bfb0ca79-baa2-48a1-8fa5-7e3c12cd88f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:18:47.286390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:47.287109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:47.287698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:47.288492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:47.289047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:47.289170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ebdf4f47-f0d3-4782-89f8-b02fba892d40 req-bfb0ca79-baa2-48a1-8fa5-7e3c12cd88f4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:18:47.289622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:47.289769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ebdf4f47-f0d3-4782-89f8-b02fba892d40 req-bfb0ca79-baa2-48a1-8fa5-7e3c12cd88f4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:18:47.290100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ebdf4f47-f0d3-4782-89f8-b02fba892d40 req-bfb0ca79-baa2-48a1-8fa5-7e3c12cd88f4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:18:47.302205 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ebdf4f47-f0d3-4782-89f8-b02fba892d40 req-bfb0ca79-baa2-48a1-8fa5-7e3c12cd88f4 service nova] Creating event network-changed:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h1-862416-4 Oct 26 06:18:47.307743 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ebdf4f47-f0d3-4782-89f8-b02fba892d40 req-bfb0ca79-baa2-48a1-8fa5-7e3c12cd88f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033451 Oct 26 06:18:47.308785 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3886/7763] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:18:47.522974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:18:47.532252 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-30018546-cae6-41be-99da-5ae55107b21a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1566 microversion: 2.1 time: 0.260548 Oct 26 06:18:47.532848 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3878/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:18:47 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:10.821325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:19:10.823611 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:10.825974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:19:10.826648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=34 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:19:10.833140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:10.833678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:10.834143 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:10.834862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:10.835340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:10.835790 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:10.892357 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-af722bde-8ec6-4765-bf14-f87283dcdd32 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action" status: 200 len: 24569 microversion: 2.1 time: 0.075415 Oct 26 06:19:10.893000 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3887/7765] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:19:10 2022] POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:19:21.884991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:19:21.887768 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:21.890115 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:19:21.890785 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=40 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:19:21.897437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:21.898017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:21.898462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:21.899162 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:21.899622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:21.900053 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:21.943116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:21.948958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Old instance type m1.heat2, new instance type m1.heat {{(pid=120586) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 26 06:19:21.955570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:19:21.955994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:19:21.956469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:19:21.956887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:19:21.957336 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:19:22.020619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9100145-2789-430d-b73e-dc891e9c9322 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action" status: 202 len: 0 microversion: 2.1 time: 0.139595 Oct 26 06:19:22.021580 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3879/7766] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:19:21 2022] POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:19:22.030325 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:22.031054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:22.034047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:19:22.035066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:19:22.046642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:22.047159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:22.047720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:22.048465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:22.048948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:22.049455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:22.194666 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:22.202817 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8548b819-7564-439b-a208-b1c0fb586b8f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1694 microversion: 2.1 time: 0.176699 Oct 26 06:19:22.203443 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3888/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:22 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:23.229539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:23.230580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:23.239860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:23.240365 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:23.240802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:23.241541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:23.242007 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:23.242440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:23.380097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:23.388498 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9f60771e-47b3-447c-a7b4-b602799f546d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1694 microversion: 2.1 time: 0.164039 Oct 26 06:19:23.389073 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3880/7768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:23 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:24.411943 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:24.412571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:24.420426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:24.420934 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:24.421434 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:24.422152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:24.422630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:24.423081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:24.554533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:24.562980 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d42b32a2-b247-4235-b70a-6f56da40ce0d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.154930 Oct 26 06:19:24.563557 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3889/7769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:24 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:25.588191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:25.588817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:25.596343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:25.596844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:25.597296 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:25.598040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:25.598507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:25.598944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:25.733049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:25.740805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1eb9739b-103e-4d99-83a9-2f2d558de967 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.156803 Oct 26 06:19:25.741399 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3881/7770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:25 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:26.765948 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:26.766497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:26.773352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:26.773859 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:26.774317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:26.775025 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:26.775498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:26.775944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:26.909060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:26.916953 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7e273456-475d-4e69-9154-3cf9c10fc749 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.155631 Oct 26 06:19:26.917563 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3890/7771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:26 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:27.941569 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:27.942192 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:27.948857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:27.949389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:27.949944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:27.950946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:27.951417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:27.951852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:28.090643 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:28.098793 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e32c3249-262f-4094-be80-7b44678ca30c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.161187 Oct 26 06:19:28.099375 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3882/7772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:27 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:29.123356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:29.123986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:29.130757 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:29.131255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:29.131711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:29.132408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:29.132876 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:29.133337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:29.265473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:29.273212 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-387da353-7b3b-495b-8097-487aece45084 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.154111 Oct 26 06:19:29.273820 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3891/7773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:29 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:30.297903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:30.298527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:30.305412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:30.305911 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:30.306359 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:30.307060 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:30.307527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:30.307963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:30.438975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:30.447024 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9cc74900-4805-47e7-8eee-bb985088ec3c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.153662 Oct 26 06:19:30.447609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3883/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:30 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:31.472224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:31.472840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:31.479626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:31.480132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:31.481240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:31.482167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:31.482647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:31.483098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:31.890227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:31.897951 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85f8eb09-7b29-4641-aa89-28e70c4ea4c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.429644 Oct 26 06:19:31.898561 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3892/7775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:31 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:32.923832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:32.924442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:32.932103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:32.932736 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:32.933181 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:32.934120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:32.934744 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:32.935324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:33.068059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:33.076289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-57d79df1-1161-46ac-8e88-56eb12e2185a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.156397 Oct 26 06:19:33.076864 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3884/7776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:32 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:34.100938 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:34.101613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:34.108843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:34.109375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:34.109832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:34.110541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:34.111016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:34.111468 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:34.249237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:34.256981 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-062a6c7b-2b5a-4287-9970-e8c05285abd6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.160127 Oct 26 06:19:34.257585 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3893/7777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:34 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:35.280832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:35.281405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:35.288389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:35.288873 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:35.289329 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:35.290038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:35.290489 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:35.290918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:35.422289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:35.430016 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b6e4b9b-6067-427f-9d0c-a885b004a528 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.153264 Oct 26 06:19:35.430589 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3885/7778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:35 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:36.453742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:36.454368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:36.461178 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:36.461708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:36.462166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:36.462877 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:36.463381 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:36.463827 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:36.603165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:36.612394 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-31278d34-467c-4d82-ab85-738cc168fbec tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.162569 Oct 26 06:19:36.612979 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3894/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:36 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:37.636288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:37.637227 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:37.644048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:37.644544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:37.644991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:37.645725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:37.646185 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:37.646619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:37.841977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:37.849794 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fe8a0ea7-d0b5-43b5-99c2-73562f0c184a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.217573 Oct 26 06:19:37.850402 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3886/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:37 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:19:38.874231 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:38.874861 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:38.881721 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:38.882226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:38.882697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:38.883411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:38.883886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:38.884362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:39.019834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:39.028053 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5fa6e7a5-726c-407a-acd2-6781875bfe4e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.157347 Oct 26 06:19:39.028634 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3895/7781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:38 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:40.052396 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:40.053043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:40.061103 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:40.061725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:40.062169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:40.062867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:40.063326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:40.063756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:40.197149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:40.205459 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ec896b80-f7a8-4bf5-8504-8081ac760588 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1699 microversion: 2.1 time: 0.157035 Oct 26 06:19:40.206039 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3887/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:40 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:41.229661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:41.230221 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:41.237108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:41.237632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:41.238085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:41.238786 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:41.239254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:41.239693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:41.392200 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:41.400428 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8bb2961c-2f96-4dd4-84bf-4d722790b26d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1698 microversion: 2.1 time: 0.174797 Oct 26 06:19:41.414807 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3896/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:41 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:41.734017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "name": "network-vif-unplugged", "status": "completed", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:19:41.744261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:41.744895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:41.745363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:41.759419 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] Creating event network-vif-unplugged:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h2-862416-4 Oct 26 06:19:41.766623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:19:41.779562 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-44a95ca4-0d7f-4e9e-8848-1fee259e8fb1 req-dd548610-ce6b-4d67-a859-4a6fa95f8169 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049824 Oct 26 06:19:41.780192 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3888/7784] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:19:42.427327 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:42.428078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:42.436776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:42.437290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:42.437771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:42.441986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:42.442497 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:42.443465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:42.580390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:42.588727 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bc04aa83-8dbb-410a-a4a9-7855504e4ac2 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1698 microversion: 2.1 time: 0.165434 Oct 26 06:19:42.589336 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3897/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:42 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:43.615140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:43.616102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:43.623647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:43.624070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:43.624542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:43.625437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:43.625895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:43.626321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:43.768071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:43.775858 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a5cee75e-bb92-461a-b002-b2be9d607788 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1696 microversion: 2.1 time: 0.166031 Oct 26 06:19:43.776467 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3889/7786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:43 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:43.821112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:19:43.831376 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:43.831926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:43.832388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:43.844300 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] Creating event network-changed:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h2-862416-4 Oct 26 06:19:43.849617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-4', 'n-h2-862416-4'} {{(pid=120585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 26 06:19:43.860893 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-d8c47a96-8151-48c5-bf57-f3486a8c339c req-a236f5cf-011c-4f39-b1d6-e020eb4017a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043607 Oct 26 06:19:43.861511 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3898/7787] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:19:44.800368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:44.800985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:44.808276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:44.809924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:44.810372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:44.811069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:44.811528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:44.811956 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:44.946701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:44.955509 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-195b5961-efb5-44b6-850b-d5e35c602100 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1696 microversion: 2.1 time: 0.159139 Oct 26 06:19:44.956081 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3890/7788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:44 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:45.981351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:45.982065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:45.988352 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:45.988864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:45.989343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:45.990067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:45.990540 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:45.990985 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.127747 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:46.135501 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1f85c2ee-3c1b-4bc6-8a6b-643ac2f02f4a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1693 microversion: 2.1 time: 0.159516 Oct 26 06:19:46.136081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3899/7789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:45 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:46.160850 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:19:46.161449 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:46.169114 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:46.169650 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:46.170092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.170786 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:46.171249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:46.171677 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.232539 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-48f3e787-4561-456f-9b1f-5b79469fc62d tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action" status: 204 len: 0 microversion: 2.1 time: 0.075378 Oct 26 06:19:46.233207 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3891/7790] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:19:46 2022] POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:19:46.241441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:46.242076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:46.248912 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:46.249458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:46.249926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.250651 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:46.251130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:46.251584 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.505341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:46.515522 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c92208ff-8b71-4d88-8db9-1140069c0e03 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1693 microversion: 2.1 time: 0.277911 Oct 26 06:19:46.516517 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3900/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:46 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:46.538913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:46.539722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:46.547528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:46.548030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:46.548475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.549183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:46.549893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:46.550312 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:46.773887 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:46.782202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5e9557ef-29d7-44e2-94f4-d9428c1dd302 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1693 microversion: 2.1 time: 0.247597 Oct 26 06:19:46.782993 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3892/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:46 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1693 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:47.807474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:19:47.808092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:19:47.815439 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:47.815923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:47.816371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:47.817077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:47.817582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:47.818014 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:47.958882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:19:47.967844 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-73ff1b96-b9b8-4b7c-8985-e076289af754 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1685 microversion: 2.1 time: 0.164311 Oct 26 06:19:47.968420 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3901/7793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:19:47 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:19:48.422021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-19554fed-9e6b-4dc4-b676-38c9f72b60ca req-0b12b3eb-1232-47cc-bc6d-2d36977d2191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "name": "network-vif-plugged", "status": "completed", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:19:48.432721 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-19554fed-9e6b-4dc4-b676-38c9f72b60ca req-0b12b3eb-1232-47cc-bc6d-2d36977d2191 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:19:48.433996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-19554fed-9e6b-4dc4-b676-38c9f72b60ca req-0b12b3eb-1232-47cc-bc6d-2d36977d2191 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:19:48.434560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-19554fed-9e6b-4dc4-b676-38c9f72b60ca req-0b12b3eb-1232-47cc-bc6d-2d36977d2191 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:19:48.450451 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-19554fed-9e6b-4dc4-b676-38c9f72b60ca req-0b12b3eb-1232-47cc-bc6d-2d36977d2191 service nova] Creating event network-vif-plugged:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h2-862416-4 Oct 26 06:19:48.455487 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-19554fed-9e6b-4dc4-b676-38c9f72b60ca req-0b12b3eb-1232-47cc-bc6d-2d36977d2191 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037598 Oct 26 06:19:48.456265 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3893/7794] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:20:18.182555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=28 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:18.183315 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=82 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:18.249843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:18.252188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:18.258194 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:18.258699 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:18.259188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:18.259903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:18.260380 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:18.260844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:18.312451 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c6b52e76-42ab-4be7-b1fa-8ad27508726f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action" status: 200 len: 24583 microversion: 2.1 time: 0.134819 Oct 26 06:20:18.313077 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3902/7795] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:20:18 2022] POST /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773/action => generated 24583 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:20:35.879783 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=34 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:35.880544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:35.884959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:35.885129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-f5c472ad-b7ff-4cab-aad4-e3fda74fb133 req-ac30147b-2261-4c28-9590-38b4f8d3ef9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:35.885762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:35.893549 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:35.894047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:35.894627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:35.894776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:35.895351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:35.895596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:35.896000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:35.896588 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:35.898990 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f5c472ad-b7ff-4cab-aad4-e3fda74fb133 req-ac30147b-2261-4c28-9590-38b4f8d3ef9c service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:35.899622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f5c472ad-b7ff-4cab-aad4-e3fda74fb133 req-ac30147b-2261-4c28-9590-38b4f8d3ef9c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:35.900334 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-f5c472ad-b7ff-4cab-aad4-e3fda74fb133 req-ac30147b-2261-4c28-9590-38b4f8d3ef9c service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:35.914921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-f5c472ad-b7ff-4cab-aad4-e3fda74fb133 req-ac30147b-2261-4c28-9590-38b4f8d3ef9c service nova] Creating event network-changed:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h2-862416-4 Oct 26 06:20:35.920072 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-f5c472ad-b7ff-4cab-aad4-e3fda74fb133 req-ac30147b-2261-4c28-9590-38b4f8d3ef9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039576 Oct 26 06:20:35.921748 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3903/7796] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:20:35.930997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:20:36.016909 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8053eef7-53fa-4719-977e-00050611b74f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 204 len: 0 microversion: 2.1 time: 0.139500 Oct 26 06:20:36.017969 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3894/7797] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:20:35 2022] DELETE /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:20:36.027781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:36.028503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:36.036874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:36.037413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:36.037871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:36.038596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:36.039070 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:36.039518 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:36.179492 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:36.187332 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2e186b12-143c-4701-9d07-68016c025665 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1691 microversion: 2.1 time: 0.164432 Oct 26 06:20:36.187911 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3904/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:36 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:37.212691 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:37.213440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:37.220895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:37.221422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:37.221863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:37.222570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:37.223032 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:37.223469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:37.360617 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:37.368435 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df4ee80c-9eba-48f3-91c7-f879f5c2358f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 200 len: 1691 microversion: 2.1 time: 0.160061 Oct 26 06:20:37.369016 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3895/7799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:37 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:37.935383 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-99a65169-a5ae-494a-84d4-89e98a751070 req-b1ebdecc-a9ad-4da0-9cc7-d5848e8ea09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66af95f-2f28-4dd8-a9e2-70071b8d5773", "name": "network-vif-deleted", "tag": "3a36bbd1-bc8b-4b5e-bd14-6feff20e4197"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:37.946131 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-99a65169-a5ae-494a-84d4-89e98a751070 req-b1ebdecc-a9ad-4da0-9cc7-d5848e8ea09f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:37.946904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-99a65169-a5ae-494a-84d4-89e98a751070 req-b1ebdecc-a9ad-4da0-9cc7-d5848e8ea09f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:37.947605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-99a65169-a5ae-494a-84d4-89e98a751070 req-b1ebdecc-a9ad-4da0-9cc7-d5848e8ea09f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:37.960629 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-99a65169-a5ae-494a-84d4-89e98a751070 req-b1ebdecc-a9ad-4da0-9cc7-d5848e8ea09f service nova] Creating event network-vif-deleted:3a36bbd1-bc8b-4b5e-bd14-6feff20e4197 for instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 on n-h2-862416-4 Oct 26 06:20:37.966292 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-99a65169-a5ae-494a-84d4-89e98a751070 req-b1ebdecc-a9ad-4da0-9cc7-d5848e8ea09f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 Oct 26 06:20:37.967148 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3905/7800] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:20:38.392960 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:38.393895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d66af95f-2f28-4dd8-a9e2-70071b8d5773] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:38.400995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:38.401688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:38.402141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:38.402851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:38.403316 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:38.403776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:38.418084 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] HTTP exception thrown: Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 could not be found. Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Request method failure captured: Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 HTTP/1.1 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWNBdaubfcGN37kV_fD-1dsTbVC6x7wuiXFeunBQvJWFh1oBys0stBGAtD0b3RfVKTL6BeM_L19hGap6dsz3oLe2u7gJDD4WBbqspVYv5SGI0mPvijI9_tC554BxXFcrRCpAMijqqt7_RliTJfLg-U7OgHaxv673xiCfcAWQavUgHrWg Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4d9b8fa88864052831d44570a94327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 9644d94c283d4cc6ae4396b85ca1d620 Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 could not be found. Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': 'd66af95f-2f28-4dd8-a9e2-70071b8d5773'} Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 could not be found. Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 could not be found. Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:20:38.419771 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 could not be found. Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Returning 404 to user: Instance d66af95f-2f28-4dd8-a9e2-70071b8d5773 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:20:38.425774 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-204856da-85d9-4602-b06b-529645afd17a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773" status: 404 len: 111 microversion: 2.1 time: 0.032303 Oct 26 06:20:38.426650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3896/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:38 2022] GET /compute/v2.1/servers/d66af95f-2f28-4dd8-a9e2-70071b8d5773 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:20:41.823844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-93368cf7-febf-4ab6-8134-fa35d99e6878 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '.version_select at 0x7f470923bc10>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:41.829507 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93368cf7-febf-4ab6-8134-fa35d99e6878 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [183d9a31-54bb-4b24-83d6-e3d1a8da99f5] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:20:42.837160 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [None req-93368cf7-febf-4ab6-8134-fa35d99e6878 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [183d9a31-54bb-4b24-83d6-e3d1a8da99f5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55868. Oct 26 06:20:42.858211 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-93368cf7-febf-4ab6-8134-fa35d99e6878 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1852065165" status: 202 len: 0 microversion: 2.1 time: 1.046495 Oct 26 06:20:42.858799 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3906/7802] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 26 06:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1852065165 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:20:42.885599 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1242a577-3ce2-4931-80f3-7ea3e1a8c045 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: .version_select at 0x7f4709f85280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1872309729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPvkSbR6vPkybW19vJZPSt7LxmG8yUq5cgZVTmkoajftdsJ7dgq9+kKWEEm59Bd3yElJB5q59dNxBkg+tuRRxi/A1j/Lm9wksuPpjgn/2fIsc04kHYRzr3Xy9cyEjo6tQ=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:42.903179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1242a577-3ce2-4931-80f3-7ea3e1a8c045 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:20:42.909279 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-1242a577-3ce2-4931-80f3-7ea3e1a8c045 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:20:42.923341 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1242a577-3ce2-4931-80f3-7ea3e1a8c045 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:20:43.930509 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-1242a577-3ce2-4931-80f3-7ea3e1a8c045 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [48a7d8ec-5d24-4425-9c5b-29d6b221787d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55872. Oct 26 06:20:43.945725 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1242a577-3ce2-4931-80f3-7ea3e1a8c045 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.064013 Oct 26 06:20:43.946339 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3897/7803] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:20:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:20:49.660371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-651757415", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "098c0efb-74ca-490b-a504-c5dc55dcfa4d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1872309729", "security_groups": [{"name": "tempest-secgroup-smoke-887720487"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:49.684755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=10 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:49.931689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] validate_networks() for [('098c0efb-74ca-490b-a504-c5dc55dcfa4d', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:20:50.358558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:20:50.359052 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:20:50.359571 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:20:50.360193 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:20:50.360630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:20:50.369788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:50.370292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:50.370751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:50.371496 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:50.371965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:50.372410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:50.390665 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:20:50.396213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:20:50.409646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:20:50.412356 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:20:50.458306 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [6ee93c99-bf6c-410e-baa2-793550982598] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:20:51.470904 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [6ee93c99-bf6c-410e-baa2-793550982598] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55924. Oct 26 06:20:51.475796 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-57f37e25-98c4-4a87-9fe2-4ce2f475d910 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.821353 Oct 26 06:20:51.476885 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3907/7804] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:20:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:20:51.491635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a61d1e0f-9215-46cf-b53d-0f1e84efa9eb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:51.492523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a61d1e0f-9215-46cf-b53d-0f1e84efa9eb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:51.497623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:20:51.615189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a61d1e0f-9215-46cf-b53d-0f1e84efa9eb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:51.628291 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a61d1e0f-9215-46cf-b53d-0f1e84efa9eb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1266 microversion: 2.1 time: 0.136170 Oct 26 06:20:51.628940 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3898/7805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:51 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:52.653162 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:52.653940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:52.660771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:52.661326 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:52.661792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:52.662511 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:52.662989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:52.663452 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:52.771404 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:52.779423 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7f300d08-88bf-4cc0-acb1-5c933a0a84d9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1326 microversion: 2.1 time: 0.131391 Oct 26 06:20:52.780198 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3908/7806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:52 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:53.802906 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:53.803529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:53.810409 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:53.810905 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:53.811354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:53.812651 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:53.813384 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:53.813901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:54.045483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:54.053247 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c12e9083-9635-4ae6-b56b-afd19eb7fa1e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1391 microversion: 2.1 time: 0.254259 Oct 26 06:20:54.054068 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3899/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:53 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1391 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:54.522378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-81cd8c7b-77e5-4c1b-8ebd-eface10b85a2 req-179f83d7-cd82-4111-b921-318273faaabc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764a7f83-2829-4f11-aae4-51182d324ab1", "tag": "c4553b6f-246a-4d61-ab2d-898ca488be90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:54.534119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81cd8c7b-77e5-4c1b-8ebd-eface10b85a2 req-179f83d7-cd82-4111-b921-318273faaabc service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:54.534763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81cd8c7b-77e5-4c1b-8ebd-eface10b85a2 req-179f83d7-cd82-4111-b921-318273faaabc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:54.535290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-81cd8c7b-77e5-4c1b-8ebd-eface10b85a2 req-179f83d7-cd82-4111-b921-318273faaabc service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:54.549926 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-81cd8c7b-77e5-4c1b-8ebd-eface10b85a2 req-179f83d7-cd82-4111-b921-318273faaabc service nova] Creating event network-changed:c4553b6f-246a-4d61-ab2d-898ca488be90 for instance 764a7f83-2829-4f11-aae4-51182d324ab1 on n-h1-862416-4 Oct 26 06:20:54.555099 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-81cd8c7b-77e5-4c1b-8ebd-eface10b85a2 req-179f83d7-cd82-4111-b921-318273faaabc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036827 Oct 26 06:20:54.556153 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3909/7808] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:20:55.076342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:55.076965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:55.084412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:55.084904 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:55.085368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:55.086071 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:55.086530 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:55.086958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:55.232309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:55.241171 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d69aa77e-84e0-481b-9ef6-c8e114f28af6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1391 microversion: 2.1 time: 0.168646 Oct 26 06:20:55.241807 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3900/7809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:55 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:56.271671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:56.272409 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:56.279384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:56.280050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:56.280506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:56.281999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:56.282489 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:56.283730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:56.506629 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:56.514457 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-cb54787c-b18f-4551-80c6-e715fa58924e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1391 microversion: 2.1 time: 0.254004 Oct 26 06:20:56.525408 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3910/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:56 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:57.538008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:57.538657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:57.545236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:57.545759 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:57.546207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:57.547538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:57.548004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:57.548438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:57.688602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:57.697397 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1deb23c1-3c4d-4b67-a244-ee8ca0f9e8c6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1391 microversion: 2.1 time: 0.163207 Oct 26 06:20:57.697925 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3901/7811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:57 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:58.722574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:58.723209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:58.730124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:58.730625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:58.731076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:58.731787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:58.732255 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:58.732695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:58.863142 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:20:58.870973 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-13225d0c-d1c4-4a12-87d4-369c5d16fc34 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1391 microversion: 2.1 time: 0.153004 Oct 26 06:20:58.871555 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3911/7812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:58 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:20:59.331555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-598f1937-5f08-4085-9747-34ea8c0a218f req-fe0075af-c888-41d5-ba4e-3e80b526d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a7f83-2829-4f11-aae4-51182d324ab1", "name": "network-vif-plugged", "status": "completed", "tag": "c4553b6f-246a-4d61-ab2d-898ca488be90"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:20:59.342186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-598f1937-5f08-4085-9747-34ea8c0a218f req-fe0075af-c888-41d5-ba4e-3e80b526d8f0 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:59.342899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-598f1937-5f08-4085-9747-34ea8c0a218f req-fe0075af-c888-41d5-ba4e-3e80b526d8f0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:59.343209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-598f1937-5f08-4085-9747-34ea8c0a218f req-fe0075af-c888-41d5-ba4e-3e80b526d8f0 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:59.356401 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-598f1937-5f08-4085-9747-34ea8c0a218f req-fe0075af-c888-41d5-ba4e-3e80b526d8f0 service nova] Creating event network-vif-plugged:c4553b6f-246a-4d61-ab2d-898ca488be90 for instance 764a7f83-2829-4f11-aae4-51182d324ab1 on n-h1-862416-4 Oct 26 06:20:59.362057 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-598f1937-5f08-4085-9747-34ea8c0a218f req-fe0075af-c888-41d5-ba4e-3e80b526d8f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 Oct 26 06:20:59.362833 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3902/7813] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:20:59.895283 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:20:59.895844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:20:59.902613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:59.903108 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:59.903561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:20:59.904263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:20:59.904737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:20:59.905177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:00.037303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:00.044977 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b2343b76-7287-4fcf-9f21-b45dfdbe8b4c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1391 microversion: 2.1 time: 0.154192 Oct 26 06:21:00.045574 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3912/7814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:20:59 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:01.070659 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:01.071362 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:01.078041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:01.078541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:01.079008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:01.079708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:01.080167 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:01.080600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:01.213564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:01.222038 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b850b950-6961-430e-995e-c5c0cc248797 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1563 microversion: 2.1 time: 0.157239 Oct 26 06:21:01.222609 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3903/7815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:01 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:01.245743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:01.246372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:01.248357 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:01.249041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:01.256388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:01.256833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:01.257293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:01.258027 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:01.258499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:01.258947 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:01.391933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:01.399690 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9f989b1a-ae6a-478c-9308-44d571fdb846 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1563 microversion: 2.1 time: 0.157882 Oct 26 06:21:01.400266 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3913/7816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:01 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:02.981088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:02.981746 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:02.984407 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-0aa6adc6-c20c-40be-94f9-dbdbd2bdc853 req-38486af2-549f-4bc4-ad42-61a5899e5eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764a7f83-2829-4f11-aae4-51182d324ab1", "tag": "c4553b6f-246a-4d61-ab2d-898ca488be90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:21:02.987894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:02.991688 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:02.992424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:02.992885 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:02.993647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:02.994116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:02.994553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:02.996995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0aa6adc6-c20c-40be-94f9-dbdbd2bdc853 req-38486af2-549f-4bc4-ad42-61a5899e5eac service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:02.997603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0aa6adc6-c20c-40be-94f9-dbdbd2bdc853 req-38486af2-549f-4bc4-ad42-61a5899e5eac service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:02.998174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-0aa6adc6-c20c-40be-94f9-dbdbd2bdc853 req-38486af2-549f-4bc4-ad42-61a5899e5eac service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:03.012147 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-0aa6adc6-c20c-40be-94f9-dbdbd2bdc853 req-38486af2-549f-4bc4-ad42-61a5899e5eac service nova] Creating event network-changed:c4553b6f-246a-4d61-ab2d-898ca488be90 for instance 764a7f83-2829-4f11-aae4-51182d324ab1 on n-h1-862416-4 Oct 26 06:21:03.018859 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-0aa6adc6-c20c-40be-94f9-dbdbd2bdc853 req-38486af2-549f-4bc4-ad42-61a5899e5eac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038590 Oct 26 06:21:03.019655 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3914/7817] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:21:03.237810 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:03.246828 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d05c880f-25aa-4cd7-8c0e-2a5fc20ffb61 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1563 microversion: 2.1 time: 0.269626 Oct 26 06:21:03.248281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3904/7818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:02 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1563 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:26.509640 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:26.510394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=36 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:26.514555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:21:26.516819 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:26.524470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:26.524965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:26.525450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:26.526148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:26.526615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:26.527051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:26.579361 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-02c7e783-8544-45d0-bb7a-1842d793ab11 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action" status: 200 len: 24576 microversion: 2.1 time: 0.071606 Oct 26 06:21:26.579998 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3915/7819] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:21:26 2022] POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action => generated 24576 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:21:37.506898 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-29f696a0-d71e-4254-9ac8-66218351aa73 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:21:37.509234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:37.509959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=32 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:37.518261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29f696a0-d71e-4254-9ac8-66218351aa73 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:37.518750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29f696a0-d71e-4254-9ac8-66218351aa73 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:37.519191 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-29f696a0-d71e-4254-9ac8-66218351aa73 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:37.543025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-29f696a0-d71e-4254-9ac8-66218351aa73 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Going to try to stop instance {{(pid=120586) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 06:21:37.584671 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-29f696a0-d71e-4254-9ac8-66218351aa73 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.081627 Oct 26 06:21:37.585281 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3905/7820] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:21:37 2022] POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:21:37.594541 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:37.595986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:37.598579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:37.599274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:21:37.605969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:37.606514 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:37.606993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:37.607881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:37.608353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:37.608796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:37.744635 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:37.753644 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-547e529b-cdf3-4206-bf2c-328ead45e0c0 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.163807 Oct 26 06:21:37.754209 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3916/7821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:37 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:38.778725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:38.779380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:38.787164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:38.787658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:38.788104 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:38.788802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:38.789276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:38.789734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:38.926638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:38.934404 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1a697ece-95e4-418e-9f08-acb5931c75f1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.160147 Oct 26 06:21:38.934984 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3906/7822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:38 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:39.958503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:39.959135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:39.965923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:39.966436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:39.966898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:39.967867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:39.968342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:39.968792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:40.100893 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:40.108745 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-285fec7a-a25c-4f90-90cf-c26c1c192420 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.154332 Oct 26 06:21:40.109337 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3917/7823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:39 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:41.134206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:41.134829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:41.142020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:41.142399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:41.142860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:41.143575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:41.144043 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:41.144480 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:41.328922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:41.338281 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d5fe11dc-8225-4a07-81c5-8b88ab9b6abf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.207820 Oct 26 06:21:41.344432 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3907/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:41 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:42.363693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:42.364313 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:42.371249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:42.371735 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:42.372192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:42.372888 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:42.373390 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:42.373830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:42.513530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:42.521849 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-92a9b205-eaa8-464b-9709-f1103485221c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.163170 Oct 26 06:21:42.522420 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3918/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:42 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:43.545975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:43.546622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:43.554550 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:43.555039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:43.555483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:43.556172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:43.556633 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:43.557062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:43.693884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:43.701594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23d021e2-be23-40c5-9236-791c025ba1f5 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.159511 Oct 26 06:21:43.702160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3908/7826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:43 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:44.725863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:44.726426 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:44.733146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:44.733669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:44.734124 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:44.734828 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:44.735301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:44.735744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:44.869878 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:44.878262 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bedd5510-1d44-42d9-b3cf-c6ff84874f87 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.156425 Oct 26 06:21:44.878836 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3919/7827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:44 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:45.901929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:45.902540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:45.909931 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:45.910421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:45.910861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:45.911555 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:45.912012 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:45.912444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:46.042784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:46.050638 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-51ec5777-04c2-4dc7-9012-ada76351fe65 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.152606 Oct 26 06:21:46.051224 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3909/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:45 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:47.074104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:47.074737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:47.082480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:47.082982 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:47.083448 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:47.084155 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:47.084627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:47.085071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:47.219891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:47.227728 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ba9f9122-6028-4ed4-8a74-406f82985017 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1692 microversion: 2.1 time: 0.157598 Oct 26 06:21:47.228315 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3920/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:47 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:48.251552 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:48.252308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:48.259370 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:48.259868 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:48.260320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:48.261024 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:48.261529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:48.261967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:48.392285 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:48.400071 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-df19b864-b22e-4e9a-ac5a-a793d70fad8b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1669 microversion: 2.1 time: 0.152984 Oct 26 06:21:48.400654 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3910/7830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:48 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:49.499850 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:21:49.502320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:49.509286 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:49.509834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:49.510292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:49.510998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:49.511470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:49.511914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:49.575134 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e107d8da-860d-4127-9a39-3e04da740c0c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action" status: 200 len: 38093 microversion: 2.1 time: 0.078998 Oct 26 06:21:49.575806 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3921/7831] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:21:49 2022] POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action => generated 38093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 06:21:49.588258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-43d30104-224b-453a-ba78-3193e9b85b6b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:21:49.596188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43d30104-224b-453a-ba78-3193e9b85b6b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:49.596684 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43d30104-224b-453a-ba78-3193e9b85b6b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:49.597130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43d30104-224b-453a-ba78-3193e9b85b6b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:49.619568 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-43d30104-224b-453a-ba78-3193e9b85b6b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Going to try to start instance {{(pid=120586) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 06:21:49.662248 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-43d30104-224b-453a-ba78-3193e9b85b6b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.077710 Oct 26 06:21:49.662873 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3911/7832] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:21:49 2022] POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:21:49.671704 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:49.672621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:49.680135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:49.680725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:49.681226 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:49.682020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:49.682498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:49.682951 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:49.870466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:49.879082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-210cdca2-0ad1-421e-a9a8-547818e9995e tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1678 microversion: 2.1 time: 0.211653 Oct 26 06:21:49.879653 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3922/7833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:49 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:21:50.905974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:21:50.908139 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:21:50.914626 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:50.915263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:50.915713 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:50.916525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:21:50.916986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:21:50.917445 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:21:51.058378 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:21:51.066924 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f478a4ca-e5b4-4ad4-9bbd-96de142961d7 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1682 microversion: 2.1 time: 0.166271 Oct 26 06:21:51.067545 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3912/7834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:21:50 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:15.288813 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:15.291051 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:15.294360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=14 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:15.295039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=40 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:15.301992 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:15.302499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:15.302953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:15.303667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:15.304140 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:15.304583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:15.365578 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27ce476d-549b-40bf-a441-09985aff4aaf tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action" status: 200 len: 62652 microversion: 2.1 time: 0.080690 Oct 26 06:22:15.366233 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3923/7835] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:22:15 2022] POST /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1/action => generated 62652 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:22:22.647069 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:22.647682 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:22.649643 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b2a53318-25b3-4d3a-88fc-b73354dde1e5 req-601c1532-2601-49a7-aca5-0c92aee6634f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764a7f83-2829-4f11-aae4-51182d324ab1", "tag": "c4553b6f-246a-4d61-ab2d-898ca488be90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:22.650149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=16 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:22.651015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:22.657398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:22.658856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:22.659338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:22.660138 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:22.660935 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:22.661146 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2a53318-25b3-4d3a-88fc-b73354dde1e5 req-601c1532-2601-49a7-aca5-0c92aee6634f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:22.661274 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:22.661722 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2a53318-25b3-4d3a-88fc-b73354dde1e5 req-601c1532-2601-49a7-aca5-0c92aee6634f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:22.662074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2a53318-25b3-4d3a-88fc-b73354dde1e5 req-601c1532-2601-49a7-aca5-0c92aee6634f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:22.675215 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b2a53318-25b3-4d3a-88fc-b73354dde1e5 req-601c1532-2601-49a7-aca5-0c92aee6634f service nova] Creating event network-changed:c4553b6f-246a-4d61-ab2d-898ca488be90 for instance 764a7f83-2829-4f11-aae4-51182d324ab1 on n-h1-862416-4 Oct 26 06:22:22.681018 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b2a53318-25b3-4d3a-88fc-b73354dde1e5 req-601c1532-2601-49a7-aca5-0c92aee6634f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035659 Oct 26 06:22:22.681886 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3924/7836] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:22:22.692211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:22:22.787026 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-44873a56-521d-4031-a16b-5d583e1b39ce tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 204 len: 0 microversion: 2.1 time: 0.143970 Oct 26 06:22:22.788022 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3913/7837] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:22:22 2022] DELETE /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:22:22.798285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:22.799613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:22.806805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:22.807342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:22.807863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:22.808589 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:22.809138 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:22.809848 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:22.966361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:22.975671 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8781fe33-7eed-4c12-abac-8c6b697a2fe1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1688 microversion: 2.1 time: 0.181950 Oct 26 06:22:22.976262 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3925/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:22 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:24.001030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:24.001694 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:24.008421 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:24.008919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:24.009392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:24.010091 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:24.010567 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:24.011002 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:24.149056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:24.156878 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b5f1906d-d31d-43c5-a608-62c5e01a7ec6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1688 microversion: 2.1 time: 0.160276 Oct 26 06:22:24.157489 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3914/7839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:23 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:24.963340 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-49ad6558-005f-48dd-b1e3-530b032e0897 req-9b263efd-3550-4313-a491-f402cecd9d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764a7f83-2829-4f11-aae4-51182d324ab1", "name": "network-vif-deleted", "tag": "c4553b6f-246a-4d61-ab2d-898ca488be90"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:24.974873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-49ad6558-005f-48dd-b1e3-530b032e0897 req-9b263efd-3550-4313-a491-f402cecd9d7a service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:24.975371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-49ad6558-005f-48dd-b1e3-530b032e0897 req-9b263efd-3550-4313-a491-f402cecd9d7a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:24.975823 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-49ad6558-005f-48dd-b1e3-530b032e0897 req-9b263efd-3550-4313-a491-f402cecd9d7a service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:24.987553 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-49ad6558-005f-48dd-b1e3-530b032e0897 req-9b263efd-3550-4313-a491-f402cecd9d7a service nova] Creating event network-vif-deleted:c4553b6f-246a-4d61-ab2d-898ca488be90 for instance 764a7f83-2829-4f11-aae4-51182d324ab1 on n-h1-862416-4 Oct 26 06:22:24.992749 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-49ad6558-005f-48dd-b1e3-530b032e0897 req-9b263efd-3550-4313-a491-f402cecd9d7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033193 Oct 26 06:22:24.993368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3926/7840] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:22:25.180624 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:25.181239 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:25.187950 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:25.188439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:25.188901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:25.189628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:25.190083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:25.190513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:25.222503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:25.222977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:25.223416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:25.223871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lazy-loading 'fault' on Instance uuid 764a7f83-2829-4f11-aae4-51182d324ab1 {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:22:25.267661 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:25.276653 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7089ede4-4a4a-44ff-8d51-deaa16ca18bb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 200 len: 1356 microversion: 2.1 time: 0.099838 Oct 26 06:22:25.277241 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3915/7841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:25 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:26.303552 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:26.304275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: 764a7f83-2829-4f11-aae4-51182d324ab1] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:26.310491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:26.310995 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:26.311455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:26.312159 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:26.312631 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:26.313076 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:26.326895 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] HTTP exception thrown: Instance 764a7f83-2829-4f11-aae4-51182d324ab1 could not be found. Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Request method failure captured: Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 HTTP/1.1 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWNBdaubfcGN37kV_fD-1dsTbVC6x7wuiXFeunBQvJWFh1oBys0stBGAtD0b3RfVKTL6BeM_L19hGap6dsz3oLe2u7gJDD4WBbqspVYv5SGI0mPvijI9_tC554BxXFcrRCpAMijqqt7_RliTJfLg-U7OgHaxv673xiCfcAWQavUgHrWg Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4d9b8fa88864052831d44570a94327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9644d94c283d4cc6ae4396b85ca1d620 Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance 764a7f83-2829-4f11-aae4-51182d324ab1 could not be found. Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': '764a7f83-2829-4f11-aae4-51182d324ab1'} Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764a7f83-2829-4f11-aae4-51182d324ab1 could not be found. Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764a7f83-2829-4f11-aae4-51182d324ab1 could not be found. Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:22:26.328537 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764a7f83-2829-4f11-aae4-51182d324ab1 could not be found. Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Returning 404 to user: Instance 764a7f83-2829-4f11-aae4-51182d324ab1 could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a0f12ca-58e8-4ca7-a03f-37a1cff5bc9c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1" status: 404 len: 111 microversion: 2.1 time: 0.032338 Oct 26 06:22:26.334592 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3927/7842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:26 2022] GET /compute/v2.1/servers/764a7f83-2829-4f11-aae4-51182d324ab1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:22:29.646539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0717439e-7cbf-4f66-8b4a-6b601addc4cd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '.version_select at 0x7f4709ee34c0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:29.670469 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0717439e-7cbf-4f66-8b4a-6b601addc4cd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1872309729" status: 202 len: 0 microversion: 2.1 time: 0.028176 Oct 26 06:22:29.671078 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3916/7843] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 26 06:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1872309729 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:22:29.703213 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-8725049f-4e40-4b44-b500-db1ee4d70f1b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: .version_select at 0x7f47091bc9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-103654676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30xnfDmJlwiOwxvhiddUF+IxMu5Jfk6OMX0Yl1EDtVoQ16gmd5d5khc7lvDCBAelOlhgJ+5zzHVtJTKCD1bvvwiDwnPBfmDuz19aSnFzeiZ43/BR1Noyi0rkWyKcKITw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:29.721210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8725049f-4e40-4b44-b500-db1ee4d70f1b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:22:29.726475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-8725049f-4e40-4b44-b500-db1ee4d70f1b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:22:29.750120 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-8725049f-4e40-4b44-b500-db1ee4d70f1b tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050756 Oct 26 06:22:29.750724 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3928/7844] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:22:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:22:35.176944 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1809362360", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "networks": [{"uuid": "bd88faf6-35d8-44e1-8f44-9be6f5f93d3c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-103654676", "security_groups": [{"name": "tempest-secgroup-smoke-1614709814"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:35.272732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:35.296176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] validate_networks() for [('bd88faf6-35d8-44e1-8f44-9be6f5f93d3c', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:22:35.728457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:22:35.728957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:22:35.729693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:22:35.730131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:22:35.730544 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:22:35.748297 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:35.749938 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:35.750860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:35.752879 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:35.753628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:35.754260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:35.777303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:22:35.786450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Getting quotas for user 9644d94c283d4cc6ae4396b85ca1d620 and project f4d9b8fa88864052831d44570a94327b. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:22:35.806038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:22:35.813062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:22:35.913667 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c1559340-b971-4df9-ad5c-e61d2d5143da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741515 Oct 26 06:22:35.921117 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3917/7845] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:22:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:22:35.929844 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-03de551b-d657-43f3-bb61-7ce428df2bc3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:35.930411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-03de551b-d657-43f3-bb61-7ce428df2bc3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:36.031241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-03de551b-d657-43f3-bb61-7ce428df2bc3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:36.045666 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-03de551b-d657-43f3-bb61-7ce428df2bc3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1266 microversion: 2.1 time: 0.123180 Oct 26 06:22:36.046258 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3929/7846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:35 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:22:37.074656 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:37.075518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:37.083681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:37.084184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:37.084623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:37.085590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:37.085985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:37.086413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:37.162706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:37.170733 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c205f168-210f-42fb-bee3-e020967999dc tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1318 microversion: 2.1 time: 0.100020 Oct 26 06:22:37.171616 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3918/7847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:37 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:38.195991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:38.196542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:38.202205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=16 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:38.207278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:38.207795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:38.208256 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:38.208988 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:38.209717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:38.210328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:38.367683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:38.376324 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e6848c8-0382-4db6-a246-56e831fae99f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1392 microversion: 2.1 time: 0.184593 Oct 26 06:22:38.377753 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3930/7848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:38 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:38.820295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-4a5ee70c-b99a-4917-8e7f-b254fe083d67 req-d4d62ffe-3b80-4836-a8e8-f1c696847aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e2d385-48f2-4c25-a1ca-11abbc9c38ec", "tag": "686cce78-754f-4ea8-b1a6-0e9af047b290"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:38.832600 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a5ee70c-b99a-4917-8e7f-b254fe083d67 req-d4d62ffe-3b80-4836-a8e8-f1c696847aca service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:38.833090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a5ee70c-b99a-4917-8e7f-b254fe083d67 req-d4d62ffe-3b80-4836-a8e8-f1c696847aca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:38.833554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-4a5ee70c-b99a-4917-8e7f-b254fe083d67 req-d4d62ffe-3b80-4836-a8e8-f1c696847aca service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:38.849947 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-4a5ee70c-b99a-4917-8e7f-b254fe083d67 req-d4d62ffe-3b80-4836-a8e8-f1c696847aca service nova] Creating event network-changed:686cce78-754f-4ea8-b1a6-0e9af047b290 for instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec on n-h1-862416-4 Oct 26 06:22:38.854993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-4a5ee70c-b99a-4917-8e7f-b254fe083d67 req-d4d62ffe-3b80-4836-a8e8-f1c696847aca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038500 Oct 26 06:22:38.855601 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3919/7849] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:22:39.401169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:39.401833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:39.408600 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:39.409105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:39.409605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:39.410319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:39.410798 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:39.411243 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:39.547681 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:39.556289 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2f477961-6ee1-4f6d-8db6-4e7cb0725c24 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1392 microversion: 2.1 time: 0.159041 Oct 26 06:22:39.556881 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3931/7850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:39 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:40.581830 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:40.582699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:40.588926 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:40.589466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:40.589919 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:40.590627 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:40.591100 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:40.591537 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:40.729942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:40.738755 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-53c454db-2135-4898-b199-9e4227a2161f tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1392 microversion: 2.1 time: 0.162743 Oct 26 06:22:40.739365 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3920/7851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:40 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:41.767749 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:41.768764 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:41.781794 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:41.785515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:41.786314 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:41.787471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:41.788251 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:41.788969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:41.938606 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:41.947710 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bbe00450-a060-46e4-81ef-d17df0d29fc1 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1392 microversion: 2.1 time: 0.189412 Oct 26 06:22:41.948299 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3932/7852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:41 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:42.972740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:42.973368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:42.980361 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:42.980853 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:42.981295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:42.982025 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:42.982490 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:42.982922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:43.121645 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:43.129963 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3a9c0de7-c0f8-4e1e-9609-c7d1cab462ab tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1392 microversion: 2.1 time: 0.162167 Oct 26 06:22:43.130573 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3921/7853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:42 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:43.869063 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-bf70c576-da98-48ba-bb80-0a20481e2724 req-c455ff1c-64bf-400d-9a7e-907692dc7aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e2d385-48f2-4c25-a1ca-11abbc9c38ec", "name": "network-vif-plugged", "status": "completed", "tag": "686cce78-754f-4ea8-b1a6-0e9af047b290"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:43.881570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bf70c576-da98-48ba-bb80-0a20481e2724 req-c455ff1c-64bf-400d-9a7e-907692dc7aba service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:43.882077 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bf70c576-da98-48ba-bb80-0a20481e2724 req-c455ff1c-64bf-400d-9a7e-907692dc7aba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:43.882528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-bf70c576-da98-48ba-bb80-0a20481e2724 req-c455ff1c-64bf-400d-9a7e-907692dc7aba service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:43.894683 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-bf70c576-da98-48ba-bb80-0a20481e2724 req-c455ff1c-64bf-400d-9a7e-907692dc7aba service nova] Creating event network-vif-plugged:686cce78-754f-4ea8-b1a6-0e9af047b290 for instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec on n-h1-862416-4 Oct 26 06:22:43.899659 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-bf70c576-da98-48ba-bb80-0a20481e2724 req-c455ff1c-64bf-400d-9a7e-907692dc7aba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Oct 26 06:22:43.900267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3933/7854] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:22:44.153479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:44.154102 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:44.161004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:44.161528 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:44.161976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:44.162676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:44.163140 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:44.163572 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:44.298557 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:44.306244 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4327e5d5-e632-454e-bd24-553e7b84932a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1392 microversion: 2.1 time: 0.156705 Oct 26 06:22:44.306823 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3922/7855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:44 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:45.332465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:45.333111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:45.335123 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:45.341282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:45.341817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:45.342273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:45.342986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:45.343713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:45.344158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:45.476466 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:45.484197 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0a8cd930-c21e-48c1-9957-67a9f1dfb10a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1564 microversion: 2.1 time: 0.157748 Oct 26 06:22:45.484765 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3934/7856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:45 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:45.509117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:45.509765 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:45.516648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:45.517295 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:45.517614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:45.518315 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:45.518781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:45.519216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:45.652951 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:45.661807 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-210eae33-ace7-41db-9937-ecab2918b3d4 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1564 microversion: 2.1 time: 0.156634 Oct 26 06:22:45.662385 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3923/7857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:45 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:22:47.546709 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-151f8e01-acaa-4eb8-b1fd-70affb9446a2 req-301546a2-d509-47b5-b23b-1afa54836191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e2d385-48f2-4c25-a1ca-11abbc9c38ec", "tag": "686cce78-754f-4ea8-b1a6-0e9af047b290"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:22:47.549450 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:22:47.550607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:22:47.552769 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=6 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:47.563070 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:47.564836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:22:47.568017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:47.568530 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:47.569050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:47.572801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:47.573289 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:47.577509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-151f8e01-acaa-4eb8-b1fd-70affb9446a2 req-301546a2-d509-47b5-b23b-1afa54836191 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:22:47.577676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:47.577998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-151f8e01-acaa-4eb8-b1fd-70affb9446a2 req-301546a2-d509-47b5-b23b-1afa54836191 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:22:47.578434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-151f8e01-acaa-4eb8-b1fd-70affb9446a2 req-301546a2-d509-47b5-b23b-1afa54836191 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:22:47.590332 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-151f8e01-acaa-4eb8-b1fd-70affb9446a2 req-301546a2-d509-47b5-b23b-1afa54836191 service nova] Creating event network-changed:686cce78-754f-4ea8-b1a6-0e9af047b290 for instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec on n-h1-862416-4 Oct 26 06:22:47.596769 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-151f8e01-acaa-4eb8-b1fd-70affb9446a2 req-301546a2-d509-47b5-b23b-1afa54836191 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057600 Oct 26 06:22:47.597753 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3924/7858] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:22:47.716059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:22:47.724866 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0163b352-44a3-4c8f-9794-2c78a178a83a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1564 microversion: 2.1 time: 0.188699 Oct 26 06:22:47.725472 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3935/7859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:22:47 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1564 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:10.991637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:10.994015 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:10.996090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:10.996940 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=36 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:11.003724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:11.004308 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:11.004753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:11.005518 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:11.005983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:11.006411 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:11.064745 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-235515c0-82c2-47c2-983b-818c610ba423 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action" status: 200 len: 24561 microversion: 2.1 time: 0.077703 Oct 26 06:23:11.065440 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3925/7860] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:23:10 2022] POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action => generated 24561 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:23:22.164919 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:22.165687 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:22.167519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:22.168257 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=32 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:22.173705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:22.174208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:22.174668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:22.175378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:22.175852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:22.176297 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:22.199656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lazy-loading 'flavor' on Instance uuid d1e2d385-48f2-4c25-a1ca-11abbc9c38ec {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:23:22.265754 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-695488db-32ad-4f69-8342-fcf5485c99c8 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action" status: 202 len: 0 microversion: 2.1 time: 0.104935 Oct 26 06:23:22.267318 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3936/7861] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:23:22 2022] POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:23:22.276284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:22.277126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:22.280615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:22.281268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=4 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:22.288923 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:22.289540 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:22.289995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:22.290706 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:22.291170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:22.291608 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:22.432892 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:22.441571 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-13b630b7-4102-4707-811f-64905919bf67 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1691 microversion: 2.1 time: 0.169627 Oct 26 06:23:22.442168 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3926/7862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:22 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:23.468060 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:23.469023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:23.476222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:23.476716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:23.477169 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:23.477900 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:23.478365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:23.478800 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:23.611109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:23.618769 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-35887350-f987-4108-b1eb-584e64647e01 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1674 microversion: 2.1 time: 0.155901 Oct 26 06:23:23.619331 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3937/7863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:23 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:24.716074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:24.718249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:24.725261 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:24.725782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:24.726225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:24.726922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:24.727382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:24.727815 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:24.789513 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-26901462-36bf-4088-a443-ec0561071f1c tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action" status: 200 len: 38355 microversion: 2.1 time: 0.077292 Oct 26 06:23:24.790160 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3927/7864] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:23:24 2022] POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action => generated 38355 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:23:24.802882 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:24.803470 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:24.811963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:24.812482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:24.813894 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:24.814624 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:24.815127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:24.815578 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:24.885077 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-432feb2d-ca67-45e6-92f0-431ff556c9c3 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action" status: 202 len: 0 microversion: 2.1 time: 0.086007 Oct 26 06:23:24.885763 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3938/7865] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:23:24 2022] POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:23:24.895000 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:24.895715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:24.902821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:24.903320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:24.903766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:24.904475 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:24.904942 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:24.905402 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:25.051716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:25.059594 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-685f0f9c-574b-4686-a362-7cc3305874e6 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1680 microversion: 2.1 time: 0.169139 Oct 26 06:23:25.060205 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3928/7866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:24 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:26.085225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:26.085993 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:26.092192 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:26.092670 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:26.093132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:26.094148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:26.094783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:26.095232 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:26.231653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:26.240307 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e9ac99f2-764e-4c05-99aa-e53f1e7f284a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1680 microversion: 2.1 time: 0.160235 Oct 26 06:23:26.240877 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3939/7867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:26 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:27.264653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:27.265275 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:27.272753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:27.273248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:27.273730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:27.274446 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:27.274908 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:27.275914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:27.408774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:27.416635 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-fb5c2db4-5776-4aeb-b0a8-a7ea09444ffd tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1683 microversion: 2.1 time: 0.155966 Oct 26 06:23:27.417209 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3929/7868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:27 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:27.513706 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:27.515939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:27.523549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:27.524049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:27.524505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:27.525220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:27.525705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:27.526148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:27.572997 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-850981c7-2361-480b-bd7a-732a1d7a197a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action" status: 200 len: 38355 microversion: 2.1 time: 0.063088 Oct 26 06:23:27.573674 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3940/7869] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:23:27 2022] POST /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec/action => generated 38355 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 06:23:28.574442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:28.574982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:28.584123 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:28.584914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:28.585397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:28.586129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:28.586601 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:28.587038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:28.617439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:23:28.646771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ff7fcdd5-5f6d-40cf-9e26-1010e7335139 req-f7983b20-6b9c-4edc-a89a-92465879ab1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e2d385-48f2-4c25-a1ca-11abbc9c38ec", "tag": "686cce78-754f-4ea8-b1a6-0e9af047b290"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:28.658435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ff7fcdd5-5f6d-40cf-9e26-1010e7335139 req-f7983b20-6b9c-4edc-a89a-92465879ab1e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:28.659277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ff7fcdd5-5f6d-40cf-9e26-1010e7335139 req-f7983b20-6b9c-4edc-a89a-92465879ab1e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:28.659952 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ff7fcdd5-5f6d-40cf-9e26-1010e7335139 req-f7983b20-6b9c-4edc-a89a-92465879ab1e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:28.672678 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ff7fcdd5-5f6d-40cf-9e26-1010e7335139 req-f7983b20-6b9c-4edc-a89a-92465879ab1e service nova] Creating event network-changed:686cce78-754f-4ea8-b1a6-0e9af047b290 for instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec on n-h1-862416-4 Oct 26 06:23:28.679898 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ff7fcdd5-5f6d-40cf-9e26-1010e7335139 req-f7983b20-6b9c-4edc-a89a-92465879ab1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106904 Oct 26 06:23:28.683908 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3941/7870] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:23:28.710080 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-43641987-50db-44f1-8a45-8919d375594a tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 204 len: 0 microversion: 2.1 time: 0.138798 Oct 26 06:23:28.711501 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3930/7871] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:23:28 2022] DELETE /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:23:28.723701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:28.724697 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:28.749133 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:28.749853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:28.750318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:28.751160 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:28.751873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:28.754864 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:28.899067 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:28.906911 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d507c6d2-d02e-4a67-82d8-d8e21e1c37e9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1689 microversion: 2.1 time: 0.190299 Oct 26 06:23:28.908467 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3942/7872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:28 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:29.934543 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:29.935188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:29.942668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:29.943164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:29.943619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:29.944323 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:29.944798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:29.945233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:30.076835 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:30.084664 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d67935cf-0aee-45cb-ad67-05b74967e0fb tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1689 microversion: 2.1 time: 0.154540 Oct 26 06:23:30.085249 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3931/7873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:29 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:30.927989 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-b2d3b4a6-8d7e-4625-8bb8-21ced861482c req-f9d321ce-1231-4245-ba75-cd982abd3d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e2d385-48f2-4c25-a1ca-11abbc9c38ec", "name": "network-vif-deleted", "tag": "686cce78-754f-4ea8-b1a6-0e9af047b290"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:30.938646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2d3b4a6-8d7e-4625-8bb8-21ced861482c req-f9d321ce-1231-4245-ba75-cd982abd3d2f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:30.939136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2d3b4a6-8d7e-4625-8bb8-21ced861482c req-f9d321ce-1231-4245-ba75-cd982abd3d2f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:30.939792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-b2d3b4a6-8d7e-4625-8bb8-21ced861482c req-f9d321ce-1231-4245-ba75-cd982abd3d2f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:30.951827 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-b2d3b4a6-8d7e-4625-8bb8-21ced861482c req-f9d321ce-1231-4245-ba75-cd982abd3d2f service nova] Creating event network-vif-deleted:686cce78-754f-4ea8-b1a6-0e9af047b290 for instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec on n-h1-862416-4 Oct 26 06:23:30.957225 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-b2d3b4a6-8d7e-4625-8bb8-21ced861482c req-f9d321ce-1231-4245-ba75-cd982abd3d2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Oct 26 06:23:30.958071 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3943/7874] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:23:31.108062 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:31.108644 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:31.116050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:31.116553 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:31.116997 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:31.117741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:31.118206 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:31.118637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:31.151349 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:31.151769 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:31.152216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:31.152672 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lazy-loading 'fault' on Instance uuid d1e2d385-48f2-4c25-a1ca-11abbc9c38ec {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:23:31.193652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9644d94c283d4cc6ae4396b85ca1d620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d9b8fa88864052831d44570a94327b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:31.201805 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-7803dc98-38c2-4b6e-8da5-eb54455688b9 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 200 len: 1356 microversion: 2.1 time: 0.097643 Oct 26 06:23:31.202400 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3932/7875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:31 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:32.227843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:32.228595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] [instance: d1e2d385-48f2-4c25-a1ca-11abbc9c38ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:32.234793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:32.235293 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:32.235750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:32.236455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:32.236927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:32.237907 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:32.251068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] HTTP exception thrown: Instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec could not be found. Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Request method failure captured: Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec HTTP/1.1 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWNBdaubfcGN37kV_fD-1dsTbVC6x7wuiXFeunBQvJWFh1oBys0stBGAtD0b3RfVKTL6BeM_L19hGap6dsz3oLe2u7gJDD4WBbqspVYv5SGI0mPvijI9_tC554BxXFcrRCpAMijqqt7_RliTJfLg-U7OgHaxv673xiCfcAWQavUgHrWg Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4d9b8fa88864052831d44570a94327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4d9b8fa88864052831d44570a94327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: f4d9b8fa88864052831d44570a94327b Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1040296679 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 9644d94c283d4cc6ae4396b85ca1d620 Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1040296679-project Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec could not be found. Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'd1e2d385-48f2-4c25-a1ca-11abbc9c38ec'} Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec could not be found. Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec could not be found. Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:23:32.252691 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec could not be found. Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Returning 404 to user: Instance d1e2d385-48f2-4c25-a1ca-11abbc9c38ec could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bee31f29-20ac-4ccf-a633-25817f0cf938 tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec" status: 404 len: 111 microversion: 2.1 time: 0.032328 Oct 26 06:23:32.259279 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3944/7876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:32 2022] GET /compute/v2.1/servers/d1e2d385-48f2-4c25-a1ca-11abbc9c38ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:23:35.880637 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-22b9a065-f19d-485d-aea1-0463164461da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] Calling method '.version_select at 0x7f4709e47b80>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:35.906824 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-22b9a065-f19d-485d-aea1-0463164461da tempest-TestNetworkAdvancedServerOps-1040296679 tempest-TestNetworkAdvancedServerOps-1040296679-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-103654676" status: 202 len: 0 microversion: 2.1 time: 0.032523 Oct 26 06:23:35.910708 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3933/7877] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 26 06:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-103654676 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:23:46.932760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=18 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:46.933603 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:47.102669 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-647468bd-017d-4d9d-9f63-614f3b0f4dfa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'create', calling method: .version_select at 0x7f47092f8310>, body: {"keypair": {"name": "tempest-TestShelveInstance-41878735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK69nrPFFTTia9IXa6+RaBRlSpQdR0E+ZFcvAG3WLQ74vSGsNwBwcnBUh+ss0ELccwpXcO82o41EXw1Cp6H4LNdSrxC70pVJefPeXV+gCKwuI9mO6IzNs+Xxr+BUlnGCw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:47.121252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-647468bd-017d-4d9d-9f63-614f3b0f4dfa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for project 2031db9648934f70aa2794b4c991a994. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:23:47.127978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-647468bd-017d-4d9d-9f63-614f3b0f4dfa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for user 468d6e2e4b854e469ecff4c2694e8dad and project 2031db9648934f70aa2794b4c991a994. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:23:47.157618 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-647468bd-017d-4d9d-9f63-614f3b0f4dfa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.231981 Oct 26 06:23:47.158368 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3945/7878] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:23:46 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:23:48.150590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:48.151485 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:48.155752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-307848629", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-41878735", "security_groups": [{"name": "tempest-secgroup-smoke-1572401960"}], "networks": [{"uuid": "ff2fc41a-a7c8-4966-95f1-1b75decbf39f"}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:48.265587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] validate_networks() for [('ff2fc41a-a7c8-4966-95f1-1b75decbf39f', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:23:49.034789 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:23:49.035225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:23:49.035716 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:23:49.036179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:23:49.036834 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:23:49.050121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:49.050752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:49.051306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:49.052657 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:49.053187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:49.053807 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:49.072782 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for project 2031db9648934f70aa2794b4c991a994. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:23:49.078298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for user 468d6e2e4b854e469ecff4c2694e8dad and project 2031db9648934f70aa2794b4c991a994. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:23:49.090778 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:23:49.093127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:23:49.150246 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3288f9f8-a68f-4f0e-b2b3-2151ae5caa95 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.001307 Oct 26 06:23:49.162207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3c32abac-8528-4526-a3ff-16abd22a64bd tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:49.163539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3c32abac-8528-4526-a3ff-16abd22a64bd tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:49.169032 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3934/7879] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:23:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:23:49.222642 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3c32abac-8528-4526-a3ff-16abd22a64bd tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:49.230068 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3c32abac-8528-4526-a3ff-16abd22a64bd tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1244 microversion: 2.1 time: 0.071713 Oct 26 06:23:49.230667 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3946/7880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:49 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:23:50.258418 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9a7397a9-d051-499f-a1cb-cb32d89e2a8e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:50.259116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9a7397a9-d051-499f-a1cb-cb32d89e2a8e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:50.331471 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9a7397a9-d051-499f-a1cb-cb32d89e2a8e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:50.339176 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9a7397a9-d051-499f-a1cb-cb32d89e2a8e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1244 microversion: 2.1 time: 0.089307 Oct 26 06:23:50.340174 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3935/7881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:50 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:51.365116 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-22896498-afaa-4fe9-8c63-6e37a5881df3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:51.365779 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-22896498-afaa-4fe9-8c63-6e37a5881df3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:51.429663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-22896498-afaa-4fe9-8c63-6e37a5881df3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:51.438266 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-22896498-afaa-4fe9-8c63-6e37a5881df3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1244 microversion: 2.1 time: 0.078569 Oct 26 06:23:51.449520 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3947/7882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:51 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:52.465122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8410c2b2-c6a7-4415-903c-a9bbd089cd14 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:52.465811 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8410c2b2-c6a7-4415-903c-a9bbd089cd14 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:52.525770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8410c2b2-c6a7-4415-903c-a9bbd089cd14 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:52.532963 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8410c2b2-c6a7-4415-903c-a9bbd089cd14 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1244 microversion: 2.1 time: 0.071831 Oct 26 06:23:52.533581 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3936/7883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:52 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:53.558871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:53.559519 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:53.566432 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:53.566936 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:53.568119 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:53.568840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:53.569342 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:53.569793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:53.630458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:53.638171 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-71b1b875-4569-4c80-9e06-7c3367aea199 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1248 microversion: 2.1 time: 0.083251 Oct 26 06:23:53.638743 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3948/7884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:53 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:54.662422 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:54.663039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:54.670293 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:54.670792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:54.671276 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:54.672041 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:54.672585 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:54.673090 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:54.746945 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:54.754568 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10016cb0-f688-457d-8ed4-134dd7fe600d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1302 microversion: 2.1 time: 0.096791 Oct 26 06:23:54.755353 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3937/7885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:54 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:55.778560 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:55.779186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:55.782209 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:23:55.782355 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:23:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e (ip 10.222.0.16) !!! Oct 26 06:23:55.790233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:55.790740 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:55.791195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:55.791916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:55.792389 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:55.792832 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:55.841050 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e936c130-691c-4d57-9324-6034ea1e9481 req-cd0deb6f-3207-4017-b42f-489c92085de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:23:55.856113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e936c130-691c-4d57-9324-6034ea1e9481 req-cd0deb6f-3207-4017-b42f-489c92085de5 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:55.856877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e936c130-691c-4d57-9324-6034ea1e9481 req-cd0deb6f-3207-4017-b42f-489c92085de5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:55.857507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e936c130-691c-4d57-9324-6034ea1e9481 req-cd0deb6f-3207-4017-b42f-489c92085de5 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:55.870334 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e936c130-691c-4d57-9324-6034ea1e9481 req-cd0deb6f-3207-4017-b42f-489c92085de5 service nova] Creating event network-changed:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h1-862416-4 Oct 26 06:23:55.875378 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e936c130-691c-4d57-9324-6034ea1e9481 req-cd0deb6f-3207-4017-b42f-489c92085de5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038056 Oct 26 06:23:55.876087 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3938/7886] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:23:56.079915 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:56.087736 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4217cedd-0a04-4014-80ba-d145f332a7f3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1370 microversion: 2.1 time: 0.312976 Oct 26 06:23:56.088173 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3949/7887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:55 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:57.111842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:57.112554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:57.119772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:57.120319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:57.120764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:57.121500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:57.121994 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:57.122425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:57.262458 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:57.271523 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eff648ff-15f2-4547-a1ca-4d010f8dfb5b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1370 microversion: 2.1 time: 0.163259 Oct 26 06:23:57.272128 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3939/7888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:57 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:58.295630 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:58.296254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:58.304115 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:58.304626 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:58.305109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:58.305852 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:58.306388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:58.307107 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:58.441680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:58.450277 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-81ac72ca-0ca6-4f7b-8cd5-356962de9ccf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1370 microversion: 2.1 time: 0.158617 Oct 26 06:23:58.450851 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3950/7889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:58 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:23:59.475264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:23:59.475995 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:23:59.478888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:23:59.484536 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:59.485031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:59.485503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:59.486202 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:23:59.486664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:23:59.487099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:23:59.619779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:23:59.627580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8459e327-62db-4616-a547-656f34610e54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1370 microversion: 2.1 time: 0.156487 Oct 26 06:23:59.628157 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3940/7890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:23:59 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:24:00.252765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-812e9cdc-a38a-43e4-a8f5-bcebd40f5497 req-05f900ea-82d4-46e8-8a15-edef56706323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "name": "network-vif-plugged", "status": "completed", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:24:00.263976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-812e9cdc-a38a-43e4-a8f5-bcebd40f5497 req-05f900ea-82d4-46e8-8a15-edef56706323 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:00.264484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-812e9cdc-a38a-43e4-a8f5-bcebd40f5497 req-05f900ea-82d4-46e8-8a15-edef56706323 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:00.264942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-812e9cdc-a38a-43e4-a8f5-bcebd40f5497 req-05f900ea-82d4-46e8-8a15-edef56706323 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:00.276157 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-812e9cdc-a38a-43e4-a8f5-bcebd40f5497 req-05f900ea-82d4-46e8-8a15-edef56706323 service nova] Creating event network-vif-plugged:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h1-862416-4 Oct 26 06:24:00.281176 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-812e9cdc-a38a-43e4-a8f5-bcebd40f5497 req-05f900ea-82d4-46e8-8a15-edef56706323 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090233 Oct 26 06:24:00.281798 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3951/7891] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:24:00.650457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:24:00.651079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:24:00.657992 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:00.658486 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:00.658934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:00.659628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:00.660092 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:00.660532 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:00.794263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:24:00.804207 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-93bc633a-df90-4ebf-81e2-e45b87f523fc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1370 microversion: 2.1 time: 0.157393 Oct 26 06:24:00.804801 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3941/7892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:24:00 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:24:01.828649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:24:01.829410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:24:01.832239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:24:01.838050 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:01.838599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:01.839059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:01.839771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:01.840245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:01.840693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:01.977716 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:24:01.985514 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0c062322-509b-446a-807f-31f0c7ec9711 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1554 microversion: 2.1 time: 0.161172 Oct 26 06:24:01.986081 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3952/7893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:24:01 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:24:02.009603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:24:02.010304 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:24:02.017093 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:02.017614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:02.018058 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:02.018753 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:02.019211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:02.019640 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:02.150246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:24:02.157887 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-10af1429-c69d-4010-87cd-77c61de16573 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1554 microversion: 2.1 time: 0.153216 Oct 26 06:24:02.158462 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3942/7894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:24:02 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:24:04.068909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-48d33d22-3ffd-4f29-b3a2-625ebd85c8ec req-ebe3b793-202d-4d6b-9b81-e539ac9ca738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:24:04.078688 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-48d33d22-3ffd-4f29-b3a2-625ebd85c8ec req-ebe3b793-202d-4d6b-9b81-e539ac9ca738 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:24:04.079185 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-48d33d22-3ffd-4f29-b3a2-625ebd85c8ec req-ebe3b793-202d-4d6b-9b81-e539ac9ca738 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:24:04.079647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-48d33d22-3ffd-4f29-b3a2-625ebd85c8ec req-ebe3b793-202d-4d6b-9b81-e539ac9ca738 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:24:04.090802 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-48d33d22-3ffd-4f29-b3a2-625ebd85c8ec req-ebe3b793-202d-4d6b-9b81-e539ac9ca738 service nova] Creating event network-changed:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h1-862416-4 Oct 26 06:24:04.096137 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-48d33d22-3ffd-4f29-b3a2-625ebd85c8ec req-ebe3b793-202d-4d6b-9b81-e539ac9ca738 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031841 Oct 26 06:24:04.096801 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3953/7895] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:26:00.344759 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:26:00.345943 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:26:00.346337 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:00.347288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:00.347871 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=34 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:00.349109 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:26:00.349258 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e/action (ip 10.222.0.16) !!! Oct 26 06:26:00.350444 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:26:00.351165 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e/action (ip 10.222.0.16) !!! Oct 26 06:26:00.356366 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:26:00.356900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:00.371754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:00.372244 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:00.372687 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:00.373405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:00.373863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:00.374292 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:00.399790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.objects.instance [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lazy-loading 'flavor' on Instance uuid b9e5290d-89bb-444d-b356-c164fd3a2f3e {{(pid=120586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:26:00.703907 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-599dbc8d-82c7-423a-a2e8-0bf924ce088a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e/action" status: 202 len: 0 microversion: 2.1 time: 0.360882 Oct 26 06:26:00.704537 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3943/7896] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:26:00 2022] POST /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:26:00.713637 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 06:26:00.714317 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:00.715166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=28 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:00.716270 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 26 06:26:00.722548 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:00.723274 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:00.731122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:00.731625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:00.732082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:00.732792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:00.733263 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:00.733745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:00.935678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:00.944804 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-60275ba0-719d-4046-8cf7-6e2fcba43922 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.235023 Oct 26 06:26:00.945884 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3954/7897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:00 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:01.971910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:01.972625 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:01.982730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:01.983222 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:01.983667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:01.984373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:01.984836 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:01.985271 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:01.989215 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56470. Oct 26 06:26:01.989952 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56472. Oct 26 06:26:02.121979 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:02.129768 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-639c3db5-3229-4be0-894e-524fc32b3732 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.164490 Oct 26 06:26:02.130344 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3944/7898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:01 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:03.152897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:03.153536 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:03.161163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:03.161693 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:03.162150 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:03.162930 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:03.163593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:03.164038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:03.170061 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56476. Oct 26 06:26:03.302045 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:03.310466 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b448189e-f2ab-4d17-8833-e9de817b1d47 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.161650 Oct 26 06:26:03.311045 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3955/7899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:03 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:04.335538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:04.336144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:04.342998 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:04.343494 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:04.343936 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:04.344635 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:04.345372 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:04.345809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:04.479920 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:04.487758 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6b3ebf42-0b17-4ae0-9b31-e3c961b40106 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.156815 Oct 26 06:26:04.488333 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3945/7900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:04 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:05.511303 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:05.511923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:05.518695 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:05.519190 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:05.519646 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:05.520346 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:05.520817 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:05.521254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:05.653188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:05.660885 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-34c95807-f40a-4909-884e-4057871c4ab1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.153527 Oct 26 06:26:05.661543 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3956/7901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:05 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:06.685195 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:06.685826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:06.692595 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:06.693083 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:06.693622 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:06.695204 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:06.695679 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:06.696108 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:06.831096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:06.838813 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8dd58028-f653-4677-9cd8-b54f6eaf6e63 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.157611 Oct 26 06:26:06.839381 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3946/7902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:06 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:07.862926 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:07.863551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:07.870417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:07.870916 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:07.871370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:07.872073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:07.872539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:07.872974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:08.002742 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:08.011424 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9871f365-2962-46aa-b494-d27c31281e33 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.152436 Oct 26 06:26:08.012289 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3957/7903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:07 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:09.035824 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:09.036426 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:09.043580 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:09.044074 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:09.044520 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:09.045252 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:09.045741 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:09.046170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:09.182413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:09.190373 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9bc537c7-a1c2-4840-a799-ef1164c3e439 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.158525 Oct 26 06:26:09.190945 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3947/7904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:09 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:10.214544 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:10.215167 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:10.222351 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:10.223007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:10.223459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:10.224284 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:10.224763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:10.225743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:10.356835 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:10.364644 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a889b96a-a3a0-4b63-83db-75332f3c2fd1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.154086 Oct 26 06:26:10.365222 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3958/7905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:10 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:11.388658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:11.389213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:11.396238 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:11.396724 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:11.397693 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:11.398872 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:11.399335 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:11.399767 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:11.539708 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:11.548056 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6e217250-ad5d-40e8-be41-b50b0f629007 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1699 microversion: 2.1 time: 0.163372 Oct 26 06:26:11.548698 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3948/7906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:11 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:12.573086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:12.573775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:12.583714 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:12.584236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:12.584760 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:12.585528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:12.585999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:12.586440 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:12.718195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:12.726797 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6e9b1b0d-8f12-4147-b243-bbb6537eb39c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1699 microversion: 2.1 time: 0.158154 Oct 26 06:26:12.727366 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3959/7907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:12 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:13.750558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:13.752004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:13.758959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:13.759730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:13.760416 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:13.761196 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:13.761915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:13.762606 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:13.912538 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:13.921760 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f07ac86a-db11-4902-b21e-faf8a5e56c49 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.175054 Oct 26 06:26:13.922558 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3949/7908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:13 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:14.948627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:14.949451 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:14.966211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:14.966737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:14.967281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:14.968421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:14.970678 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:14.971781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:15.146392 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:15.154524 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-29669dec-9120-4590-90a3-7e3901d390d7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.210884 Oct 26 06:26:15.155343 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3960/7909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:14 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:16.180441 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:16.182166 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:16.189546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:16.190320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:16.190985 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:16.192023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:16.192742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:16.193447 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:16.349545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:16.355958 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-740a5735-61b3-46b0-9eb0-986f9aa00ded tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.179727 Oct 26 06:26:16.356784 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3950/7910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:16 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:16.908766 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7e605a6b-d92c-41fe-b4ab-8040f3443907 req-23da73b9-c37f-47c0-8fc7-57ea6fa533f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "name": "network-vif-plugged", "status": "completed", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:26:16.921253 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e605a6b-d92c-41fe-b4ab-8040f3443907 req-23da73b9-c37f-47c0-8fc7-57ea6fa533f1 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:16.922043 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e605a6b-d92c-41fe-b4ab-8040f3443907 req-23da73b9-c37f-47c0-8fc7-57ea6fa533f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:16.922904 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7e605a6b-d92c-41fe-b4ab-8040f3443907 req-23da73b9-c37f-47c0-8fc7-57ea6fa533f1 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:16.937357 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7e605a6b-d92c-41fe-b4ab-8040f3443907 req-23da73b9-c37f-47c0-8fc7-57ea6fa533f1 service nova] Creating event network-vif-plugged:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h1-862416-4 Oct 26 06:26:16.944681 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7e605a6b-d92c-41fe-b4ab-8040f3443907 req-23da73b9-c37f-47c0-8fc7-57ea6fa533f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039545 Oct 26 06:26:16.946431 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3961/7911] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:26:17.379712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:17.380954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:17.389921 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:17.390766 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:17.391432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:17.392355 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:17.392816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:17.393249 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:17.562065 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:17.571336 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9590d3b0-765d-4802-b484-9116dbfd9e40 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.195505 Oct 26 06:26:17.585342 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3951/7912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:17 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:18.597939 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:18.598765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:18.609296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:18.609841 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:18.610318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:18.611086 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:18.611555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:18.612013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:18.757072 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:18.765757 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5718d751-7aab-461f-ac00-5632aca667e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.173134 Oct 26 06:26:18.766628 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3962/7913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:18 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:19.792432 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:19.793021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:19.800401 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:19.801214 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:19.801912 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:19.802878 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:19.803984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:19.804393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:19.953253 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:19.961931 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-ac284259-93e6-43b8-8409-b367d5d61ec0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.173494 Oct 26 06:26:19.976746 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3952/7914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:19 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:20.987554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:20.988349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:20.996344 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:20.996932 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:20.997487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:20.999782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:20.999782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:20.999782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:21.168011 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:21.176915 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-682469f9-40e5-4c48-938d-66a1168262bb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.193345 Oct 26 06:26:21.177723 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3963/7915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:20 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:22.208425 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:22.210560 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:22.219085 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:22.219589 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:22.220284 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:22.221495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:22.222371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:22.223154 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:22.370278 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:22.378623 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-791e21ad-3c72-4088-9bf2-9eb670c061a6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1694 microversion: 2.1 time: 0.175876 Oct 26 06:26:22.379582 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3953/7916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:22 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:23.403625 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:23.404294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:23.412085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:23.413217 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:23.413773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:23.414502 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:23.415008 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:23.415509 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:23.635281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:23.643496 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-88fea4ce-5c7b-430b-8bc7-95aa733683d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1676 microversion: 2.1 time: 0.243855 Oct 26 06:26:23.644072 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3964/7917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:23 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:24.669081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:24.669727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:24.676527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:24.677021 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:24.677504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:24.678833 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:24.679298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:24.679734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:24.814175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:24.822243 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-eaeaf756-f5ed-4e55-853b-f2ac17acd27f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1676 microversion: 2.1 time: 0.157105 Oct 26 06:26:24.822827 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3954/7918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:24 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:25.847177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:25.847810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:25.854725 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:25.855230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:25.855690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:25.856413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:25.856887 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:25.857360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:25.992683 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:26.000481 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9df6afe7-226f-4bcd-8ba3-8275cebf39d9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1619 microversion: 2.1 time: 0.157587 Oct 26 06:26:26.001049 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3965/7919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:25 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1619 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:26.028896 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:26:26.029571 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:26.036393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:26.036918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:26.037392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:26.038664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:26.039129 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:26.039566 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:26.080954 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120586) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 06:26:26.148344 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [cad98b36-7380-4165-9311-b87e77593280] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:26:26.908833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-c11c00a2-a0dd-49f4-8cf1-ad01d8a32404 req-cc651b38-bbd3-4e66-86dd-29c9b3dbee5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:26:26.920577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c11c00a2-a0dd-49f4-8cf1-ad01d8a32404 req-cc651b38-bbd3-4e66-86dd-29c9b3dbee5d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:26.921100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c11c00a2-a0dd-49f4-8cf1-ad01d8a32404 req-cc651b38-bbd3-4e66-86dd-29c9b3dbee5d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:26.921568 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-c11c00a2-a0dd-49f4-8cf1-ad01d8a32404 req-cc651b38-bbd3-4e66-86dd-29c9b3dbee5d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:26.933453 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_external_events [req-c11c00a2-a0dd-49f4-8cf1-ad01d8a32404 req-cc651b38-bbd3-4e66-86dd-29c9b3dbee5d service nova] Unable to find a host for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e. Dropping event network-vif-unplugged {{(pid=120585) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 06:26:26.934348 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-c11c00a2-a0dd-49f4-8cf1-ad01d8a32404 req-cc651b38-bbd3-4e66-86dd-29c9b3dbee5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029510 Oct 26 06:26:26.934946 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3966/7920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 26 06:26:27.154626 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [cad98b36-7380-4165-9311-b87e77593280] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56572. Oct 26 06:26:27.157581 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4861ad95-8d49-4faf-b80f-c05220692660 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e/action" status: 202 len: 0 microversion: 2.1 time: 1.132759 Oct 26 06:26:27.158398 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3955/7921] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:26:26 2022] POST /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:26:27.166617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:27.167277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:27.174079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:27.174593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:27.175049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:27.175775 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:27.176245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:27.176896 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:27.317073 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:27.325774 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3aa74502-faf6-4983-9b41-fdc7164b1f6e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1627 microversion: 2.1 time: 0.162982 Oct 26 06:26:27.326495 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3967/7922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:27 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1627 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:28.352049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:28.352675 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:28.359809 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:28.360305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:28.360754 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:28.361496 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:28.361962 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:28.362397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:28.381975 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:28.498914 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:28.507415 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f9d1a4d-13dc-492b-9fff-5d333d6c81b4 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.160239 Oct 26 06:26:28.508179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3956/7923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:28 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:29.411789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-05a771e0-5826-4ce9-8272-07f9ac67e909 req-022f8b45-9435-4f7e-b4a5-451a9a007f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:26:29.422202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05a771e0-5826-4ce9-8272-07f9ac67e909 req-022f8b45-9435-4f7e-b4a5-451a9a007f2f service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:29.422667 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05a771e0-5826-4ce9-8272-07f9ac67e909 req-022f8b45-9435-4f7e-b4a5-451a9a007f2f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:29.423122 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-05a771e0-5826-4ce9-8272-07f9ac67e909 req-022f8b45-9435-4f7e-b4a5-451a9a007f2f service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:29.435503 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-05a771e0-5826-4ce9-8272-07f9ac67e909 req-022f8b45-9435-4f7e-b4a5-451a9a007f2f service nova] Creating event network-changed:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h2-862416-4 Oct 26 06:26:29.440722 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-05a771e0-5826-4ce9-8272-07f9ac67e909 req-022f8b45-9435-4f7e-b4a5-451a9a007f2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088900 Oct 26 06:26:29.441360 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3968/7924] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:26:29.533504 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:29.534225 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:29.542604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:29.543431 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:29.544018 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:29.545031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:29.545299 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:29.545772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:29.688406 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:29.697571 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-551f5f93-7b2e-4591-9296-d735a259eddc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.169235 Oct 26 06:26:29.698171 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3957/7925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:29 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:30.725056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:30.726474 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:30.733132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:30.733662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:30.734117 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:30.734830 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:30.735300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:30.735741 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:30.738542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=79 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:30.895456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:30.904444 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-87da9bb7-cc26-479d-9eb9-a04dee33b006 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.185541 Oct 26 06:26:30.914028 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3969/7926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:30 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:26:31.945404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:31.960527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:31.964947 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:31.971669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:31.972176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:31.972623 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:31.973436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:31.973903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:31.974343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:32.129676 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:32.139492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-f5272869-8b1b-46e2-aed2-4fad95a48a30 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.199212 Oct 26 06:26:32.151989 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3958/7927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:31 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:33.165638 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:33.166436 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:33.169377 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=33 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:26:33.174111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:33.174628 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:33.175168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:33.175914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:33.176397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:33.176849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:33.337881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:33.346399 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-27a91586-a4c8-4894-89bf-f747a7b131bf tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.184689 Oct 26 06:26:33.347303 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3970/7928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:33 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:34.371509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:34.372120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:34.379929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:34.380539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:34.381030 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:34.382006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:34.382483 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:34.382925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:34.547961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:34.556492 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-59f6436f-d7de-4642-994a-5e01dac4b42a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.188861 Oct 26 06:26:34.557273 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3959/7929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:34 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:35.580870 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:35.581686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:35.589247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:35.589822 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:35.590224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:35.590991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:35.591410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:35.592188 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:35.751224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:35.760000 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-76954eec-b178-4271-a6e2-abbc58628904 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.182988 Oct 26 06:26:35.760588 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3971/7930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:35 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:36.784259 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:36.784929 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:36.792233 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:36.792728 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:36.793177 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:36.793913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:36.794380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:36.794819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:36.962119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:36.971928 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c85e9020-ac9a-42c9-a727-3ad473fe7e35 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.190077 Oct 26 06:26:36.985817 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3960/7931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:36 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:37.994574 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:37.995204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:38.002111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:38.002613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:38.003071 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:38.003774 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:38.004245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:38.004689 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:38.138212 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:38.145878 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ed109d21-bb83-43f2-87a9-27dbfe64748f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.155197 Oct 26 06:26:38.146455 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3972/7932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:37 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:39.170343 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:39.170969 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:39.177882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:39.178959 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:39.179294 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:39.179980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:39.180522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:39.180867 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:39.312188 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:39.320062 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1f51c264-c681-48b1-9624-d85d8c6e667a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.153719 Oct 26 06:26:39.320650 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3961/7933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:39 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:40.344245 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:40.344873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:40.352572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:40.353098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:40.353583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:40.354290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:40.354759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:40.355227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:40.490795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:40.499293 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d5f26131-168c-4fe5-bbc7-b3e72063eb87 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.158942 Oct 26 06:26:40.499870 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3973/7934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:40 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:41.524003 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:41.524576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:41.531541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:41.532036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:41.532477 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:41.533176 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:41.533660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:41.534089 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:41.670817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:41.678552 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-222eb94e-8ddd-4206-8d69-4681c1be4171 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.159516 Oct 26 06:26:41.679159 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3962/7935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:41 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:42.702009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:42.703209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:42.709944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:42.711061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:42.711880 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:42.712234 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:42.712781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:42.713285 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:42.850372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:42.858732 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-926b9a9c-aa46-4e52-9678-0a73e81818e9 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.160573 Oct 26 06:26:42.859400 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3974/7936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:42 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:43.881823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:43.883013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:43.889915 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:43.890407 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:43.890852 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:43.891551 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:43.892017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:43.892444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:44.028989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:44.036754 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-333966da-41f0-4271-b156-7de2151d7760 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.158843 Oct 26 06:26:44.037347 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3963/7937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:43 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:44.703727 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-68569a27-b8f5-4b4e-8241-5aba988fe92d req-6a3f0d67-c135-4633-802c-99359380c199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "name": "network-vif-plugged", "status": "completed", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:26:44.714984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-68569a27-b8f5-4b4e-8241-5aba988fe92d req-6a3f0d67-c135-4633-802c-99359380c199 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:44.715488 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-68569a27-b8f5-4b4e-8241-5aba988fe92d req-6a3f0d67-c135-4633-802c-99359380c199 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:44.715941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-68569a27-b8f5-4b4e-8241-5aba988fe92d req-6a3f0d67-c135-4633-802c-99359380c199 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:44.728022 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-68569a27-b8f5-4b4e-8241-5aba988fe92d req-6a3f0d67-c135-4633-802c-99359380c199 service nova] Creating event network-vif-plugged:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h2-862416-4 Oct 26 06:26:44.733035 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-68569a27-b8f5-4b4e-8241-5aba988fe92d req-6a3f0d67-c135-4633-802c-99359380c199 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Oct 26 06:26:44.733674 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3975/7938] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:26:45.060593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:45.061216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:45.068234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:45.068730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:45.069198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:45.069984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:45.070448 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:45.070882 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:45.204374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:45.212861 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-42f58941-f290-4392-843b-3078fc68ae38 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.156206 Oct 26 06:26:45.213466 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3964/7939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:45 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:46.239020 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:46.239737 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:46.246059 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:46.247000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:46.247580 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:46.248296 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:46.248776 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:46.249220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:46.404969 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:46.412862 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4747d8f6-5c83-499e-bd6e-2f06bf690923 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1685 microversion: 2.1 time: 0.178960 Oct 26 06:26:46.414275 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3976/7940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:46 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:26:47.436986 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:26:47.437578 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:26:47.444949 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:47.445509 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:47.445955 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:47.446681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:26:47.447125 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:26:47.447559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:26:47.577172 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:26:47.584853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b6fe6d46-a890-45fe-a89b-8351f63fddfb tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1672 microversion: 2.1 time: 0.152020 Oct 26 06:26:47.586523 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3965/7941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:26:47 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:32.651165 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=13 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:32.653275 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=43 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:32.654763 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:28:32.654926 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e (ip 10.222.0.16) !!! Oct 26 06:28:32.657880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-199efe08-b0d4-4f50-bf46-2d20b62813d1 req-21e40fa6-9d95-4eec-82c8-a9cf16bc4bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:28:32.660543 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:32.661295 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:32.670517 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=15 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:32.670787 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:32.671200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=56 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:32.672691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:32.673465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:32.674389 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-199efe08-b0d4-4f50-bf46-2d20b62813d1 req-21e40fa6-9d95-4eec-82c8-a9cf16bc4bb7 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:32.674730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:32.674922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-199efe08-b0d4-4f50-bf46-2d20b62813d1 req-21e40fa6-9d95-4eec-82c8-a9cf16bc4bb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:32.675220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:32.675514 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-199efe08-b0d4-4f50-bf46-2d20b62813d1 req-21e40fa6-9d95-4eec-82c8-a9cf16bc4bb7 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:32.676186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:32.690688 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-199efe08-b0d4-4f50-bf46-2d20b62813d1 req-21e40fa6-9d95-4eec-82c8-a9cf16bc4bb7 service nova] Creating event network-changed:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h2-862416-4 Oct 26 06:28:32.696121 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-199efe08-b0d4-4f50-bf46-2d20b62813d1 req-21e40fa6-9d95-4eec-82c8-a9cf16bc4bb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044851 Oct 26 06:28:32.696949 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3966/7942] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:28:32.705551 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:28:32.798042 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-6bbfac06-6c90-4fcb-be5e-ae60cf1aa5a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 204 len: 0 microversion: 2.1 time: 0.148270 Oct 26 06:28:32.798517 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3977/7943] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:28:32 2022] DELETE /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:28:32.806860 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:32.807636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:32.814440 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:32.815013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:32.815519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:32.816281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:32.816832 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:32.817338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:32.969957 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:32.978124 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a8a81651-0069-430b-888f-8d0fa567c9ab tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.175364 Oct 26 06:28:32.978719 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3967/7944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:32 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:28:34.002332 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7813b65-3d9c-45f7-af47-65a9f25bbe02] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:28:34.006273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:34.006978 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:34.013784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:34.014273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:34.014723 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:34.015417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:34.015881 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:34.016319 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:34.154094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:34.161846 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-01baf882-bf33-48a9-a0f0-8739a2ea7591 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.161129 Oct 26 06:28:34.162417 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3978/7945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:33 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:34.711922 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-1292229d-5c42-4d06-ae70-97fbeb9788e3 req-539fda55-3ee1-4928-9f7f-51eefb0cbc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5290d-89bb-444d-b356-c164fd3a2f3e", "name": "network-vif-deleted", "tag": "b5a1fe6f-ca17-4cb0-b475-f38c0015b81f"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:28:34.723961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1292229d-5c42-4d06-ae70-97fbeb9788e3 req-539fda55-3ee1-4928-9f7f-51eefb0cbc61 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:34.724442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1292229d-5c42-4d06-ae70-97fbeb9788e3 req-539fda55-3ee1-4928-9f7f-51eefb0cbc61 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:34.724874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-1292229d-5c42-4d06-ae70-97fbeb9788e3 req-539fda55-3ee1-4928-9f7f-51eefb0cbc61 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:34.736541 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-1292229d-5c42-4d06-ae70-97fbeb9788e3 req-539fda55-3ee1-4928-9f7f-51eefb0cbc61 service nova] Creating event network-vif-deleted:b5a1fe6f-ca17-4cb0-b475-f38c0015b81f for instance b9e5290d-89bb-444d-b356-c164fd3a2f3e on n-h2-862416-4 Oct 26 06:28:34.742317 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-1292229d-5c42-4d06-ae70-97fbeb9788e3 req-539fda55-3ee1-4928-9f7f-51eefb0cbc61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034081 Oct 26 06:28:34.743170 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3968/7946] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:28:35.186720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:35.187350 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: b9e5290d-89bb-444d-b356-c164fd3a2f3e] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:35.195549 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:35.195996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:35.196454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:35.197166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:35.197661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:35.198110 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:35.204895 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7813b65-3d9c-45f7-af47-65a9f25bbe02] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56750. Oct 26 06:28:35.213913 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] HTTP exception thrown: Instance b9e5290d-89bb-444d-b356-c164fd3a2f3e could not be found. Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Request method failure captured: Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e HTTP/1.1 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWNJtOXNuYpH30KXlp_m00dyw1ITbX0_zuEiZoQdopuCfp6aa3KFxfw3nuzgRbiJrJGFQ7pNsGDOmZVF89neA453txndJIkc2xdnJEUyHoL4AFvd6kIZ0GjP5osyVajySSqUxuTI3KawZzfTXS4Yg295bLeSFjSPq_FOAeMEpwa9xBqM Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 2031db9648934f70aa2794b4c991a994 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestShelveInstance-26370697 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2031db9648934f70aa2794b4c991a994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2031db9648934f70aa2794b4c991a994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2031db9648934f70aa2794b4c991a994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2031db9648934f70aa2794b4c991a994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestShelveInstance-26370697 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 2031db9648934f70aa2794b4c991a994 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestShelveInstance-26370697 Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestShelveInstance-26370697-project Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 468d6e2e4b854e469ecff4c2694e8dad Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestShelveInstance-26370697-project Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance b9e5290d-89bb-444d-b356-c164fd3a2f3e could not be found. Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'b9e5290d-89bb-444d-b356-c164fd3a2f3e'} Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e5290d-89bb-444d-b356-c164fd3a2f3e could not be found. Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e5290d-89bb-444d-b356-c164fd3a2f3e could not be found. Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:28:35.215863 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e5290d-89bb-444d-b356-c164fd3a2f3e could not be found. Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Returning 404 to user: Instance b9e5290d-89bb-444d-b356-c164fd3a2f3e could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d952e7ea-304d-4fbd-9b5b-c0cec47fb900 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e" status: 404 len: 111 microversion: 2.1 time: 0.035282 Oct 26 06:28:35.221771 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3979/7947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:35 2022] GET /compute/v2.1/servers/b9e5290d-89bb-444d-b356-c164fd3a2f3e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:28:35.379466 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4432bad6-b726-4f06-aa91-89417790be0f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '.version_select at 0x7f4709fa7ee0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:35.405735 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4432bad6-b726-4f06-aa91-89417790be0f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-41878735" status: 202 len: 0 microversion: 2.1 time: 0.030641 Oct 26 06:28:35.406567 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3969/7948] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 26 06:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-41878735 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:28:35.431047 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-84360c24-84ac-4dd2-bd87-e0111cdc359d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'create', calling method: .version_select at 0x7f47092e4820>, body: {"keypair": {"name": "tempest-TestShelveInstance-2061837311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFrlOFutELPegjnbIZHndTGrECgN4vOuLucLhhpd5wuGWZq36hG5Xa4kiHDE0aR+R/gqfElrAIdMuepK4EqwXbHGld2lKgOo93YXLP3RpO1YDso508P7p2B3OMr6L51Hw=="}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:28:35.447428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-84360c24-84ac-4dd2-bd87-e0111cdc359d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for project 2031db9648934f70aa2794b4c991a994. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:28:35.453458 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-84360c24-84ac-4dd2-bd87-e0111cdc359d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for user 468d6e2e4b854e469ecff4c2694e8dad and project 2031db9648934f70aa2794b4c991a994. Resources: {'key_pairs'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:28:35.480840 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-84360c24-84ac-4dd2-bd87-e0111cdc359d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053791 Oct 26 06:28:35.481481 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3980/7949] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:28:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:28:51.790413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=10 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:51.791235 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:51.796037 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1757257908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2061837311", "security_groups": [{"name": "tempest-secgroup-smoke-1859510158"}], "networks": [{"uuid": "ff2fc41a-a7c8-4966-95f1-1b75decbf39f"}], "block_device_mapping_v2": [{"uuid": "b62924cb-7535-49d9-b884-b4a4f63a0c42", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:28:51.910187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.network.neutron [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] validate_networks() for [('ff2fc41a-a7c8-4966-95f1-1b75decbf39f', None, None, None, None, None)] {{(pid=120586) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:28:52.329095 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Flavor limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:28:52.329563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Image limits 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:28:52.330048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Flavor pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:28:52.330469 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Image pref 0:0:0 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:28:52.330893 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.virt.hardware [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:28:52.340400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:52.340894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:52.341371 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:52.342111 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:52.342579 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:52.343014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:52.360006 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for project 2031db9648934f70aa2794b4c991a994. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:28:52.365615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Getting quotas for user 468d6e2e4b854e469ecff4c2694e8dad and project 2031db9648934f70aa2794b4c991a994. Resources: {'instances', 'cores', 'ram'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:28:52.423288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Going to run 1 instances... {{(pid=120586) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:28:52.425548 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b62924cb-7535-49d9-b884-b4a4f63a0c42',volume_size=None,volume_type=None)] {{(pid=120586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:28:52.556789 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9789838c-5be8-4ffc-a386-f3ba1fe42a60 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768120 Oct 26 06:28:52.557473 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3970/7950] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:28:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:28:52.566837 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:52.567662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:52.568304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:28:52.572891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-bea7ff90-e2c2-49a6-837f-866bac8c4015 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:52.572891 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-bea7ff90-e2c2-49a6-837f-866bac8c4015 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:52.632170 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-bea7ff90-e2c2-49a6-837f-866bac8c4015 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:52.639671 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-bea7ff90-e2c2-49a6-837f-866bac8c4015 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1089 microversion: 2.1 time: 0.074560 Oct 26 06:28:52.640228 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3981/7951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:52 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:53.664200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a13a9f46-a379-4f52-9a4b-8aa61ff74d11 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:53.664831 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a13a9f46-a379-4f52-9a4b-8aa61ff74d11 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:53.722917 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a13a9f46-a379-4f52-9a4b-8aa61ff74d11 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:53.729766 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a13a9f46-a379-4f52-9a4b-8aa61ff74d11 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1089 microversion: 2.1 time: 0.070421 Oct 26 06:28:53.730334 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3971/7952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:53 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:54.752428 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f1b5a23a-5ca2-4364-ad14-1216704209e7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:54.753058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f1b5a23a-5ca2-4364-ad14-1216704209e7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:55.103736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f1b5a23a-5ca2-4364-ad14-1216704209e7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:55.111447 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f1b5a23a-5ca2-4364-ad14-1216704209e7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1089 microversion: 2.1 time: 0.363025 Oct 26 06:28:55.112027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3982/7953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:54 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1089 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:56.134727 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:56.135363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:56.143631 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:56.144120 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:56.144562 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:56.145250 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:56.145734 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:56.146163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:56.209481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:56.218097 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e1c38edc-2dfc-40b0-893a-e0204824d8c1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1139 microversion: 2.1 time: 0.087316 Oct 26 06:28:56.218660 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3972/7954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:56 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:57.242154 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:57.242781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:57.251103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:57.251607 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:57.252064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:57.252773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:57.253247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:57.253712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:57.318501 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:57.327550 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c0c9f818-c341-419e-b8fe-3d41c94c1fb1 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1131 microversion: 2.1 time: 0.089263 Oct 26 06:28:57.328128 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3983/7955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:57 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1131 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:58.352387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:58.353075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:58.360327 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:58.360828 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:58.361270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:58.362004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:58.362467 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:58.362897 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:58.599036 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:58.613736 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8f92ac4-c36a-481d-afd3-1ecf7049907f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1273 microversion: 2.1 time: 0.265108 Oct 26 06:28:58.614356 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3973/7956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:58 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:28:59.396339 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-a12b13e6-31f2-484d-be1a-b6f10aff46b3 req-fa99f798-10f5-4246-ae73-1a3407544bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:28:59.407230 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a12b13e6-31f2-484d-be1a-b6f10aff46b3 req-fa99f798-10f5-4246-ae73-1a3407544bed service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:59.407733 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a12b13e6-31f2-484d-be1a-b6f10aff46b3 req-fa99f798-10f5-4246-ae73-1a3407544bed service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:59.408186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-a12b13e6-31f2-484d-be1a-b6f10aff46b3 req-fa99f798-10f5-4246-ae73-1a3407544bed service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:59.424926 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-a12b13e6-31f2-484d-be1a-b6f10aff46b3 req-fa99f798-10f5-4246-ae73-1a3407544bed service nova] Creating event network-changed:33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9 for instance 3463e127-390a-4699-afe0-a228ac50252d on n-h1-862416-4 Oct 26 06:28:59.430313 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-a12b13e6-31f2-484d-be1a-b6f10aff46b3 req-fa99f798-10f5-4246-ae73-1a3407544bed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100502 Oct 26 06:28:59.431192 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3984/7957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:28:59.638415 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:28:59.639039 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:28:59.646155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:59.646653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:59.647097 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:59.647857 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:28:59.648324 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:28:59.648757 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:28:59.857495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:28:59.865580 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6520f5ae-4741-40df-ad76-d33d92bdb428 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1273 microversion: 2.1 time: 0.231059 Oct 26 06:28:59.866168 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3974/7958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:28:59 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:00.891977 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:00.892793 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:00.899066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:00.899566 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:00.900016 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:00.900991 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:00.902002 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:00.902456 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:01.041508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:01.050775 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c400ecca-756e-4f3c-9db2-65cd86ad1e2a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1273 microversion: 2.1 time: 0.163766 Oct 26 06:29:01.051485 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3985/7959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:00 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:02.074699 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:02.075503 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:02.081902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:02.082388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:02.082826 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:02.083619 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:02.084031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:02.084433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:02.218155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:02.226152 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8fb3f3f6-3c1e-4863-bef2-9bb8caf38092 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1273 microversion: 2.1 time: 0.155452 Oct 26 06:29:02.226950 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3975/7960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:02 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:03.250247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:03.250661 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:03.257000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:03.257542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:03.257997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:03.258705 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:03.259182 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:03.259621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:03.394223 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:03.403014 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-67c02efc-943b-4080-8e22-76c1261ecb29 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.156264 Oct 26 06:29:03.403593 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3986/7961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:03 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:04.426187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:04.426854 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:04.428698 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:29:04.430330 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:29:04.436405 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:04.437020 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:04.437500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:04.438226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:04.438692 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:04.439124 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:04.583155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:04.594015 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b008a052-29ea-4595-94b6-466c346d0823 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.171675 Oct 26 06:29:04.594623 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3976/7962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:04 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:05.619209 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:05.619868 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:05.622997 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=4 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:29:05.628564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:05.629065 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:05.629558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:05.630266 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:05.630739 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:05.631183 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:05.765652 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:05.773446 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9fe44cd8-af2a-4de8-8c71-484038b9bb05 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.158286 Oct 26 06:29:05.774027 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3987/7963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:05 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:06.796841 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:06.797481 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:06.804213 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:06.804701 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:06.805135 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:06.805848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:06.806306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:06.806733 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:06.936964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:06.944669 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-65deaa55-9987-4c95-86f7-3a152128cd18 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.151932 Oct 26 06:29:06.945252 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3977/7964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:06 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:07.970074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:07.970684 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:07.977785 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:07.978290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:07.978758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:07.979475 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:07.980056 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:07.980507 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:08.114617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:08.123262 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-0edbbc22-6c17-4ad0-82d8-294f76ccd78b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.157114 Oct 26 06:29:08.123840 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3988/7965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:07 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:09.147130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:09.147745 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:09.155223 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:09.155712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:09.156151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:09.156844 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:09.157325 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:09.157758 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:09.289902 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:09.297765 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2f53eb0e-3974-4648-ab41-b42351c7e4d5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.154516 Oct 26 06:29:09.298373 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3978/7966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:09 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:10.321220 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:10.321898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:10.328744 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:10.329246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:10.329736 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:10.330443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:10.330921 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:10.331372 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:10.462875 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:10.471939 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-97d0b95a-b160-4c1f-aa5f-e343f318ccc0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.154747 Oct 26 06:29:10.472533 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3989/7967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:10 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:29:11.497116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:11.497756 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:11.504667 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:11.505088 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:11.505602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:11.506298 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:11.506755 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:11.507179 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:11.648014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:11.656584 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-91ef617f-a5ab-462d-9c14-a1659d0c8175 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.164494 Oct 26 06:29:11.657191 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3979/7968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:11 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:12.680594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:12.681228 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:12.688171 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:12.688672 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:12.689130 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:12.689866 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:12.690341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:12.690788 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:12.824068 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:12.831858 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-47b5c925-62cf-4b24-9647-d18acfd4da0b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.155184 Oct 26 06:29:12.832429 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3990/7969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:12 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:13.730990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e65cc701-6a57-45b8-9769-7c84c522ffcc req-417ef2f6-e17b-4b0c-8bfc-66c9f1e330c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "name": "network-vif-plugged", "status": "completed", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:29:13.740593 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e65cc701-6a57-45b8-9769-7c84c522ffcc req-417ef2f6-e17b-4b0c-8bfc-66c9f1e330c6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:13.741077 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e65cc701-6a57-45b8-9769-7c84c522ffcc req-417ef2f6-e17b-4b0c-8bfc-66c9f1e330c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:13.741542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e65cc701-6a57-45b8-9769-7c84c522ffcc req-417ef2f6-e17b-4b0c-8bfc-66c9f1e330c6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:13.752414 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e65cc701-6a57-45b8-9769-7c84c522ffcc req-417ef2f6-e17b-4b0c-8bfc-66c9f1e330c6 service nova] Creating event network-vif-plugged:33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9 for instance 3463e127-390a-4699-afe0-a228ac50252d on n-h1-862416-4 Oct 26 06:29:13.757407 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e65cc701-6a57-45b8-9769-7c84c522ffcc req-417ef2f6-e17b-4b0c-8bfc-66c9f1e330c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088002 Oct 26 06:29:13.758003 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3980/7970] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:29:13.856233 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:13.856886 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:13.864007 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:13.864506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:13.864955 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:13.865692 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:13.866158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:13.866595 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:14.016132 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:14.023871 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1ed26213-d5cc-469b-a0e2-4e68b25b0fb0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1261 microversion: 2.1 time: 0.171934 Oct 26 06:29:14.024451 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3991/7971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:13 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:15.049109 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:15.050130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:15.060186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:15.060681 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:15.061117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:15.062340 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:15.062805 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:15.063236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:15.198149 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:15.206929 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-78b8972f-c872-45df-a646-e9f2eb3227e6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1444 microversion: 2.1 time: 0.162075 Oct 26 06:29:15.207513 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3981/7972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:15 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:29:15.230505 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:29:15.231135 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:29:15.238013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:15.238527 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:15.238986 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:15.239698 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:15.240174 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:15.240621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:15.379218 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:29:15.387765 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2a3690d2-2991-444b-92c9-0516526a6486 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1444 microversion: 2.1 time: 0.161262 Oct 26 06:29:15.388340 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3992/7973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:29:15 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:29:17.339790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-56140947-c072-486c-bc9f-ba2acd0e625d req-d8734fac-efbc-4684-837c-5bdb2f5772ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:29:17.350300 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-56140947-c072-486c-bc9f-ba2acd0e625d req-d8734fac-efbc-4684-837c-5bdb2f5772ea service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:29:17.350784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-56140947-c072-486c-bc9f-ba2acd0e625d req-d8734fac-efbc-4684-837c-5bdb2f5772ea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:29:17.351217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-56140947-c072-486c-bc9f-ba2acd0e625d req-d8734fac-efbc-4684-837c-5bdb2f5772ea service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:29:17.362913 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-56140947-c072-486c-bc9f-ba2acd0e625d req-d8734fac-efbc-4684-837c-5bdb2f5772ea service nova] Creating event network-changed:33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9 for instance 3463e127-390a-4699-afe0-a228ac50252d on n-h1-862416-4 Oct 26 06:29:17.367938 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-56140947-c072-486c-bc9f-ba2acd0e625d req-d8734fac-efbc-4684-837c-5bdb2f5772ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032392 Oct 26 06:29:17.368536 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3982/7974] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:31:14.311509 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:31:14.312583 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=28 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:14.313365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=56 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:14.314575 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:31:14.314766 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d/action (ip 10.222.0.16) !!! Oct 26 06:31:14.319778 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:31:14.320329 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:14.328597 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:14.329100 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:14.329596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:14.330304 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:14.330773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:14.331214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:14.355276 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lazy-loading 'flavor' on Instance uuid 3463e127-390a-4699-afe0-a228ac50252d {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:31:14.425805 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9fdf6f0e-7845-42d3-aad8-6a497f52e375 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d/action" status: 202 len: 0 microversion: 2.1 time: 0.115920 Oct 26 06:31:14.426394 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3993/7975] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:31:14 2022] POST /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:31:14.432854 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:31:14.433817 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:31:14.434428 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:14.435183 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=60 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:14.436916 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:31:14.437329 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d (ip 10.222.0.16) !!! Oct 26 06:31:14.443642 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:14.444628 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:14.456303 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:14.456806 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:14.457247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:14.457988 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:14.458465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:14.458894 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:14.967248 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:14.977111 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-da898885-1359-49a5-b928-a83446f564fa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.546192 Oct 26 06:31:14.977772 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3983/7976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:14 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:16.004424 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:16.005064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:16.012271 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:16.012770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:16.013224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:16.013975 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:16.014443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:16.014883 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:16.021029 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57028. Oct 26 06:31:16.208645 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:16.217227 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80b6647d-4902-462b-bf67-93d3ff94ab85 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.218335 Oct 26 06:31:16.217833 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3994/7977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:15 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:17.241821 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:17.242439 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:17.251234 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:17.251725 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:17.252165 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:17.252866 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:17.253558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:17.255169 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:17.260540 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57036. Oct 26 06:31:17.280549 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57034. Oct 26 06:31:17.398968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:17.407555 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b7244f1d-9373-486a-8676-1af9fda0475f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.169738 Oct 26 06:31:17.408134 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3984/7978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:17 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:18.431148 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:18.431834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:18.439365 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:18.440472 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:18.440933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:18.441676 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:18.442152 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:18.442596 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:18.578759 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:18.586684 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fbf9f1ee-a07c-4811-8fdb-76591f26e3aa tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.159478 Oct 26 06:31:18.587259 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3995/7979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:18 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:19.611450 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:19.612031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:19.618774 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:19.619268 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:19.619714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:19.620980 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:19.621525 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:19.621961 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:19.756208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:19.764599 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b0c1845b-068f-4922-bd61-41fcf2d8fe0c tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.157450 Oct 26 06:31:19.765176 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3985/7980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:19 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:20.787892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:20.788437 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:20.796099 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:20.796593 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:20.797041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:20.797773 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:20.798239 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:20.798675 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:20.930205 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:20.938061 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-53d2565e-4518-43b4-a780-38f2822689c7 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.154145 Oct 26 06:31:20.938637 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3996/7981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:20 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:21.961870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:21.962575 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:21.969662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:21.970186 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:21.970636 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:21.971354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:21.971820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:21.972256 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:22.105669 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:22.113475 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8b47d88c-242a-4dc8-bc3e-94c963bc7f54 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.155568 Oct 26 06:31:22.114069 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3986/7982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:21 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:23.138679 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:23.139361 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:23.146109 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:23.146608 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:23.147097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:23.147799 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:23.148269 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:23.148711 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:23.547105 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:23.554868 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-efec2d55-a649-467a-9fd2-c662bf63d0d2 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.420207 Oct 26 06:31:23.555459 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3997/7983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:23 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:24.578965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:24.579584 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:24.586862 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:24.587368 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:24.587820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:24.588534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:24.589545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:24.589996 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:24.752189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:24.759998 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-033c8eb4-4a0c-4e21-8b4e-ba87f170a6bc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.184889 Oct 26 06:31:24.760583 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3987/7984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:24 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:25.783994 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:25.784561 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:25.791555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:25.792613 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:25.793089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:25.793829 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:25.794306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:25.794754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:25.927650 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:25.936030 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2b8d37e-3192-4f60-8a73-a5035783799e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.156069 Oct 26 06:31:25.936591 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3998/7985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:25 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:26.959613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:26.960229 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:26.968487 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:26.968977 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:26.969438 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:26.970141 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:26.970634 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:26.971047 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:27.109614 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:27.118020 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-edf008a2-aef8-4e28-9fe1-179135094d6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.162178 Oct 26 06:31:27.119001 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3988/7986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:26 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:28.142158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:28.142717 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:28.149484 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:28.149984 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:28.150435 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:28.151139 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:28.151756 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:28.152207 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:28.315386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:28.323575 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-664f076d-d869-49b2-ac87-e87e1c58db79 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.185442 Oct 26 06:31:28.324168 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 3999/7987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:28 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:29.349829 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:29.350501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:29.358492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:29.358982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:29.359564 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:29.360462 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:29.360925 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:29.361387 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:29.502363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:29.510141 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9d42bae8-7249-4119-a8f5-bd655bd6630e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1509 microversion: 2.1 time: 0.164505 Oct 26 06:31:29.511215 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3989/7988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:29 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:29.533582 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:31:29.534214 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:29.541360 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:29.542405 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:29.543022 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:29.543680 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:29.544163 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:29.544662 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:29.652366 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120585) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 06:31:29.718718 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-74a0bad9-116c-4599-b924-02f28a0261a0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "POST /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d/action" status: 202 len: 0 microversion: 2.1 time: 0.189039 Oct 26 06:31:29.722362 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4000/7989] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:31:29 2022] POST /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 06:31:29.728576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:29.728576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:29.735198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:29.735696 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:29.736413 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:29.737542 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:29.738040 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:29.738493 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:29.881113 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:29.889649 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-5705fd98-8157-4371-8e2c-64a5993d9bcc tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1517 microversion: 2.1 time: 0.165647 Oct 26 06:31:29.890228 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3990/7990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:29 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:30.914224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:30.914927 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:30.921834 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:30.922337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:30.922791 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:30.923508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:30.924012 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:30.924454 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:31.059222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:31.067303 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7c806413-6028-4a47-b67e-ef0b993a402a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1517 microversion: 2.1 time: 0.158022 Oct 26 06:31:31.067887 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4001/7991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:30 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:32.092790 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:32.093546 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:32.101079 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:32.101212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:32.101660 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:32.102364 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:32.102827 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:32.103281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:32.240797 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:32.249948 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b4bdda19-115d-4c9b-8ef1-7bd16695389e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1517 microversion: 2.1 time: 0.161732 Oct 26 06:31:32.250608 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3991/7992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:32 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:32.381491 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-088fa972-9ce1-4e96-9ecb-d8a060bd5efd req-926a1524-df25-453f-9f76-ebf248555302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "name": "network-vif-unplugged", "status": "completed", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:31:32.392873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-088fa972-9ce1-4e96-9ecb-d8a060bd5efd req-926a1524-df25-453f-9f76-ebf248555302 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:32.393483 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-088fa972-9ce1-4e96-9ecb-d8a060bd5efd req-926a1524-df25-453f-9f76-ebf248555302 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:32.393940 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-088fa972-9ce1-4e96-9ecb-d8a060bd5efd req-926a1524-df25-453f-9f76-ebf248555302 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:32.405857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.compute.server_external_events [req-088fa972-9ce1-4e96-9ecb-d8a060bd5efd req-926a1524-df25-453f-9f76-ebf248555302 service nova] Unable to find a host for instance 3463e127-390a-4699-afe0-a228ac50252d. Dropping event network-vif-unplugged {{(pid=120585) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 26 06:31:32.406763 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-088fa972-9ce1-4e96-9ecb-d8a060bd5efd req-926a1524-df25-453f-9f76-ebf248555302 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029242 Oct 26 06:31:32.407345 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4002/7993] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 26 06:31:33.274096 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:33.274819 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:33.282559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:33.283126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:33.283629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:33.284400 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:33.284924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:33.285444 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:33.422883 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:33.430796 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b5579693-1790-4c83-8254-9b54a7083815 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1517 microversion: 2.1 time: 0.160736 Oct 26 06:31:33.431377 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3992/7994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:33 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:34.455770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:34.456180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:34.462974 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:34.463479 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:34.465061 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:34.465810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:34.466282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:34.466728 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:34.603959 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:34.612984 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-10c8158b-0268-44a5-b0b9-061901efae6a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1519 microversion: 2.1 time: 0.161429 Oct 26 06:31:34.614432 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4003/7995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:34 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:35.638080 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:35.638678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:35.645630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:35.646147 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:35.646611 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:35.647309 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:35.647770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:35.648203 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:35.784110 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:35.792616 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0422aaec-220e-4ef3-8f30-3ed4901d022b tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1519 microversion: 2.1 time: 0.158306 Oct 26 06:31:35.793203 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3993/7996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:35 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:36.816145 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:36.816805 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:36.823632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:36.824267 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:36.824730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:36.825576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:36.826054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:36.826499 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:36.959528 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:36.968928 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-524d70f1-03c4-48df-8c76-215852f1c0e5 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1519 microversion: 2.1 time: 0.157039 Oct 26 06:31:36.969536 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4004/7997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:36 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:37.992107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:37.992702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:38.000288 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:38.000772 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:38.001205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:38.001918 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:38.002382 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:38.002808 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:38.136051 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:38.144653 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-699231d5-48c4-419e-b1e7-3de558d8b5b0 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1519 microversion: 2.1 time: 0.156434 Oct 26 06:31:38.145231 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3994/7998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:37 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:39.168288 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:39.169036 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:39.176685 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:39.176944 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:39.177306 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:39.178041 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:39.178745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:39.179097 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:39.322375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:39.331197 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-db3b2534-3077-4744-833d-59cdb1a77674 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1519 microversion: 2.1 time: 0.166858 Oct 26 06:31:39.331788 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4005/7999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:39 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:40.355723 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:40.356457 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:40.363321 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:40.363816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:40.364264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:40.364978 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:40.365464 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:40.365901 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:40.506360 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:40.514767 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-4aab7667-eb7e-4183-b790-c97716445362 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.163662 Oct 26 06:31:40.515363 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3995/8000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:40 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:41.538701 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:41.539391 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:41.546664 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:41.547186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:41.547647 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:41.548374 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:41.548853 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:41.549349 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:41.684478 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:41.692463 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b3110342-7199-46e3-82ca-e790017296b6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.157908 Oct 26 06:31:41.693036 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4006/8001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:41 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:31:42.716875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:42.717468 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:42.724390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:42.724877 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:42.725326 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:42.726023 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:42.726478 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:42.726910 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:42.863131 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:42.871487 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d12ca0cc-4098-4e0a-94b4-3b1f801b399e tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.158760 Oct 26 06:31:42.872069 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3996/8002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:42 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:43.895616 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:43.896246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:43.904305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:43.904810 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:43.905270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:43.906019 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:43.906493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:43.906941 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:43.910953 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:44.040572 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:44.048880 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e99162e3-b849-4691-8e9e-31c428e11677 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.157255 Oct 26 06:31:44.049488 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4007/8003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:43 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:45.073374 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:45.074010 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:45.076702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=29 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:45.082119 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:45.082603 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:45.083042 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:45.083730 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:45.084190 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:45.084615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:45.089164 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=85 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:45.220423 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:45.228482 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1b72162b-acf3-44c9-9711-c015f1d78a6f tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.159179 Oct 26 06:31:45.229095 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3997/8004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:45 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:46.252545 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:46.253172 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:46.255708 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:31:46.261064 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:46.262197 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:46.262656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:46.263371 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:46.263847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:46.264294 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:46.399249 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:46.407379 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-d2e6d781-e8e6-4ccd-b37f-f26fea39cda3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.158778 Oct 26 06:31:46.407971 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4008/8005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:46 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:47.431570 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:47.432184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:47.438939 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:47.439436 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:47.439880 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:47.440586 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:47.441049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:47.441507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:47.571388 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:47.579777 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c0485503-2fdd-4ee9-a807-ea7178a8801d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.152198 Oct 26 06:31:47.580275 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3998/8006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:47 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:48.603784 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:48.604337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:48.611421 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:48.611945 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:48.612397 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:48.613127 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:48.613627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:48.614094 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:48.751300 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:48.758990 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-931b5af6-c4e1-4b48-a6fc-f4a28f33b56d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.159276 Oct 26 06:31:48.759581 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4009/8007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:48 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:49.783665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:49.784263 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:49.791776 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:49.792273 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:49.792710 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:49.793658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:49.794130 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:49.794554 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:49.924547 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:49.932306 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-9b640376-5525-4c13-b576-c54649588a0d tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.152650 Oct 26 06:31:49.932881 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 3999/8008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:49 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:50.478973 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-ae7d49f5-5424-4844-beef-adcdc8909ff2 req-121908e7-0a03-4272-b5d3-05ffb3b1ee13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "name": "network-vif-plugged", "status": "completed", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:31:50.490795 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ae7d49f5-5424-4844-beef-adcdc8909ff2 req-121908e7-0a03-4272-b5d3-05ffb3b1ee13 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:50.491743 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ae7d49f5-5424-4844-beef-adcdc8909ff2 req-121908e7-0a03-4272-b5d3-05ffb3b1ee13 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:50.492270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-ae7d49f5-5424-4844-beef-adcdc8909ff2 req-121908e7-0a03-4272-b5d3-05ffb3b1ee13 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:50.504256 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-ae7d49f5-5424-4844-beef-adcdc8909ff2 req-121908e7-0a03-4272-b5d3-05ffb3b1ee13 service nova] Creating event network-vif-plugged:33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9 for instance 3463e127-390a-4699-afe0-a228ac50252d on n-h1-862416-4 Oct 26 06:31:50.509522 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-ae7d49f5-5424-4844-beef-adcdc8909ff2 req-121908e7-0a03-4272-b5d3-05ffb3b1ee13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035113 Oct 26 06:31:50.510380 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4010/8009] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:31:50.957558 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:50.958184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:50.966211 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:50.966802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:50.967257 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:50.967965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:50.968434 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:50.968870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:51.106226 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:51.113955 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-216371f5-9fc5-48c7-8ac4-353635c3c382 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1575 microversion: 2.1 time: 0.160364 Oct 26 06:31:51.114532 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4000/8010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:50 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:31:52.139049 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:31:52.139763 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:31:52.145957 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:52.146461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:52.146933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:52.147622 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:31:52.148093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:31:52.148537 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:31:52.280236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:31:52.288151 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c8de2aa3-d417-4a35-ad74-b3dbbaf4441a tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1562 microversion: 2.1 time: 0.154464 Oct 26 06:31:52.288736 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4011/8011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:31:52 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:06.697816 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:06.698398 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:06.700823 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=7 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:06.701471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=7 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:06.702151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=23 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:06.702529 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=24 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:06.703031 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:33:06.703204 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d (ip 10.222.0.16) !!! Oct 26 06:33:06.704148 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:33:06.704280 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d (ip 10.222.0.16) !!! Oct 26 06:33:06.712899 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:06.713513 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:06.714189 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:06.715198 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:06.716430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:06.717048 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:06.747884 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Going to try to terminate instance {{(pid=120586) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:33:06.774621 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-2985a974-0a34-4b8d-a79f-a9a739fe01bf req-4847e4a6-42c7-4d36-ab7b-67298a8181cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:06.784337 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2985a974-0a34-4b8d-a79f-a9a739fe01bf req-4847e4a6-42c7-4d36-ab7b-67298a8181cf service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:06.785089 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2985a974-0a34-4b8d-a79f-a9a739fe01bf req-4847e4a6-42c7-4d36-ab7b-67298a8181cf service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:06.785564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-2985a974-0a34-4b8d-a79f-a9a739fe01bf req-4847e4a6-42c7-4d36-ab7b-67298a8181cf service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:06.797979 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-2985a974-0a34-4b8d-a79f-a9a739fe01bf req-4847e4a6-42c7-4d36-ab7b-67298a8181cf service nova] Creating event network-changed:33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9 for instance 3463e127-390a-4699-afe0-a228ac50252d on n-h1-862416-4 Oct 26 06:33:06.803549 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-2985a974-0a34-4b8d-a79f-a9a739fe01bf req-4847e4a6-42c7-4d36-ab7b-67298a8181cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108980 Oct 26 06:33:06.804507 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4012/8012] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:33:06.840277 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-967cdbd0-61cc-4e9e-a1d3-4420cf0c1365 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 204 len: 0 microversion: 2.1 time: 0.147625 Oct 26 06:33:06.841203 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4001/8013] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:33:06 2022] DELETE /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:33:06.855310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:06.856038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:06.863093 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:06.863577 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:06.864260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:06.864996 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:06.865668 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:06.866382 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:07.007176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:07.015679 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-e8cf0233-a747-40de-ba69-dfae15337c82 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.170129 Oct 26 06:33:07.016267 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4013/8014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:06 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:08.041281 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:08.042717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:08.049653 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:08.050152 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:08.050602 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:08.051305 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:08.051770 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:08.052207 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:08.248258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:08.256202 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6cac41a8-425c-48e3-bf59-8fa3ad120691 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1568 microversion: 2.1 time: 0.219851 Oct 26 06:33:08.257014 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4002/8015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:08 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:09.028173 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-4a7d7642-d5f4-4c84-b161-786d3684952a req-ae5b63c3-a32f-448e-b854-269cbbb658eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3463e127-390a-4699-afe0-a228ac50252d", "name": "network-vif-deleted", "tag": "33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:09.041413 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4a7d7642-d5f4-4c84-b161-786d3684952a req-ae5b63c3-a32f-448e-b854-269cbbb658eb service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:09.041862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4a7d7642-d5f4-4c84-b161-786d3684952a req-ae5b63c3-a32f-448e-b854-269cbbb658eb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:09.042320 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-4a7d7642-d5f4-4c84-b161-786d3684952a req-ae5b63c3-a32f-448e-b854-269cbbb658eb service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:09.054401 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-4a7d7642-d5f4-4c84-b161-786d3684952a req-ae5b63c3-a32f-448e-b854-269cbbb658eb service nova] Creating event network-vif-deleted:33dfe456-aa97-4ddc-b5a0-e5d076dcd6c9 for instance 3463e127-390a-4699-afe0-a228ac50252d on n-h1-862416-4 Oct 26 06:33:09.061063 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-4a7d7642-d5f4-4c84-b161-786d3684952a req-ae5b63c3-a32f-448e-b854-269cbbb658eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036777 Oct 26 06:33:09.061695 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4014/8016] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:33:09.280145 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:09.280717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:09.287796 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:09.288289 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:09.288748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:09.289501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:09.290861 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:09.291840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:09.358236 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:09.366574 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23b6b2f1-83d2-4201-a520-e39ce8999550 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1220 microversion: 2.1 time: 0.090405 Oct 26 06:33:09.367179 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4003/8017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:09 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:10.392111 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:10.392833 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:10.400576 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:10.401085 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:10.401569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:10.402287 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:10.402821 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:10.403273 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:10.471305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:10.480275 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ea79c59c-2cdd-4fd4-8e1c-b4549dab1451 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1220 microversion: 2.1 time: 0.092407 Oct 26 06:33:10.480860 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4015/8018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:10 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:11.503443 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:11.504067 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:11.511970 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:11.512461 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:11.512903 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:11.513630 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:11.514094 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:11.514534 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:11.577913 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:11.585853 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-96f873b6-24f9-4d99-9193-e722c8988b28 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1220 microversion: 2.1 time: 0.086283 Oct 26 06:33:11.586439 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4004/8019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:11 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:12.609751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:12.610588 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:12.617449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:12.618513 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:12.619017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:12.619738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:12.620254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:12.620703 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:12.686081 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468d6e2e4b854e469ecff4c2694e8dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031db9648934f70aa2794b4c991a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:12.694358 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-939e11f2-f040-4080-80be-f2ff9dc86bd6 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 200 len: 1220 microversion: 2.1 time: 0.088634 Oct 26 06:33:12.695290 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4016/8020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:12 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:13.720215 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:13.720825 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] [instance: 3463e127-390a-4699-afe0-a228ac50252d] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:13.728559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:13.729742 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:13.730201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:13.730967 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:13.731451 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:13.731927 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:13.747146 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] HTTP exception thrown: Instance 3463e127-390a-4699-afe0-a228ac50252d could not be found. Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Request method failure captured: Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d HTTP/1.1 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWNJtOXNuYpH30KXlp_m00dyw1ITbX0_zuEiZoQdopuCfp6aa3KFxfw3nuzgRbiJrJGFQ7pNsGDOmZVF89neA453txndJIkc2xdnJEUyHoL4AFvd6kIZ0GjP5osyVajySSqUxuTI3KawZzfTXS4Yg295bLeSFjSPq_FOAeMEpwa9xBqM Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 2031db9648934f70aa2794b4c991a994 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestShelveInstance-26370697 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2031db9648934f70aa2794b4c991a994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2031db9648934f70aa2794b4c991a994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2031db9648934f70aa2794b4c991a994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2031db9648934f70aa2794b4c991a994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestShelveInstance-26370697 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 2031db9648934f70aa2794b4c991a994 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestShelveInstance-26370697 Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestShelveInstance-26370697-project Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 468d6e2e4b854e469ecff4c2694e8dad Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestShelveInstance-26370697-project Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 3463e127-390a-4699-afe0-a228ac50252d could not be found. Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '3463e127-390a-4699-afe0-a228ac50252d'} Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3463e127-390a-4699-afe0-a228ac50252d could not be found. Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3463e127-390a-4699-afe0-a228ac50252d could not be found. Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:33:13.748842 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3463e127-390a-4699-afe0-a228ac50252d could not be found. Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Returning 404 to user: Instance 3463e127-390a-4699-afe0-a228ac50252d could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-d500b051-3f03-4c89-892a-a94db19e1908 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d" status: 404 len: 111 microversion: 2.1 time: 0.034144 Oct 26 06:33:13.755545 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4005/8021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:13 2022] GET /compute/v2.1/servers/3463e127-390a-4699-afe0-a228ac50252d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:33:13.916180 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f99e2118-98fd-4dd0-b996-70e8b2b23eb3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] Calling method '.version_select at 0x7f47091bd3a0>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:13.946123 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f99e2118-98fd-4dd0-b996-70e8b2b23eb3 tempest-TestShelveInstance-26370697 tempest-TestShelveInstance-26370697-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2061837311" status: 202 len: 0 microversion: 2.1 time: 0.034343 Oct 26 06:33:13.947255 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4017/8022] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 26 06:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2061837311 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 06:33:31.951013 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:31.951762 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:32.166792 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-43498a98-bf7e-4875-ba10-7966f7bf66a5 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Action: 'create', calling method: .version_select at 0x7f47095c0f70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1996302735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMhpFvO9QTGHSpDaPZ6kq/ZSG/lcnk4ZFdRP21cR/d/TaSxceC622pfchkTIf6+CqhRGKvpp+e1KksTjd29itGbovHYN2qwZ+NFpHXHy8eHTMkhET/nsxiV7QZCp3ug7g=="}} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:32.184501 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-43498a98-bf7e-4875-ba10-7966f7bf66a5 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Getting quotas for project 6d85e16674f042cd9a2884d6854ba829. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:33:32.192075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.quota [None req-43498a98-bf7e-4875-ba10-7966f7bf66a5 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Getting quotas for user 3133eff47a9d4b9bbfe5c085a622136a and project 6d85e16674f042cd9a2884d6854ba829. Resources: {'key_pairs'} {{(pid=120586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:33:32.226808 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-43498a98-bf7e-4875-ba10-7966f7bf66a5 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.281502 Oct 26 06:33:32.228779 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4006/8023] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 26 06:33:31 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:33:33.225277 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1059570135", "imageRef": "d596d51f-4bb2-4340-8449-72226e2537e8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1996302735", "security_groups": [{"name": "tempest-secgroup-smoke-1180215628"}], "networks": [{"uuid": "2e4fce4e-9d65-43ed-981d-1a203b6207f3"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:33.236843 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=22 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:33.237558 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:33.342465 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] validate_networks() for [('2e4fce4e-9d65-43ed-981d-1a203b6207f3', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:33:33.761441 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:33:33.761898 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:33:33.762394 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:33:33.762825 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:33:33.763411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:33:33.774557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:33.775066 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:33.775564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:33.777237 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:33.777754 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:33.778208 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:33.796555 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Getting quotas for project 6d85e16674f042cd9a2884d6854ba829. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:33:33.801892 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Getting quotas for user 3133eff47a9d4b9bbfe5c085a622136a and project 6d85e16674f042cd9a2884d6854ba829. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:33:33.815028 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:33:33.817398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d596d51f-4bb2-4340-8449-72226e2537e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:33:33.865251 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [6ee93c99-bf6c-410e-baa2-793550982598] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 06:33:34.873679 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [6ee93c99-bf6c-410e-baa2-793550982598] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57322. Oct 26 06:33:34.878028 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-83e161fe-2dce-4492-82e8-83afbc6e4e83 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.657527 Oct 26 06:33:34.878922 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4018/8024] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:33:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:33:34.891863 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-33b23c1d-6a35-417c-b22d-6e6cba62228d tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:34.893208 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-33b23c1d-6a35-417c-b22d-6e6cba62228d tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:34.950924 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-33b23c1d-6a35-417c-b22d-6e6cba62228d tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:34.961883 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-33b23c1d-6a35-417c-b22d-6e6cba62228d tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1249 microversion: 2.1 time: 0.074916 Oct 26 06:33:34.962515 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4007/8025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:34 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:33:35.986632 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-7eaeda25-a1dd-4eaf-8d9a-6c95187d3569 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:35.987354 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-7eaeda25-a1dd-4eaf-8d9a-6c95187d3569 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:36.046260 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-7eaeda25-a1dd-4eaf-8d9a-6c95187d3569 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:36.053242 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-7eaeda25-a1dd-4eaf-8d9a-6c95187d3569 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1249 microversion: 2.1 time: 0.071427 Oct 26 06:33:36.053853 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4019/8026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:35 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:37.077270 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3cfb073f-30ca-4382-9b2e-4c413d38875e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:37.078381 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3cfb073f-30ca-4382-9b2e-4c413d38875e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:37.133933 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3cfb073f-30ca-4382-9b2e-4c413d38875e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:37.141447 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3cfb073f-30ca-4382-9b2e-4c413d38875e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1249 microversion: 2.1 time: 0.067966 Oct 26 06:33:37.154752 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4008/8027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:37 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:38.166204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-9eb1c90f-7bfc-4c62-bddc-9adf5820ecb7 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:38.167570 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-9eb1c90f-7bfc-4c62-bddc-9adf5820ecb7 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:38.222812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-9eb1c90f-7bfc-4c62-bddc-9adf5820ecb7 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:38.231333 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-9eb1c90f-7bfc-4c62-bddc-9adf5820ecb7 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1249 microversion: 2.1 time: 0.069210 Oct 26 06:33:38.231885 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4020/8028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:38 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:39.253748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:39.254373 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:39.262033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:39.262521 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:39.262964 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:39.263668 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:39.264128 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:39.264563 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:39.325662 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:39.333406 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b9bf2ca4-fcd3-4d4a-a339-887b61490464 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1253 microversion: 2.1 time: 0.083677 Oct 26 06:33:39.333978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4009/8029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:39 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:40.357328 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:40.358013 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:40.365408 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:40.365914 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:40.366370 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:40.367082 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:40.367554 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:40.367999 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:40.437855 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:40.445274 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3dfac92b-4142-4392-96bb-6aa81e417abf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1307 microversion: 2.1 time: 0.091793 Oct 26 06:33:40.446032 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4021/8030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:40 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:33:41.442201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-aa80ded3-0143-4118-bbf1-0affc4b6eb31 req-aaf80573-21c5-4411-b65f-dfd5c47023f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:41.453170 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aa80ded3-0143-4118-bbf1-0affc4b6eb31 req-aaf80573-21c5-4411-b65f-dfd5c47023f4 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:41.453952 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aa80ded3-0143-4118-bbf1-0affc4b6eb31 req-aaf80573-21c5-4411-b65f-dfd5c47023f4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:41.455306 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-aa80ded3-0143-4118-bbf1-0affc4b6eb31 req-aaf80573-21c5-4411-b65f-dfd5c47023f4 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:41.471462 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-aa80ded3-0143-4118-bbf1-0affc4b6eb31 req-aaf80573-21c5-4411-b65f-dfd5c47023f4 service nova] Creating event network-changed:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:33:41.471682 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:41.472292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:41.484904 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-aa80ded3-0143-4118-bbf1-0affc4b6eb31 req-aaf80573-21c5-4411-b65f-dfd5c47023f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046090 Oct 26 06:33:41.485976 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:41.486562 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:41.486978 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4010/8031] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:33:41.487487 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:41.488225 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:41.488816 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:41.489136 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:41.637168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:41.650309 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-fa2580c7-9dd9-4073-9cd8-a1b9c7310af6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1375 microversion: 2.1 time: 0.184654 Oct 26 06:33:41.652253 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4022/8032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:41 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:42.678059 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:42.678787 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:42.685144 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:42.685665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:42.686101 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:42.687209 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:42.687671 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:42.688098 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:42.827117 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:42.834831 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-b94cab65-6a72-42ac-8297-51a5402e90fb tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1375 microversion: 2.1 time: 0.162052 Oct 26 06:33:42.835419 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4011/8033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:42 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:43.859663 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:43.860305 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:43.863084 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:43.868482 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:43.868979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:43.870738 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:43.871455 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:43.871929 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:43.872375 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:44.004104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:44.011975 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-a2ab16e2-f79a-4c5e-bf8b-dea4bbb8e920 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1375 microversion: 2.1 time: 0.157308 Oct 26 06:33:44.012563 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4023/8034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:43 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:45.035004 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:45.035714 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:45.043163 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:45.043658 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:45.044099 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:45.044801 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:45.045260 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:45.045738 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:45.181247 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:45.190076 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e9f5fc80-cdb3-4987-9901-c9d13c9c5dd6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1375 microversion: 2.1 time: 0.159066 Oct 26 06:33:45.190654 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4012/8035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:45 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:46.212840 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:46.214202 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:46.220889 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:46.221415 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:46.221874 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:46.222587 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:46.223058 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:46.223745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:46.364581 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:46.372826 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-eae3f245-1618-4f81-8d26-4e86e069e762 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1375 microversion: 2.1 time: 0.163988 Oct 26 06:33:46.373440 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4024/8036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:46 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:47.057851 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-5f28db31-4c5f-473f-b073-897bc35c1a16 req-a47a1efe-a257-47f9-b80e-1b09bb7ba5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "name": "network-vif-plugged", "status": "completed", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:47.068352 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5f28db31-4c5f-473f-b073-897bc35c1a16 req-a47a1efe-a257-47f9-b80e-1b09bb7ba5d6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:47.068848 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5f28db31-4c5f-473f-b073-897bc35c1a16 req-a47a1efe-a257-47f9-b80e-1b09bb7ba5d6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:47.069287 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-5f28db31-4c5f-473f-b073-897bc35c1a16 req-a47a1efe-a257-47f9-b80e-1b09bb7ba5d6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:47.080739 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-5f28db31-4c5f-473f-b073-897bc35c1a16 req-a47a1efe-a257-47f9-b80e-1b09bb7ba5d6 service nova] Creating event network-vif-plugged:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:33:47.085732 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-5f28db31-4c5f-473f-b073-897bc35c1a16 req-a47a1efe-a257-47f9-b80e-1b09bb7ba5d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Oct 26 06:33:47.086340 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4013/8037] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:33:47.396395 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:47.397017 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:47.404024 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:47.404525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:47.404979 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:47.405713 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:47.406186 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:47.406627 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:47.537808 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:47.546173 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-5232c9cf-a1b5-40e0-aa9e-d009382da851 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1375 microversion: 2.1 time: 0.153712 Oct 26 06:33:47.546746 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4025/8038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:47 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:48.566393 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=8 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:48.571717 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:48.572424 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:48.579126 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:48.579616 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:48.580056 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:48.580750 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:48.581218 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:48.581678 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:48.718442 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:48.726388 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e8af329c-b7e1-4289-8abb-fa253f939850 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1560 microversion: 2.1 time: 0.160977 Oct 26 06:33:48.726959 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4014/8039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:48 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:48.749461 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:33:48.750098 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:33:48.751963 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=10 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:33:48.758222 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:48.758730 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:48.759195 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:48.759913 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:48.760410 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:48.760895 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:48.891818 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:33:48.899724 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-3a5c4ba3-46da-4a97-9110-3d283fd1208c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1560 microversion: 2.1 time: 0.154252 Oct 26 06:33:48.900304 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4026/8040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:33:48 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:33:50.575155 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-14e04367-75f9-44a6-9c18-5257615910c8 req-bb38a31a-2202-416f-8353-107a0edeea54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:33:50.586777 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-14e04367-75f9-44a6-9c18-5257615910c8 req-bb38a31a-2202-416f-8353-107a0edeea54 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:33:50.587576 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-14e04367-75f9-44a6-9c18-5257615910c8 req-bb38a31a-2202-416f-8353-107a0edeea54 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:33:50.588011 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-14e04367-75f9-44a6-9c18-5257615910c8 req-bb38a31a-2202-416f-8353-107a0edeea54 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:33:50.599724 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-14e04367-75f9-44a6-9c18-5257615910c8 req-bb38a31a-2202-416f-8353-107a0edeea54 service nova] Creating event network-changed:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:33:50.605707 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-14e04367-75f9-44a6-9c18-5257615910c8 req-bb38a31a-2202-416f-8353-107a0edeea54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034645 Oct 26 06:33:50.606436 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4015/8041] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:35:48.029157 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7813b65-3d9c-45f7-af47-65a9f25bbe02] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:35:48.033653 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1754837498"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:35:48.036112 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:35:48.038539 n-d-862416-4 devstack@n-api.service[120585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:35:48.039054 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:35:48.039783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=38 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:35:48.040721 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:35:48.040873 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec/action (ip 10.222.0.16) !!! Oct 26 06:35:48.042547 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 26 06:35:48.042674 n-d-862416-4 devstack@n-api.service[120585]: Wed Oct 26 06:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec/action (ip 10.222.0.16) !!! Oct 26 06:35:48.052252 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:35:48.053299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:35:48.053792 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:35:48.054520 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:35:48.055000 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:35:48.055446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:35:48.254931 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-1b83e4cf-5f69-4134-afcd-236116533f85 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "POST /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.227331 Oct 26 06:35:48.255778 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4027/8042] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:35:48 2022] POST /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 06:35:53.865416 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:35:53.866796 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 26 06:35:53.871604 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:35:53.874620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=30 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:35:53.956254 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-10dd8f01-a01c-4916-bdaf-d987ac63fb20 req-91baffe4-ce25-4ae3-b075-848cd95a6f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "name": "network-vif-plugged", "status": "completed", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:35:53.968033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10dd8f01-a01c-4916-bdaf-d987ac63fb20 req-91baffe4-ce25-4ae3-b075-848cd95a6f82 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:35:53.968545 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10dd8f01-a01c-4916-bdaf-d987ac63fb20 req-91baffe4-ce25-4ae3-b075-848cd95a6f82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:35:53.968982 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-10dd8f01-a01c-4916-bdaf-d987ac63fb20 req-91baffe4-ce25-4ae3-b075-848cd95a6f82 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:35:53.982269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-10dd8f01-a01c-4916-bdaf-d987ac63fb20 req-91baffe4-ce25-4ae3-b075-848cd95a6f82 service nova] Creating event network-vif-plugged:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:35:53.988571 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-10dd8f01-a01c-4916-bdaf-d987ac63fb20 req-91baffe4-ce25-4ae3-b075-848cd95a6f82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124610 Oct 26 06:35:53.989191 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4016/8043] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:36:01.821042 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:01.822030 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:01.826309 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2115185791", "imageRef": "14f3e98b-defd-4e64-ba64-65a9339ab769", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1996302735", "security_groups": [{"name": "tempest-secgroup-smoke-1180215628"}], "networks": [{"uuid": "2e4fce4e-9d65-43ed-981d-1a203b6207f3"}]}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:36:01.853545 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [4bcf7169-8654-48fc-8d47-650cdb8af091] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57552. Oct 26 06:36:01.856168 n-d-862416-4 devstack@n-api.service[120585]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7813b65-3d9c-45f7-af47-65a9f25bbe02] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57550. Oct 26 06:36:01.943471 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.network.neutron [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] validate_networks() for [('2e4fce4e-9d65-43ed-981d-1a203b6207f3', None, None, None, None, None)] {{(pid=120585) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 06:36:02.318972 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Flavor limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 06:36:02.319417 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Image limits 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 06:36:02.319924 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Flavor pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 06:36:02.320343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Image pref 0:0:0 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 06:36:02.320777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.virt.hardware [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 06:36:02.329942 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:02.330446 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:02.330903 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:02.331656 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:02.332129 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:02.332579 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:02.351302 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Getting quotas for project 6d85e16674f042cd9a2884d6854ba829. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 06:36:02.356525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.quota [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Getting quotas for user 3133eff47a9d4b9bbfe5c085a622136a and project 6d85e16674f042cd9a2884d6854ba829. Resources: {'instances', 'cores', 'ram'} {{(pid=120585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 06:36:02.369525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Going to run 1 instances... {{(pid=120585) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 06:36:02.372035 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='14f3e98b-defd-4e64-ba64-65a9339ab769',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 06:36:02.419082 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-80deb13e-77f0-4fca-8b87-ae73cc419356 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.600116 Oct 26 06:36:02.421340 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4028/8044] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 26 06:36:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 06:36:02.436137 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c361c191-2839-49ad-b27b-3b10622f6ee4 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:02.437014 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c361c191-2839-49ad-b27b-3b10622f6ee4 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:02.448814 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57568. Oct 26 06:36:02.450704 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57566. Oct 26 06:36:02.497712 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c361c191-2839-49ad-b27b-3b10622f6ee4 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:02.505213 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c361c191-2839-49ad-b27b-3b10622f6ee4 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1249 microversion: 2.1 time: 0.077040 Oct 26 06:36:02.505817 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4017/8045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:02 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:03.528910 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-95c20c55-4470-413e-84cd-8fc7a9ae79fe tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:03.529862 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-95c20c55-4470-413e-84cd-8fc7a9ae79fe tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:03.586905 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-95c20c55-4470-413e-84cd-8fc7a9ae79fe tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:03.593956 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-95c20c55-4470-413e-84cd-8fc7a9ae79fe tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1249 microversion: 2.1 time: 0.069784 Oct 26 06:36:03.594521 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4029/8046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:03 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:04.617781 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-c00fec25-dff6-4cbf-8ada-815e88f73d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:04.618437 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-c00fec25-dff6-4cbf-8ada-815e88f73d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:04.621453 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:04.678217 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-c00fec25-dff6-4cbf-8ada-815e88f73d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:04.686545 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-c00fec25-dff6-4cbf-8ada-815e88f73d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1249 microversion: 2.1 time: 0.072780 Oct 26 06:36:04.687115 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4018/8047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:04 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:05.699258 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3f0a728c-d3f5-4d74-b860-6df247e6c678 req-51becfe0-8d82-46b0-9a61-6382cbee9885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "name": "network-vif-unplugged", "status": "completed", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:36:05.711620 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e06870f6-6b11-422b-9bcc-95e017726930 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:05.712246 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e06870f6-6b11-422b-9bcc-95e017726930 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:05.719290 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3f0a728c-d3f5-4d74-b860-6df247e6c678 req-51becfe0-8d82-46b0-9a61-6382cbee9885 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:05.722203 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3f0a728c-d3f5-4d74-b860-6df247e6c678 req-51becfe0-8d82-46b0-9a61-6382cbee9885 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:05.722343 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3f0a728c-d3f5-4d74-b860-6df247e6c678 req-51becfe0-8d82-46b0-9a61-6382cbee9885 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:05.735576 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3f0a728c-d3f5-4d74-b860-6df247e6c678 req-51becfe0-8d82-46b0-9a61-6382cbee9885 service nova] Creating event network-vif-unplugged:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:36:05.741043 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3f0a728c-d3f5-4d74-b860-6df247e6c678 req-51becfe0-8d82-46b0-9a61-6382cbee9885 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045827 Oct 26 06:36:05.742071 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4030/8048] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:36:05.796665 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e06870f6-6b11-422b-9bcc-95e017726930 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:05.804750 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e06870f6-6b11-422b-9bcc-95e017726930 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1249 microversion: 2.1 time: 0.097389 Oct 26 06:36:05.805571 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4019/8049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:05 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:06.830087 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:06.830503 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:06.836782 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:06.837282 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:06.837765 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:06.838498 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:06.838964 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:06.839402 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:06.906962 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:06.914667 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-50a558b4-0f4b-44f1-9334-dd0760890de0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1253 microversion: 2.1 time: 0.090251 Oct 26 06:36:06.915515 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4031/8050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:06 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:07.939351 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:07.939983 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:07.947380 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:07.948151 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:07.948784 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:07.949715 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:07.950347 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:07.951008 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:08.059342 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:08.067676 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-23a52d3f-08ec-4705-aa36-aabe46390b5b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1307 microversion: 2.1 time: 0.132767 Oct 26 06:36:08.072491 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4020/8051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:07 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:09.096386 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:09.097871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:09.105780 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:09.106615 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:09.107278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:09.108075 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:09.108777 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:09.109229 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:09.546301 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:09.555061 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-85ad6f40-fda2-4440-80f0-3ddc6c472bfc tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.462728 Oct 26 06:36:09.555651 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4032/8052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:09 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:10.580963 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:10.582495 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:10.589522 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:10.589989 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:10.590529 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:10.591264 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:10.591976 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:10.592629 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:10.734646 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:10.742662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-2b483576-2745-485b-85bb-d052f7068148 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.167157 Oct 26 06:36:10.743404 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4021/8053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:10 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:11.768649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:11.769211 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:11.776176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:11.776971 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:11.777493 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:11.778219 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:11.778690 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:11.780512 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:11.930609 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:11.938911 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-58504e74-a239-4037-b4f0-f5399cd3220f tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.175647 Oct 26 06:36:11.939506 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4033/8054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:11 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:12.963798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:12.964433 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:12.972840 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:12.973519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:12.973968 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:12.975216 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:12.975680 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:12.976121 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:13.118638 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:13.127404 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-1aced8bb-8903-4d47-b038-be5fa4b25822 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.167430 Oct 26 06:36:13.128003 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4022/8055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:12 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:14.151856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:14.152569 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:14.154648 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:14.156247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell0:SELECT=8 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:14.163897 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:14.164691 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:14.165508 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:14.166449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:14.167103 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:14.168443 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:14.317789 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:14.326362 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f8b3d259-ec0c-4ba4-988a-8536c1b38d47 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.178359 Oct 26 06:36:14.326963 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4034/8056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:14 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:15.350740 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:15.351345 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:15.359087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:15.359587 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:15.360033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:15.360748 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:15.361212 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:15.361732 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:15.592937 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:15.601289 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-3f6e31f7-e01b-4dd9-85cc-42c736996eb0 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.254611 Oct 26 06:36:15.601907 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4023/8057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:15 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:16.625781 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:16.626411 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:16.633177 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:16.633712 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:16.634168 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:16.634871 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:16.635341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:16.635783 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:16.822204 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:16.830481 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49b63dce-a288-4a3c-b64e-02e4fcd694f8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.209268 Oct 26 06:36:16.831062 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4035/8058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:16 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:17.852704 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:17.853397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:17.855200 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell0:SELECT=6 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:17.862031 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:17.862519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:17.862958 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:17.863648 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:17.864107 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:17.864533 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:17.996559 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:18.004839 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6d25b946-eb86-4c57-b560-2ed0ba2721bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.156280 Oct 26 06:36:18.005451 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4024/8059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:17 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:18.806480 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-7b9adb8a-8cf0-4aab-896b-eeccca99340b req-d4f30b44-c713-484d-a145-0c1f6cb9180e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ae699c-7876-435f-a285-7dcad89bfe99", "tag": "f9a00f05-67d0-4c9b-96d9-a284a820e9fd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:36:18.819270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7b9adb8a-8cf0-4aab-896b-eeccca99340b req-d4f30b44-c713-484d-a145-0c1f6cb9180e service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:18.827473 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7b9adb8a-8cf0-4aab-896b-eeccca99340b req-d4f30b44-c713-484d-a145-0c1f6cb9180e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:18.828055 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-7b9adb8a-8cf0-4aab-896b-eeccca99340b req-d4f30b44-c713-484d-a145-0c1f6cb9180e service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:18.839942 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-7b9adb8a-8cf0-4aab-896b-eeccca99340b req-d4f30b44-c713-484d-a145-0c1f6cb9180e service nova] Creating event network-changed:f9a00f05-67d0-4c9b-96d9-a284a820e9fd for instance 29ae699c-7876-435f-a285-7dcad89bfe99 on n-h2-862416-4 Oct 26 06:36:18.844986 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-7b9adb8a-8cf0-4aab-896b-eeccca99340b req-d4f30b44-c713-484d-a145-0c1f6cb9180e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042450 Oct 26 06:36:18.845858 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4036/8060] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:36:19.031452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:19.032122 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:19.038870 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:19.039357 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:19.039798 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:19.040488 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:19.040946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:19.041399 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:19.176404 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:19.184269 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-34c202c9-fd38-43c0-b7dc-c4e591f6cd64 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.157736 Oct 26 06:36:19.184854 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4025/8061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:19 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:20.209605 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:20.210341 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:20.216644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:20.217158 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:20.217649 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:20.218368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:20.218847 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:20.219299 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:20.354909 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:20.363041 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-473ee726-3205-4df1-ac5e-2fbf430759bf tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.158685 Oct 26 06:36:20.363630 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4037/8062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:20 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:36:21.386890 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:21.387615 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:21.394541 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:21.395035 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:21.395479 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:21.396184 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:21.396647 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:21.397081 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:21.539049 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:21.547496 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-79417ef8-0f38-41c3-9114-7844db1ef936 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.164573 Oct 26 06:36:21.548107 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4026/8063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:21 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:22.572009 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:22.572644 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:22.579563 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:22.580074 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:22.580533 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:22.581246 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:22.581751 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:22.582198 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:22.720362 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:22.728480 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-44c478fa-1167-468d-b737-a9304cd8426b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.160546 Oct 26 06:36:22.729079 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4038/8064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:22 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:23.752934 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:23.753697 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:23.760817 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:23.761333 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:23.761820 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:23.762527 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:23.763052 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:23.763491 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:23.869506 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-31256e67-a3d9-4fd9-9ec2-7f1b40ad4b67 req-cbacc985-8fcf-47b7-9bdd-438295f21cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ae699c-7876-435f-a285-7dcad89bfe99", "name": "network-vif-plugged", "status": "completed", "tag": "f9a00f05-67d0-4c9b-96d9-a284a820e9fd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:36:23.881262 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-31256e67-a3d9-4fd9-9ec2-7f1b40ad4b67 req-cbacc985-8fcf-47b7-9bdd-438295f21cee service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:23.881801 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-31256e67-a3d9-4fd9-9ec2-7f1b40ad4b67 req-cbacc985-8fcf-47b7-9bdd-438295f21cee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:23.882247 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-31256e67-a3d9-4fd9-9ec2-7f1b40ad4b67 req-cbacc985-8fcf-47b7-9bdd-438295f21cee service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:23.894687 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-31256e67-a3d9-4fd9-9ec2-7f1b40ad4b67 req-cbacc985-8fcf-47b7-9bdd-438295f21cee service nova] Creating event network-vif-plugged:f9a00f05-67d0-4c9b-96d9-a284a820e9fd for instance 29ae699c-7876-435f-a285-7dcad89bfe99 on n-h2-862416-4 Oct 26 06:36:23.900347 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-31256e67-a3d9-4fd9-9ec2-7f1b40ad4b67 req-cbacc985-8fcf-47b7-9bdd-438295f21cee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035102 Oct 26 06:36:23.901019 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4039/8065] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:36:23.901974 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:23.910993 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-0bdeee77-cc84-4253-aeba-ce78e1abbaa3 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.162098 Oct 26 06:36:23.911594 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4027/8066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:23 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:24.939199 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:24.939950 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:24.946236 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:24.946956 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:24.947617 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:24.948379 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:24.948911 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:24.949384 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:25.091856 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:25.099570 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-2d313d48-b568-49b3-a8d5-e4704d89dd7b tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1375 microversion: 2.1 time: 0.167593 Oct 26 06:36:25.100391 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4040/8067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:24 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:26.123417 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:26.124038 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:26.127412 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=31 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:36:26.132590 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:26.133075 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:26.133539 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:26.134230 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:26.134685 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:26.135112 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:26.266429 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:26.274253 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-a57e5bf3-5548-4712-8f51-19fb9bc26fb9 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1561 microversion: 2.1 time: 0.154756 Oct 26 06:36:26.274833 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4028/8068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:26 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:26.297923 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:36:26.298564 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:36:26.306745 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:26.307599 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:26.308083 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:26.308812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:26.309292 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:26.309768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:26.443671 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:36:26.451430 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-ee4e98e7-5290-49c1-ba65-616b9561770e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1561 microversion: 2.1 time: 0.158156 Oct 26 06:36:26.452004 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4041/8069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:36:26 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:36:28.119134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-e0a32c9d-fc4a-49a5-8c4a-40062ffb138b req-faa8378d-aca7-4047-9d2b-eb1c2b0c04a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ae699c-7876-435f-a285-7dcad89bfe99", "tag": "f9a00f05-67d0-4c9b-96d9-a284a820e9fd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:36:28.128991 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e0a32c9d-fc4a-49a5-8c4a-40062ffb138b req-faa8378d-aca7-4047-9d2b-eb1c2b0c04a6 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:36:28.129535 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e0a32c9d-fc4a-49a5-8c4a-40062ffb138b req-faa8378d-aca7-4047-9d2b-eb1c2b0c04a6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:36:28.129946 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-e0a32c9d-fc4a-49a5-8c4a-40062ffb138b req-faa8378d-aca7-4047-9d2b-eb1c2b0c04a6 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:36:28.141662 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-e0a32c9d-fc4a-49a5-8c4a-40062ffb138b req-faa8378d-aca7-4047-9d2b-eb1c2b0c04a6 service nova] Creating event network-changed:f9a00f05-67d0-4c9b-96d9-a284a820e9fd for instance 29ae699c-7876-435f-a285-7dcad89bfe99 on n-h2-862416-4 Oct 26 06:36:28.146978 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-e0a32c9d-fc4a-49a5-8c4a-40062ffb138b req-faa8378d-aca7-4047-9d2b-eb1c2b0c04a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096289 Oct 26 06:36:28.147816 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4029/8070] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:38:27.795710 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:27.796594 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=62 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:27.801539 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-884077303"}} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:38:27.803854 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:27.811353 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:27.812373 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:27.812849 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:27.813601 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:27.814078 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:27.814525 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:28.016740 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-f89eaf4f-8461-42aa-a2f0-bba4a75ae20c tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "POST /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99/action" status: 202 len: 0 microversion: 2.1 time: 0.222860 Oct 26 06:38:28.017415 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4042/8071] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 26 06:38:27 2022] POST /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 26 06:38:36.524256 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 06:38:36.526172 n-d-862416-4 devstack@n-api.service[120586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 26 06:38:36.527134 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=3 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:36.528017 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=56 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:36.528793 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:38:36.529034 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 26 06:38:36.530243 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 06:38:36.530567 n-d-862416-4 devstack@n-api.service[120586]: Wed Oct 26 06:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 26 06:38:36.548319 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-b451c077-5004-4421-9689-f80009502d78 req-eb16acbd-31fc-4973-81e2-1aca0d0cd489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ae699c-7876-435f-a285-7dcad89bfe99", "name": "network-vif-plugged", "status": "completed", "tag": "f9a00f05-67d0-4c9b-96d9-a284a820e9fd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:38:36.563779 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b451c077-5004-4421-9689-f80009502d78 req-eb16acbd-31fc-4973-81e2-1aca0d0cd489 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:36.564519 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b451c077-5004-4421-9689-f80009502d78 req-eb16acbd-31fc-4973-81e2-1aca0d0cd489 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:36.565175 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-b451c077-5004-4421-9689-f80009502d78 req-eb16acbd-31fc-4973-81e2-1aca0d0cd489 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:36.590283 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-b451c077-5004-4421-9689-f80009502d78 req-eb16acbd-31fc-4973-81e2-1aca0d0cd489 service nova] Creating event network-vif-plugged:f9a00f05-67d0-4c9b-96d9-a284a820e9fd for instance 29ae699c-7876-435f-a285-7dcad89bfe99 on n-h2-862416-4 Oct 26 06:38:36.598985 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-b451c077-5004-4421-9689-f80009502d78 req-eb16acbd-31fc-4973-81e2-1aca0d0cd489 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076277 Oct 26 06:38:36.599901 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4030/8072] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:38:47.239998 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_api:SELECT=2 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:47.240965 n-d-862416-4 devstack@n-api.service[120585]: DEBUG dbcounter [-] [120585] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:47.241116 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_api:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:47.242311 n-d-862416-4 devstack@n-api.service[120586]: DEBUG dbcounter [-] [120586] Writing DB stats nova_cell1:SELECT=2 {{(pid=120586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 06:38:47.246515 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:47.247399 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:47.247752 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-66432106-7565-4879-868f-b9e8115db5e7 req-4c09b339-c361-4550-8ad5-cc98534a943d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ae699c-7876-435f-a285-7dcad89bfe99", "tag": "f9a00f05-67d0-4c9b-96d9-a284a820e9fd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:38:47.255254 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:47.256023 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:47.256655 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:47.257758 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:47.258240 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:47.258686 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:47.262430 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66432106-7565-4879-868f-b9e8115db5e7 req-4c09b339-c361-4550-8ad5-cc98534a943d service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:47.263127 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66432106-7565-4879-868f-b9e8115db5e7 req-4c09b339-c361-4550-8ad5-cc98534a943d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:47.263565 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-66432106-7565-4879-868f-b9e8115db5e7 req-4c09b339-c361-4550-8ad5-cc98534a943d service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:47.275798 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [03674429-80d9-4e59-9ae9-735969b6982a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57904. Oct 26 06:38:47.278900 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-66432106-7565-4879-868f-b9e8115db5e7 req-4c09b339-c361-4550-8ad5-cc98534a943d service nova] Creating event network-changed:f9a00f05-67d0-4c9b-96d9-a284a820e9fd for instance 29ae699c-7876-435f-a285-7dcad89bfe99 on n-h2-862416-4 Oct 26 06:38:47.283910 n-d-862416-4 devstack@n-api.service[120586]: INFO oslo.messaging._drivers.impl_rabbit [-] [9303ff71-bd8a-4f70-8b0e-679507352ed2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57902. Oct 26 06:38:47.285739 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-66432106-7565-4879-868f-b9e8115db5e7 req-4c09b339-c361-4550-8ad5-cc98534a943d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046710 Oct 26 06:38:47.286896 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4031/8073] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 06:38:47.291189 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:38:47.382076 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-c000a303-f6a3-4911-8dd2-4677c30ed04a tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 204 len: 0 microversion: 2.1 time: 0.144665 Oct 26 06:38:47.383169 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4043/8074] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:38:47 2022] DELETE /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:38:47.392875 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:47.394258 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:47.400664 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:47.401148 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:47.401613 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:47.402320 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:47.402780 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:47.403205 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:47.562338 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:38:47.569705 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb888567-043a-43de-a0fd-3d915badd7bd tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1686 microversion: 2.1 time: 0.182044 Oct 26 06:38:47.570294 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4032/8075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:47 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:38:48.595210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:48.596460 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:48.603216 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:48.603720 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:48.604166 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:48.604873 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:48.605368 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:48.605814 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:48.743270 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:38:48.751921 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-b60d8b64-e907-4f83-abcf-311f25fdf7a2 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1686 microversion: 2.1 time: 0.161632 Oct 26 06:38:48.752726 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4044/8076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:48 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 06:38:49.538201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-01a52a98-0d54-4e71-8d13-ff350fc7f1d8 req-62a4da97-c7dc-4212-94ec-9b93b7d05458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ae699c-7876-435f-a285-7dcad89bfe99", "name": "network-vif-deleted", "tag": "f9a00f05-67d0-4c9b-96d9-a284a820e9fd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:38:49.548984 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-01a52a98-0d54-4e71-8d13-ff350fc7f1d8 req-62a4da97-c7dc-4212-94ec-9b93b7d05458 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:49.549523 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-01a52a98-0d54-4e71-8d13-ff350fc7f1d8 req-62a4da97-c7dc-4212-94ec-9b93b7d05458 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:49.549990 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-01a52a98-0d54-4e71-8d13-ff350fc7f1d8 req-62a4da97-c7dc-4212-94ec-9b93b7d05458 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:49.562619 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-01a52a98-0d54-4e71-8d13-ff350fc7f1d8 req-62a4da97-c7dc-4212-94ec-9b93b7d05458 service nova] Creating event network-vif-deleted:f9a00f05-67d0-4c9b-96d9-a284a820e9fd for instance 29ae699c-7876-435f-a285-7dcad89bfe99 on n-h2-862416-4 Oct 26 06:38:49.567324 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-01a52a98-0d54-4e71-8d13-ff350fc7f1d8 req-62a4da97-c7dc-4212-94ec-9b93b7d05458 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092015 Oct 26 06:38:49.567933 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4033/8077] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:38:49.776298 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:49.776937 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:49.785039 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:49.785612 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:49.786079 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:49.786812 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:49.787318 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:49.787770 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:49.821768 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:49.822278 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:49.822750 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:49.823227 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.objects.instance [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lazy-loading 'fault' on Instance uuid 29ae699c-7876-435f-a285-7dcad89bfe99 {{(pid=120585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 06:38:49.873449 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.policy [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120585) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:38:49.882901 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-59e67e2f-4277-4749-8704-0cab1e229ea1 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 200 len: 1339 microversion: 2.1 time: 0.110528 Oct 26 06:38:49.893843 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4045/8078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:49 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:38:50.909026 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:50.909764 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: 29ae699c-7876-435f-a285-7dcad89bfe99] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:50.915874 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:50.916354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:50.916791 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:50.917507 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:50.917965 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:50.918392 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:50.931988 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.wsgi [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] HTTP exception thrown: Instance 29ae699c-7876-435f-a285-7dcad89bfe99 could not be found. Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Request method failure captured: Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: request: GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 HTTP/1.1 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Accept: application/json Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Accept-Encoding: identity Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Connection: close Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Content-Length: 0 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Content-Type: application/json Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Host: 10.222.0.16 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: Openstack-System-Scope: None Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: User-Agent: python-urllib3/1.26.12 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Auth-Token: gAAAAABjWNS2cu9it403XAOyV1UYofhVRK9vTxe-U03ztCP5qgnrUKbwho4UC1hp5XmUq-6B9DthzBRTXQL5Wn-o0Lfml7maaknzqvrrYwIizmEe4W4XsM4kJeeCRunbegu4G6YU-JKyVRG1VQ27PVN7PJiMIjl4bmWKdGT_qfV8n3asSNgwFLs Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Id: None Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Domain-Name: None Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Identity-Status: Confirmed Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Is-Admin-Project: True Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Id: default Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Domain-Name: Default Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Id: 6d85e16674f042cd9a2884d6854ba829 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Project-Name: tempest-TestSnapshotPattern-1704102331 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Role: reader,member Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Roles: reader,member Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant: tempest-TestSnapshotPattern-1704102331 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Id: 6d85e16674f042cd9a2884d6854ba829 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-Tenant-Name: tempest-TestSnapshotPattern-1704102331 Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-User: tempest-TestSnapshotPattern-1704102331-project Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Id: default Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Domain-Name: Default Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Id: 3133eff47a9d4b9bbfe5c085a622136a Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: X-User-Name: tempest-TestSnapshotPattern-1704102331-project Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: method: > Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: exception: Instance 29ae699c-7876-435f-a285-7dcad89bfe99 could not be found. Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: action_args: {'id': '29ae699c-7876-435f-a285-7dcad89bfe99'} Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ae699c-7876-435f-a285-7dcad89bfe99 could not be found. Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ae699c-7876-435f-a285-7dcad89bfe99 could not be found. Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:38:50.933621 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ae699c-7876-435f-a285-7dcad89bfe99 could not be found. Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: ERROR nova.api.openstack.wsgi Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Returning 404 to user: Instance 29ae699c-7876-435f-a285-7dcad89bfe99 could not be found. {{(pid=120586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-6300b058-bd4a-4af8-9748-5da785a883af tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99" status: 404 len: 111 microversion: 2.1 time: 0.031080 Oct 26 06:38:50.940888 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4034/8079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:50 2022] GET /compute/v2.1/servers/29ae699c-7876-435f-a285-7dcad89bfe99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:38:52.283573 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:52.284104 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:52.285895 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [req-daf7aea5-82d4-46ce-b77c-64bd5a6e99ec req-1c46fd18-8d21-401d-8a04-0ff8318fe736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:38:52.292038 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:52.292557 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:52.293031 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:52.293796 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:52.294281 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:52.294857 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:52.302087 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-daf7aea5-82d4-46ce-b77c-64bd5a6e99ec req-1c46fd18-8d21-401d-8a04-0ff8318fe736 service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:52.303363 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-daf7aea5-82d4-46ce-b77c-64bd5a6e99ec req-1c46fd18-8d21-401d-8a04-0ff8318fe736 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:52.303856 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [req-daf7aea5-82d4-46ce-b77c-64bd5a6e99ec req-1c46fd18-8d21-401d-8a04-0ff8318fe736 service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:52.316630 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.compute.server_external_events [req-daf7aea5-82d4-46ce-b77c-64bd5a6e99ec req-1c46fd18-8d21-401d-8a04-0ff8318fe736 service nova] Creating event network-changed:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:38:52.321855 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [req-daf7aea5-82d4-46ce-b77c-64bd5a6e99ec req-1c46fd18-8d21-401d-8a04-0ff8318fe736 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040070 Oct 26 06:38:52.322482 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4035/8080] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:38:52.323504 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Going to try to terminate instance {{(pid=120585) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 06:38:52.413585 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-49197407-0d0f-4aea-b81f-74c55e648b6e tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 204 len: 0 microversion: 2.1 time: 0.133384 Oct 26 06:38:52.414644 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4046/8081] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 26 06:38:52 2022] DELETE /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 06:38:52.424722 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:52.425802 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:52.432900 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:52.433846 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:52.434492 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:52.435397 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:52.436033 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:52.436702 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:52.586452 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:38:52.595133 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-8c5ecab8-7df3-4c85-acbe-ad18a0bc4f55 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1684 microversion: 2.1 time: 0.175109 Oct 26 06:38:52.595890 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4036/8082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:52 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:38:53.613388 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [req-3e13da26-4480-4382-8f51-1c7559d0a842 req-7552cdc4-f8a6-4ce8-b198-cec28926f08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec", "name": "network-vif-deleted", "tag": "7cd28c0c-303f-4396-8c2d-993132f227bd"}]} {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 06:38:53.621354 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:53.623390 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.compute.api [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120586) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:53.625241 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3e13da26-4480-4382-8f51-1c7559d0a842 req-7552cdc4-f8a6-4ce8-b198-cec28926f08b service nova] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:53.626378 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3e13da26-4480-4382-8f51-1c7559d0a842 req-7552cdc4-f8a6-4ce8-b198-cec28926f08b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:53.626933 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [req-3e13da26-4480-4382-8f51-1c7559d0a842 req-7552cdc4-f8a6-4ce8-b198-cec28926f08b service nova] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:53.632500 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:53.632999 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:53.633474 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:53.634187 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:53.634652 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:53.635201 n-d-862416-4 devstack@n-api.service[120586]: DEBUG oslo_concurrency.lockutils [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:53.638644 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.compute.server_external_events [req-3e13da26-4480-4382-8f51-1c7559d0a842 req-7552cdc4-f8a6-4ce8-b198-cec28926f08b service nova] Creating event network-vif-deleted:7cd28c0c-303f-4396-8c2d-993132f227bd for instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec on n-h1-862416-4 Oct 26 06:38:53.644253 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [req-3e13da26-4480-4382-8f51-1c7559d0a842 req-7552cdc4-f8a6-4ce8-b198-cec28926f08b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035581 Oct 26 06:38:53.645163 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4047/8083] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 26 06:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 06:38:53.706465 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.policy [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3133eff47a9d4b9bbfe5c085a622136a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d85e16674f042cd9a2884d6854ba829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120586) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 06:38:53.715914 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-e0bfff1a-f00c-445a-918f-f494900ebc86 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 200 len: 1498 microversion: 2.1 time: 0.100071 Oct 26 06:38:53.716507 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4037/8084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:53 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 1498 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 06:38:54.742459 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '>' {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:54.743092 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.compute.api [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] [instance: e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec] Fetching instance by UUID {{(pid=120585) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 06:38:54.749224 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:54.749755 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:54.750210 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:54.751398 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Acquiring lock "174eed2b-b467-49bb-99a7-157ccab94f7f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 06:38:54.751867 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 06:38:54.752310 n-d-862416-4 devstack@n-api.service[120585]: DEBUG oslo_concurrency.lockutils [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Lock "174eed2b-b467-49bb-99a7-157ccab94f7f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 06:38:54.765652 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.wsgi [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] HTTP exception thrown: Instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec could not be found. Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Request method failure captured: Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: request: GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec HTTP/1.1 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Accept: application/json Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Accept-Encoding: identity Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Connection: close Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Content-Length: 0 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Content-Type: application/json Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Host: 10.222.0.16 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: Openstack-System-Scope: None Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: User-Agent: python-urllib3/1.26.12 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Auth-Token: gAAAAABjWNS2cu9it403XAOyV1UYofhVRK9vTxe-U03ztCP5qgnrUKbwho4UC1hp5XmUq-6B9DthzBRTXQL5Wn-o0Lfml7maaknzqvrrYwIizmEe4W4XsM4kJeeCRunbegu4G6YU-JKyVRG1VQ27PVN7PJiMIjl4bmWKdGT_qfV8n3asSNgwFLs Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Id: None Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Domain-Name: None Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Identity-Status: Confirmed Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Is-Admin-Project: True Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Id: default Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Domain-Name: Default Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Id: 6d85e16674f042cd9a2884d6854ba829 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Project-Name: tempest-TestSnapshotPattern-1704102331 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Role: reader,member Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Roles: reader,member Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d85e16674f042cd9a2884d6854ba829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant: tempest-TestSnapshotPattern-1704102331 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Id: 6d85e16674f042cd9a2884d6854ba829 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-Tenant-Name: tempest-TestSnapshotPattern-1704102331 Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-User: tempest-TestSnapshotPattern-1704102331-project Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Id: default Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Domain-Name: Default Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Id: 3133eff47a9d4b9bbfe5c085a622136a Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: X-User-Name: tempest-TestSnapshotPattern-1704102331-project Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: method: > Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: exception: Instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec could not be found. Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: action_args: {'id': 'e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec'} Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: {{(pid=120585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec could not be found. Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec could not be found. Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 06:38:54.767542 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec could not be found. Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: ERROR nova.api.openstack.wsgi Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: DEBUG nova.api.openstack.wsgi [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Returning 404 to user: Instance e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec could not be found. {{(pid=120585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: INFO nova.api.openstack.requestlog [None req-4fb0b5d8-6d01-4d40-af09-f5dd554918c8 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec" status: 404 len: 111 microversion: 2.1 time: 0.031735 Oct 26 06:38:54.773176 n-d-862416-4 devstack@n-api.service[120585]: [pid: 120585|app: 0|req: 4048/8085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 26 06:38:54 2022] GET /compute/v2.1/servers/e9b55cbb-7b26-4cdd-8053-5c7a516fc5ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 06:38:54.933512 n-d-862416-4 devstack@n-api.service[120586]: DEBUG nova.api.openstack.wsgi [None req-bb37cc19-bca3-4475-9e16-bfd688a9bad6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] Calling method '.version_select at 0x7f470935daf0>' {{(pid=120586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 06:38:54.959649 n-d-862416-4 devstack@n-api.service[120586]: INFO nova.api.openstack.requestlog [None req-bb37cc19-bca3-4475-9e16-bfd688a9bad6 tempest-TestSnapshotPattern-1704102331 tempest-TestSnapshotPattern-1704102331-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1996302735" status: 202 len: 0 microversion: 2.1 time: 0.029914 Oct 26 06:38:54.960499 n-d-862416-4 devstack@n-api.service[120586]: [pid: 120586|app: 0|req: 4038/8086] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 26 06:38:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1996302735 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)